Arrow Research search

Author name cluster

Tonio Ball

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

22 papers
2 author rows

Possible papers

22

TMLR Journal 2025 Journal Article

Multi-BK-Net: Multi-Branch Multi-Kernel Convolutional Neural Networks for Clinical EEG Analysis

  • Ann-Kathrin Kiessner
  • Tonio Ball
  • Joschka Boedecker

Classifying an electroencephalography (EEG) recording as pathological or non-pathological is an important first step in diagnosing and managing neurological diseases and disorders. As manual EEG classification is costly, time-consuming and requires highly trained experts, deep learning methods for automated classification of general EEG pathology offer a promising option to assist clinicians in screening EEGs. Convolutional neural networks (CNNs) are well-suited for classifying pathological EEG signals due to their ability to perform end-to-end learning. In practice, however, current CNN solutions suffer from limited classification performance due to I) a single-scale network design that cannot fully capture the high intra- and inter-subject variability of the EEG signal, the diversity of the data, and the heterogeneity of pathological EEG patterns and II) the small size and limited diversity of the dataset commonly used to train and evaluate the networks. These challenges result in a low sensitivity score and a performance drop on more diverse patient populations, further hindering their reliability for real-world applications. Here, we propose a novel multi-branch, multi-scale CNN called Multi-BK-Net (Multi-Branch Multi-Kernel Network), comprising five parallel branches that incorporate temporal convolution, spatial convolution, and pooling layers, with temporal kernel sizes defined by five clinically relevant frequency bands in its first block. Evaluation is based on two public datasets with predefined test sets: the Temple University Hospital (TUH) Abnormal EEG Corpus and the TUH Abnormal Expansion Balanced EEG Corpus. Our Multi-BK-Net outperforms five baseline architectures and state-of-the-art end-to-end approaches in terms of accuracy and sensitivity on these datasets, setting a new benchmark. Furthermore, ablation experiments highlight the importance of the multi-branch, multi-scale input block of the Multi-BK-Net. Overall, our findings indicate the efficacy of multi-branch, multi-scale CNNs in accurately and reliably classifying EEG pathology, demonstrating advantages in handling data heterogeneity compared to other deep learning approaches. Thus, this study contributes to the ongoing development of deep end-to-end methods for general EEG pathology classification.

YNICL Journal 2023 Journal Article

An extended clinical EEG dataset with 15,300 automatically labelled recordings for pathology decoding

  • Ann-Kathrin Kiessner
  • Robin T. Schirrmeister
  • Lukas A.W. Gemein
  • Joschka Boedecker
  • Tonio Ball

Automated clinical EEG analysis using machine learning (ML) methods is a growing EEG research area. Previous studies on binary EEG pathology decoding have mainly used the Temple University Hospital (TUH) Abnormal EEG Corpus (TUAB) which contains approximately 3,000 manually labelled EEG recordings. To evaluate and eventually even improve the generalisation performance of machine learning methods for EEG pathology, decoding larger, publicly available datasets is required. A number of studies addressed the automatic labelling of large open-source datasets as an approach to create new datasets for EEG pathology decoding, but little is known about the extent to which training on larger, automatically labelled dataset affects decoding performances of established deep neural networks. In this study, we automatically created additional pathology labels for the Temple University Hospital (TUH) EEG Corpus (TUEG) based on the medical reports using a rule-based text classifier. We generated a dataset of 15,300 newly labelled recordings, which we call the TUH Abnormal Expansion EEG Corpus (TUABEX), and which is five times larger than the TUAB. Since the TUABEX contains more pathological (75%) than non-pathological (25%) recordings, we then selected a balanced subset of 8,879 recordings, the TUH Abnormal Expansion Balanced EEG Corpus (TUABEXB). To investigate how training on a larger, automatically labelled dataset affects the decoding performance of deep neural networks, we applied four established deep convolutional neural networks (ConvNets) to the task of pathological versus non-pathological classification and compared the performance of each architecture after training on different datasets. The results show that training on the automatically labelled TUABEXB dataset rather than training on the manually labelled TUAB dataset increases accuracies on TUABEXB and even for TUAB itself for some architectures. We argue that automatically labelling of large open-source datasets can be used to efficiently utilise the massive amount of EEG data stored in clinical archives. We make the proposed TUABEXB available open source and thus offer a new dataset for EEG machine learning research.

YNIMG Journal 2022 Journal Article

A reusable benchmark of brain-age prediction from M/EEG resting-state signals

  • Denis A. Engemann
  • Apolline Mellot
  • Richard Höchenberger
  • Hubert Banville
  • David Sabbagh
  • Lukas Gemein
  • Tonio Ball
  • Alexandre Gramfort

Population-level modeling can define quantitative measures of individual aging by applying machine learning to large volumes of brain images. These measures of brain age, obtained from the general population, helped characterize disease severity in neurological populations, improving estimates of diagnosis or prognosis. Magnetoencephalography (MEG) and Electroencephalography (EEG) have the potential to further generalize this approach towards prevention and public health by enabling assessments of brain health at large scales in socioeconomically diverse environments. However, more research is needed to define methods that can handle the complexity and diversity of M/EEG signals across diverse real-world contexts. To catalyse this effort, here we propose reusable benchmarks of competing machine learning approaches for brain age modeling. We benchmarked popular classical machine learning pipelines and deep learning architectures previously used for pathology decoding or brain age estimation in 4 international M/EEG cohorts from diverse countries and cultural contexts, including recordings from more than 2500 participants. Our benchmarks were built on top of the M/EEG adaptations of the BIDS standard, providing tools that can be applied with minimal modification on any M/EEG dataset provided in the BIDS format. Our results suggest that, regardless of whether classical machine learning or deep learning was used, the highest performance was reached by pipelines and architectures involving spatially aware representations of the M/EEG signals, leading to R2 scores between 0. 60-0. 74. Hand-crafted features paired with random forest regression provided robust benchmarks even in situations in which other approaches failed. Taken together, this set of benchmarks, accompanied by open-source software and high-level Python scripts, can serve as a starting point and quantitative reference for future efforts at developing M/EEG-based measures of brain aging. The generality of the approach renders this benchmark reusable for other related objectives such as modeling specific cognitive variables or clinical endpoints.

YNIMG Journal 2021 Journal Article

Blink- and saccade-related suppression effects in early visual areas of the human brain: Intracranial EEG investigations during natural viewing conditions

  • Markus Kern
  • Andreas Schulze-Bonhage
  • Tonio Ball

Blinks and saccades, both ubiquitous in natural viewing conditions, cause rapid changes of visual inputs that are hardly consciously perceived. The neural dynamics in early visual areas of the human brain underlying this remarkable visual stability are still incompletely understood. We used electrocorticography (ECoG) from electrodes directly implanted on the human early visual areas V1, V2, V3d/v, V4d/v and the fusiform gyrus to investigate blink- and saccade-related neuronal suppression effects during non-experimental, free viewing conditions. We found a characteristic, biphasic, broadband gamma power decrease-increase pattern in all investigated visual areas. During saccades, a decrease in gamma power clearly preceded eye movement onset, at least in V1. This may indicate that cortical information processing is actively suppressed in human early visual areas before and during saccades, which then possibly mediates perceptual visual suppression. The following eye movement offset-related increase in gamma power may indicate the recovery of visual perception and the resumption of visual processing.

YNIMG Journal 2020 Journal Article

Machine-learning-based diagnostics of EEG pathology

  • Lukas A.W. Gemein
  • Robin T. Schirrmeister
  • Patryk Chrabąszcz
  • Daniel Wilson
  • Joschka Boedecker
  • Andreas Schulze-Bonhage
  • Frank Hutter
  • Tonio Ball

Machine learning (ML) methods have the potential to automate clinical EEG analysis. They can be categorized into feature-based (with handcrafted features), and end-to-end approaches (with learned features). Previous studies on EEG pathology decoding have typically analyzed a limited number of features, decoders, or both. For a I) more elaborate feature-based EEG analysis, and II) in-depth comparisons of both approaches, here we first develop a comprehensive feature-based framework, and then compare this framework to state-of-the-art end-to-end methods. To this aim, we apply the proposed feature-based framework and deep neural networks including an EEG-optimized temporal convolutional network (TCN) to the task of pathological versus non-pathological EEG classification. For a robust comparison, we chose the Temple University Hospital (TUH) Abnormal EEG Corpus (v2. 0. 0), which contains approximately 3000 EEG recordings. The results demonstrate that the proposed feature-based decoding framework can achieve accuracies on the same level as state-of-the-art deep neural networks. We find accuracies across both approaches in an astonishingly narrow range from 81 to 86%. Moreover, visualizations and analyses indicated that both approaches used similar aspects of the data, e. g. , delta and theta band power at temporal electrode locations. We argue that the accuracies of current binary EEG pathology decoders could saturate near 90% due to the imperfect inter-rater agreement of the clinical labels, and that such decoders are already clinically useful, such as in areas where clinical EEG experts are rare. We make the proposed feature-based framework available open source and thus offer a new tool for EEG machine learning research.

NeurIPS Conference 2020 Conference Paper

Understanding Anomaly Detection with Deep Invertible Networks through Hierarchies of Distributions and Features

  • Robin Schirrmeister
  • Yuxuan Zhou
  • Tonio Ball
  • Dan Zhang

Deep generative networks trained via maximum likelihood on a natural image dataset like CIFAR10 often assign high likelihoods to images from datasets with different objects (e. g. , SVHN). We refine previous investigations of this failure at anomaly detection for invertible generative networks and provide a clear explanation of it as a combination of model bias and domain prior: Convolutional networks learn similar low-level feature distributions when trained on any natural image dataset and these low-level features dominate the likelihood. Hence, when the discriminative features between inliers and outliers are on a high-level, e. g. , object shapes, anomaly detection becomes particularly challenging. To remove the negative impact of model bias and domain prior on detecting high-level differences, we propose two methods, first, using the log likelihood ratios of two identical models, one trained on the in-distribution data (e. g. , CIFAR10) and the other one on a more general distribution of images (e. g. , 80 Million Tiny Images). We also derive a novel outlier loss for the in-distribution network on samples from the more general distribution to further improve the performance. Secondly, using a multi-scale model like Glow, we show that low-level features are mainly captured at early scales. Therefore, using only the likelihood contribution of the final scale performs remarkably well for detecting high-level feature differences of the out-of-distribution and the in-distribution. This method is especially useful if one does not have access to a suitable general distribution. Overall, our methods achieve strong anomaly detection performance in the unsupervised setting, and only slightly underperform state-of-the-art classifier-based methods in the supervised setting. Code can be found at https: //github. com/boschresearch/hierarchical anomaly detection.

YNIMG Journal 2018 Journal Article

Computationally optimized ECoG stimulation with local safety constraints

  • Seyhmus Guler
  • Moritz Dannhauer
  • Biel Roig-Solvas
  • Alexis Gkogkidis
  • Rob Macleod
  • Tonio Ball
  • Jeffrey G. Ojemann
  • Dana H. Brooks

Direct stimulation of the cortical surface is used clinically for cortical mapping and modulation of local activity. Future applications of cortical modulation and brain-computer interfaces may also use cortical stimulation methods. One common method to deliver current is through electrocorticography (ECoG) stimulation in which a dense array of electrodes are placed subdurally or epidurally to stimulate the cortex. However, proximity to cortical tissue limits the amount of current that can be delivered safely. It may be desirable to deliver higher current to a specific local region of interest (ROI) while limiting current to other local areas more stringently than is guaranteed by global safety limits. Two commonly used global safety constraints bound the total injected current and individual electrode currents. However, these two sets of constraints may not be sufficient to prevent high current density locally (hot-spots). In this work, we propose an efficient approach that prevents current density hot-spots in the entire brain while optimizing ECoG stimulus patterns for targeted stimulation. Specifically, we maximize the current along a particular desired directional field in the ROI while respecting three safety constraints: one on the total injected current, one on individual electrode currents, and the third on the local current density magnitude in the brain. This third set of constraints creates a computational barrier due to the huge number of constraints needed to bound the current density at every point in the entire brain. We overcome this barrier by adopting an efficient two-step approach. In the first step, the proposed method identifies the safe brain region, which cannot contain any hot-spots solely based on the global bounds on total injected current and individual electrode currents. In the second step, the proposed algorithm iteratively adjusts the stimulus pattern to arrive at a solution that exhibits no hot-spots in the remaining brain. We report on simulations on a realistic finite element (FE) head model with five anatomical ROIs and two desired directional fields. We also report on the effect of ROI depth and desired directional field on the focality of the stimulation. Finally, we provide an analysis of optimization runtime as a function of different safety and modeling parameters. Our results suggest that optimized stimulus patterns tend to differ from those used in clinical practice.

YNICL Journal 2018 Journal Article

Spectral bandwidth of interictal fast epileptic activity characterizes the seizure onset zone

  • Marcel Heers
  • Moritz Helias
  • Tanguy Hedrich
  • Matthias Dümpelmann
  • Andreas Schulze-Bonhage
  • Tonio Ball

The foremost aim of presurgical epilepsy evaluation is the delineation of the seizure onset zone (SOZ). There is increasing evidence that fast epileptic activity (FEA, 14-250 Hz) occurring interictally, i.e. between seizures, is predominantly localized within the SOZ. Currently it is unknown, which frequency band of FEA performs best in identifying the SOZ, although prior studies suggest highest concordance of spectral changes with the SOZ for high frequency changes. We suspected that FEA reflects dampened oscillations in local cortical excitatory-inhibitory neural networks, and that interictal FEA in the SOZ is a consequence of reduced oscillatory damping. We therefore predict a narrowing of the spectral bandwidth alongside increased amplitudes of spectral peaks during interictal FEA events. To test this hypothesis, we evaluated spectral changes during interictal FEA in invasive EEG (iEEG) recordings of 13 patients with focal epilepsy. In relative spectra of beta and gamma band changes (14-250 Hz) during FEA, we found that spectral peaks within the SOZ indeed were significantly more narrow-banded and their power changes were significantly higher than outside the SOZ. In contrast, the peak frequency did not differ within and outside the SOZ. Our results show that bandwidth and power changes of spectral modulations during FEA both help localizing the SOZ. We propose the spectral bandwidth as new source of information for the evaluation of EEG data.

YNIMG Journal 2018 Journal Article

The dynamics of error processing in the human brain as reflected by high-gamma activity in noninvasive and intracranial EEG

  • Martin Völker
  • Lukas D.J. Fiederer
  • Sofie Berberich
  • Jiří Hammer
  • Joos Behncke
  • Pavel Kršek
  • Martin Tomášek
  • Petr Marusič

Error detection in motor behavior is a fundamental cognitive function heavily relying on local cortical information processing. Neural activity in the high-gamma frequency band (HGB) closely reflects such local cortical processing, but little is known about its role in error processing, particularly in the healthy human brain. Here we characterize the error-related response of the human brain based on data obtained with noninvasive EEG optimized for HGB mapping in 31 healthy subjects (15 females, 16 males), and additional intracranial EEG data from 9 epilepsy patients (4 females, 5 males). Our findings reveal a multiscale picture of the global and local dynamics of error-related HGB activity in the human brain. On the global level as reflected in the noninvasive EEG, the error-related response started with an early component dominated by anterior brain regions, followed by a shift to parietal regions, and a subsequent phase characterized by sustained parietal HGB activity. This phase lasted for more than 1 s after the error onset. On the local level reflected in the intracranial EEG, a cascade of both transient and sustained error-related responses involved an even more extended network, spanning beyond frontal and parietal regions to the insula and the hippocampus. HGB mapping appeared especially well suited to investigate late, sustained components of the error response, possibly linked to downstream functional stages such as error-related learning and behavioral adaptation. Our findings establish the basic spatio-temporal properties of HGB activity as a neural correlate of error processing, complementing traditional error-related potential studies.

ICRA Conference 2016 Conference Paper

Automatic bone parameter estimation for skeleton tracking in optical motion capture

  • Tobias Schubert 0002
  • Katharina Eggensperger
  • Alexis Gkogkidis
  • Frank Hutter
  • Tonio Ball
  • Wolfram Burgard

Motion analysis is important in a broad range of contexts, including animation, bio-mechanics, robotics and experiments investigating animal behavior. For applications, in which tracking accuracy is one of the main requirements, passive optical motion capture systems are widely used. Many skeleton tracking methods based on such systems use a predefined skeleton model, which is scaled once in the initialization step to the individual size of the character to be tracked. However, there are remarkable differences in the bone length relations across gender and even more across mammal races. In practice, the optimal skeleton model has to be determined in a manual and time-consuming process. In this paper, we reformulate this task as an optimization problem aiming to rescale a rough hierarchical skeleton structure to optimize probabilistic skeleton tracking performance. We solve this optimization problem by means of state-of-the-art blackbox optimization methods based on sequential model-based Bayesian optimization (SMBO). We compare different SMBO methods on three real-world datasets with an animal and humans, demonstrating that we can automatically find skeleton structures for previously unseen mammals. The same methods also allow an automated choice of a suitable starting frame for initializing tracking.

ICRA Conference 2015 Conference Paper

An autonomous robotic assistant for drinking

  • Sebastian Schroer
  • Ingo Killmann
  • Barbara Frank
  • Martin Voelker
  • Lukas Dominique Josef Fiederer
  • Tonio Ball
  • Wolfram Burgard

Stroke and neurodegenerative diseases, among a range of other neurologic disorders, can cause chronic paralysis. Patients suffering from paralysis may remain unable to achieve even basic everyday tasks such as liquid intake. Currently, there is a great interest in developing robotic assistants controlled via brain-machine interfaces (BMIs) to restore the ability to perform such tasks. This paper describes an autonomous robotic assistant for liquid intake. The components of the system include autonomous online detection both of the cup to be grasped and of the mouth of the user. It plans motions of the robot arm under the constraints that the cup stays upright while moving towards the mouth and that the cup stays in direct contact with the user's mouth while the robot tilts it during the drinking phase. To achieve this, our system also includes a technique for online estimation of the location of the user's mouth even under partial occlusions by the cup or robot arm. We tested our system in a real environment and in a shared-control setting using frequency-specific modulations recorded by electroencephalography (EEG) from the brain of the user. Our experiments demonstrate that our BMI-controlled robotic system enables a reliable liquid intake. We believe that our approach can easily be extended to other useful tasks including food intake and object manipulation.

ICRA Conference 2015 Conference Paper

Automatic initialization for skeleton tracking in optical motion capture

  • Tobias Schubert 0002
  • Alexis Gkogkidis
  • Tonio Ball
  • Wolfram Burgard

The ability to track skeletal movements is important in a variety of applications including animation, biological studies and animal experiments. To detect even small movements, such a method should provide highly accurate estimates. Besides that it should not impede the mammal in its motion. This motivates the usage of a passive optical motion capture system. Thereby the main challenges are the initialization, the association of the unlabeled markers to their corresponding segment also across the frames, and the estimation of the skeleton configuration. While many existing approaches can deal with the latter two problems, they typically need a specific pose for initialization. This is rather unpractical in the context of animal tracking and often requires a manual initialization process. In this paper, we present an approach to reliably track animals and humans in marker-based optical motion capture systems with freely attached markers. Our method is also able to perform an automatic initialization without any pre-or post-processing of the data. To achieve this, our approach utilizes a large database of previously observed poses. We present our algorithm and its evaluation on real-world data sets with an animal and humans. The results demonstrate that our initialization method performs accurately for the most kind of initial poses and our tracking approach outperforms a popular fully automatic skeleton tracking method especially with respect to the smoothness of the motion.

YNIMG Journal 2015 Journal Article

Causal interpretation rules for encoding and decoding models in neuroimaging

  • Sebastian Weichwald
  • Timm Meyer
  • Ozan Özdenizci
  • Bernhard Schölkopf
  • Tonio Ball
  • Moritz Grosse-Wentrup

Causal terminology is often introduced in the interpretation of encoding and decoding models trained on neuroimaging data. In this article, we investigate which causal statements are warranted and which ones are not supported by empirical evidence. We argue that the distinction between encoding and decoding models is not sufficient for this purpose: relevant features in encoding and decoding models carry a different meaning in stimulus- and in response-based experimental paradigms. We show that only encoding models in the stimulus-based setting support unambiguous causal interpretations. By combining encoding and decoding models trained on the same data, however, we obtain insights into causal relations beyond those that are implied by each individual model type. We illustrate the empirical relevance of our theoretical findings on EEG data recorded during a visuo-motor learning task.

YNIMG Journal 2013 Journal Article

Co-localizing linguistic and musical syntax with intracranial EEG

  • Daniela Sammler
  • Stefan Koelsch
  • Tonio Ball
  • Armin Brandt
  • Maren Grigutsch
  • Hans-Jürgen Huppertz
  • Thomas R. Knösche
  • Jörg Wellmer

Despite general agreement on shared syntactic resources in music and language, the neuroanatomical underpinnings of this overlap remain largely unexplored. While previous studies mainly considered frontal areas as supramodal grammar processors, the domain-general syntactic role of temporal areas has been so far neglected. Here we capitalized on the excellent spatial and temporal resolution of subdural EEG recordings to co-localize low-level syntactic processes in music and language in the temporal lobe in a within-subject design. We used Brain Surface Current Density mapping to localize and compare neural generators of the early negativities evoked by violations of phrase structure grammar in both music and spoken language. The results show that the processing of syntactic violations relies in both domains on bilateral temporo-fronto-parietal neural networks. We found considerable overlap of these networks in the superior temporal lobe, but also differences in the hemispheric timing and relative weighting of their fronto-temporal constituents. While alluding to the dissimilarity in how shared neural resources may be configured depending on the musical or linguistic nature of the perceived stimulus, the combined data lend support for a co-localization of early musical and linguistic syntax processing in the temporal lobe.

YNIMG Journal 2013 Journal Article

Heart cycle-related effects on event-related potentials, spectral power changes, and connectivity patterns in the human ECoG

  • Markus Kern
  • Ad Aertsen
  • Andreas Schulze-Bonhage
  • Tonio Ball

The perception of one's own heartbeat is a fundamental interoceptive process that involves cortical and subcortical structures. Yet, the precise spatiotemporal neuronal activity patterns underlying the cortical information processing have remained largely elusive. Although the high temporal and spatial resolution of electrocorticographic (ECoG) recordings is increasingly being exploited in functional neuroimaging, it has not been used to study heart cycle-related effects. Here, we addressed the capacity of ECoG to characterize neuronal signals within the cardiac cycle, as well as to disentangle them from heart cycle-related artifacts. Based on topographical distribution and latency, we identified a biphasic potential within the primary somatosensory cortex, which likely constitutes a heartbeat-evoked potential (HEP) of neuronal origin. We also found two different types of artifacts: i) oscillatory potential changes with a frequency identical to the heart pulse rate, which probably represent pulsatility artifacts and ii) sharp potentials synchronized to the R-peak, corresponding to the onset of ventricular contraction and the cardiac field artifact (CFA) in EEG. Finally, we show that heart cycle-related effects induce pronounced phase-synchrony patterns in the ECoG and that this kind of correlation patterns, which may confound ECoG connectivity studies, can be reduced by a suitable correction algorithm. The present study is, to our knowledge, the first one to show a focally localized cortical HEP that could be clearly and consistently observed over subjects, suggesting a basic role of primary sensory cortex in processing of heart-related sensory inputs. We also conclude that taking into account and reducing heart cycle-related effects may be advantageous for many ECoG studies, and are of crucial importance, particularly for ECoG-based connectivity studies. Thus, in summary, although ECoG poses new challenges, it opens up new possibilities for the investigation of heartbeat-related viscerosensory processing in the human brain.

YNIMG Journal 2013 Journal Article

Somatotopic mapping of natural upper- and lower-extremity movements and speech production with high gamma electrocorticography

  • Johanna Ruescher
  • Olga Iljina
  • Dirk-Matthias Altenmüller
  • Ad Aertsen
  • Andreas Schulze-Bonhage
  • Tonio Ball

Precise delineation of pathological and eloquent cortices is essential in pre-neurosurgical diagnostics of epilepsy. A limitation of existing experimental procedures, however, is that they critically require active cooperation of the patient, which is not always achievable, particularly in infants and in patients with insufficient cognitive abilities. In the present study, we evaluated the potential of electrocorticographic recordings of high gamma activity during natural, non-experimental behavior of epilepsy patients to localize upper- and lower-extremity motor and language functions, and compared the results with those obtained using electrocortical stimulation. The observed effects were highly significant and functionally specific, and agreed well with the somatotopic organization of the motor cortex, both on the lateral convexity and in the supplementary motor area. Our approach showed a similar specificity and sensitivity for extremity movements as previously obtained from experimental data. We were able to quantify, for the first time, sensitivity and specificity of high gamma underlying non-experimental lower-extremity movements in four patients, and observed values in the same range as for upper extremities (analyzed in six patients). Speech-related responses in the three investigated patients, however, exhibited only a very low sensitivity. The present findings indicate that localization of not only upper- but also lower-extremity movements congruent with electrocortical stimulation mapping is possible based on event-related high gamma responses that can be observed during natural behavior. Thus, non-experimental mapping may be usefully applied as adjunct to established clinical procedures for identification of both upper- and lower-extremity motor functions.

YNIMG Journal 2013 Journal Article

Traveling waves and trial averaging: The nature of single-trial and averaged brain responses in large-scale cortical signals

  • David M. Alexander
  • Peter Jurica
  • Chris Trengove
  • Andrey R. Nikolaev
  • Sergei Gepshtein
  • Mikhail Zvyagintsev
  • Klaus Mathiak
  • Andreas Schulze-Bonhage

Analyzing single trial brain activity remains a challenging problem in the neurosciences. We gain purchase on this problem by focusing on globally synchronous fields in within-trial evoked brain activity, rather than on localized peaks in the trial-averaged evoked response (ER). We analyzed data from three measurement modalities, each with different spatial resolutions: magnetoencephalogram (MEG), electroencephalogram (EEG) and electrocorticogram (ECoG). We first characterized the ER in terms of summation of phase and amplitude components over trials. Both contributed to the ER, as expected, but the ER topography was dominated by the phase component. This means the observed topography of cross-trial phase will not necessarily reflect the phase topography within trials. To assess the organization of within-trial phase, traveling wave (TW) components were quantified by computing the phase gradient. TWs were intermittent but ubiquitous in the within-trial evoked brain activity. At most task-relevant times and frequencies, the within-trial phase topography was described better by a TW than by the trial-average of phase. The trial-average of the TW components also reproduced the topography of the ER; we suggest that the ER topography arises, in large part, as an average over TW behaviors. These findings were consistent across the three measurement modalities. We conclude that, while phase is critical to understanding the topography of event-related activity, the preliminary step of collating cortical signals across trials can obscure the TW components in brain activity and lead to an underestimation of the coherent motion of cortical fields.

YNIMG Journal 2012 Journal Article

Decoding natural grasp types from human ECoG

  • Tobias Pistohl
  • Andreas Schulze-Bonhage
  • Ad Aertsen
  • Carsten Mehring
  • Tonio Ball

Electrocorticographic (ECoG) signals have been successfully used to provide information about arm movement direction, individual finger movements and even continuous arm movement trajectories. Thus, ECoG has been proposed as a potential control signal for implantable brain–machine interfaces (BMIs) in paralyzed patients. For the neuronal control of a prosthesis with versatile hand/arm functions, it is also necessary to successfully decode different types of grasping movements, such as precision grip and whole-hand grip. Although grasping is one of the most frequent and important hand movements performed in everyday life, until now, the decoding of ECoG activity related to different grasp types has not been systematically investigated. Here, we show that two different grasp types (precision vs. whole-hand grip) can be reliably distinguished in natural reach-to-grasp movements in single-trial ECoG recordings from the human motor cortex. Self-paced movement execution in a paradigm accounting for variability in grasped object position and weight was chosen to create a situation similar to everyday settings. We identified three informative signal components (low-pass-filtered component, low-frequency and high-frequency amplitude modulations), which allowed for accurate decoding of precision and whole-hand grips. Importantly, grasp type decoding generalized over different object positions and weights. Within the frontal lobe, informative signals predominated in the precentral motor cortex and could also be found in the right hemisphere's homologue of Broca's area. We conclude that ECoG signals are promising candidates for BMIs that include the restoration of grasping movements. Highlights ► Two modes of natural grasping can be reliably discriminated from human ECoG. ► The decoding of grasp types generalizes over different object positions and weights. ► A low-frequency component and high-frequency amplitudes yield best decoding. ► ECoG may be used in BMIs for the restoration of grasping movements.

NeurIPS Conference 2011 Conference Paper

Multilinear Subspace Regression: An Orthogonal Tensor Decomposition Approach

  • Qibin Zhao
  • Cesar Caiafa
  • Danilo Mandic
  • Liqing Zhang
  • Tonio Ball
  • Andreas Schulze-Bonhage
  • Andrzej Cichocki

A multilinear subspace regression model based on so called latent variable decomposition is introduced. Unlike standard regression methods which typically employ matrix (2D) data representations followed by vector subspace transformations, the proposed approach uses tensor subspace transformations to model common latent variables across both the independent and dependent data. The proposed approach aims to maximize the correlation between the so derived latent variables and is shown to be suitable for the prediction of multidimensional dependent data from multidimensional independent data, where for the estimation of the latent variables we introduce an algorithm based on Multilinear Singular Value Decomposition (MSVD) on a specially defined cross-covariance tensor. It is next shown that in this way we are also able to unify the existing Partial Least Squares (PLS) and N-way PLS regression algorithms within the same framework. Simulations on benchmark synthetic data confirm the advantages of the proposed approach, in terms of its predictive ability and robustness, especially for small sample sizes. The potential of the proposed technique is further illustrated on a real world task of the decoding of human intracranial electrocorticogram (ECoG) from a simultaneously recorded scalp electroencephalograph (EEG).

YNIMG Journal 2009 Journal Article

Signal quality of simultaneously recorded invasive and non-invasive EEG

  • Tonio Ball
  • Markus Kern
  • Isabella Mutschler
  • Ad Aertsen
  • Andreas Schulze-Bonhage

Both invasive and non-invasive electroencephalographic (EEG) recordings from the human brain have an increasingly important role in neuroscience research and are candidate modalities for medical brain–machine interfacing. It is often assumed that the major artifacts that compromise non-invasive EEG, such as caused by blinks and eye movement, are absent in invasive EEG recordings. Quantitative investigations on the signal quality of simultaneously recorded invasive and non-invasive EEG in terms of artifact contamination are, however, lacking. Here we compared blink related artifacts in non-invasive and invasive EEG, simultaneously recorded from prefrontal and motor cortical regions using an approach suitable for detection of small artifact contamination. As expected, we find blinks to cause pronounced artifacts in non-invasive EEG both above prefrontal and motor cortical regions. Unexpectedly, significant blink related artifacts were also found in the invasive recordings, in particular in the prefrontal region. Computing a ratio of artifact amplitude to the amplitude of ongoing brain activity, we find that the signal quality of invasive EEG is 20 to above 100 times better than that of simultaneously obtained non-invasive EEG. Thus, while our findings indicate that ocular artifacts do exist in invasive recordings, they also highlight the much better signal quality of invasive compared to non-invasive EEG data. Our findings suggest that blinks should be taken into account in the experimental design of ECoG studies, particularly when event related potentials in fronto-anterior brain regions are analyzed. Moreover, our results encourage the application of techniques for reducing ocular artifacts to further optimize the signal quality of invasive EEG.

YNIMG Journal 2008 Journal Article

Movement related activity in the high gamma range of the human EEG

  • Tonio Ball
  • Evariste Demandt
  • Isabella Mutschler
  • Eva Neitzel
  • Carsten Mehring
  • Klaus Vogt
  • Ad Aertsen
  • Andreas Schulze-Bonhage

Electrocorticographic (ECoG) recordings obtained using intracranially implanted electrodes in epilepsy patients indicate that high gamma band (HGB) activity of sensorimotor cortex is focally increased during voluntary movement. These movement related HGB modulations may play an important role in sensorimotor cortex function. It is however currently not clear to what extent this type of neural activity can be detected using non-invasive electroencephalography (EEG) and how similar HGB responses in healthy human subjects are to those observed in epilepsy patients. Using the same arm reaching task, we have investigated spectral power changes both in intracranial ECoG recordings in epilepsy patients and in non-invasive EEG recordings optimized for detecting HGB activity in healthy subjects. Our results show a common HGB response pattern both in ECoG and EEG recorded above the sensorimotor cortex contralateral to the side of arm movement. In both cases, HGB activity increased around movement onset in the 60–90 Hz range and became most pronounced at reaching movement end. Additionally, we found EEG HGB activity above the frontal midline possibly generated by the anterior supplementary motor area (SMA), a region that was however not covered by the intracranial electrodes used in the present study. In summary, our findings show that HGB activity from human sensorimotor cortex can be non-invasively detected in healthy subjects using EEG, opening a new perspective for investigating the role of high gamma range neuronal activity both in function and dysfunction of the human cortical sensorimotor network.

YNIMG Journal 1999 Journal Article

The Role of Higher-Order Motor Areas in Voluntary Movement as Revealed by High-Resolution EEG and fMRI

  • Tonio Ball
  • Axel Schreiber
  • Bernd Feige
  • Michael Wagner
  • Carl Hermann Lücking
  • Rumyana Kristeva-Feige

In the human motor cortex structural and functional differences separate motor areas related to motor output from areas essentially involved in higher-order motor control. Little is known about the function of these higher-order motor areas during simple voluntary movement. We examined a simple finger flexion movement in six healthy subjects using a novel brainimaging approach, integrating high-resolution EEG with the individual structural and functional MRI. Electrical source reconstruction was performed in respect to the individual brain morphology from MRI. Highly converging results from EEG and fMRI were obtained for both executive and higher-order motor areas. All subjects showed activation of the primary motor area (MI) and of the frontal medial wall motor areas. Two different types of medial wall activation were observed with both methods: Four of the subjects showed an anterior type of activation, and two of the subjects a posterior type of activation. In the former, activity started in the anterior cingulate motor area (CMA) and subsequently shifted its focus to the intermediate supplementary motor area (SMA). Approximately 120 ms before the movement started, the intermediate SMA showed a drop of source strength, and simultaneously MI showed an increase of source strength. In the posterior type, activation was restricted to the posterior SMA. Further, three of the subjects investigated showed activation in the inferior parietal lobe (IPL) starting during early movement preparation. In all subjects showing activation of higher-order motor areas (anterior CMA, intermediate SMA, IPL) these areas became active before the executive motor areas (MI and posterior SMA). We suggest that the early activation of the anterior CMA and the IPL may be related to attentional functions of these areas. Further, we argue that the intermediate part of the SMA triggers the actual motor act via the release of inhibition of the primary motor area. Our results demonstrate that a noninvasive, multimodal brain imaging technique can reveal individual cortical brain activity with high temporal and spatial resolution, independent of a priori physiological assumptions.

v2026.09.13