People

Year: 2022

Kumar, P., Taubert, N., Raman, R., Vogels, R., de Gelder, B. & Giese, M. A (2022). Neural model for the representation of static and dynamic bodies in cortical body patches . VSS 2022.
Neural model for the representation of static and dynamic bodies in cortical body patches
Authors: Kumar, Prerana; Taubert, Nick; Raman, Rajani Vogels, Rufin de Gelder, Beatrice Giese, Martin A.
Type of Publication: In Collection
Publisher: VSS 2022
Mukovskiy, A., Hovaidi-Ardestani, M., Salatiello, A., Stettler, M., Vogels, R. & Giese, M. A (2022). Neurophysiologically-inspired computational model of the visual recognition of social behavior and intent . FENS Forum, Paris.
Neurophysiologically-inspired computational model of the visual recognition of social behavior and intent
Abstract:

AIMS: Humans recognize social interactions and intentions from videos of moving abstract stimuli, including simple geometric figures (Heider {&} Simmel, 1944). The neural machinery supporting such social interaction perception is completely unclear. Here, we present a physiologically plausible neural model of social interaction recognition that identifies social interactions in videos of simple geometric figures and fully articulating animal avatars, moving in naturalistic environments. METHODS: We generated the trajectories for both geometric and animal avatars using an algorithm based on a dynamical model of human navigation (Hovaidi-Ardestani, et al., 2018, Warren, 2006). Our neural recognition model combines a Deep Neural Network, realizing a shape-recognition pathway (VGG16), with a top-level neural network that integrates RBFs, motion energy detectors, and dynamic neural fields. The model implements robust tracking of interacting agents based on interaction-specific visual features (relative position, speed, acceleration, and orientation). RESULTS: A simple neural classifier, trained to predict social interaction categories from the features extracted by our neural recognition model, makes predictions that resemble those observed in previous psychophysical experiments on social interaction recognition from abstract (Salatiello, et al. 2021) and naturalistic videos. CONCLUSION: The model demonstrates that recognition of social interactions can be achieved by simple physiologically plausible neural mechanisms and makes testable predictions about single-cell and population activity patterns in relevant brain areas. Acknowledgments: ERC 2019-SyG-RELEVANCE-856495, HFSP RGP0036/2016, BMBF FKZ 01GQ1704, SSTeP-KiZ BMG: ZMWI1-2520DAT700, and NVIDIA Corporation.

Type of Publication: In Collection
Giese, M. A., BOGNÁR, A. & Vogels, R (2022). Physiologically-inspired neural model for anorthoscopic perception .
Physiologically-inspired neural model for anorthoscopic perception
Type of Publication: In Collection
St-Amand, J., Taubert, N., Gizzi, L. & Giese, M. A (2022). A Hierarchical Gaussian Process Control Algorithm for Bimanual Coordination with Hand Rehabilitation Devices .
A Hierarchical Gaussian Process Control Algorithm for Bimanual Coordination with Hand Rehabilitation Devices
Type of Publication: In Collection
Full text: PDF
Siebert, R., Stettler, M., Taubert, N., Dicke, P., Giese, M. A. & Thier, P (2022). Encoding of dynamic facial expressions in the macaque superior temporal sulcus . Society for Neuroscience.
Encoding of dynamic facial expressions in the macaque superior temporal sulcus
Authors: Siebert, Ramona Stettler, Michael; Taubert, Nick; Dicke, Peter Giese, Martin A.; Thier, Peter
Type of Publication: In Collection
Mukovskiy, A., Hovaidi-Ardestani, M., Salatiello, A., Stettler, M., Vogels, R. & Giese, M. A (2022). Physiologically-inspired neural model for social interaction recognition from abstract and naturalistic videos . VSS Annual Meeting 2022.
Physiologically-inspired neural model for social interaction recognition from abstract and naturalistic videos
Type of Publication: In Collection
Chiovetto, E., Salatiello, A., D'Avella, A. & Giese, M. A. (2022). Toward a unifying framework for the modeling and identification of motor primitives. Frontiers in computational neuroscience, 16 926345.
Toward a unifying framework for the modeling and identification of motor primitives
Abstract:

A large body of evidence suggests that human and animal movements, despite their apparent complexity and flexibility, are remarkably structured. Quantitative analyses of various classes of motor behaviors consistently identify spatial and temporal features that are invariant across movements. Such invariant features have been observed at different levels of organization in the motor system, including the electromyographic, kinematic, and kinetic levels, and are thought to reflect fixed modules-named motor primitives-that the brain uses to simplify the construction of movement. However, motor primitives across space, time, and organization levels are often described with ad-hoc mathematical models that tend to be domain-specific. This, in turn, generates the need to use model-specific algorithms for the identification of both the motor primitives and additional model parameters. The lack of a comprehensive framework complicates the comparison and interpretation of the results obtained across different domains and studies. In this work, we take the first steps toward addressing these issues, by introducing a unifying framework for the modeling and identification of qualitatively different classes of motor primitives. Specifically, we show that a single model, the anechoic mixture model, subsumes many popular classes of motor primitive models. Moreover, we exploit the flexibility of the anechoic mixture model to develop a new class of identification algorithms based on the Fourier-based Anechoic Demixing Algorithm (FADA). We validate our framework by identifying eight qualitatively different classes of motor primitives from both simulated and experimental data. We show that, compared to established model-specific algorithms for the identification of motor primitives, our flexible framework reaches overall comparable and sometimes superior reconstruction performance. The identification framework is publicly released as a MATLAB toolbox (FADA-T, https://tinyurl.com/compsens) to facilitate the identification and comparison of different motor primitive models.

Type of Publication: Article
Journal: Frontiers in computational neuroscience
Volume: 16 926345
Year: 2022
Full text: PDF
Ramachandra, V., Giese, M. A. & Benali, A. (2022). The Effects of Low-Intensity Repetitive Transcranial Magnetic Stimulation on White Matter Plasticity and Depression. .
The Effects of Low-Intensity Repetitive Transcranial Magnetic Stimulation on White Matter Plasticity and Depression
Authors: Ramachandra, Vishnudev Giese, Martin A.; Benali, Alia
Type of Publication: Article
Full text: PDF | Online version
Hörner, M., Groh, J., Klein, D., Ilg, W., Schöls, L., Santos, S. D. et al. (2022). CNS-associated T-lymphocytes in a mouse model of Hereditary Spastic Paraplegia type 11 (SPG11) are therapeutic targets for established immunomodulators.. accepted in Experimental Neurology.
CNS-associated T-lymphocytes in a mouse model of Hereditary Spastic Paraplegia type 11 (SPG11) are therapeutic targets for established immunomodulators.
Authors: Hörner, M. Groh, J. Klein, D. Ilg, Winfried; Schöls, L. Santos, S. Dos Bergmann, A. Klebe, S. Cauhape, M. Branchu, J. Hachimi, K. El Stevanin, G. Darios, F. Martini, R.
Research Areas: Uncategorized
Type of Publication: Article
Thierfelder, A., Primbs, J., Severitt, B., Hohnecker, C. S., K\"uhnhausen, J., Alt, A. K. et al. (2022). Multimodal sensor-based identification of stress and compulsive actions in children with obsessive-compulsive disorder for telemedical treatment. 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.
Multimodal sensor-based identification of stress and compulsive actions in children with obsessive-compulsive disorder for telemedical treatment
Abstract:

In modern psychotherapy, digital health technology offers advanced and personalized therapy options, increasing availability as well as ecological validity. These aspects have proven to be highly relevant for children and adolescents with obsessive-compulsive disorder (OCD). Exposure and Response Prevention therapy, which is the state-of-the-art treatment for OCD, builds on the reconstruction of everyday life exposure to anxious situations. However, while compulsive behavior predominantly occurs in home environments, exposure situations during therapy are limited to clinical settings. Telemedical treatment allows to shift from this limited exposure reconstruction to exposure situations in real life. In the SSTeP KiZ study (smart sensor technology in telepsychotherapy for children and adolescents with OCD), we combine video therapy with wearable sensors delivering physiological and behavioral measures to objectively determine the stress level of patients. The setup allows to gain information from exposure to stress in a realistic environment both during and outside of therapy sessions. In a first pilot study, we explored the sensitivity of individual sensor modalities to different levels of stress and anxiety. For this, we captured the obsessive-compulsive behavior of five adolescents with an ECG chest belt, inertial sensors capturing hand movements, and an eye tracker. Despite their prototypical nature, our results deliver strong evidence that the examined sensor modalities yield biomarkers allowing for personalized detection and quantification of stress and anxiety. This opens up future possibilities to evaluate the severity of individual compulsive behavior based on multi-variate state classification in real-life situations.

Authors: Thierfelder, Annika; Primbs, Jonas Severitt, Björn Hohnecker, Carolin Sarah K\"uhnhausen, Jan Alt, Annika Kristin Pascher, Anja Wörz, Ursula Passon, Helene Seemann, Jens; Ernst, Christian Lautenbacher, Heinrich Holderried, Martin Kasneci, Enkelejda Giese, Martin A.; Bulling, Andreas Menth, Michael Barth, Gottfried Maria Ilg, Winfried; Hollmann, Karsten Renner, Tobias Johann
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version

Year: 2021

Benali, A., Li, B., Ramachandra, V., Oeltermann, A., Giese, M. A. & Schwarz, C (2021). Deciphering the dynamics of neuronal activity evoked by transcranial magnetic stimulation.. Brain Stimulation 14 (6) , 1745. Elsevier.
Deciphering the dynamics of neuronal activity evoked by transcranial magnetic stimulation.
Abstract:

Transcranial magnetic stimulation (TMS), a non-invasive method for stimulating the brain, has been used for more than 35 years. Since then, there have been many human studies using sophisticated methods to infer how TMS interacts with the brain. However, these methods have their limitations, e.g. recording of EEG potentials, which are summation potentials from many cells and generated across many cortical layers, make it very difficult to localize the origin of the potentials and relate it to TMS induced effects. However, this is necessary to build accurate models that predict TMS action in the human brain. In recent years, we have developed a method that allows us to demonstrate nearly the direct effect of a TMS pulse at the cellular level. We transferred a TMS stimulation protocol from humans to a rat model. In this way, we were able to gain direct access to neurons activated by TMS, thereby reducing the parameter space by many factors. Our data show that a single TMS pulse affects cortical neurons for more than 300 ms. In addition to temporal dynamics, there are also spatial effects. These effects arise at both local and global scale after a single TMS pulse. The local effect occurs in the motor cortex and is very short-lived. It is characterized by a high-frequency neuronal discharge and is reminiscent of the I-wave patterns described in humans at the level of the spinal cord. The global effect occurs in many cortical and subcortical areas in both hemispheres and is characterized by an alternation of excitation and inhibition. Both effects either occur together or only the global effect is present. Next, we are planning to correlate these neurometric data with induced electric field modeling to create detailed TMS-triggered neuronal excitation models that could help us better understand cortical TMS interference.

Authors: Benali, Alia; Li, Bingshuo Ramachandra, Vishnudev Oeltermann, Axel Giese, Martin A.; Schwarz, Cornelius
Type of Publication: In Collection
Full text: PDF | Online version
Lang, J., Giese, M. A., Synofzik, M., Ilg, W. & Otte, S. (2021). Early Recognition of Ball Catching Success in Clinical Trials with RNN-Based Predictive Classification.. - ICANN 2021 30th International Conference on Artificial Neural Networks.
Early Recognition of Ball Catching Success in Clinical Trials with RNN-Based Predictive Classification.
Abstract:

Motor disturbances can affect the interaction with dynamic objects, such as catching a ball. A classification of clinical catching trials might give insight into the existence of pathological alterations in the relation of arm and ball movements. Accurate, but also early decisions are required to classify a catching attempt before the catcher's first ball contact. To obtain clinically valuable results, a significant decision confidence of at least 75% is required. Hence, three competing objectives have to be optimized at the same time: accuracy, earliness and decision-making confidence. Here we propose a coupled classification and prediction approach for early time series classification: a predictive, generative recurrent neural network (RNN) forecasts the next data points of ball trajectories based on already available observations; a discriminative RNN continuously generates classification guesses based on the available data points and the unrolled sequence predictions. We compare our approach, which we refer to as predictive sequential classification (PSC), to state-of-the-art sequence learners, including various RNN and temporal convolutional network (TCN) architectures. On this hard real-world task we can consistently demonstrate the superiority of PSC over all other models in terms of accuracy and confidence with respect to earliness of recognition. Specifically, PSC is able to confidently classify the success of catching trials as early as 123 milliseconds before the first ball contact. We conclude that PSC is a promising approach for early time series classification, when accurate and confident decisions are required.

Authors: Lang, Jana Giese, Martin A.; Synofzik, M. Ilg, Winfried; Otte, S.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Taubert, N., Stettler, M., Siebert, R., Spadacenta, S., Sting, L., Dicke, P. et al. (2021). Shape-invariant encoding of dynamic primate facial expressions in human perception. eLife.
Shape-invariant encoding of dynamic primate facial expressions in human perception
Abstract:

Dynamic facial expressions are crucial for communication in primates. Due to the difficulty to control shape and dynamics of facial expressions across species, it is unknown how species-specific facial expressions are perceptually encoded and interact with the representation of facial shape. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique. Consistent with our hypothesis, we found that human observers learned cross-species expressions very quickly, where face dynamics was represented largely independently of facial shape. This result supports the co-evolution of the visual processing and motor control of facial expressions, while it challenges appearance-based neural network theories of dynamic expression recognition.

Authors: Taubert, Nick; Stettler, Michael; Siebert, R. Spadacenta, S. Sting, L. Dicke, P. Thier, P. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Giese, M. A., Mukovskiy, A., Hovaidi-Ardestani, M., Salatiello, A. & Stettler, M. (2021). Neurophysiologically-inspired model for social interactions recognition from abstract and naturalistic stimuli. VSS 2021.
Neurophysiologically-inspired model for social interactions recognition from abstract and naturalistic stimuli
Research Areas: Uncategorized
Type of Publication: Article
Salatiello, A. & Giese, M. A. (2021). Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses.. Proceedings of the 2021 IEEE International Joint Conference on Neural Networks, 1-8.
Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses.
Abstract:

State-of-the-art motorized hand prostheses are endowed with actuators able to provide independent and proportional control of as many as six degrees of freedom (DOFs). The control signals are derived from residual electromyographic (EMG) activity, recorded concurrently from relevant forearm muscles. Nevertheless, the functional mapping between forearm EMG activity and hand kinematics is only known with limited accuracy. Therefore, no robust method exists for the reliable computation of control signals for the independent and proportional actuation of more than two DOFs. A common approach to deal with this limitation is to preprogram the prostheses for the execution of a restricted number of behaviors (e.g., pinching, grasping, and wrist rotation) that are activated by the detection of specific EMG activation patterns. However, this approach severely limits the range of activities users can perform with the prostheses during their daily living. In this work, we introduce a novel method, based on a long short-term memory (LSTM) network, to map forearm EMG activity onto hand kinematics online. Critically, unlike previous research efforts that tend to focus on simple and highly controlled motor tasks, we tested our method on a dataset of daily living activities (ADLs): the KIN-MUS UJI dataset. To the best of our knowledge, ours is the first reported work on the prediction of hand kinematics that uses this challenging dataset. Remarkably, we show that our network is able to generalize to novel untrained ADLs. Our results suggest that the presented method is suitable for the generation of control signals for the independent and proportional actuation of the multiple DOFs of state-of-the-art hand prostheses.

Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Thierfelder, A., Seemann, J., John, N., Giese, M. A., Schöls, L., Timman, D. et al. (2021). Turning movements in real life capture subtle longitudinal and preataxic changes in cerebellar ataxia. bioRxiv.
Turning movements in real life capture subtle longitudinal and preataxic changes in cerebellar ataxia
Abstract:

OBJECTIVES Clinical and regulatory acceptance of upcoming molecular treatments in degenerative ataxias might greatly benefit from ecologically valid endpoints which capture change in ataxia severity in patients’ real life. This longitudinal study aimed to unravel quantitative motor biomarkers in degenerative ataxias in real life turning movements which are sensitive for changes both longitudinally and at the preataxic stage.

Authors: Thierfelder, Annika; Seemann, Jens; John, N. Giese, Martin A.; Schöls, L. Timman, D. Synofzik, M. Ilg, Winfried
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Benali, A., Pfeiffer, F. & Tsutsui, K.-I. (2021). Brain Stimulation: From Basic Research to Clinical Use. .
Brain Stimulation: From Basic Research to Clinical Use
Abstract:

Originating in basic research, as a basis for understanding the function of brain areas, brain stimulation is currently employed for the treatment of many brain disorders including Parkinson's Disease, Epilepsy, and Depression. However, the available techniques for brain stimulation can differ, in the degree of surgical intervention: Invasive Brain Stimulation (IBS) techniques such as Deep Brain Stimulation (DBS) and Intracortical Microstimulation (ICMS) that require extensive surgical intervention for placement of electrodes, or Non-Invasive Brain Stimulation (NIBS) techniques, for example, Transcranial Magnetic Stimulation (TMS) and Transcranial Electrical Current Stimulation (tES) that require minimal or no intervention. With the development of thin movable electrodes having superior biocompatibility, some of the side effects related to the invasive procedure of IBS will very likely to be overcome. Likewise, advances in NIBS techniques related to spatial and temporal precision have closed the gap to its invasive counterparts. In parallel, considerable progress is being made in research laboratories using brain stimulation techniques to gain deeper insights into brain functions, and underlying neural and glial mechanisms, which in turn increase the efficacy of brain stimulation in treatments. Therefore, the therapeutic potential of stimulation techniques is not yet completed exhausted. However, the question remains, can the results from basic research be transferred easily to treatment of patients? By looking at the successes achieved in the past years, the answer to this question should be yes. Well-described animal models, good theoretical and anatomical models are essential for such translations. The proposed research topic aims to gather more evidence on the role of BS as a tool to better understand the physiological mechanisms of the brain, by studying the temporal and spatial dynamics of cortical and subcortical activations, and to discuss challenges and develop strategies for innovative therapeutic procedures. This Research Topic welcomes Original Research, Perspectives, Systematic Reviews, and Meta-Analyses covering the following topics: - Basic research models, theoretical models, preclinical or clinical applications of cortical and subcortical stimulation using TMS, tES, ICMS, and DBS in animal models and humans - Translational articles dealing with the effects of neuromodulation on the biochemistry of brain tissues, as well as those focusing on modeling strategies and closed-loop technologies - Neurophysiological studies in animal models and humans focusing on the mechanisms leading to altered cortical excitability, plasticity, and connectivity, or new experimental models aimed at understanding changes in cellular processes induced by electrical or inductive stimulation of neurons.

Authors: Benali, Alia; Pfeiffer, Friederike Tsutsui, Ken-Ichiro
Type of Publication: Article
Full text: Online version
Benali, A., Tsutsui, K.-I., Pfeiffer, F. & Sekino, M. (2021). Brain Stimulation: From Basic Research to Clinical Use. Frontiers in Human Neuroscience Brain Imaging and Stimulation. Retrieved from https://www.frontiersin.org/research-topics/18713/brain-stimulation-from-basic-research-to-clinical-use.
Brain Stimulation: From Basic Research to Clinical Use
Abstract:

Originating in basic research, as a basis for understanding the function of brain areas, brain stimulation is currently employed for the treatment of many brain disorders including Parkinson's Disease, Epilepsy, and Depression. However, the available techniques for brain stimulation can differ, in the degree of surgical intervention: Invasive Brain Stimulation (IBS) techniques such as Deep Brain Stimulation (DBS) and Intracortical Microstimulation (ICMS) that require extensive surgical intervention for placement of electrodes, or Non-Invasive Brain Stimulation (NIBS) techniques, for example, Transcranial Magnetic Stimulation (TMS) and Transcranial Electrical Current Stimulation (tES) that require minimal or no intervention. With the development of thin movable electrodes having superior biocompatibility, some of the side effects related to the invasive procedure of IBS will very likely to be overcome. Likewise, advances in NIBS techniques related to spatial and temporal precision have closed the gap to its invasive counterparts. In parallel, considerable progress is being made in research laboratories using brain stimulation techniques to gain deeper insights into brain functions, and underlying neural and glial mechanisms, which in turn increase the efficacy of brain stimulation in treatments. Therefore, the therapeutic potential of stimulation techniques is not yet completed exhausted. However, the question remains, can the results from basic research be transferred easily to treatment of patients? By looking at the successes achieved in the past years, the answer to this question should be yes. Well-described animal models, good theoretical and anatomical models are essential for such translations. The proposed research topic aims to gather more evidence on the role of BS as a tool to better understand the physiological mechanisms of the brain, by studying the temporal and spatial dynamics of cortical and subcortical activations, and to discuss challenges and develop strategies for innovative therapeutic procedures. This Research Topic welcomes Original Research, Perspectives, Systematic Reviews, and Meta-Analyses covering the following topics: - Basic research models, theoretical models, preclinical or clinical applications of cortical and subcortical stimulation using TMS, tES, ICMS, and DBS in animal models and humans - Translational articles dealing with the effects of neuromodulation on the biochemistry of brain tissues, as well as those focusing on modeling strategies and closed-loop technologies - Neurophysiological studies in animal models and humans focusing on the mechanisms leading to altered cortical excitability, plasticity, and connectivity, or new experimental models aimed at understanding changes in cellular processes induced by electrical or inductive stimulation of neurons.

Authors: Benali, Alia; Tsutsui, Ken-Ichiro Pfeiffer, F. Sekino, Masaki
Type of Publication: Electronic Article
Journal: Frontiers in Human Neuroscience Brain Imaging and Stimulation
Full text: Online version
Kumar, P., Taubert, N., Raman, R., Vogels, R., de Gelder, B. & Giese, M. A (2021). Physiologically-inspired neural model for the visual recognition of dynamic bodies . Neuroscience 2021.
Physiologically-inspired neural model for the visual recognition of dynamic bodies
Authors: Kumar, Prerana; Taubert, Nick; Raman, Rajani Vogels, Rufin de Gelder, Beatrice Giese, Martin A.
Type of Publication: In Collection
Kumar, P., Taubert, N., Stettler, M., Vogels, R., de Gelder, B. & Giese, M. A (2021). Neurodynamical model for the visual recognition of dynamic bodies . ECVP 2021.
Neurodynamical model for the visual recognition of dynamic bodies
Type of Publication: In Collection
Kumar, P., Taubert, N., Stettler, M., Vogels, R., de Gelder, B. & Giese, M. A (2021). Neurodynamical model for the visual recognition of dynamic bodies . CNS 2021.
Neurodynamical model for the visual recognition of dynamic bodies
Type of Publication: In Collection
Giese, M. A., Mukovskiy, A., Hovaidi-Ardestani, M., Salatiello, A. & Stettler, M (2021). Neurophysiologically-inspired model for social interactions recognition from abstract and naturalistic stimuli. VSS 2021, May 21-26 .
Neurophysiologically-inspired model for social interactions recognition from abstract and naturalistic stimuli
Type of Publication: In Collection
Mukovskiy, A., Ardestani, M. H., Salatiello, A., Stettler, M. & Giese, M. A (2021). Physiologically-inspired neural model for social interactions recognition from abstract and naturalistic stimuli. Göttingen Meeting of the German Neuroscience Society 2021, Germany .
Physiologically-inspired neural model for social interactions recognition from abstract and naturalistic stimuli
Type of Publication: In Collection
Taubert, N. & Giese, M. A. (2021). Hierarchical Deep Gaussian Processes Latent Variable Model via Expectation Propagation. Artificial Neural Networks and Machine Learning – ICANN 2021 30th International Conference on Artificial Neural Networks, Bratislava, Slovakia, September 14-17, 2021, Proceedings, Part I. Springer, Berlin.
Hierarchical Deep Gaussian Processes Latent Variable Model via Expectation Propagation
Type of Publication: Article
Full text: PDF
Salatiello, A. & Giese, M. A. (2021). Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses. arXiv preprint.
Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses
Abstract:

State-of-the-art motorized hand prostheses are endowed with actuators able to provide independent and proportional control of as many as six degrees of freedom (DOFs). The control signals are derived from residual electromyographic (EMG) activity, recorded concurrently from relevant forearm muscles. Nevertheless, the functional mapping between forearm EMG activity and hand kinematics is only known with limited accuracy. Therefore, no robust method exists for the reliable computation of control signals for the independent and proportional actuation of more than two DOFs. A common approach to deal with this limitation is to pre-program the prostheses for the execution of a restricted number of behaviors (e.g., pinching, grasping, and wrist rotation) that are activated by the detection of specific EMG activation patterns. However, this approach severely limits the range of activities users can perform with the prostheses during their daily living. In this work, we introduce a novel method, based on a long short-term memory (LSTM) network, to continuously map forearm EMG activity onto hand kinematics. Critically, unlike previous work, which often focuses on simple and highly controlled motor tasks, we tested our method on a dataset of activities of daily living (ADLs): the KIN-MUS UJI dataset. To the best of our knowledge, ours is the first reported work on the prediction of hand kinematics that uses this challenging dataset. Remarkably, we show that our network is able to generalize to novel untrained ADLs. Our results suggest that the presented method is suitable for the generation of control signals for the independent and proportional actuation of the multiple DOFs of state-of-the-art hand prostheses.

Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Salatiello, A., Hovaidi-Ardestani, M. & Giese, M. A. (2021). A Dynamical Generative Model of Social Interactions. Frontiers in Neurorobotics, 15, 62.
A Dynamical Generative Model of Social Interactions
Abstract:

The ability to make accurate social inferences makes humans able to navigate and act in their social environment effortlessly. Converging evidence shows that motion is one of the most informative cues in shaping the perception of social interactions. However, the scarcity of parameterized generative models for the generation of highly-controlled stimuli has slowed down both the identification of the most critical motion features and the understanding of the computational mechanisms underlying their extraction and processing from rich visual inputs. In this work, we introduce a novel generative model for the automatic generation of an arbitrarily large number of videos of socially interacting agents for comprehensive studies of social perception. The proposed framework, validated with three psychophysical experiments, allows generating as many as 15 distinct interaction classes. The model builds on classical dynamical system models of biological navigation and is able to generate visual stimuli that are parametrically controlled and representative of a heterogeneous set of social interaction classes. The proposed method represents thus an important tool for experiments aimed at unveiling the computational mechanisms mediating the perception of social interactions. The ability to generate highly-controlled stimuli makes the model valuable not only to conduct behavioral and neuroimaging studies, but also to develop and validate neural models of social inference, and machine vision systems for the automatic recognition of social interactions. In fact, contrasting human and model responses to a heterogeneous set of highly-controlled stimuli can help to identify critical computational steps in the processing of social interaction stimuli.

Authors: Salatiello, Alessandro; Hovaidi-Ardestani, M. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Stettler, M., Taubert, N., Siebert, R., Spadacenta, S., Dicke, P., Thier, P. et al (2021). Neural models for the (cross-species) recognition of dynamic facial expressions. Göttingen Meeting of the German Neuroscience Society 2021, Germany .
Neural models for the (cross-species) recognition of dynamic facial expressions
Authors: Stettler, Michael; Taubert, Nick; Siebert, Ramona Spadacenta, Silvia Dicke, Peter Thier, Peter Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: PDF
Stettler, M., Taubert, N., Siebert, R., Spadacenta, S., Dicke, P., Thier, P. et al (2021). Neural models for the cross-species recognition of dynamic facial expressions. VSS 2021, May 21-26 .
Neural models for the cross-species recognition of dynamic facial expressions
Authors: Stettler, Michael; Taubert, Nick; Siebert, Ramona Spadacenta, Silvia Dicke, Peter Thier, Peter Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: PDF
Gomes, C. A., Steiner, K. M., Ludolph, N., Spisak, T., Ernst, T. M., Mueller, O. et al. (2021). Resection of cerebellar tumours causes widespread and functionally relevant white matter impairments. Hum Brain Mapp. Online ahead of print..
Resection of cerebellar tumours causes widespread and functionally relevant white matter impairments
Authors: Gomes, Carlos Alexandre Steiner, Katharina M Ludolph, Nicolas Spisak, Tamas Ernst, Thomas M Mueller, Oliver Göricke, Sophia L Labrenz, Franziska Ilg, Winfried; Axmacher, Nikolai Timmann, Dagmar
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Mukovskiy, A., Ardestani, M. H., Salatiello, A., Stettler, M. & Giese, M. A. (2021). Physiologically-inspired neural model for social interactions recognition from abstract and naturalistic stimuli.. Göttingen Meeting of the German Neuroscience Society.
Physiologically-inspired neural model for social interactions recognition from abstract and naturalistic stimuli.
Research Areas: Uncategorized
Type of Publication: Article
Salatiello, A. & Giese, M. A. (2021). Unsupervised identification of space-, time-, and action-dependent latent factors underlying muscle activity during reaching. 30th Annual Computational Neuroscience Meeting.
Unsupervised identification of space-, time-, and action-dependent latent factors underlying muscle activity during reaching
Research Areas: Uncategorized
Type of Publication: Article

Year: 2020

Vogel, A. P., Magee, M., Torres-Vega, R., Medrano-Montero, J., Cyngler, M. P., Kruse, M. et al. (2020). Features of speech and swallowing dysfunction in pre-ataxic spinocerebellar ataxia type 2. Neurology, 95(2):e194-e205.
Features of speech and swallowing dysfunction in pre-ataxic spinocerebellar ataxia type 2
Authors: Vogel, Adam P. Magee, Michelle Torres-Vega, Reidenis Medrano-Montero, Jacqueline Cyngler, Melissa P. Kruse, Megan Rojas, Sandra Cubillos, Sebastian Contreras Canento, Tamara Maldonado, Fernanda Vazquez-Mojena, Yaimee Ilg, Winfried; Rodríguez-Labrada, Roberto Velázquez-Pérez, Luis Synofzik, Matthis
Type of Publication: Article
Full text: Online version
Steiner, K. M., Thier, W., Batsikadze, G., Ludolph, N., Ilg, W. & Timmann, D. (2020). Lack of effects of a single session of cerebellar transcranial direct current stimulation (tDCS) in a dynamic balance task. Journal of Neurology, 267, pages1206–1208(2020).
Lack of effects of a single session of cerebellar transcranial direct current stimulation (tDCS) in a dynamic balance task
Authors: Steiner, K. M. Thier, W. Batsikadze, G. Ludolph, N. Ilg, Winfried; Timmann, D.
Type of Publication: Article
Full text: PDF | Online version
Pomper, J. K., Spadacenta, S., Bunjes, F., Arnstein, D., Giese, M. A. & Thier, P. (2020). Representation of the observer's predicted outcome value in mirror and nonmirror neurons of macaque F5 ventral premotor cortex. J Neurophysiol, 124(3), 941-961.
Representation of the observer's predicted outcome value in mirror and nonmirror neurons of macaque F5 ventral premotor cortex
Authors: Pomper, Joern K Spadacenta, Silvia Bunjes, Friedemann Arnstein, Daniel Giese, Martin A.; Thier, Peter
Type of Publication: Article
Full text: Online version
Taubert, N., St-Amand, J., Kumar, P., Gizzi, L. & Giese, M. A. (2020). Reactive Hand Movements from Arm Kinematics and EMG Signals Based on Hierarchical Gaussian Process Dynamical Models. Artificial Neural Networks and Machine Learning – ICANN 2020 29th International Conference on Artificial Neural Networks, Bratislava, Slovakia, September 15–18, 2020, Proceedings, Part I. Springer, Berlin(127-140).
Reactive Hand Movements from Arm Kinematics and EMG Signals Based on Hierarchical Gaussian Process Dynamical Models
Type of Publication: Article
Full text: Online version
Stettler, M., Taubert, N., Azizpour, T., Siebert, R., Spadacenta, S., Dicke, P. et al. (2020). Physiologically-inspired Neural Circuits for the Recognition of Dynamic Faces. Artificial Neural Networks and Machine Learning – ICANN 2020 29th International Conference on Artificial Neural Networks, Bratislava, Slovakia, September 15–18, 2020, Proceedings, Part I. Springer, Berlin(168-179).
Physiologically-inspired Neural Circuits for the Recognition of Dynamic Faces
Authors: Stettler, Michael; Taubert, Nick; Azizpour, Tahereh Siebert, Ramona Spadacenta, Silvia Dicke, Peter Thier, Hans Peter Giese, Martin A.
Type of Publication: Article
Full text: Online version
Ardestani, M. H., Mukovskiy, A., Stettler, M., Saini, N. & Giese, M. A (2020). Physiologically-inspired neural model for the visual recognition of social interactions from abstract and natural stimuli. VSS 2020, 19-24 Jun .
Physiologically-inspired neural model for the visual recognition of social interactions from abstract and natural stimuli
Type of Publication: In Collection
Siebert, R., Taubert, N., Spadacenta, S., Dicke, P. W., Giese, M. A. & Thier, P. (2020). A naturalistic dynamic monkey head avatar elicits species-typical reactions and overcomes the uncanny valley. ENEURO.0524-19.2020.
A naturalistic dynamic monkey head avatar elicits species-typical reactions and overcomes the uncanny valley
Authors: Siebert, Ramona Taubert, Nick; Spadacenta, Silvia Dicke, Peter W. Giese, Martin A.; Thier, Peter
Type of Publication: Article
Full text: Online version
Pfeiffer, F. & Benali, A. (2020). Could non-invasive brain-stimulation prevent neuronal degeneration upon ion channel re-distribution and ion accumulation after demyelination?. Neural Regeneration Research, 15(11), 1977-1980.
Could non-invasive brain-stimulation prevent neuronal degeneration upon ion channel re-distribution and ion accumulation after demyelination?
Abstract:

Fast and efficient transmission of electrical signals in the nervous system is mediated through myelinated nerve fibers. In neuronal diseases such as multiple sclerosis, the conduction properties of axons are disturbed by the removal of the myelin sheath, leaving nerve cells at a higher risk of degenerating. In some cases, the protective myelin sheath of axons can be rebuilt by remyelination through oligodendroglial cells. In any case, however, changes in the ion channel organization occur and may help to restore impulse conduction after demyelination. On the other hand, changes in ion channel distribution may increase the energy demand of axons, thereby increasing the probability of axonal degeneration. Many attempts have been made or discussed in recent years to increase remyelination of affected axons in demyelinating diseases such as multiple sclerosis. These approaches range from pharmacological treatments that reduce inflammatory processes or block ion channels to the modulation of neuronal activity through electrical cortical stimulation. However, these treatments either affect the entire organism (pharmacological) or exert a very local effect (electrodes). Current results show that neuronal activity is a strong regulator of oligodendroglial development. To bridge the gap between global and very local treatments, non-invasive transcranial magnetic stimulation could be considered. Transcranial magnetic stimulation is externally applied to brain areas and experiments with repetitive transcranial magnetic stimulation show that the neuronal activity can be modulated depending on the stimulation parameters in both humans and animals. In this review, we discuss the possibilities of influencing ion channel distribution and increasing neuronal activity by transcranial magnetic stimulation as well as the effect of this modulation on oligodendroglial cells and their capacity to remyelinate previously demyelinated axons. Although the physiological mechanisms underlying the effects of transcranial magnetic stimulation clearly need further investigations, repetitive transcranial magnetic stimulation may be a promising approach for non-invasive neuronal modulation aiming at enhancing remyelination and thus reducing neurodegeneration

Authors: Pfeiffer, F. Benali, Alia
Type of Publication: Article
Full text: PDF | Online version
Salatiello, A. & Giese, M. A. (2020). Recurrent Neural Network Learning of Performance and Intrinsic Population Dynamics from Sparse Neural Data. Artificial Neural Networks and Machine Learning – ICANN 2020 29th International Conference on Artificial Neural Networks, Bratislava, Slovakia, September 15–18, 2020, Proceedings, Part I. Springer, Berlin(874-886).
Recurrent Neural Network Learning of Performance and Intrinsic Population Dynamics from Sparse Neural Data
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Ilg, W. & Timmann, D. (2020). General Management of Cerebellar Disorders. An Overview. In: Manto M., Gruol D., Schmahmann J., Koibuchi N., Sillitoe R. (eds) Handbook of the Cerebellum and Cerebellar Disorders.Springer, Cham, 1-28.
General Management of Cerebellar Disorders
Authors: Ilg, Winfried; Timmann, Dagmar
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Rauscher, M., Yavari, F., Batsikadze, G., Ludolph, N., Ilg, W., Nitsche, M. et al. (2020). Lack of Cerebellar tDCS Effects on Learning of a Complex Whole Body Dynamic Balance Task in Middle-Aged (50-65 Years) Adults. Neurol. Res. Pract. 2, 38.
Lack of Cerebellar tDCS Effects on Learning of a Complex Whole Body Dynamic Balance Task in Middle-Aged (50-65 Years) Adults
Authors: Rauscher, Manuel Yavari, Fatemeh Batsikadze, Giorgi Ludolph, Nicolas Ilg, Winfried; Nitsche, Michael Timmann, Dagmar Steiner, Katharina Marie
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Petrasch-Parwez, E., Schöbel, A., Benali, A., Moinfar, Z., Förster, E., Br\"une, M. et al. (2020). Lateralization of increased density of Iba1-immunopositive microglial cells in the anterior midcingulate cortex of schizophrenia and bipolar disorder. Eur Arch Psychiatry Clin Neurosci. 2020, Online ahead of print, 270(7), 819-828.
Lateralization of increased density of Iba1-immunopositive microglial cells in the anterior midcingulate cortex of schizophrenia and bipolar disorder
Abstract:

There is increasing evidence from genetic, biochemical, pharmacological, neuroimaging and post-mortem studies that immunological dysregulation plays a crucial role in the pathogenesis of psychoses. The involvement of microglia in schizophrenia and bipolar disorder (BD) has remained controversial, however, since results from various post-mortem studies are still inconclusive. Here, we analyzed the estimated density of microglia of age-matched individuals with schizophrenia (n=17), BD (n=13), and non-psychiatric control subjects (n=17) in the anterior midcingulate cortex (aMCC), a brain area putatively involved in the pathogenesis of psychoses, using ionized calcium binding adaptor molecule 1 (Iba1)—immunohistochemistry. The microglial cells displayed a homogenously distributed Iba1—staining pattern in the aMCC with slightly varying activation states in all three groups. The estimated microglial densities did not difer signifcantly between individuals with schizophrenia, BD and control subjects. Remarkably, when both hemispheres were investigated separately within the three groups, the density was signifcantly lateralized towards the right aMCC in schizophrenia (p=0.01) and—even more evident—in BD subjects (p=0.008). This left–right lateralization was not observed in the control group (p=0.52). Of note, microglial density was signifcantly lower in BD individuals who did not commit suicide compared with BD individuals who died from suicide (p=0.002). This diference was not observed between individuals with BD who committed suicide and controls. The results, tentatively interpreted, suggest a hitherto unknown increased lateralization of microglial density to the right hemisphere in both psychiatric groups. If confrmed in independent samples, lateralization should be considered in all post-mortem studies on microglia. Density diferences between suicide and non-suicide individuals needs further elucidation.

Authors: Petrasch-Parwez, E. Schöbel, A. Benali, Alia; Moinfar, Z. Förster, E. Br\"une, M. Juckel, G.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Taubert, N., Stettler, M., Sting, L., Siebert, R., Spadacenta, S., Dicke, P. et al (2020). Cross-species diferences in the perception of dynamic facial expressions. VSS 2020, 19-24 Jun .
Cross-species diferences in the perception of dynamic facial expressions
Authors: Taubert, Nick; Stettler, Michael; Sting, Louisa Siebert, Ramona Spadacenta, Silvia Dicke, Peter Thier, Hans-Peter Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: PDF
Stettler, M. & Giese, M. A (2020). Physiologically-inspired Neural Circuits for the Recognition of Dynamic Faces. ICANN 2020 .
Physiologically-inspired Neural Circuits for the Recognition of Dynamic Faces
Research Areas: Uncategorized
Type of Publication: In Collection
Salatiello, A. & Giese, M. A (2020). Recurrent Neural Network Learning of Performance and Intrinsic Population Dynamics from Sparse Neural Data. ICANN2020, arXiv:2005.02211v1 [q-bio.NC] .
Recurrent Neural Network Learning of Performance and Intrinsic Population Dynamics from Sparse Neural Data
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: PDF
Ilg, W., Seemann, J., Giese, M. A., Trasch\"utz, A., Schöls, L., Timmann, D. et al. (2020). Real-life gait assessment in degenerative cerebellar ataxia: Towards ecologically valid biomarkers. Neurology, 95(9):e119-e210.
Real-life gait assessment in degenerative cerebellar ataxia: Towards ecologically valid biomarkers
Authors: Ilg, Winfried; Seemann, Jens; Giese, Martin A.; Trasch\"utz, Andreas Schöls, Ludger Timmann, Dagmar Synofzik, Matthis
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Lang, J., Haas, E., -Schmid, J. H., Anderson, C. J., Pulst, S. M., Giese, M. A. et al. (2020). Detecting and quantifying ataxia-related motor impairments in rodents using markerless motion tracking with deep neural networks. 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'20) to be held at the Palais des congrès de Montréal, Montréal, Québec, Canada July 20-24, 2020.
Detecting and quantifying ataxia-related motor impairments in rodents using markerless motion tracking with deep neural networks
Authors: Lang, Jana Haas, E -Schmid, Jeannette H\"ubener Anderson, C. J. Pulst, S. M. Giese, Martin A.; Ilg, Winfried
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Huber, M. E., Chiovetto, E., Giese, M. A. & Sternad, D. (2020). Rigid soles improve balance in beam walking, but improvements do not persist with bare feet. Sci Rep, 10(1), 7629.
Rigid soles improve balance in beam walking, but improvements do not persist with bare feet
Authors: Huber, Meghan E Chiovetto, Enrico Giese, Martin A.; Sternad, Dagmar
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Stollenmaier, K., Ilg, W. & Haeufle, D. F. (2020). Predicting perturbed human arm movements in a neuro-musculoskeletal model to investigate the muscular force response. Frontiers in Bioengineering and Biotechnology, section Bionics and Biomimetics, 8(308).
Predicting perturbed human arm movements in a neuro-musculoskeletal model to investigate the muscular force response
Authors: Stollenmaier, Katrin Ilg, Winfried; Haeufle, Daniel F. B.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version

Information

All images and videos displayed on this webpage are protected by copyright law. These copyrights are owned by Computational Sensomotorics.

If you wish to use any of the content featured on this webpage for purposes other than personal viewing, please contact us for permission.

Social Media

We use cookies

We use cookies on our website. Some of them are essential for the operation of the site, while others help us to improve this site and the user experience (tracking cookies). You can decide for yourself whether you want to allow cookies or not. Please note that if you reject them, you may not be able to use all the functionalities of the site.