Section Computational
Sensomotorics
Department of Cognitive Neurology
CIN.jpg
MonkeyHead_SlideShow_Full_2.jpg
KinectSystemLab.jpg

Home

Year: 2025

Martini, L. M., Lappe, A. & Giese, M. A (2025). Pose and shape reconstruction of nonhuman primates from images for studying social perception. Journal of Vision September 2025 . Vision Science Society.
Pose and shape reconstruction of nonhuman primates from images for studying social perception
Abstract:

The neural and computational mechanisms of the visual encoding of body pose and motion remain poorly understood. One important obstacle in their investigation is the generation of highly controlled stimuli with exactly specified form and motion parameters. Avatars are ideal for this purpose, but for nonhuman species the generation of appropriate motion and shape data is extremely costly, where video-based methods often are not accurate enough to generate convincing 3D animations with highly specified parameters. METHODS: Based on a photorealistic 3D model for macaque monkeys, which we have developed recently, we propose a method that adjusts this model automatically to other nonhuman primate shapes, requiring only a small number of photographs and hand-labeled keypoints for that species. The resulting 3D model allows to generate highly realistic animations with different primate species, combining the same motion with different body shapes. Our method is based on an algorithm that deforms a polygon mesh of a macaque model with 10,632 vertices with an underlying rig of 115 joints automatically, matching the silhouettes of the animals and a small number of specified key points in the example pictures. Optimization is based on a composite error function that integrates terms for matching quality of the silhouettes, keypoints, and bone length, and for minimizing local surface deformation. RRSULTS: We demonstrate the efficiency of the method for several monkey and ape species. In addition, we are presently investigating in a psychophysical experiment how the body shape of different primate species interacts with the categorization of body movements of humans and non-human primates in human perception. CONCLUSION: Using modern computer graphics methods, highly realistic and well-controlled body motion stimuli can be generated from small numbers of photographs, allowing to study how species-specific motion and body shape interact in visual body motion perception. Acknowledgements: ERC 2019-SyG-RELEVANCE-856495; SSTeP-KiZ BMG: ZMWI1-2520DAT700.

Type of Publication: In Collection
JRESEARCH_BOOK_TITLE: Journal of Vision September 2025
Publisher: Vision Science Society
Month: September
Jiang, X. & Giese, M. A (2025). Modeling Action-Perception Coupling with Reciprocally Connected Neural Fields. Journal of Vision September 2025 . Vision Science Society.
Modeling Action-Perception Coupling with Reciprocally Connected Neural Fields
Type of Publication: In Collection
Full text: PDF
Bohn, K., Seemann, J., Synofzik, M. & Ilg, W (2025). Understanding the relationship of static and dynamic balance measures in ataxic stance and gait at different disease stages. International Society of Posture and Gait Research (ISPGR) Maastricht .
Understanding the relationship of static and dynamic balance measures in ataxic stance and gait at different disease stages
Abstract:

BACKGROUND AND AIM: Ataxic gait is typically characterized by an unstable, stumbling gait, increased step width, and high gait variability. The characteristic high variability is thought to result from the complex interaction between cerebellar-induced deficits in balance control and multi-joint coordination, the compensatory strategies used, and inaccurate postural adjustments to the apparent loss of balance. The interplay and relative importance of these individual factors and their development over the course of the disease are not fully understood. Clarifying their relationship during disease progression would allow both efficient neurorehabilitation and the development of disease-phase sensitive performance markers for clinical trials. Here, we aimed to investigate the role of ataxia-specific balance dysfunction in static (stance) and dynamic (gait) conditions, particularly in very early and pre-symptomatic disease stages (i.e., mutation carriers without clinical manifestation). METHODS: We assessed static and dynamic balance of subjects with degenerative cerebellar ataxia at baseline and 1-year follow-up using three body-worn inertial sensors. Stance conditions included natural stance and feet together stance with eyes opened and eyes closed. As a measure of static balance performance we used the sway path length (SPL) based on the hip sensor. Walking was performed in laboratory settings, i.e., supervised straight walking of a 60m corridor at preferred speed, and unsupervised in real life. The compound measure of spatial step variability (SPcmp), which integrates step length variability and lateral step deviation, served as a measure of ataxia-specific gait variability. RESULTS: Cross-sectional analysis of symptomatic ataxia patients (n = 44, SARA = 10.1) revealed correlations between SPL during natural stance and SPcmp during walking, with increasing effects moving from laboratory (r = 0.36, p {\textless} 0.0001) to real-life conditions (r = 0.51, p {\textless} 0.0001). For the group of pre-ataxic mutations carriers (n = 33, SARA = 0.7) we saw a strong trend for the relation of gait variability and sway in a stance task with increased complexity (i.e., feet together, eyes closed) (r = 0.25, p = 0.06). The relation was particularly evident longitudinally when 1-year changes in stance sway and gait variability were correlated (r = 0.44, p = 0.01). CONCLUSIONS: We were able to identify specific influences of the static balance mechanism on gait in pre-symptomatic mutation carriers, suggesting that alterations in balance control mechanisms already play a verifiable role in pre-symptomatic and very early disease stages, whereas cerebellar-induced deficits in balance control and multi-joint coordination and compensatory strategies such as slowing down may have a greater influence in later disease stages. This highlights the importance of static stance testing and related balance exercises in rehabilitation, particularly in pre-symptomatic and early disease stages.

Type of Publication: In Collection
Marrazzo, G., Martino, F. D., Mukovskiy, A., Giese, M. A. & de Gelder, B. (2025). Neural encoding of biomechanically (im)possible human movements in occipitotemporal cortex. bioRxiv.
Neural encoding of biomechanically (im)possible human movements in occipitotemporal cortex
Abstract:

Understanding how the human brain processes body movements is essential for clarifying the mechanisms underlying social cognition and interaction. This study investigates the encoding of biomechanically possible and impossible body movements in occipitotemporal cortex using ultra-high field 7Tesla fMRI. By predicting the response of single voxels to impossible/possible movements using a computational modelling approach, our findings demonstrate that a combination of postural, biomechanical, and categorical features significantly predicts neural responses in the ventral visual cortex, particularly within the extrastriate body area (EBA), underscoring the brain{\textquoteright}s sensitivity to biomechanical plausibility. Lastly, these findings highlight the functional heterogeneity of EBA, with specific regions (middle/superior occipital gyri) focusing on detailed biomechanical features and anterior regions (lateral occipital sulcus and inferior temporal gyrus) integrating more abstract, categorical information.Competing Interest StatementThe authors have declared no competing interest.

Authors: Marrazzo, Giuseppe Martino, Federico De Mukovskiy, Albert; Giese, Martin A.; de Gelder, Beatrice
Type of Publication: Article
Journal: bioRxiv
Year: 2025
Full text: PDF | Online version
Lappe, A. & Giese, M. A. (2025). Register and CLS tokens yield a decoupling of local and global features in large ViTs. arXiv.
Register and CLS tokens yield a decoupling of local and global features in large ViTs
Abstract:

Recent work has shown that the attention maps of the widely popular DINOv2 model exhibit artifacts, which hurt both model interpretability and performance on dense image tasks. These artifacts emerge due to the model repurposing patch tokens with redundant local information for the storage of global image information. To address this problem, additional register tokens have been incorporated in which the model can store such information instead. We carefully examine the influence of these register tokens on the relationship between global and local image features, showing that while register tokens yield cleaner attention maps, these maps do not accurately reflect the integration of local image information in large models. Instead, global information is dominated by information extracted from register tokens, leading to a disconnect between local and global features. Inspired by these findings, we show that the CLS token itself, which can be interpreted as a register, leads to a very similar phenomenon in models without explicit register tokens. Our work shows that care must be taken when interpreting attention maps of large ViTs. Further, by clearly attributing the faulty behaviour to register and CLS tokens, we show a path towards more interpretable vision models.

Type of Publication: Article
Full text: PDF | Online version
Ilg, W., Wochner, I., Charaja, J. P., Hofmann, V., Strenge, O., Adam, M. et al (2025). iAssistADL: Intelligent assistive device for patients with neuro- degenerative movement disorder: Concepts and first implementations. In Proc. International Consortium for Rehabilitation Robotics (ICORR), pages 1-6.
iAssistADL: Intelligent assistive device for patients with neuro- degenerative movement disorder: Concepts and first implementations
Abstract:

Upper-limb activities of daily living like eating and drinking are crucial for self-determination and autonomy and, thus, quality of life. Patients with neurodegenerative diseases such as Parkinson’s disease, multiple sclerosis or cerebellar ataxia are often severely impaired in performing these activities of daily living. While these patients are still able to plan motor actions, and their muscle strength is rarely impaired, tremor or overshooting movements disturb the intended movements. This occurs progressively in the course of disease in a way that inde- pendent eating and drinking becomes increasingly difficult. The goal of this research project is to develop a non-invasive assistive device suppressing pathological movement components while allowing intended movement. The newly designed hardware will be controlled by a combination of computational methods to detect user intention, detect pathological movement components within intended movements, and predict the required correction forces for several upper-limb activities of daily living. In this manuscript, we will describe concepts of control hard- and software as well as first implementation and experiments with the individual components we plan to integrate in the future.

Authors: Ilg, Winfried; Wochner, Isabell Charaja, Jhon Paul Feliciano Hofmann, Veronika Strenge, Ole Adam, Melanie Lendway, Regine Kerner, Jan Vashisht, Bhavya Deep Ackermann, Marko Bunjes, Friedemann Schneider, Urs Giese, Martin A.; Bulling, Andreas Schmitt, Syn Maufroy, Christophe Haeufle, Daniel Florian Benedict
Type of Publication: In Proceedings
Book title: Proc. International Consortium for Rehabilitation Robotics (ICORR)
Pages: 1-6
Full text: PDF
Seemann, J., Beyme, T., John, N., Harmuth, F., Giese, M. A., Schöls, L. et al. (2025). Capturing longitudinal change in cerebellar ataxia: Context-sensitive analysis of real-life walking increases patient relevance and effect size. Movement Disorders.
Capturing longitudinal change in cerebellar ataxia: Context-sensitive analysis of real-life walking increases patient relevance and effect size
Abstract:

OBJECTIVES: With disease-modifying drugs for degenerative ataxias on the horizon, ecologically valid measures of motor performance that can detect patient-relevant changes in short, trial-like time frames are highly warranted. In this 2-year longitudinal study, we aimed to unravel and evaluate measures of ataxic gait which are sensitive to longitudinal changes in patients{\textquoteright} real life by using wearable sensors. METHODS: We assessed longitudinal gait changes of 26 participants with degenerative cerebellar disease (SARA:9.4{\textpm}4.1) at baseline, 1-year and 2-year follow-up assessment using 3 body-worn inertial sensors in two conditions: (1) laboratory-based walking (LBW); (2) real-life walking (RLW) during everyday living. In the RLW condition, a context-sensitive analysis was performed by selecting comparable walking bouts according to macroscopic gait characteristics, namely bout length and number of turns within a two-minute time interval. Movement analysis focussed on measures of spatio-temporal variability, in particular stride length variability, lateral step deviation, and a compound measure of spatial variability (SPCmp). RESULTS: Gait variability measures showed high test-retest reliability in both walking conditions (ICC \> 0.82). Cross-sectional analyses revealed high correlations of gait measures with ataxia severity (SARA, effect size ρ >= 0.75); and in particular with patients{\textquoteright} subjective balance confidence (ABC score, ρ>=0.71), here achieving higher effect sizes for real-life than lab-based gait measures (e.g. SPCmp: RLW ρ=0.81 vs LBW ρ=0.71). While the clinician-reported outcome SARA showed longitudinal changes only after two years, the gait measure SPCmp revealed changes already after one year with high effect size (rprb=0.80). In the subgroup with spinocerebellar ataxia type 1, 2 or 3 (SCA1/2/3), the effect size was even higher (rprb=0.86). Based on these effect sizes, sample size estimation for the gait measure SPCmp showed a required cohort size of n=42 participants (n=38 for SCA1/2/3 subgroup) for detecting a 50\% reduction of natural progression after one year by a hypothetical intervention, compared to n=254 for the SARA. CONCLUSIONS: Gait variability measures revealed high reliability and sensitivity to longitudinal change in both laboratory-based constrained walking as well as in real-life walking. Due to their ecological validity and larger effect sizes, characteristics of real-life gait recordings are promising motor performance measures as outcomes for future treatment trials.Competing Interest StatementDr Ilg received consultancy honoraria by Ionis Pharmaceuticals, unrelated to the present work. Mr Seemann reports no disclosures. Mrs Beyme reports no disclosures. Mrs John reports no disclosures. Mr Harmuth reports no disclosures. Prof Giese reports no disclosures. Prof Schoels served as advisor for Alexion, Novartis and Vico. He participates as a principal investigator in clinical studies sponsored by Vigil Neuroscience (VGL101-01.001; VGL101-01.002), Vico Therapeutics (VO659-CT01), PTC Therapeutics (PTC743-NEU-003-FA) and Stealth BioTherapeutics (SPIMD-301), all unrelated to the present work. Prof Timmann reports no disclosures. Prof Synofzik has received consultancy honoraria from Ionis, UCB, Prevail, Orphazyme, Biogen, Servier, Reata, GenOrph, AviadoBio, Biohaven, Zevra, Lilly, and Solaxa, all unrelated to the present manuscript. Funding StatementThis work was supported by the International Max Planck Research School for Intelligent Systems (IMPRS-IS) (to J.S.) and the Else Kroener-Fresenius-Stiftung Medical Scientist programme ClinbrAIn (to W.I. and M.G.). as well as the Else Kroener-Fresenius Stiftung Clinician Scientist program PRECISE.net (to M.S.). In addition, this work was supported by the European Union, project European Rare Disease Research Alliance (ERDERA, $\#$ 101156595) (to M.S.).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethics committee/IRB of University Tuebingen, Germany gave ethical approval for this workI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Yes I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesData will be made available upon reasonable request. The authors confirm that the data supporting the findings of this study are available within the article and its Supplementary material. Raw data regarding human participants (e.g. clinical data) are not shared freely to protect the privacy of the human participants involved in this study; no consent for open sharing has been obtained.

Authors: Seemann, Jens; Beyme, Theresa John, Natalie Harmuth, Florian Giese, Martin A.; Schöls, Ludger Timmann, Dagmar Synofzik, Matthis Ilg, Winfried
Type of Publication: Article
Full text: Online version
Bohn, K., Seemann, J., Synofzik, M. & Ilg, W (2025). Turns increase the impact of impaired eye movements on locomotion in cerebellar ataxia. International Society of Posture and Gait Research (ISPGR) Maastricht .
Turns increase the impact of impaired eye movements on locomotion in cerebellar ataxia
Abstract:

BACKGROUND AND AIM: Turning movements are a highly relevant component of everyday walking behavior, since 35-45\% of steps are taken during turning. Turning movements are thought to be more challenging in terms of dynamic balance than straight walking, as they require more anticipatory postural adjustments and trunk-limb coordination strategies. In addition, certain types of degenerative cerebellar ataxias are associated with disturbances in eye movements such as nystagmus and disturbed VOR reflexes, which occur particularly during head rotation and peripheral gaze and may therefore affect turning more than straight walking. In this study, we compared the turning movements of SCA27B ataxia patients with downbeat nystagmus (DBN) to those of patients with spinocerebellar ataxia (SCA, types 1, 2, 3, 6) without nystagmus and investigated the influence of the drug 4-aminopyridine (4AP) on the reduction of DBN during turning movements. METHODS: We performed a cross-sectional analysis of motion data collected by three body-worn inertial sensors from subjects with SCA1, 2, 3, 6 (n = 359, SARA = 6.81) as well as SCA27B (n = 49, SARA = 7.0) in two conditions: a) lab-based supervised walking of a 60m corridor at preferred speed, b) lab-based turn task, i.e., subjects were instructed to walk along a T-junction of a corridor, including several 90° turns. Turning analysis included standard measures (i.e., mean and peak angular velocity (MAV, PAV), turn duration (TD), number of steps during turning (NoS)) and a measure quantifying dynamic balance during turning (lateral velocity change, LVC), which has been shown to be sensitive to ataxic-specific changes in turning and has strong correlations with self-reported balance confidence as measured by the ABC score. RESULTS: Turn analysis of the LVC revealed significantly greater impairments during lab-based 90° turning (p = 0.001, Cliff’s δ = 0.45) in SCA27B patients with DBN (n = 18) than in SCA1/2/3/6 patients without oculomotor impairment (n = 359). Small or no effects were found for the standard turn parameters (e.g., PAV (p = 0.49, δ = 0.10), TD (p = 0.30, δ = -0.15). Single-subject analysis of a 4AP-treated SCA27B patient with prominent DBN at right and left gaze directions showed both a reduction in DBN and LVC in the ON treatment phase compared to pre-treatment. The slow phase velocity was reduced by 16.1\% in right and by 51.2\% in left gaze. Accordingly, the LVC decreased by -0.46 m/s (-85.3\%) during right and by -0.51 m/s (-98.38\%) during left turns. Here, no improvements were found for the standard turn parameters. CONCLUSIONS: Ataxia-related oculomotor impairments may increase abnormalities in dynamic balance control during turning, which are not reflected in common compensatory strategies such as slowing down and taking smaller steps. The 4AP-induced reduction in DBN in SCA27B patients improves turning performance, with potentially beneficial implications for everyday walking behavior.

Type of Publication: In Collection
Giese, M. A. (2025). Encoding of movement style: from kinematics to neurons Comment on 'Kinematic coding: Measuring information in naturalistic behavior'. Physics of Life Reviews, 51.
Encoding of movement style: from kinematics to neurons Comment on 'Kinematic coding: Measuring information in naturalistic behavior'
Abstract:

Recent years have seen an explosion of interest in naturalistic behaviour and in machine learning tools for automatically tracking it. However, questions about what to measure, how to measure it, and how to relate naturalistic behaviour to neural activity and cognitive processes remain unresolved. In this Perspective, we propose a general experimental and computational framework - kinematic coding - for measuring how information about cognitive states is encoded in structured patterns of behaviour and how this information is read out by others during social interactions. This framework enables the design of new experiments and the generation of testable hypotheses that link behaviour, cognition, and neural activity at the single-trial level. Researchers can employ this framework to identify single-subject, single-trial encoding and readout computations and address meaningful questions about how information encoded in bodily motion is transmitted and communicated.

Authors: Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Seemann, J., Bohn, K., Synofzik, M. & Ilg, W (2025). From Increased Heart rate to Stride variability: How Short Physical Exertion Can Influence Free Walking in Cerebellar Ataxia. International Society of Posture and Gait Research (ISPGR) Maastricht .
From Increased Heart rate to Stride variability: How Short Physical Exertion Can Influence Free Walking in Cerebellar Ataxia
Abstract:

Background and Aim: As in many neurological movement disorders, patients with cerebellar ataxia report an increase in gait impairment during physical activity, fatigue, and stress. This important patient-reported observation is not reflected in clinical gait analysis at present, and these particularly critical periods are not specifically examined in current motion analyses in patients' everyday lives either. The aim of this study is to investigate how short periods of physical activity (stair climbing) with corresponding increases in heart rate affect ataxia-sensitive gait measures during free walking using a multimodal approach combining wearable motion and heart rate monitoring. Methods: We evaluated gait changes in 32 individuals with degenerative cerebellar disease (SARA: 7.3±5.1; age: 45.4±14.7) and 10 age-matched healthy controls. Gait was quantified using three body-worn inertial and barometric sensors, along with an ECG chest strap, during 10 minutes of free walking. This included a fixed sequence of straight walking, climbing a flight of stairs and walking uphill one floor, and returning. Movement analysis focused on ataxia-sensitive lateral step deviation (LSD) as well as gait speed (GS) in relation to heart rate (HR). Episodes involving stairs and inclines were identified through changes in the barometric signal and excluded from the analysis. Results: Comparisons between ataxic subjects and healthy controls revealed higher effect sizes during exerted state (e.g. LSD, FWe: r = 0.52, FWf: r = 0.57) compared to rested state (e.g. LSD, FWr: r = 0.33). Lateral step deviation indicated a moderate correlation with heart rate (HR) during the fatigued phase (FWf: R=0.38). Notably, in the moderately impaired subcohort (n=17, SARA>7, determined via median split), correlation was higher (R_mod=0.51). During the exerted walking phase (FWe), gait speed (GS) showed a negative correlation with HR (GS: R=-0.36; R_mod=-0.58), whereas no correlation was observed during FWr or FWf. In contrast, healthy controls displayed no significant correlations in ataxia-sensitive measures or gait speed across conditions. Conclusions: In this study, we found a significant relationship between heart rate and quality of ataxic gait. When walking after physical exertion, subjects exhibited slower gait speeds and increased ataxia-specific spatiotemporal variability (LSD) compared to when they were rested. These findings suggest that physical exertion and fatigue may exacerbate gait symptoms, particularly in the later stages of the disease. Since fatigue is a common and critical aspect of daily life, it is essential for future therapy evaluation studies to examine patients' gait under fatigued conditions as well, in order to obtain a real-world estimate of treatment efficacy.

Authors: Seemann, Jens; Bohn, Kristina; Synofzik, Matthis Ilg, Winfried
Research Areas: Uncategorized
Type of Publication: In Collection
Seemann, J., Angehrn, S., Finkbeiner, A.-T., Casey, H., Harker, G., Synofzik, M. et al (2025). Capturing ataxic gait with or without shoes? - A question of sensitivity versus relevance to everyday life. International Society of Posture and Gait Research (ISPGR) Maastricht .
Capturing ataxic gait with or without shoes? - A question of sensitivity versus relevance to everyday life
Abstract:

Background and Aim: The comparability of gait analysis studies may depend on several factors, such as the length of the pathway and whether the assessment was performed with or without shoes. With disease-modifying drugs for degenerative ataxias on the horizon, these environmental changes need to be controlled in multicentre clinical trials before extracting digital performance markers. The aim of this study is to investigate the extent to which ataxia-related gait measures, which have been shown in previous studies to be sensitive to the severity of ataxia, differ between walking with and without shoes. We hypothesize that ataxic subjects will adapt their foot placement to walking without shoes, resulting in larger differences in gait compared to age-matched control subjects. Methods: We assessed gait changes in 30 subjects with degenerative cerebellar disease (SARA: 7.2 ± 5.2, age: 49.4 ± 12.9) from three sites (Tübingen n=15, Chicago n=10, Portland n=5) and 13 age-matched healthy controls from Tübingen. Gait was quantified using 3 body-worn, inertial sensors under 2 conditions: self-paced walking 2 minutes over 10 metres (1) barefoot and (2) with shoes. Movement analysis focused on measures of spatio-temporal variability sensitive to ataxia: stride duration variability (SDcv), lateral step deviation (LSD) and toe out angle standard deviation (TOAstd). In addition, the pitch angle of the foot at initial contact (FPic) and at toe-off (FPto), the toe out angle (TOA) as well as the gait speed (GS) were examined. Results: All foot angles and gait speed differed significantly in subjects with ataxia when walking with versus without shoes with high effect sizes (FPic r=-0.93, FPto r=-0.88, TOA r=0.69, GS r=-0.94). In addition, measures of spatio-temporal variability showed moderate effect sizes (TOAstd r=0.52, SDcv r=0.51, LSD r=0.48). Healthy controls indicated similar effects in foot pitch angles and gait speed (FPic r=-1.00, FPto r=-1.00, GS r=-0.93) but no significant change in ataxia-sensitive measures (SDcv, LSD, TOAstd). Furthermore, group analyses comparing gait measures between healthy controls and a mild cohort (n=13, SARA<7.5) revealed higher effect sizes without shoes (TOAstd: r_mild = 0.48) compared to shoes (TOAstd: r_mild = 0.34). Conclusions: In this study, we observed a significant dependence of ataxic gait quality on foot wear. When walking without shoes, the subjects showed slower speed, less foot dorsiflexion and a greater external rotation of the feet, as well as an increase in ataxia-specific spatial-temporal variability (SDcv, LSD, TOAstd) than with shoes. Therefore, walking barefoot can increase the sensitivity of the gait examination, especially in the very early stages of the disease. However, gait measurements with shoes may be more relevant for functional ability in everyday life. Since wearing shoes significantly improves ataxia-specific parameters, patients should be advised to wear shoes for greater stability in everyday life.

Authors: Seemann, Jens; Angehrn, Sarah; Finkbeiner, Anna-Theresa Casey, Hannah Harker, Graham Synofzik, Matthis Gomez, Christopher M. Horak, Fay B. McNames, James Ilg, Winfried
Research Areas: Uncategorized
Type of Publication: In Collection
Laßmann, C. (2025). Prediction of altered gait patterns by neuro-musculoskeletal simulations in the early stage of spastic paraplegia. Phd Thesis.
Prediction of altered gait patterns by neuro-musculoskeletal simulations in the early stage of spastic paraplegia
Research Areas: Uncategorized
Type of Publication: Phd Thesis
Stettler, M. (2025). Investigation and Modelling of Dynamical Facial Expression Perception. Phd Thesis.
Investigation and Modelling of Dynamical Facial Expression Perception
Research Areas: Uncategorized
Type of Publication: Phd Thesis
Willemse, I., Mellone, S., Tacconi, C., Ilg, W., Schüle, R., Synofzik, M. et al. (2025). Smartphone Application for Spastic Ataxias: Cross-Sectional Validation of a Newly Developed Smartphone App for Remote Monitoring in Spastic Ataxias. The Cerebellum, 24.
Smartphone Application for Spastic Ataxias: Cross-Sectional Validation of a Newly Developed Smartphone App for Remote Monitoring in Spastic Ataxias
Abstract:

Effective trial-planning in Spastic ataxias (SPAX) is impeded by the absence of validated outcome measures for detecting longitudinal changes. Digital outcome measures show promise, demonstrating sensitivity to disease severity changes in ataxia and strong correlations with clinical scales. The objective of this study was to develop a smartphone application for SPAX (SPAX-app) to obtain valid digital outcome measures for use in clinical trials. The app contains four tasks assessing gait, standing balance (stance), and finger and hand movements. We carried out a validation study in 22 SPAX patients and 10 controls. Subjects performed the tasks three times during one visit. In parallel, we performed Ambulatory Parkinson's Disease Monitoring (APDM) sensor recordings, Q-motor upper limb assessment, and the Scale for the Assessment and Rating of Ataxia (SARA). Significant correlations were found between the SPAX-app and APDM or Q-motor for step time (r = 0.91), all measures of stance (r = 0.51-0.87) and duration of hand alternation (r = 0.64). No significant correlations were found for variability measures (e.g. standard deviation of step time). All tasks of the SPAX-app, except for stance, can discriminate SPAX from controls and show moderate to high test-retest reliability (ICC 0.67-0.97). Significant correlations were found between SARA and step time (r = 0.70), inter-onset interval in finger tapping (r = 0.57), and duration of hand alternation (r = 0.65). The stance task did not show significant correlations with SARA. With the SPAX-app, we present a set of digital outcome measures for potential use in clinical trials. Longitudinal studies are needed to evaluate whether these measures can track disease progression.

Authors: Willemse, Ilse Mellone, Sabato Tacconi, Carlo Ilg, Winfried; Schüle, Rebecca Synofzik, Matthis Nonnekes, Jorik Warrenburg, Bart
Type of Publication: Article
Full text: PDF

Year: 2024

Lappe, A., Bognár, A., Nejad, G. G., Raman, R., Mukovskiy, A., Martini, L. M. et al (2024). Predictive Features in Deep Neural Network Models of Macaque Body Patch Selectivity. Journal of Vision September 2024 . Vision Science Society.
Predictive Features in Deep Neural Network Models of Macaque Body Patch Selectivity
Abstract:

Previous work has shown that neurons from body patches in macaque superior temporal sulcus (STS) respond selectively to images of bodies. However, the visual features leading to this body selectivity remain unclear. METHODS: We conducted experiments using 720 stimuli presenting a monkey avatar in various poses and viewpoints. Spiking activity was recorded from mid-STS (MSB) and anterior-STS (ASB) body patches, previously identified using fMRI. To identify visual features driving the neural responses, we used a model with a deep network as frontend and a linear readout model that was fitted to predict the neuron activities. Computing the gradients of the outputs backwards along the neural network, we identified the image regions that were most influential for the model neuron output. Since previous work suggests that neurons from this area also respond to some extent to images of objects, we used a similar approach to visualize object parts eliciting responses from the model neurons. Based on an object dataset, we identified the shapes that activate each model unit maximally. Computing and combining the pixel-wise gradients of model activations from object and body processing, we were able to identify common visual features driving neural activity in the model. RESULTS: Linear models fit the data well, with mean noise-corrected correlations with neural data of 0.8 in ASB and 0.94 in MSB. Gradient analysis on the body stimuli did not reveal clear preferences of certain body parts and were difficult to interpret visually. However, the joint gradients between objects and bodies traced visually similar features in both images. CONCLUSION: Deep neural networks model STS data well, even though for all tested models, explained variance was substantially lower in the more anterior region. Further work will test if the features that the deep network relies on are also used by body patch neurons.

Authors: Lappe, Alexander; Bognár, Anna Nejad, Ghazaleh Ghamkhari Raman, Rajani Mukovskiy, Albert; Martini, Lucas M.; Vogels, Rufin Giese, Martin A.
Type of Publication: In Collection
Martini, L. M., Bognár, A., Vogels, R. & Giese, M. A (2024). Macaques show an uncanny valley in body perception. Journal of Vision September 2024 . Vision Science Society.
Macaques show an uncanny valley in body perception
Abstract:

Previous work has shown that neurons from body patches in macaque superior temporal sulcus (STS) respond selectively to images of bodies. However, the visual features leading to this body selectivity remain unclear. METHODS: We conducted experiments using 720 stimuli presenting a monkey avatar in various poses and viewpoints. Spiking activity was recorded from mid-STS (MSB) and anterior-STS (ASB) body patches, previously identified using fMRI. To identify visual features driving the neural responses, we used a model with a deep network as frontend and a linear readout model that was fitted to predict the neuron activities. Computing the gradients of the outputs backwards along the neural network, we identified the image regions that were most influential for the model neuron output. Since previous work suggests that neurons from this area also respond to some extent to images of objects, we used a similar approach to visualize object parts eliciting responses from the model neurons. Based on an object dataset, we identified the shapes that activate each model unit maximally. Computing and combining the pixel-wise gradients of model activations from object and body processing, we were able to identify common visual features driving neural activity in the model. RESULTS: Linear models fit the data well, with mean noise-corrected correlations with neural data of 0.8 in ASB and 0.94 in MSB. Gradient analysis on the body stimuli did not reveal clear preferences of certain body parts and were difficult to interpret visually. However, the joint gradients between objects and bodies traced visually similar features in both images. CONCLUSION: Deep neural networks model STS data well, even though for all tested models, explained variance was substantially lower in the more anterior region. Further work will test if the features that the deep network relies on are also used by body patch neurons.

Type of Publication: In Collection
Beichert, L., Seemann, J., Kessler, C., Traschütz, A., Müller, D., Dillmann-Jehn, K. et al. (2024). Towards patient-relevant, trial-ready digital motor outcomes for SPG7: a cross-sectional prospective multi-center study (PROSPAX). MedRxiv preprint.
Towards patient-relevant, trial-ready digital motor outcomes for SPG7: a cross-sectional prospective multi-center study (PROSPAX)
Abstract:

Background and Objectives With targeted treatment trials on the horizon, identification of sensitive and valid outcome measures becomes a priority for the >100 spastic ataxias. Digital-motor measures, assessed by wearable sensors, are prime outcome candidates for SPG7 and other spastic ataxias. We here aimed to identify candidate digital-motor outcomes for SPG7 – as one of the most common spastic ataxias – that: (i) reflect patient-relevant health aspects, even in mild, trial-relevant disease stages; (ii) are suitable for a multi-center setting; and (iii) assess mobility also during uninstructed walking simulating real-life.

Authors: Beichert, Lukas Seemann, Jens; Kessler, Christoph Traschütz, Andreas Müller, Doreen Dillmann-Jehn, Katrin Ricca, Ivana Satolli, Sara Başak, Ayşe Nazli Coarelli, Giulia Timmann, Dagmar Gagnon, Cynthia van de Warrenburg, Bart P. Ilg, Winfried; Synofzik, Matthis Schüle, Rebecca
Type of Publication: Article
Full text: PDF | Online version
Bohn, K., Seemann, J., Giese, M. A., Synofzik, M. & Ilg, W (2024). Understanding the relationship of static and dynamic balance measures in ataxic stance and gait. International Congress for Ataxia Research (ICAR) London .
Understanding the relationship of static and dynamic balance measures in ataxic stance and gait
Abstract:

Impairments in gait– with a key component of dynamic balance– and stance– with a key component of static balance- represent the key hallmarks of ataxia; not only in clinical assessments and clinician-reported outcomes; but also in patients’ voice burden of disease severity and patient-reported outcomes. While it is obvious that both features are not independent from each other, their interplay in ataxia – in terms of underlying control mechanisms- remains unknown. Here we aimed to assess the interaction be-tween dynamic balance (gait) and static balance (stance) in response to longitudinal changes in cerebellar ataxia using wearable sensors. We assessed cross-sectional and longitudinal balance of subjects with degenerative cerebellar disease (SARA:7.5±5.14) at baseline and 1-year follow-up (n=60) by 3 body-worn inertial sensors in two conditions: (1) stance with feet together (30 seconds), (2) straight walking (2 minutes). Based on the hip sensor, sway path length was calculated as a measure of static balance during stance using both directions of sway (PLtotal), as well as exclusively anterior-posterior (PLap) and medial-lateral (PLml) direction. Gait analysis focussed on ataxic-sensitive measures of spatio-temporal variability: stride length variability (SLCV) in gait direction and lateral step deviation (LSD) as well as upper body range of motion during gait in respective directions (ROMap, ROMml). Cross-sectional analyses revealed significant correlations between PLtotal and LSD as well as ROMml (r {\textgreater}0.6), and between PLtotal and SLCV and ROMap (r{\textgreater}0.4). Matching directions of sway showed a mildly increased effect (e.g. LSD{\textbackslash}PLap:r\_total=0.61,r\_ap= 0.63). Corresponding stance and gait measures showed similar correlations to patient-reported balance confidence (ABC-score;PLtotal:0.65,LSD:0.69). Longitudinal changes in static balance were correlated with changes in dynamic bal-ance specifically in the corresponding direction (e.g. deltaLSD{\textbackslash}deltaPLml:r=0.40). We were able to identify specific influences of the static balance mechanism on gait, demonstrating the patient's relevance of static stance testing and related balance exer-cises in rehabilitation.

Type of Publication: In Collection
Seemann, J., Giese, M. A., Synofzik, M. & Ilg, W (2024). Context matters: Gait analysis in real-life—but not in-lab or SARA—reveals disease progression in spinocerebellar ataxias already after 1 year. 2024 International Congress for Ataxia Research (ICAR) London .
Context matters: Gait analysis in real-life—but not in-lab or SARA—reveals disease progression in spinocerebellar ataxias already after 1 year
Abstract:

Objectives: In this observational study, we aim to unravel performance markers of ataxic gait for upcoming therapy trials using wearable sensors. We hypothesize that in short, trial-like time-frames gait measures captured in complex real-life settings of patients are more sensitive to natural disease progression compared to lab-based gait assessments and clinical rating scales. Methods: We assessed longitudinal gait changes of 24 subjects with spinocerebellar ataxia (SCA types: 1, 2, 3, 6) at baseline (SARA:9.4±4.1), 1-year and 2-years follow-up assessment by three body-worn inertial sensors in two conditions: (1) laboratory-based walking; (2) real-life walking in everyday environment. In the real-life walking condition, a context-sensitive analysis was performed by selecting comparable walking bouts according to bout length and number of performed turns. Movement analysis focussed on measures of spatio-temporal variability, in particular lateral step deviation (LSD) and a compound measure of spatial variability (SPcmp). Results: Cross-sectional analyses revealed high correlation to ataxia severity (SARA) and patients subjective balance confidence (ABC-Scale) in both conditions (r>0.7). While clinical ataxia score and gait measure in lab-based gait assessments identified changes after two years only (SARA: rprb=0.71; LSD: rprb=0.67), real life assessment of lateral step deviation and a compound measure of spatial step variability identified changes already after one year, with high effect sizes (LSD: rprb=0.66; SPcmp: rprb=0.68) and additionally increased effect sizes after two years (LSD: rprb=0.77; SPcmp: rprb=0.82). Discussion: Utilizing a context-sensitive matching procedure with high robustness to disease-independent changes of environment, real-life gait measures capture longitudinal change within one year with high effect size. In contrast, clinical scores like the SARA or lab-based gait measures show longitudinal change only after two years. Conclusions: Features of real-life gait constitute promising performance markers for upcoming therapy trials, yielding ecologically validity, earlier sensitivity and increased effect sizes in comparison with clinical scores and lab-based gait assessment.

Authors: Seemann, Jens; Giese, Martin A.; Synofzik, Matthis Ilg, Winfried
Research Areas: Uncategorized
Type of Publication: In Collection
Smekal, V., Solanas, T. S., Lappe, A., Giese, M. A. & de Gelder, B (2024). Data-driven Features of Human Body Movements and their Neural Correlate . ESCAN2024.
Data-driven Features of Human Body Movements and their Neural Correlate
Authors: Smekal, Vojtěch Solanas, Tamás Szűcs Marta Poyo Lappe, Alexander; Giese, Martin A.; de Gelder, Beatrice
Type of Publication: In Collection
Lappe, A., Bognár, A., Nejad, G. G., Mukovskiy, A., Martini, L. M., Giese, M. A. et al. (2024). Parallel Backpropagation for Shared-Feature Visualization. Advances in Neural Information Processing Systems(37), 22993-23012.
Parallel Backpropagation for Shared-Feature Visualization
Authors: Lappe, Alexander; Bognár, Anna Nejad, Ghazaleh Ghamkhari Mukovskiy, Albert; Martini, Lucas M.; Giese, Martin A.; Vogels, Rufin
Type of Publication: Article
Full text: PDF | Online version
Martini, L. M., Bognár, A., Vogels, R. & Giese, M. A. (2024). MacAction: Realistic 3D macaque body animation based on multi-camera markerless motion capture. bioRxiv.
MacAction: Realistic 3D macaque body animation based on multi-camera markerless motion capture
Abstract:

Social interaction is crucial for survival in primates. For the study of social vision in monkeys, highly controllable macaque face avatars have recently been developed, while body avatars with realistic motion do not yet exist. Addressing this gap, we developed a pipeline for three-dimensional motion tracking based on synchronized multi-view video recordings, achieving sufficient accuracy for life-like full-body animation. By exploiting data-driven pose estimation models, we track the complete time course of individual actions using a minimal set of hand-labeled keyframes. Our approach tracks single actions more accurately than existing pose estimation pipelines for behavioral tracking of non-human primates, requiring less data and fewer cameras. This efficiency is also confirmed for a state-of-the-art human benchmark dataset. A behavioral experiment with real macaque monkeys demonstrates that animals perceive the generated animations as similar to genuine videos, and establishes an uncanny valley effect for bodies in monkeys.Competing Interest StatementThe authors have declared no competing interest.

Type of Publication: Article
Full text: Online version
Abassi, E., Bognár, A., de Gelder, B., Giese, M. A., Isik, L., Lappe, A. et al. (2024). Neural Encoding of Bodies for Primate Social Perception. Journal of Neuroscience, 44(40).
Neural Encoding of Bodies for Primate Social Perception
Abstract:

Primates, as social beings, have evolved complex brain mechanisms to navigate intricate social environments. This review explores the neural bases of body perception in both human and nonhuman primates, emphasizing the processing of social signals conveyed by body postures, movements, and interactions. Early studies identified selective neural responses to body stimuli in macaques, particularly within and ventral to the superior temporal sulcus (STS). These regions, known as body patches, represent visual features that are present in bodies but do not appear to be semantic body detectors. They provide information about posture and viewpoint of the body. Recent research using dynamic stimuli has expanded the understanding of the body-selective network, highlighting its complexity and the interplay between static and dynamic processing. In humans, body-selective areas such as the extrastriate body area (EBA) and fusiform body area (FBA) have been implicated in the perception of bodies and their interactions. Moreover, studies on social interactions reveal that regions in the human STS are also tuned to the perception of dyadic interactions, suggesting a specialized social lateral pathway. Computational work developed models of body recognition and social interaction, providing insights into the underlying neural mechanisms. Despite advances, significant gaps remain in understanding the neural mechanisms of body perception and social interaction. Overall, this review underscores the importance of integrating findings across species to comprehensively understand the neural foundations of body perception and the interaction between computational modeling and neural recording.

Authors: Abassi, Etienne Bognár, Anna de Gelder, Bea Giese, Martin A.; Isik, Leyla Lappe, Alexander; Mukovskiy, Albert; Solanas, Marta Poyo Taubert, Jessica Vogels, Rufin
Type of Publication: Article
Full text: Online version
Renner, T. J., Gawrilow, C., Conzelmann, A., Giese, M. A., Kasneci, E., Swoboda, W. et al. (2024). Lessons learned from a multimodal sensor-based eHealth approach for treating pediatric obsessive-compulsive disorder. Frontiers in Digital Health, 6.
Lessons learned from a multimodal sensor-based eHealth approach for treating pediatric obsessive-compulsive disorder
Authors: Renner, Tobias J. Gawrilow, Caterina Conzelmann, Annette Giese, Martin A.; Kasneci, Enkelejda Swoboda, Walter Löchner, Johanna Bethge, Wolfgang A. Lautenbacher, Heinrich Thierfelder, Annika; Ilg, Winfried; Primbs, Jonas Seizer, Lennart Alt, Annika Kristin Kühnhausen, Jan Hollmann, Karsten Klein, Carolin S.
Type of Publication: Article
Full text: PDF | Online version
Pellerin, D., Seemann, J., Traschütz, A., Brais, B., Ilg, W. & Synofzik, M. (2024). Reduced Age-Dependent Penetrance of a Large FGF14 GAA Repeat Expansion in a 74-Year-Old Woman from a German Family with SCA27BD. Movement Disorders, n/a(n/a).
Reduced Age-Dependent Penetrance of a Large FGF14 GAA Repeat Expansion in a 74-Year-Old Woman from a German Family with SCA27BD
Authors: Pellerin, David Seemann, Jens; Traschütz, Andreas Brais, Bernard Ilg, Winfried; Synofzik, Matthis
Type of Publication: Article
Full text: PDF | Online version
Beichert, L., Ilg, W., Kessler, C., Traschütz, A., Reich, S., Santorelli, F. M. et al. (2024). Digital gait outcomes for ARSACS: discriminative, convergent and ecological validity in a multi-center study (PROSPAX) accepted for Movement Disorders. IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.
Digital gait outcomes for ARSACS: discriminative, convergent and ecological validity in a multi-center study (PROSPAX) accepted for Movement Disorders
Authors: Beichert, Lukas Ilg, Winfried; Kessler, Christoph Traschütz, Andreas Reich, Selina Santorelli, Filippo M. Başak, Ayşe Nazli Gagnon, Cynthia Schüle, Rebecca Synofzik, Matthis
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Hermle, D., Schubert, R., Barallon, P., Ilg, W., Schüle, R., Reilmann, R. et al. (2024). Multifeature quantitative motor assessment of upper limb ataxia including drawing and reaching. Annals of Clinical and Translational Neurology, n/a(n/a).
Multifeature quantitative motor assessment of upper limb ataxia including drawing and reaching
Abstract:

Abstract Objective Voluntary upper limb movements are an ecologically important yet insufficiently explored digital-motor outcome domain for trials in degenerative ataxia. We extended and validated the trial-ready quantitative motor assessment battery “Q-Motor” for upper limb movements with clinician-reported, patient-focused, and performance outcomes of ataxia. Methods Exploratory single-center cross-sectional assessment in 94 subjects (46 cross-genotype ataxia patients; 48 matched controls), comprising five tasks measured by force transducer and/or position field: Finger Tapping, diadochokinesia, grip-lift, and—as novel implementations—Spiral Drawing, and Target Reaching. Digital-motor measures were selected if they discriminated from controls (AUC >0.7) and correlated—with at least one strong correlation (rho ≥0.6)—to the Scale for the Assessment and Rating of Ataxia (SARA), activities of daily living (FARS-ADL), and the Nine-Hole Peg Test (9HPT). Results Six movement features with 69 measures met selection criteria, including speed and variability in all tasks, stability in grip-lift, and efficiency in Target Reaching. The novel drawing/reaching tasks best captured impairment in dexterity (|rho9HPT| ≤0.81) and FARS-ADL upper limb items (|rhoADLul| ≤0.64), particularly by kinematic analysis of smoothness (SPARC). Target hit rate, a composite of speed and endpoint precision, almost perfectly discriminated ataxia and controls (AUC: 0.97). Selected measures in all tasks discriminated between mild, moderate, and severe impairment (SARA upper limb composite: 0–2/>2–4/>4–6) and correlated with severity in the trial-relevant mild ataxia stage (SARA ≤10, n = 20). Interpretation Q-Motor assessment captures multiple features of impaired upper limb movements in degenerative ataxia. Validation with key clinical outcome domains provides the basis for evaluation in longitudinal studies and clinical trial settings.

Authors: Hermle, Dominik Schubert, Robin Barallon, Pascal Ilg, Winfried; Schüle, Rebecca Reilmann, Ralf Synofzik, Matthis Traschütz, Andreas
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Seemann, J., Daghsen, L., Cazier, M., Lamy, J.-C., Welter, M.-L., Giese, M. A. et al. (2024). Digital gait measures capture 1-year progression in early-stage spinocerebellar ataxia type 2. Movement disorders : official journal of the Movement Disorder Society.
Digital gait measures capture 1-year progression in early-stage spinocerebellar ataxia type 2
Abstract:

BACKGROUND With disease-modifying drugs in reach for cerebellar ataxias, fine-grained digital health measures are highly warranted to complement clinical and patient-reported outcome measures in upcoming treatment trials and treatment monitoring. These measures need to demonstrate sensitivity to capture change, in particular in the early stages of the disease.OBJECTIVE To unravel gait measures sensitive to longitudinal change in the - particularly trial-relevant- early stage of spinocerebellar ataxia type 2 (SCA2).METHODS Multi-center longitudinal study with combined cross-sectional and 1-year interval longitudinal analysis in early-stage SCA2 participants (n=23, including 9 pre-ataxic expansion carriers; median ATXN2 CAG repeat expansion 38{\textpm}2; median SARA [Scale for the Assessment and Rating of Ataxia] score 4.83{\textpm}4.31). Gait was assessed using three wearable motion sensors during a 2-minute walk, with analyses focusing on gait measures of spatiotemporal variability shown sensitive to ataxia severity, e.g. lateral step deviation.RESULTS We found significant changes for gait measures between baseline and 1-year follow-up with large effect sizes (lateral step deviation p=0.0001, effect size rprb=0.78), whereas the SARA score showed no change (p=0.67). Sample size estimation indicates a required cohort size of n=43 to detect a 50\% reduction in natural progression. Test-retest reliability and Minimal Detectable Change analysis confirm the accuracy of detecting 50\% of the identified 1-year change.CONCLUSIONS Gait measures assessed by wearable sensors can capture natural progression in early-stage SCA2 within just one year {\textendash} in contrast to a clinical ataxia outcome. Lateral step deviation thus represents a promising outcome measure for upcoming multi-centre interventional trials, particularly in the early stages of cerebellar ataxia.Competing Interest StatementJ. Seemann, L. Daghsen, M. Cazier, J. Lamy, ML. Welter, A. Giese, and G. Coarelli report no disclosures. Prof. Durr serves as an advisor to Critical Path Ataxia Therapeutics Consortium and her institution (Paris Brain institute) receives her consulting fees from Pfizer, Huntix, UCB, Reata, PTC Therapeutics as well as research grants from the NIH, Biogen, Servier, and the National Clinical Research Program and she holds partly a Patent B 06291873.5 on Anaplerotic Therapy of Huntington{\textquoteright}s Disease and other polyglutamine diseases (2006). Prof. Synofzik has received consultancy honoraria from Ionis, UCB, Prevail, Orphazyme, Servier, Reata, GenOrph, AviadoBio, Biohaven, Zevra, and Lilly, all unrelated to the present manuscript. Dr. Ilg received consultancy honoraria by Ionis Pharmaceuticals, unrelated to the present work. Funding StatementWe would like to thank all the participants including in this study. We would like to thank BIOGEN and IONIS which funded the NCT04288128 study and INSERM, which sponsored the NCT04288128 study (to A. D.). This work was supported by the International Max Planck Research School for Intelligent Systems (IMPRS-IS) (to J.S.) and the Else Kroener-Fresenius-Stiftung Medical Scientist programme ClinbrAIn (to W.I.), as well as the Else Kroener-Fresenius Stiftung Clinician Scientist programme PRECISE.net (to M.S.). Work on this project was supported, in part, by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) No 441409627, as part of the PROSPAX consortium under the frame of EJP RD, the European Joint Programme on Rare Diseases, under the EJP RD COFUND-EJP 825575 (to M.S. and A.D.).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethics committee/IRB of Sorbonne universite and University Tuebingen, Germany gave ethical approval for this workI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesData will be made available upon reasonable request. The authors confirm that the data supporting the findings of this study are available within the article. Raw data regarding human subjects (e.g. clinical data) are not shared freely to protect the privacy of the human subjects involved in this study; no consent for open sharing has been obtained.

Authors: Seemann, Jens; Daghsen, Lina Cazier, Mathieu Lamy, Jean-Charles Welter, Marie-Laure Giese, Martin A.; Synofzik, Matthis Durr, Alexandra Ilg, Winfried; Coarelli, Giulia
Type of Publication: Article
Full text: PDF | Online version
Lappe, A., Bognár, A., Nejad, G. G., Mukovskiy, A., Giese, M. A. & Vogels, R (2024). Encoding of bodies and objects in body-selective neurons. Society for Neuroscience .
Encoding of bodies and objects in body-selective neurons
Abstract:

The primate visual system has evolved subareas in which neurons appear to respond more strongly to images of a specific semantic category, like faces or bodies. The computational processes underlying these regions remain unclear, and there is debate on whether this effect is in fact driven by semantics or rather by visual features that occur more often among images from the specific category. Recent works tackling the question of whether the same visual features drive responses of face-selective cells to face images and non-face images have yielded mixed results. Here, we report findings on shared encoding of body and object images in body-selective neurons in macaque superior temporal sulcus. We targeted two fMRI-defined regions, anterior and posterior body patches in two awake macaques using V probes, recording multi-unit activity in and around these patches. In a first phase, we recorded responses to a set of 475 images of a macaque avatar in various poses. We then trained a deep-neural-network based model to predict responses to these images, and subsequently evaluated the model on two sets of object and body stimuli consisting of 6857 and 2068 images, respectively. These images comprised a variety of object types and animal species. After the inference process, we selected the highest and lowest predicted activator for each recording channel from both object and body images. In a second phase, we recorded responses of the same multi-units to these stimuli. For analysis, we only kept those multi-unit sites with high test/retest reliability. Also, we only considered multi-unit sites for which the selected bodies elicited a significantly higher response than the selected objects. We then tested whether the high-predicted objects/bodies indeed lead to higher responses at the corresponding electrode than the low-predicted ones. Across neurons, we found a significant preference of the high-predicted stimulus for both objects and bodies. The highly-activating objects consisted of a variety of everyday objects and did not necessarily globally resemble a body. Furthermore, the correlations between predicted and recorded responses to the objects were consistently positive for both monkeys and recording areas, meaning that the model was able to predict responses to objects after having only been trained on images of a macaque avatar. Our results show that the feature preferences of body-selective neurons are at least partially shared between bodies and objects. On a larger scope, we provide further evidence that category selectivity arises due to highly shared visual features among category instances, rather than semantics.

Authors: Lappe, Alexander; Bognár, A. Nejad, G. G. Mukovskiy, Albert; Giese, Martin A.; Vogels, Rufin
Research Areas: Uncategorized
Type of Publication: In Collection
Vogels, R., Raman, R., Nejad, G. G., Mukovskiy, A., Lappe, A., Giese, M. A. et al (2024). Keypoint-based modeling of body posture selectivity of macaque inferotemporal neurons. Society for Neuroscience .
Keypoint-based modeling of body posture selectivity of macaque inferotemporal neurons
Abstract:

Non-verbal social communication relies on the interpretation of visual cues from the body. fMRI studies in macaques have identified regions within the inferotemporal (IT) cortex that exhibit heightened activation to bodies compared to faces and objects. Among these regions, the ventral bank Superior Temporal Sulcus (STS) patches, i.e. the mid STS (MSB) and anterior STS body patch (ASB), show selectivity for static (and dynamic) bodies. However, the body features that drive the response of these neurons, in particular their representation of body posture, within these two levels of processing are unclear. To investigate this, we recorded multi- unit responses, using 16-channel V-probes, within and around MSB and ASB in two monkeys, employing a stimulus set comprising 720 stimuli featuring a monkey avatar in 45 body postures, rendered from 16 viewing angles. The static stimuli were presented during passive fixation. We employed principal component regression to model the response of the neurons based on the 10 principal components of 22 2D body keypoints extracted from the stimuli, which explained about 90% of the stimulus variance. Of the body-category selective neurons (at least twofold higher response to dynamic bodies compared to dynamic faces and objects), the 2D key-point-based model explained the selectivity for body posture and view with a median reliability-corrected coefficient of determination of 0.42 and 0.20 in the MSB and ASB regions, respectively. Inclusion of the depth dimension increased the model fit significantly for ASB but not MSB. When comparing with a convolutional neural network (CNN; ResNet50-robust; regression on 50 PCs) feature-based approach, the keypoint-based model exhibited slightly inferior performance, particularly in ASB, when focusing on higher-layer features but remained superior to the lower- layer features-based CNN model. Inverting the keypoint models allowed visualization of the body features that drove the posture selectivity of the neurons. We found that these body features ranged from local body features like the upper limbs or tail to combinations of them, but rarely the entire body. Some neurons, even in the mid STS region, tolerated changes in the view of the preferred body parts. The view tolerance was significantly greater in ASB compared to MSB. Our study shows that a body keypoint representation explains a sizable proportion of the selectivity to body posture and view of macaque visual cortical neurons, especially in the mid STS. Furthermore, the modeling suggests that 3D cues contribute to the body selectivity of anterior but not posterior IT neurons.

Authors: Vogels, Rufin Raman, R. Nejad, G. G. Mukovskiy, Albert; Lappe, Alexander; Giese, Martin A.; Martini, Lucas M.; Bognár, A.
Research Areas: Uncategorized
Type of Publication: In Collection
Marrazzo, G., Martino, F. D., Mukovskiy, A., Giese, M. A. & de Gelder, B (2024). Voxelwise encoding of biomechanics in occipitotemporal cortex using dynamic body stimuli at ultra-high field 7T. Society for Neuroscience .
Voxelwise encoding of biomechanics in occipitotemporal cortex using dynamic body stimuli at ultra-high field 7T
Abstract:

In this fMRI study we investigated the role played by biomechanical plausibility in the representation of bodies in EBA. The extrastriate body area (EBA) (Downing et al. 2001, Peelen and Downing, 2005) is currently considered to be a ventral cortex object category area, selective for body stimuli but little yet is understood about its computational functions. In a previous study we showed that the EBA is sensitive to joints position in still body stimuli (Marrazzo et al. 2023). Here, we used video images to investigate whether disrupting joints configuration affects the representation of bodies in EBA. Stimuli depicted artificial whole-body movements and were generated from the MoVI dataset. We selected 60 trials of naturalistic body movement and created 60 (possible) videos. Additionally, these stimuli underwent further processing where elbows and knees position/angle were manually modified, to create (from possible stimuli) biomechanically impossible stimuli. Therefore, the stimuli set included 120 videos (60 possible, 60 impossible). 12 participants were scanned using a 7T (T2*-weighted Multi-Band accelerated EPI 2D BOLD sequence, MB = 2, voxel size = 0.8 mm3, TR = 2300 ms, TE = 27 ms) in a fast event-related design over 12 separate runs. Each run consisted of 20 unique stimuli (10 possible, 10 impossible repeated 6 times across the 12 runs) which appeared on the screen for 2-3 s. Participants were asked to fixate and attention was controlled using catch trials (fixation shape change). The fMRI response was modeled using several features extracted from the stimuli: 3D coordinates and rotation matrices of key joints (kp/rot) and a model which represents within\between distance between joints for each video as a mean to encode biomechanical information (simdist). The fMRI predicted responses from each model were generated via banded ridge regression (Nunez-Elizalde et al. 2019, Dupré La Tour et al. 2022) using crossvalidation. Results show a pattern of responses across visual cortex with simdist and kp model best predicting responses to our stimuli. Specifically, the simdist representation shows higher prediction accuracy in in high-level temporal areas such as EBA outperforming the kp model. These findings expand on previous research showing that EBA codes for specific features of the body, which in the case of kp model, are the joints position (Marrazzo et al. 2023). Additionally, EBA shows high degree of sensitivity for joints configuration to the point that biomechanically possible/impossible bodies appear to be differentially encoded. Acknowledgments: This work was supported by ERC 2019-SyG-RELEVANCE-856495

Authors: Marrazzo, G. Martino, F. De Mukovskiy, Albert; Giese, Martin A.; de Gelder, Beatrice
Research Areas: Uncategorized
Type of Publication: In Collection
Beichert, L., Seemann, J., Kessler, C., Traschütz, A., Ricca, I., Satolli, S. et al (2024). Longitudinal progression of digital gait measures in patients with spastic paraplegia type 7 (SPG7): an international multi-center study (PROSPAX). 2024 International Congress for Ataxia Research (ICAR) London .
Longitudinal progression of digital gait measures in patients with spastic paraplegia type 7 (SPG7): an international multi-center study (PROSPAX)
Abstract:

Background and Objective: With treatment trials on the horizon, sensitive outcome measures are highly needed for the >100 spastic ataxias. Digital-motor gait measures, assessed by wearable sensors, are considered prime outcome candidates for spastic ataxias and have shown favourable cross-sectional properties in spastic paraplegia type 7 (SPG7). However, their longitudinal sensitivity to change is yet unknown. This study aimed to assess 1-year progression of digital gait measures in patients with SPG7. Methods: Longitudinal multi-center study (7 centers, 6 countries), assessments at baseline and after 1 year. Gait was analysed in 49 SPG7 patients (baseline, median [min-max]: age=52 [22-69], SARA=9.0 [3.5-17.0], SPRS=14 [3-28]) using 3 wearable motion sensors (Opal APDM) during laboratory-based walking and ‘supervised free walking’, resembling real-life walking. Assessments included rating of the Scale for the assessment and rating of ataxia (SARA) and the Spastic paraplegia rating scale (SPRS). Effect size and significance of 1-year changes were assessed using non-parametric matched-pairs rank biserial correlation (rprb) and Wilcoxon signed-rank test, respectively. Results: In laboratory-based walking, 1-year progression was observed for measures of trunk range of motion variability (CoronalRoM_CV: rprb=0.46, p=0.0051), of gait smoothness (harmonicRatioML: rprb=-0.40, p=0.015) and of spatiotemporal stride variability (e.g. DoubleSupport_MADN: rprb=0.31-0.37). In the trial-relevant subcohort of mildly affected patients (SPRS items 1-6≤9; n=34), CoronalRoM_CV (rprb=0.59, p=0.0027) exhibited larger effect size than clinician-reported outcomes like SARA (rprb=0.53, p=0.0055) or SPRS (rprb=0.30, p=0.087). In supervised free walking, progression was observed for measures of gait smoothness and temporal variability (e.g. harmonicRatioML, DoubleSupport_MADN: |rprb|=0.28-0.44). Discussion and Conclusion: In this first longitudinal multi-center study of digital gait measures in SPG7, 1-year progression was captured for several gait measures, with effect sizes partly exceeding those of key clinician-reported outcomes (SARA, SPRS). These gait measures could thus improve sensitivity to treatment effects in future clinical trials in SPG7 and possibly also other spastic ataxias.

Authors: Beichert, Lukas Seemann, Jens; Kessler, Christoph Traschütz, Andreas Ricca, Ivana Satolli, Sara Başak, Ayşe Nazli Coarelli, Giulia Timmann, Dagmar Gagnon, Cynthia van de Warrenburg, Bart P. consortium, PROSPAX Ilg, Winfried; Synofzik, Matthis Schüle, Rebecca
Research Areas: Uncategorized
Type of Publication: In Collection
Sarvestan, J., Seemann, J., Din, S. D., Synofzik, M., Ilg, W. & Alcock, L (2024). Gait event detection in cerebellar ataxia: A single vs. multiple device approach. 2024 International Congress for Ataxia Research (ICAR) London .
Gait event detection in cerebellar ataxia: A single vs. multiple device approach
Abstract:

Introduction: Monitoring gait with wearable sensors provides an opportunity for improving clinical management and evaluating therapeutic interventions in patients with degenerative cerebellar ataxia (DCA). While multi-sensor configurations are recommended for robust gait evaluation, using a single sensor offers several advantages including reduced data footprint, minimized patient burden, and extended battery life. Methods: 96 participants (control: n=42; preclinical DCA: n=19; clinical DCA: n=35) completed two 25m straight walks at their self-selected preferred pace in a laboratory setting. A wearable sensor (APDM, Opal 128Hz) was affixed to the lower back and the dorsum of both feet. Gait events (initial contact-IC, final contact-FC) were detected using a single sensor and multiple sensors (reference system). Agreement between the single and multi-sensor configurations (bias, limits of agreement, intraclass correlation coefficient) and accuracy (Positive predictive value; PPV, median absolute error; MAE) were quantified. Relationships between event detection accuracy and gait outcomes derived by the reference system were explored. Results: A total of 8473 steps were included in the analyses. Accuracy was high for identification of IC in controls (PPV=97%), preclinical DCA (PPV=96%) and clinical DCA (PPV=86%). Accuracy was lower for FC compared to IC for controls (PPV=88%), preclinical DCA (PPV=90%) and clinical DCA (PPV=82%). The MAE was low for all groups (<0.12s). Significant correlations were observed indicating that gait events were detected less accurately for individuals walking with a reduced cadence, longer stride duration, and increased gait variability (gait speed, stride length and duration). Discussion and Conclusion: Accuracy for the single sensor approach was high and exceeded the threshold of 80% indicating that this approach may be used with confidence. Noticeable differences were observed in FC identification for clinical DCA, which may impact the calculation of gait outcomes. Additional refinements to optimize the algorithm should be considered to improve gait event detection accuracy.

Authors: Sarvestan, Javad Seemann, Jens; Din, Silvia Del Synofzik, Matthis Ilg, Winfried; Alcock, Lisa
Research Areas: Uncategorized
Type of Publication: In Collection
Lappe, A., Bognár, A., Nejad, G. G., Mukovskiy, A., Giese, M. A. & Vogels, R (2024). Encoding of bodies and objects in body-selective neurons. 2024 Neuroscience Meeting Planner .
Encoding of bodies and objects in body-selective neurons
Authors: Lappe, Alexander; Bognár, Anna Nejad, Ghazal Ghamkhari Mukovskiy, Albert; Giese, Martin A.; Vogels, Rufin
Research Areas: Uncategorized
Type of Publication: In Collection
Kumar, P., Raman, R., Bognár, A., Taubert, N., Nejad, G. G., Vogels, R. et al (2024). Neural models for the visual recognition of static body poses and dynamic body movements. 2024 Neuroscience Meeting Planner .
Neural models for the visual recognition of static body poses and dynamic body movements
Authors: Kumar, Prerana; Raman, Rajani Bognár, Anna Taubert, Nick; Nejad, Ghazal Ghamkhari Vogels, Rufin Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Martini, L. M., Lappe, A. & Giese, M. A (2024). Pose and shape reconstruction of nonhuman primates from images for studying social perception . Society for Neuroscience.
Pose and shape reconstruction of nonhuman primates from images for studying social perception
Abstract:

The neural and computational mechanisms of the visual encoding of body pose and motion remain poorly understood. One important obstacle in their investigation is the generation of highly controlled stimuli with exactly specified form and motion parameters. Avatars are ideal for this purpose, but for nonhuman species the generation of appropriate motion and shape data is extremely costly, where video-based methods often are not accurate enough to generate convincing 3D animations with highly specified parameters. METHODS: Based on a photorealistic 3D model for macaque monkeys, which we have developed recently, we propose a method that adjusts this model automatically to other nonhuman primate shapes, requiring only a small number of photographs and hand-labeled keypoints for that species. The resulting 3D model allows to generate highly realistic animations with different primate species, combining the same motion with different body shapes. Our method is based on an algorithm that deforms a polygon mesh of a macaque model with 10,632 vertices with an underlying rig of 115 joints automatically, matching the silhouettes of the animals and a small number of specified key points in the example pictures. Optimization is based on a composite error function that integrates terms for matching quality of the silhouettes, keypoints, and bone length, and for minimizing local surface deformation. RRSULTS: We demonstrate the efficiency of the method for several monkey and ape species. In addition, we are presently investigating in a psychophysical experiment how the body shape of different primate species interacts with the categorization of body movements of humans and non-human primates in human perception. CONCLUSION: Using modern computer graphics methods, highly realistic and well-controlled body motion stimuli can be generated from small numbers of photographs, allowing to study how species-specific motion and body shape interact in visual body motion perception.

Research Areas: Uncategorized
Type of Publication: In Collection
Laßmann, C., Schöls, L., Giese, M. A., Haeufle, D. & Ilg, W (2024). Quantifying the Restoration of a Norm-Like Gait Pattern from Mid-Foot Strike by Botulinum-Toxin-A Treatment in a Patient with Hereditary Spastic Paraplegia, pages 406-410.
Quantifying the Restoration of a Norm-Like Gait Pattern from Mid-Foot Strike by Botulinum-Toxin-A Treatment in a Patient with Hereditary Spastic Paraplegia
Abstract:

Hereditary spastic paraplegia is characterized by progressive spasticity and muscle weakness, significantly impairing gait. In neuro-musculoskeletal models, gradually increasing hyperreflexia could simulate severity-related gait patterns. This shows a potential application of neuromusculoskeletal models in predicting outcomes of treatments managing spasticity. As a first step, this case-study investigates the efficacy of Botulinum-Toxin-A in improving gait kinematics in a 54-year-old male with HSP and impaired gait. Instrumented gait analysis was conducted before and after treatment using dynamic time warping to compare the participant’s gait to healthy controls. Post-treatment results showed increased segmental angle range of motions and gait speed. The dynamic time warping analysis revealed a 13% restoration towards a healthy gait, indicating that kinematic analyses effectively quantify BoNT-A treatment effects in HSP patients.

Type of Publication: In Book
Pages: 406-410
Month: 12
ISBN: 978-3-031-77583-3
Barliya, A., Krausz, N., Naaman, H., Chiovetto, E., Giese, M. A. & Flash, T. (2024). Human arm redundancy: a new approach for the inverse kinematics problem. Royal Society Open Science, 11.
Human arm redundancy: a new approach for the inverse kinematics problem
Abstract:

The inverse kinematics (IK) problem addresses how both humans and robotic systems coordinate movement to resolve redundancy, as in the case of arm reaching where more degrees of freedom are available at the joint versus hand level. This work focuses on which coordinate frames best represent human movements, enabling the motor system to solve the IK problem in the presence of kinematic redundancies. We used a multi-dimensional sparse source separation method to derive sets of basis (or source) functions for both the task and joint spaces, with joint space represented by either absolute or anatomical joint angles. We assessed the similarities between joint and task sources in each of these joint representations, finding that the time-dependent profiles of the absolute reference frame’s sources show greater similarity to corresponding sources in the task space. This result was found to be statistically significant. Our analysis suggests that the nervous system represents multi-joint arm movements using a limited number of basis functions, allowing for simple transformations between task and joint spaces. Additionally, joint space seems to be represented in an absolute reference frame to simplify the IK transformations, given redundancies. Further studies will assess this finding’s generalizability and implications for neural control of movement.

Authors: Barliya, Avi Krausz, Nili Naaman, Hila Chiovetto, Enrico Giese, Martin A.; Flash, Tamar
Type of Publication: Article
Full text: PDF
Casas, J. P., Wochner, I., Schumacher, P., Ilg, W., Giese, M. A., Maufroy, C. et al. (2024). Generating Realistic Arm Movements in Reinforcement Learning: A Quantitative Comparison of Reward Terms and Task Requirements. IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.
Generating Realistic Arm Movements in Reinforcement Learning: A Quantitative Comparison of Reward Terms and Task Requirements
Authors: Casas, Jhon Paul Feliciano Charaja Wochner, Isabell Schumacher, Pierre Ilg, Winfried; Giese, Martin A.; Maufroy, Christophe Bulling, Andreas Schmitt, Syn Haeufle, Daniel Florian Benedict
Research Areas: Uncategorized
Type of Publication: Article
Sapounaki, M., Schumacher, P., Ilg, W., Giese, M. A., Maufroy, C., Bulling, A. et al. (2024). Quantifying human upper limb stiffness responses based on a computationally efficient neuromusculoskeletal arm model. IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.
Quantifying human upper limb stiffness responses based on a computationally efficient neuromusculoskeletal arm model
Authors: Sapounaki, Maria Schumacher, Pierre Ilg, Winfried; Giese, Martin A.; Maufroy, Christophe Bulling, Andreas Schmitt, Syn Haeufle, Isabell Wochner Daniel Florian Benedict
Research Areas: Uncategorized
Type of Publication: Article
Wochner, I., Nadler, T., Stollenmaier, K., Pley, C., Ilg, W., Schmitt, S. et al. (2024). ATARO: a muscle-driven biorobotic arm to investigate healthy and impaired motor control. IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.
ATARO: a muscle-driven biorobotic arm to investigate healthy and impaired motor control
Authors: Wochner, Isabell Nadler, Tobias Stollenmaier, Katrin Pley, Christina Ilg, Winfried; Schmitt, Syn Haeufle, Daniel Florian Benedict
Research Areas: Uncategorized
Type of Publication: Article
Christensen, A., Taubert, N., in ’t Veld, E. M., de Gelder, B. & Giese, M. A. (2024). Perceptual encoding of emotions in interactive bodily expressions. iScience. VOLUME 27, ISSUE 1, 108548, JANUARY 19, 2024.
Perceptual encoding of emotions in interactive bodily expressions
Abstract:

For social species, e.g., primates, the perceptual analysis of social interactions is an essential skill for survival, emerging already early during development. While real-life emotional behavior includes predominantly interactions between conspecifics, research on the perception of emotional body expressions has primarily focused on perception of single individuals. While previous studies using point-light or video stimuli of interacting people suggest an influence of social context on the perception and neural encoding of interacting bodies, it remains entirely unknown how emotions of multiple interacting agents are perceptually integrated. We studied this question using computer animation by creating scenes with two interacting avatars whose emotional style was independently controlled. While participants had to report the emotional style of a single agent, we found a systematic influence of the emotion expressed by the other, which was consistent with the social interaction context. The emotional styles of interacting individuals are thus jointly encoded.

Authors: Christensen, Andrea Taubert, Nick; in ’t Veld, Elisabeth M.J. Huis de Gelder, Beatrice Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version

Year: 2023

Laßmann, C., Ilg, W., Rattay, T. W., Schöls, L., Giese, M. A. & Haeufle, D. F. (2023). Dysfunctional neuro-muscular mechanisms explain gradual gait changes in prodromal spastic paraplegia. Journal of NeuroEngineering and Rehabilitation. Jul 15;20(1):90.
Dysfunctional neuro-muscular mechanisms explain gradual gait changes in prodromal spastic paraplegia
Abstract:

Background In Hereditary Spastic Paraplegia (HSP) type 4 (SPG4) a length-dependent axonal degeneration in the cortico-spinal tract leads to progressing symptoms of hyperrefexia, muscle weakness, and spasticity of lower extremities. Even before the manifestation of spastic gait, in the prodromal phase, axonal degeneration leads to subtle gait changes. These gait changes - depicted by digital gait recording - are related to disease severity in prodromal and early-to-moderate manifest SPG4 participants. Methods We hypothesize that dysfunctional neuro-muscular mechanisms such as hyperrefexia and muscle weak- ness explain these disease severity-related gait changes of prodromal and early-to-moderate manifest SPG4 partici- pants. We test our hypothesis in computer simulation with a neuro-muscular model of human walking. We introduce neuro-muscular dysfunction by gradually increasing sensory-motor refex sensitivity based on increased velocity feedback and gradually increasing muscle weakness by reducing maximum isometric force. Results By increasing hyperrefexia of plantarfexor and dorsifexor muscles, we found gradual muscular and kin- ematic changes in neuro-musculoskeletal simulations that are comparable to subtle gait changes found in prodromal SPG4 participants. Conclusions Predicting kinematic changes of prodromal and early-to-moderate manifest SPG4 participants by grad- ual alterations of sensory-motor refex sensitivity allows us to link gait as a directly accessible performance marker to emerging neuro-muscular changes for early therapeutic interventions. Keywords Gait simulation, Spasticity, Hyperrefexia, Prodromal, SPG4, HSP, Movement disorder

Authors: Laßmann, Christian; Ilg, Winfried; Rattay, Tim W. Schöls, Ludger Giese, Martin A.; Haeufle, Daniel F. B.
Type of Publication: Article
Full text: PDF
Bognár, A., Raman, R., Taubert, N., Li, B., Zafirova, Y., Giese, M. A. et al. (2023). The contribution of dynamics to macaque body and face patch responses. NeuroImage, 269.
The contribution of dynamics to macaque body and face patch responses
Abstract:

Previous functional imaging studies demonstrated body-selective patches in the primate visual temporal cortex, comparing activations to static bodies and static images of other categories. However, the use of static instead of dynamic displays of moving bodies may have underestimated the extent of the body patch network. Indeed, body dynamics provide information about action and emotion and may be processed in patches not activated by static images. Thus, to map with fMRI the full extent of the macaque body patch system in the visual temporal cortex, we employed dynamic displays of natural-acting monkey bodies, dynamic monkey faces, objects, and scrambled versions of these videos, all presented during fixation. We found nine body patches in the visual temporal cortex, starting posteriorly in the superior temporal sulcus (STS) and ending anteriorly in the temporal pole. Unlike for static images, body patches were present consistently in both the lower and upper banks of the STS. Overall, body patches showed a higher activation by dynamic displays than by matched static images, which, for identical stimulus displays, was less the case for the neighboring face patches. These data provide the groundwork for future single-unit recording studies to reveal the spatiotemporal features the neurons of these body patches encode. These fMRI findings suggest that dynamics have a stronger contribution to population responses in body than face patches.

Authors: Bognár, A. Raman, R. Taubert, Nick; Li, B Zafirova, Y Giese, Martin A.; Gelder, B. De Vogels, R.
Type of Publication: Article
Full text: PDF
Timmann, D., Ernst, T. M., Ilg, W. & Donchin, O (2023). Lesion-Symptom Mapping, chapter Essentials, pages 479–483. Springer, Cham.
Lesion-Symptom Mapping
Abstract:

In this chapter, methods will be introduced which are currently available to perform lesion-symptom mapping in patients with focal and degenerative cerebellar disease. At the beginning of the chapter, strength and weaknesses inherent in studies on localization of cerebellar function in these different patient populations will be discussed. Next, methods of lesion-symptom mapping in focal cerebellar disease will be explained in more detail including lesion delineation, lesion normalization, and descriptive and inferential statistical analysis. Finally, methods of lesion-symptom mapping in cerebellar degeneration and available atlases of the cerebellum in stereotaxic space will be introduced.

Authors: Timmann, D. Ernst, T. M. Ilg, Winfried; Donchin, Opher
Type of Publication: In Book
Full text: Online version
Ilg, W. & Timmann, D (2023). Motor Rehabilitation of Cerebellar Disorders, chapter Essentials, pages 709–714. Springer, Cham.
Motor Rehabilitation of Cerebellar Disorders
Type of Publication: In Book
Full text: Online version
Timmann, D. & Ilg, W (2023). Drugs in Selected Ataxias, chapter Essentials, pages 699–703. Springer, Cham.
Drugs in Selected Ataxias
Abstract:

In this chapter, drug treatment in the few treatable causes of degenerative ataxias will first be presented including vitamin deficiency, metabolic disorders, and autoimmune disorders. Next, older and more recent drug trials will be discussed which have been performed in Friedreich’s ataxia and may lead to effective drug treatments in the future. Finally, it will be shown that, as yet, symptomatic treatments of most degenerative ataxias are lacking, that is, there is still no “anti-ataxic drug.” The only exceptions are aminopyridines and acetazolamide which can be beneficial in the treatment of downbeat nystagmus and episodic ataxias.

Type of Publication: In Book
Full text: Online version
Li, B., Solanas, M. P., Marrazzo, G., Raman, R., Taubert, N., Giese, M. A. et al. (2023). A large-scale brain network of species-specific dynamic human body perception. Progress in Neurobiology, 221.
A large-scale brain network of species-specific dynamic human body perception
Abstract:

This ultrahigh field 7 T fMRI study addressed the question of whether there exists a core network of brain areas at the service of different aspects of body perception. Participants viewed naturalistic videos of monkey and human faces, bodies, and objects along with mosaic-scrambled videos for control of low-level features. Independent component analysis (ICA) based network analysis was conducted to find body and species modulations at both the voxel and the network levels. Among the body areas, the highest species selectivity was found in the middle frontal gyrus and amygdala. Two large-scale networks were highly selective to bodies, dominated by the lateral occipital cortex and right superior temporal sulcus (STS) respectively. The right STS network showed high species selectivity, and its significant human body-induced node connectivity was focused around the extrastriate body area (EBA), STS, temporoparietal junction (TPJ), premotor cortex, and inferior frontal gyrus (IFG). The human body-specific network discovered here may serve as a brain-wide internal model of the human body serving as an entry point for a variety of processes relying on body descriptions as part of their more specific categorization, action, or expression recognition functions.

Authors: Li, Baichen Solanas, Marta Poyo Marrazzo, Giuseppe Raman, Rajani Taubert, Nick; Giese, Martin A.; Vogels, Rufin de Gelder, Beatrice
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version
Benali, A., Ramachandra, V., Oelterman, A., Schwarz, C. & Giese, M. A. (2023). Is it possible to separate intra-cortical evoked neural dynamics from peripheral evoked potentials during transcranial magnetic stimulation?. Brain Stimulation, 16, 162.
Is it possible to separate intra-cortical evoked neural dynamics from peripheral evoked potentials during transcranial magnetic stimulation?
Abstract:

When TMS is applied over motor cortex, it elicits movements that can be recorded in humans as motor-evoked muscle potentials, as well as in patterns in EEG. A discussion has been started recently in the community that TMS may not only excite neuronal structures in the central nervous system, but also cause peripheral co-stimulation of sensory and motor axons of the meninges, blood vessels, skin, and muscle. These structures may also excite the same cortical site that TMS was meant to stimulate in the first place, resulting in contamination of the TMS-induced cortical response. Therefore, many efforts are made to identify and isolate peripheral evoked potentials (PEPs) from TMS-induced cortical responses in EEG-Data. However, it is very difficult to develop an appropriate sham stimulation for humans that closely reflects auditory, somatosensory, and motor responses accompanying TMS. An obvious route to clarify the issue is the blockade of cranial nerves, which requires animal models where invasive experiments to discover putative areas of origin can be done. In recent years, we have developed a method to demonstrate the direct effect of a TMS pulse at the cellular level. We have transferred single pulse and repeated stimulation protocols from humans to a rat model. With selective blockade of PEP, we were able to show that the trigeminal nerve is a major contributor to TMS-evoked neuronal signals in motor cortex, represented by a prominent excitatory peak at around 20 ms after stimulation. TEPs starts much earlier and lasts up to 6 ms after the stimulus pulse. Both inputs then merge into a canonical inhibition-excitation pattern lasting more than 350 ms.

Authors: Benali, Alia; Ramachandra, Vishnudev Oelterman, Axel Schwarz, Cornelius Giese, Martin A.
Type of Publication: Article
Full text: PDF | Online version
Raman, R., Bognár, A., Nejad, G. G., Taubert, N., Giese, M. A. & Vogels, R. (2023). Bodies in motion: Unraveling the distinct roles of motion and shape in dynamic body responses in the temporal cortex. Cell Reports, 42(12), 113438.
Bodies in motion: Unraveling the distinct roles of motion and shape in dynamic body responses in the temporal cortex
Abstract:

Summary The temporal cortex represents social stimuli, including bodies. We examine and compare the contributions of dynamic and static features to the single-unit responses to moving monkey bodies in and between a patch in the anterior dorsal bank of the superior temporal sulcus (dorsal patch [DP]) and patches in the anterior inferotemporal cortex (ventral patch [VP]), using fMRI guidance in macaques. The response to dynamics varies within both regions, being higher in DP. The dynamic body selectivity of VP neurons correlates with static features derived from convolutional neural networks and motion. DP neurons’ dynamic body selectivity is not predicted by static features but is dominated by motion. Whereas these data support the dominance of motion in the newly proposed “dynamic social perception” stream, they challenge the traditional view that distinguishes DP and VP processing in terms of motion versus static features, underscoring the role of inferotemporal neurons in representing body dynamics.

Authors: Raman, Rajani Bognár, Anna Nejad, Ghazaleh Ghamkhari Taubert, Nick; Giese, Martin A.; Vogels, Rufin
Type of Publication: Article
Full text: PDF | Online version

Information

All images and videos displayed on this webpage are protected by copyright law. These copyrights are owned by Computational Sensomotorics.

If you wish to use any of the content featured on this webpage for purposes other than personal viewing, please contact us for permission.

Social Media

We use cookies

We use cookies on our website. Some of them are essential for the operation of the site, while others help us to improve this site and the user experience (tracking cookies). You can decide for yourself whether you want to allow cookies or not. Please note that if you reject them, you may not be able to use all the functionalities of the site.