Personal Page

M. Sc. Taubert, Nick

Room: 5.523a
Section for Computational Sensomotorics
Department of Cognitive Neurology
Hertie Institute for Clinical Brain Research
Centre for Integrative Neuroscience
University Clinic Tübingen
Otfried-Müller-Str. 25
72076 Tübingen, Germany
+497071 2989135
Nick Taubert

Reseach Interests

  • Machine learning algorithms for human body movements
  • Interactions between humans and virtual characters in VR
  • Computer graphics and computer animation

Projects

Publications

Christensen, A., Taubert, N., in ’t Veld, E. M., de Gelder, B. & Giese, M. A. (2024). Perceptual encoding of emotions in interactive bodily expressions. iScience. VOLUME 27, ISSUE 1, 108548, JANUARY 19, 2024.
Perceptual encoding of emotions in interactive bodily expressions
Abstract:

For social species, e.g., primates, the perceptual analysis of social interactions is an essential skill for survival, emerging already early during development. While real-life emotional behavior includes predominantly interactions between conspecifics, research on the perception of emotional body expressions has primarily focused on perception of single individuals. While previous studies using point-light or video stimuli of interacting people suggest an influence of social context on the perception and neural encoding of interacting bodies, it remains entirely unknown how emotions of multiple interacting agents are perceptually integrated. We studied this question using computer animation by creating scenes with two interacting avatars whose emotional style was independently controlled. While participants had to report the emotional style of a single agent, we found a systematic influence of the emotion expressed by the other, which was consistent with the social interaction context. The emotional styles of interacting individuals are thus jointly encoded.

Authors: Christensen, Andrea Taubert, Nick; in ’t Veld, Elisabeth M.J. Huis de Gelder, Beatrice Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Journal: iScience. VOLUME 27, ISSUE 1, 108548, JANUARY 19, 2024
Year: 2024
Bognár, A., Raman, R., Taubert, N., Li, B., Zafirova, Y., Giese, M. A. et al. (2023). The contribution of dynamics to macaque body and face patch responses. NeuroImage, 269.
The contribution of dynamics to macaque body and face patch responses
Abstract:

Previous functional imaging studies demonstrated body-selective patches in the primate visual temporal cortex, comparing activations to static bodies and static images of other categories. However, the use of static instead of dynamic displays of moving bodies may have underestimated the extent of the body patch network. Indeed, body dynamics provide information about action and emotion and may be processed in patches not activated by static images. Thus, to map with fMRI the full extent of the macaque body patch system in the visual temporal cortex, we employed dynamic displays of natural-acting monkey bodies, dynamic monkey faces, objects, and scrambled versions of these videos, all presented during fixation. We found nine body patches in the visual temporal cortex, starting posteriorly in the superior temporal sulcus (STS) and ending anteriorly in the temporal pole. Unlike for static images, body patches were present consistently in both the lower and upper banks of the STS. Overall, body patches showed a higher activation by dynamic displays than by matched static images, which, for identical stimulus displays, was less the case for the neighboring face patches. These data provide the groundwork for future single-unit recording studies to reveal the spatiotemporal features the neurons of these body patches encode. These fMRI findings suggest that dynamics have a stronger contribution to population responses in body than face patches.

Authors: Bognár, A. Raman, R. Taubert, Nick; Li, B Zafirova, Y Giese, Martin A.; Gelder, B. De Vogels, R.
Type of Publication: Article
Full text: PDF
Li, B., Solanas, M. P., Marrazzo, G., Raman, R., Taubert, N., Giese, M. A. et al. (2023). A large-scale brain network of species-specific dynamic human body perception. Progress in Neurobiology, 221.
A large-scale brain network of species-specific dynamic human body perception
Abstract:

This ultrahigh field 7 T fMRI study addressed the question of whether there exists a core network of brain areas at the service of different aspects of body perception. Participants viewed naturalistic videos of monkey and human faces, bodies, and objects along with mosaic-scrambled videos for control of low-level features. Independent component analysis (ICA) based network analysis was conducted to find body and species modulations at both the voxel and the network levels. Among the body areas, the highest species selectivity was found in the middle frontal gyrus and amygdala. Two large-scale networks were highly selective to bodies, dominated by the lateral occipital cortex and right superior temporal sulcus (STS) respectively. The right STS network showed high species selectivity, and its significant human body-induced node connectivity was focused around the extrastriate body area (EBA), STS, temporoparietal junction (TPJ), premotor cortex, and inferior frontal gyrus (IFG). The human body-specific network discovered here may serve as a brain-wide internal model of the human body serving as an entry point for a variety of processes relying on body descriptions as part of their more specific categorization, action, or expression recognition functions.

Authors: Li, Baichen Solanas, Marta Poyo Marrazzo, Giuseppe Raman, Rajani Taubert, Nick; Giese, Martin A.; Vogels, Rufin de Gelder, Beatrice
Research Areas: Uncategorized
Type of Publication: Article
Kumar, P., Taubert, N., Raman, R., Bognár, A., Nejad, G. G., Vogels, R. et al (2023). Neurodynamical Model of the Visual Recognition of Dynamic Bodily Actions from Silhouettes. In Iliadis, Lazaros, Papaleonidas, Antonios, Angelov, Plamen et al (editors), Artificial Neural Networks and Machine Learning -- ICANN 2023 , 533-544. Cham : Springer Nature Switzerland.
Neurodynamical Model of the Visual Recognition of Dynamic Bodily Actions from Silhouettes
Abstract:

For social species, including primates, the recognition of dynamic body actions is crucial for survival. However, the detailed neural circuitry underlying this process is currently not well understood. In monkeys, body-selective patches in the visual temporal cortex may contribute to this processing. We propose a physiologically-inspired neural model of the visual recognition of body movements, which combines an existing image-computable model (`ShapeComp') that produces high-dimensional shape vectors of object silhouettes, with a neurodynamical model that encodes dynamic image sequences exploiting sequence-selective neural fields. The model successfully classifies videos of body silhouettes performing different actions. At the population level, the model reproduces characteristics of macaque single-unit responses from the rostral dorsal bank of the Superior Temporal Sulcus (Anterior Medial Upper Body (AMUB) patch). In the presence of time gaps in the stimulus videos, the predictions made by the model match the data from real neurons. The underlying neurodynamics can be analyzed by exploiting the framework of neural field dynamics.

Authors: Kumar, Prerana; Taubert, Nick; Raman, Rajani Bognár, Anna Nejad, Ghazaleh Ghamkhari Vogels, Rufin Giese, Martin A.
Type of Publication: In Collection
JRESEARCH_BOOK_TITLE: Artificial Neural Networks and Machine Learning -- ICANN 2023
Publisher: Springer Nature Switzerland
Editor: Iliadis, Lazaros and Papaleonidas, Antonios and Angelov, Plamen and Jayne, Chrisina
Address: Cham
Pages: 533-544
ISBN: 978-3-031-44210-0
Bognár, A., Mukovskiy, A., Nejad, G. G., Taubert, N., Stettler, M., Martini, L. M. et al (2023). Simultaneous recordings from posterior and anterior body responsive regions in the macaque Superior Temporal Sulcus . VSS 2023, May 19-24 2023, St. Pete Beach, Florida.
Simultaneous recordings from posterior and anterior body responsive regions in the macaque Superior Temporal Sulcus
Type of Publication: In Collection
View All

Information

All images and videos displayed on this webpage are protected by copyright law. These copyrights are owned by Computational Sensomotorics.

If you wish to use any of the content featured on this webpage for purposes other than personal viewing, please contact us for permission.

Social Media