Modelling and Investigation of Facial Expression Perception

Research Area

Neural and Computational Principles of Action and Social Processing

Researchers

Martin A. Giese; Nick Taubert; Michael Stettler;

Collaborators

Aleix Martinez (Ohio State University); Peter Thier; Peter Dicke; Silvia Spadacenta; Ramona Siebert; Marius Görner

Description

Dynamic faces are essential for the communication of humans and non-human primates. However, the exact neural circuits of their processing remain unclear. Based on previous models for cortical neural processes involved for social recognition (of static faces and dynamic bodies), we propose  a norm-based mechanism, relying on neurons that represent dierences between the actual facial shape and the neutral facial pose. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique.

Subprojects

Multi-Domain Norm-Referenced Encoding

Biologically-inspired mechanism for such transfer learning, which is based on norm-referenced encoding, where patterns are encoded in terms of difference vectors relative to a domain-specific reference vector.

Shape-invariant encoding of dynamic primate facial expressions in human perception

In this project we want to develop highly controllable face stimuli to study the neural basis of face processing and the analyses of the dynamics and structure of facial movements.

Publications

Taubert, N., Stettler, M., Siebert, R., Spadacenta, S., Sting, L., Dicke, P. et al. (2021). Shape-invariant encoding of dynamic primate facial expressions in human perception. eLife.
Shape-invariant encoding of dynamic primate facial expressions in human perception
Abstract:

Dynamic facial expressions are crucial for communication in primates. Due to the difficulty to control shape and dynamics of facial expressions across species, it is unknown how species-specific facial expressions are perceptually encoded and interact with the representation of facial shape. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique. Consistent with our hypothesis, we found that human observers learned cross-species expressions very quickly, where face dynamics was represented largely independently of facial shape. This result supports the co-evolution of the visual processing and motor control of facial expressions, while it challenges appearance-based neural network theories of dynamic expression recognition.

Authors: Nick Taubert; Michael Stettler; R. Siebert S. Spadacenta L. Sting P. Dicke P. Thier Martin A. Giese
Research Areas: Uncategorized
Type of Publication: Article
Journal: eLife
Year: 2021
Month: June
Stettler, M., Taubert, N., Siebert, R., Spadacenta, S., Dicke, P., Thier, P. et al (2021). Neural models for the (cross-species) recognition of dynamic facial expressions. Göttingen Meeting of the German Neuroscience Society 2021, Germany .
Neural models for the (cross-species) recognition of dynamic facial expressions
Authors: Michael Stettler; Nick Taubert; Ramona Siebert Silvia Spadacenta Peter Dicke Peter Thier Martin A. Giese
Research Areas: Uncategorized
Type of Publication: In Collection
JRESEARCH_BOOK_TITLE: Göttingen Meeting of the German Neuroscience Society 2021, Germany
Full text: PDF
Stettler, M., Taubert, N., Azizpour, T., Siebert, R., Spadacenta, S., Dicke, P. et al. (2020). Physiologically-inspired Neural Circuits for the Recognition of Dynamic Faces. Artificial Neural Networks and Machine Learning – ICANN 2020 29th International Conference on Artificial Neural Networks, Bratislava, Slovakia, September 15–18, 2020, Proceedings, Part I. Springer, Berlin(168-179).
Physiologically-inspired Neural Circuits for the Recognition of Dynamic Faces
Authors: Michael Stettler; Nick Taubert; Tahereh Azizpour Ramona Siebert Silvia Spadacenta Peter Dicke Hans Peter Thier Martin A. Giese
Type of Publication: Article

Information

All images and videos displayed on this webpage are protected by copyright law. These copyrights are owned by Computational Sensomotorics.

If you wish to use any of the content featured on this webpage for purposes other than personal viewing, please contact us for permission.

Social Media