Section Computational
Sensomotorics
Department of Cognitive Neurology
CIN.jpg
MonkeyHead_SlideShow_Full_2.jpg
KinectSystemLab.jpg

Home

Year: 2011

Endres, D. & Oram, M (2011). Modeling Non-stationarity and Inter-spike Dependency in High-level Visual Cortical Area STSa Ninth Göttingen meeting of the German Neuroscience Society.
Modeling Non-stationarity and Inter-spike Dependency in High-level Visual Cortical Area STSa
Authors: Endres, Dominik Oram, Mike
Research Areas: Uncategorized
Type of Publication: In Collection
Month: 03
Full text: Online version

Year: 2010

Thurman, S. M., Giese, M. A. & Grossman, E. D. (2010). Perceptual and computational analysis of critical features for biological motion. Journal of Vision, 10(12), 1-15.
Perceptual and computational analysis of critical features for biological motion
Authors: Thurman, Steven M. Giese, Martin A.; Grossman, Emily D.
Research Areas: Uncategorized
Type of Publication: Article
Journal: Journal of Vision
Volume: 10
Number: 12
Pages: 1-15
Year: 2010
Month: 10
Full text: PDF
Fleischer, F., Caggiano, V., Fogassi, L., Rizzolatti, G., Thier, P. & Giese, M. A (2010). Temporal and Semantic Selectivity in Mirror Neurons in monkey premotor area F5 Meeting of the Society for Neuroscience 2010, San Diego, USA.
Temporal and Semantic Selectivity in Mirror Neurons in monkey premotor area F5
Authors: Fleischer, Falk Caggiano, Vittorio Fogassi, Leonardo Rizzolatti, Giacomo Thier, Peter Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Mukovskiy, A., Slotine, J.-J. & Giese, M. A. (2010). Analysis of the global dynamical stability of crowd navigation applying Contraction Theory. In: Electronic Proceedings of Workshop on Crowd Simulation, 23rd Int. Conference on Computer Animation and Social Agents (CASA 2010), May 31-June 2, 2010, Saint-Malo, France.
Analysis of the global dynamical stability of crowd navigation applying Contraction Theory
Authors: Mukovskiy, Albert; Slotine, Jean-Jacques E. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Fleischer, F., Casile, A. & Giese, M. A. (2010). Computational Mechanisms of the Visual Processing of Action Stimuli.
Computational Mechanisms of the Visual Processing of Action Stimuli
Authors: Fleischer, Falk Casile, Antonino Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Book
Month: 04
Full text: Online version
Baranauskas, G., Mukovskiy, A., Wolf, J. & Volgushev, M. (2010). The determinants of the onset dynamics of action potentials in a computational model. Neuroscience, 167(4), 1070-1090.
The determinants of the onset dynamics of action potentials in a computational model
Authors: Baranauskas, Gytis Mukovskiy, Albert; Wolf, Julia Volgushev, Maxim
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Mukovskiy, A., Slotine, J.-J. & Giese, M. A. (2010). Contraction theory as method for the analysis and the design of stability of collective behavior in crowds. In: Electronic Proc. IADIS Int. Conference on Computer Graphics, Visualization, Computer Vision and Image Processing (CGVCVIP 2010) 27-29 July,2010 Freiburg, Germany, 47-56.
Contraction theory as method for the analysis and the design of stability of collective behavior in crowds
Authors: Mukovskiy, Albert; Slotine, Jean-Jacques E. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Giese, M. A., Caggiano, V. & Thier, P (2010). View-based neural encoding of goal-directed actions: a physiologically-inspired neural theory Journal of Vision, 10(7), 1095.
View-based neural encoding of goal-directed actions: a physiologically-inspired neural theory
Abstract:

View-based neural encoding of goal-directed actions: a physiologically-inpired neural theory The visual recognition of goal-directed movements is crucial for action understanding. Neurons with visual selectivity for goal-directed hand actions have been found in multiple cortical regions. Such neurons are characterized by a remarkable combination of selectivity and invariance: Their responses vary with subtle differences between hand shapes (e.g. defining different grip types) and the exact spatial relationship between effector and goal object (as required for a successful grip). At the same time, many of these neurons are largely invariant with respect to the spatial position of the stimulus and the visual perspective. This raises the question how the visual system accomplishes this combination of spatial accuracy and invariance. Numerous theories for visual action recognition in neuroscience and robotics have postulated that the visual system reconstructs the three-dimensional structures of effector and object and then verifies their correct spatial relationship, potentially by internal simulation of the observed action in a motor frame of reference. However, novel electrophysiological data showing view-dependent responses of mirror neurons point towards an alternative explanation. We propose an alternative theory that is based on physiologically plausible mechanisms, and which makes predictions that are compatible with electrophysiological results. It is based on the following key components: (1) A neural shape recognition hierarchy with incomplete position invariance; (2) a dynamic neural mechanism that associates shape information over time; (3) a gain-field-like mechanism that computes affordance- and spatial matching between effector and goal object; (4) pooling of the output signals of a small number of view-specific action-selective modules. We show that this model is computationally powerful enough to accomplish robust position- and view-invariant recognition on real videos. At the same time, it reproduces and correctly predicts data from single-cell recordings, e.g. on the view- and temporal–order selectivity of mirror neurons in area F5.

Authors: Giese, Martin A.; Caggiano, Vittorio Thier, Peter
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Fleischer, F., Caggiano, V. & Giese, M. A (2010). Neural model for the visual tuning properties of action-selective neurons in monkey cortex Meeting of the German Neuroscience Society (GNS), Goettingen, Germany..
Neural model for the visual tuning properties of action-selective neurons in monkey cortex
Authors: Fleischer, Falk Caggiano, Vittorio Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Endres, D., Höffken, M., Vintila, F., Bruce, N. D., Bouecke, J. D., Kornprobst, P. et al (2010). Hooligan Detection: the Effects of Saliency and Expert Knowledge ECVP 2010 and Perception 39 supplement, page 193.
Hooligan Detection: the Effects of Saliency and Expert Knowledge
Authors: Endres, Dominik Höffken, M. Vintila, F. Bruce, Neil D. B. Bouecke, Jan D. Kornprobst, Pierre Neumann, H. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Endres, D., Beck, T., Bouecke, J. D., Omlor, L., Neumann, H. & Giese, M. A (2010). Segmentation of Action Streams: Comparison between Human and Statistically Optimal Performance Vision Sciences Society Congress, VSS 2010 and Journal of Vision, vol. 10 no. 7 article 807, 2010..
Segmentation of Action Streams: Comparison between Human and Statistically Optimal Performance
Abstract:

Natural body movements arise in form of temporal sequences of individual actions. In order to realize a visual analysis of these actions, the visual system must accomplish a temporal segmentation of such action sequences. Previous work has studied in detail the segmentation of sequences of piecewise linear movements in the two-dimensional plane. In our study, we tried to compare statistical approaches for segmentation of human full-body movement with human responses. Video sequences were generated by synthesized sequences of natural actions based on motion capture, using appropriate methods for motion blending. Human segmentation was assessed by an interactive adjustment paradigm, where participants had to indicate segmentation points by selection of the relevant frames. We compared this psychophysical data against different segmentation algorithms, which were based on the available 3D joint trajectories that were used for the synthesis of the motion stimuli. Simple segmentation methods, e.g. based on discontinuities in path direction or speed, were compared with an optimal Bayesian action segmentation approach from machine learning. This method is based on a generative probabilistic model. Transitions between classes (types of actions) were modelled by resetting the feature priors at the change points. Change point configurations were modelled by Bayesian binning. Applying optimization within a Bayesian framework, number and the length of individual action segments were determined automatically. Performance of this algorithmic approach was compared with human performance.

Authors: Endres, Dominik Beck, Tobias Bouecke, Jan D. Omlor, Lars Neumann, H. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Endres, D., Földiák, P. & Priss, U. (2010). An Application of Formal Concept Analysis to Semantic Neural Decoding. Annals of Mathematics and Artificial Intelligence, 57(3-4), 233-248.
An Application of Formal Concept Analysis to Semantic Neural Decoding
Authors: Endres, Dominik Földiák, Peter Priss, Uta
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Christensen, A., Ilg, W., Karnath, H. O. & Giese, M. A (2010). Influence of (a)synchronous egomotion on action perception In: Neural Encoding of Perception and Action, Tuebingen, Germany.
Influence of (a)synchronous egomotion on action perception
Authors: Christensen, Andrea Ilg, Winfried; Karnath, H. O. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Christensen, A., Ilg, W., Karnath, H. O. & Giese, M. A (2010). Einfluss (a)synchroner Eigenbewegung auf die Handlungswahrnehmung In: Tagung experimentell arbeitender Psychologen, Saarbruecken, Germany.
Einfluss (a)synchroner Eigenbewegung auf die Handlungswahrnehmung
Authors: Christensen, Andrea Ilg, Winfried; Karnath, H. O. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Casile, A., Dayan, E., Caggiano, V., Hendler, T., Flash, T. & Giese, M. A. (2010). Neuronal encoding of human kinematic invariants during action observation. Cerebral Cortex, 20(7), 1647-55.
Neuronal encoding of human kinematic invariants during action observation
Authors: Casile, Antonino Dayan, Eran Caggiano, Vittorio Hendler, Talma Flash, Tamar Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Endres, D., Schindelin, J., Földiák, P. & Oram, M. (2010). Modelling Spike Trains and Extracting Response Latency with Bayesian Binning. Journal of Physiology (Paris), 104(3-4), 128-136.
Modelling Spike Trains and Extracting Response Latency with Bayesian Binning
Abstract:

The peristimulus time histogram (PSTH) and the spike density function (SDF) are commonly used in the analysis of neurophysiological data. The PSTH is usually obtained by binning spike trains, the SDF being a (Gaussian) kernel smoothed version of the PSTH. While selection of the bin width or kernel size is often relatively arbitrary there have been recent attempts to remedy this situation. We further develop an exact Bayesian generative model approach to estimating PSTHs and demonstate its superiority to competing methods using data from early (LGN) and late (STSa) visual areas. We also highlight the advantages of our scheme’s automatic complexity control and generation of error bars. Additionally, our approach allows extraction of excitatory and inhibitory response latency from spike trains in a principled way, both on repeated and single trial data. We show that the method can be applied to data with high background firing rates and inhibitory responses (LGN) as well as to data with low firing rate and excitatory responses (STSa). Furthermore, we demonstrate on simulated data that our latency extraction method works for a range of signal-to-noise ratios and background firing rates. While further studies are needed to examine the sensitivity of our method to, for example, gradual changes in firing rate and adaptation, the current results suggest that Bayesian binning is a powerful method for the estimation of firing rate and the extraction response latency from neuronal spike trains.

Authors: Endres, Dominik Schindelin, Johannes Földiák, Peter Oram, Mike
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Chiovetto, E., Berret, B. & Pozzo, T. (2010). Tri-dimensional and triphasic muscle organization of whole-body pointing movements. Neuroscience, 170(4), 1223 - 1238.
Tri-dimensional and triphasic muscle organization of whole-body pointing movements
Authors: Chiovetto, Enrico Berret, Bastien Pozzo, T.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Omlor, L. (2010). New methods for anechoic demixing with application to shift invariant feature extraction. Phd Thesis.
New methods for anechoic demixing with application to shift invariant feature extraction
Authors: Omlor, Lars
Research Areas: Uncategorized
Type of Publication: Phd Thesis
Month: 04
Mukovskiy, A., Slotine, J.-J. & Giese, M. A. (2010). Design of the Dynamic Stability Properties of the Collective Behavior of Articulated Bipeds. Proceedings of 10th IEEE-RAS Int. Conference on Humanoid Robots,( Humanoids 2010) December 6-8, 2010, Nashville, TN, USA. pp. 66-73. In press in special issue of IEEE Journal on Robotics and Automation.
Design of the Dynamic Stability Properties of the Collective Behavior of Articulated Bipeds
Authors: Mukovskiy, Albert; Slotine, Jean-Jacques E. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Endres, D. & Oram, M. (2010). Feature Extraction from Spike Trains with Bayesian Binning: Latency is Where the Signal Starts. Journal of Computational Neuroscience, 29(1-2), 149-169.
Feature Extraction from Spike Trains with Bayesian Binning: Latency is Where the Signal Starts
Abstract:

The peristimulus time histogram (PSTH) and its more continuous cousin, the spike density function (SDF) are staples in the analytic toolkit of neurophysiologists. The former is usually obtained by binning spike trains, whereas the standard method for the latter is smoothing with a Gaussian kernel. Selection of a bin width or a kernel size is often done in an relatively arbitrary fashion, even though there have been recent attempts to remedy this situation. We develop an exact Bayesian, generative model approach to estimating PSTHs. Advantages of our scheme include automatic complexity control and error bars on its predictions. We show how to perform feature extraction on spike trains in a principled way, exemplified through latency and firing rate posterior distribution evaluations on repeated and single trial data. We also demonstrate using both simulated and real neuronal data that our approach provides a more accurate estimates of the PSTH and the latency than current competing methods. We employ the posterior distributions for an information theoretic analysis of the neural code comprised of latency and firing rate of neurons in high-level visual area STSa.A software implementation of our method is available at the machine learning open source software repository (www.mloss.org, project ‘binsdfc’).

Authors: Endres, Dominik Oram, Mike
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Ilg, W., Broetz, D., Burkard, S., Giese, M. A., Schöls, L. & Synofzik, M. (2010). Long-term effects of coordinative training in degenerative cerebellar disease. Movement disorders, 25(14), 2239-2246.
Long-term effects of coordinative training in degenerative cerebellar disease
Authors: Ilg, Winfried; Broetz, D. Burkard, Susanne Giese, Martin A.; Schöls, L. Synofzik, Matthis
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF
Ilg, W., Synofzik, M., Broetz, D., Burkard, S., Giese, M. A. & Schöls, L. (2010). Ataxie-Patienten profitieren von Physiotherapie. Aerztliche Praxis Neurologie Psychatrie (in German)(4), 10-12.
Ataxie-Patienten profitieren von Physiotherapie
Authors: Ilg, Winfried; Synofzik, Matthis Broetz, D. Burkard, Susanne Giese, Martin A.; Schöls, L.
Research Areas: Uncategorized
Type of Publication: Article
Christensen, A., Ilg, W., Karnath, H. O. & Giese, M. A (2010). Facilitation of biological-motion detection by motor execution does not depend on attributed body side Perception 39 ECVP Abstract Supplement, page 18.
Facilitation of biological-motion detection by motor execution does not depend on attributed body side
Authors: Christensen, Andrea Ilg, Winfried; Karnath, H. O. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version

Year: 2009

Ilg, W., Synofzik, M., Broetz, D., Burkard, S., Giese, M. A. & Schöls, L. (2009). Intensive coordinative training improves motor performance in degenerative disease. Neurology 2009, 73, 1823-1830.
Intensive coordinative training improves motor performance in degenerative disease
Abstract:

Objectives: The cerebellum is known to play a strong functional role in both motor control and motor learning. Hence, the benefit of physiotherapeutic training remains controversial for patients with cerebellar degeneration. In this study, we examined the effectiveness of a 4-week intensive coordinative training for 16 patients with progressive ataxia due to cerebellar degeneration (n  10) or degeneration of afferent pathways (n  6). Methods: Effects were assessed by clinical ataxia rating scales, individual goal attainment scores, and quantitative movement analysis. Four assessments were performed: 8 weeks before, immediately before, directly after, and 8 weeks after training. To control for variability in disease progression, we used an intraindividual control design, where performance changes with and without training were compared. Results: Significant improvements in motor performance and reduction of ataxia symptoms were observed in clinical scores after training and were sustained at follow-up assessment. Patients with predominant cerebellar ataxia revealed more distinct improvement than patients with afferent ataxia in several aspects of gait like velocity, lateral sway, and intralimb coordination. Consistently, in patients with cerebellar but without afferent ataxia, the regulation of balance in static and dynamic balance tasks improved significantly. Conclusion: In patients with cerebellar ataxia, coordinative training improves motor performance and reduces ataxia symptoms, enabling them to achieve personally meaningful goals in everyday life. Training effects were more distinct for patients whose afferent pathways were not affected. For both groups, continuous training seems crucial for stabilizing improvements and should become standard of care. Level of evidence: This study provides Class III evidence that coordinative training improves motor performance and reduces ataxia symptoms in patients with progressive cerebellar ataxia

Authors: Ilg, Winfried; Synofzik, Matthis Broetz, D. Burkard, Susanne Giese, Martin A.; Schöls, L.
Type of Publication: Article
Full text: PDF | Online version
Fleischer, F., Caggiano, V., Casile, A. & Giese, M. A (2009). Neural model for the visual tuning properties of action-selective neurons in premotor cortex Meeting of the German Neuroscience Society (GNS), Goettingen, Germany.
Neural model for the visual tuning properties of action-selective neurons in premotor cortex
Abstract:

Neural model for the visual tuning properties of action-selective neurons in premotor cortex The visual recognition of goal-directed movements is crucial for the learning of actions, and possibly for the understanding of the intentions and goals of others. The discovery of mirror neurons has stimulated a vast amount of research investigating possible links between action perception and action execution [1,2]. However, it remains largely unknown what the precise nature of this putative visuo-motor interaction is, and which relevant computational functions can be accomplished by purely visual processing. Here, we present a neurophysiologically inspired model for the visual recognition of grasping movements from videos. The model shows that the recognition of functional actions can be accounted for to a substantial degree by the analysis of spatio-temporal visual features using well-established simple neural circuits. The model integrates a hierarchical neural architecture that extracts form information in a view-dependent way accomplishing partial position and scale invariance [3,4,5]. It includes physiologically plausible recurrent neural circuits that result in temporal sequence selectivity [6,7,8]. As a novel computational step, the model proposes a simple neural mechanism that accounts for the selective matching between the spatial properties of goal objects and the specific posture, position and orientation of the effector (hand). Opposed to other models that assume a complete reconstruction of the 3D effector and object shape our model is consistent with the fact that almost 90 % of mirror neurons in premotor cortex show view-tuning. We demonstrate that the model is sufficiently powerful for recognizing goal-directed actions from real video sequences. In addition, it correctly predicts several key properties of the visual tuning of neurons in premotor cortex. We conclude that the recognition of functional actions can be accomplished by simple physiologically plausible mechanisms, without the explicit reconstruction of the 3D structures of objects and effector. Instead, prediction over time can be accomplished by the learning of spatio-temporal visual pattern sequences. This ‘bottom-up’ view of action recognition complements existing models for the mirror neuron system [9] and motivates a more detailed analysis of the complementary contributions of visual pattern analysis and motor representations on the visual recognition of imitable actions. References [1] Di Pellegrino, G. et al. (1992): Exp. Brain Res. 91, 176-180. [2] Rizzolatti, G. and Craighero, L. (2004): Annu. Rev. Neurosci. 27, 169-192. [3] Riesenhuber, M. and Poggio, T. (1999): Nat. Neurosci. 2, 1019-1025. [4] Giese, A.M. and Poggio, T. (2003): Nat. Rev. Neurosci. 4, 179-192. [5] Serre, T. et al. (2007): IEEE Pattern Anal. Mach. Int. 29, 411-426. [6] Zhang, K. (1996): J. Neurosci. 16, 2112-2126. [7] Hopfield, J. and Brody, D. (2000): Proc Natl Acad Sci USA 97, 13919-13924. [8] Xie, X. and Giese, M. (2002): Phys Rev E Stat Nonlin Soft Matter Phys 65, 051904. [9] Oztop, E. et al. (2006): Neural Netw. 19, 254-271.

Authors: Fleischer, Falk Caggiano, Vittorio Casile, Antonino Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Giese, M. A., Casile, A. & Fleischer, F (2009). Neural model of action-selective neurons in STS and area F5 Int Conf on Cognitive Systems Neuroscience (COSYNE) 2009, Salt Lake City, USA.
Neural model of action-selective neurons in STS and area F5
Abstract:

Neural model of action-selective neurons in STS and area F5 The visual recognition of goal-directed movements is crucial for the understanding of intentions and goals of others as well as for imitation learning. So far, it is largely unknown how visual information about effectors and goal objects of actions is integrated in the brain. Specifically, it is unclear whether a robust recognition of goal-directed actions can be accomplished by purely visual processing or if it requires a reconstruction of the three-dimensional structure of object and effector geometry. We present a neurophysiologically inspired model for the recognition of goal-directed grasping movements from real video sequences. The model integrates several physiologically plausible mechanisms in order to realize the integration of information about goal objects and the effector and its movement: (1) A hierarchical neural architecture for the recognition of hand and object shapes, which realizes position and scale-invariant recognition by subsequent increase of feature complexity and invariance along the hierarchy based on learned example views [1,2,3]. However, in contrast to standard models for visual object recognition this invariance is incomplete, so that the retinal positions of goal object and effector can be extracted by a population code. (2) Simple recurrent neural circuits for the realization of temporal sequence selectivity [4,5,6]. (3) A novel mechanism combines information about object shape and affordance and about effector (hand) posture and position in an object-centered frame of reference. This mechanism exploits gain fields in order to implement the relevant coordinate transformation [7,8]. The model shows that a robust integration of effector and object information can be accomplished by well-established physiologically plausible principles. Specifically, the proposed model does not contain explicit 3D representations of objects and the effector movement. Instead, it realizes predictions over time based on learned view-dependent representation of the visual input. Our results complement those of existing models of action recognition [8] and motivate a more detailed analysis of the complementary contributions of visual pattern analysis and motor representations on the visual recognition of imitable actions. References [1] Riesenhuber, M. and Poggio, T. (1999): Nat. Neurosci. 2, 1019-1025. [2] Giese, A.M. and Poggio, T. (2003): Nat. Rev. Neurosci. 4, 179-192. [3] Serre, T. et al. (2007): IEEE Pattern Anal. Mach. Int. 29, 411-426. [4] Zhang, K. (1996): J. Neurosci. 16, 2112-2126. [5] Hopfield, J. and Brody, D. (2000): Proc Natl Acad Sci USA 97, 13919-13924. [6] Xie, X. and Giese, M. (2002): Phys Rev E Stat Nonlin Soft Matter Phys 65, 051904. [7] Salinas, E. and Abbott, L. (1995): J. Neurosci. 75, 6461-6474. [8] Pouget, A. and Sejnowski, T. (1997): J. Cogn. Neurosci. 9, 222-237. [9] Oztop, E. et al. (2006): Neural Netw. 19, 254-271.

Authors: Giese, Martin A.; Casile, Antonino Fleischer, Falk
Research Areas: Uncategorized
Type of Publication: In Collection
Fleischer, F., Casile, A. & Giese, M. A (2009). A neural model of the visual tuning properties of action-selective neurons in STS and area F5 Journal of Vision, 9(8), 1106.
A neural model of the visual tuning properties of action-selective neurons in STS and area F5
Abstract:

A neural model of the visual tuning properties of action-selective neurons in STS and area F5 The visual recognition of goal-directed movements is crucial for the understanding of intentions and goals of others as well as for imitation learning. So far, it is largely unknown how visual information about effectors and goal objects of actions is integrated in the brain. Specifically, it is unclear whether a robust recognition of goal-directed actions can be accomplished by purely visual processing or if it requires a reconstruction of the three-dimensional structure of object and effector geometry. We present a neurophysiologically inspired model for the recognition of goal-directed grasping movements. The model reproduces fundamental properties of action-selective neurons in STS and area F5. The model is based on a hierarchical architecture with neural detectors that reproduce the properties of cells in visual cortex. It contains a novel physiologically plausible mechanism that combines information on object shape and effector (hand) shape and movement, implementing the necessary coordinate transformations from retinal to an object centered frame of reference. The model was evaluated with real video sequences of human grasping movements, using a separate training and test set. The model reproduces a variety of tuning properties that have been observed in electrophysiological experiments for action-selective neurons in STS and area F5. The model shows that the integration of effector and object information can be accomplished by well-established physiologically plausible principles. Specifically, the proposed model does not compute explicit 3D representations of objects and the action. Instead, it realizes predictions over time based on learned view-dependent representations for sequences of hand shapes. Our results complement those of existing models for the recognition of goal-directed actions and motivate a more detailed analysis of the complementary contributions of visual pattern analysis and motor representations on the visual recognition of imitable actions.

Authors: Fleischer, Falk Casile, Antonino Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Giese, M. A., Caggiano, V., Casile, A. & Fleischer, F (2009). Visual encoding of goal-directed movements: a physiologically plausible neural model Meeting of the Society for Neuroscience 2009, Washington DC, USA.
Visual encoding of goal-directed movements: a physiologically plausible neural model
Abstract:

Visual encoding of goal-directed movements: a physiologically plausible neural model Visual responses of action-selective neurons, e.g. in premotor cortex and the superior temporal sulcus of the macaque monkey, are characterized by a remarkable combination of selectivity and invariance. On the one hand, the responses of such neurons show high selectivity for details about the grip and the spatial relationship between effector and object. At the same time, these responses show substantial invariance against the retinal stimulus position. While numerous models for the mirror neuron system have been proposed in robotics and neuroscience, almost none of them accounts for the visual tuning properties of action-selective neurons exploiting physiologically plausible neural mechanisms. In addition, many existing models assume that action encoding is based on a full reconstruction of the 3D geometry of effector and object. This contradicts recent electrophysiological results showing view-dependence of the majority of action-selective neurons, e.g. in premotor cortex. We present a neurophysiologically plausible model for the visual recognition of grasping movements from real videos. The model is based on simple well-established neural circuits. Recognition of effector and goal object is accomplished by a hierarchical neural architecture, where scale and position invariance are accomplished by nonlinear pooling along the hierarchy, consistent with many established models from object recognition. Effector recognition includes a simple predictive neural circuit that results in temporal sequence selectivity. Effector and goal position are encoded within the neural hierarchy in terms of population codes, which can be processed by a simple gain field-like mechanism in order to compute the relative position of effector and object in a retinal frame of reference. Based on this signal, and object and effector shape, the highest hierarchy level accomplishes a distinction between functional (hand matches object shape and position) and dysfunctional (no match between hand and object shape or position) grips, at the same time being invariant against strong changes of the stimulus position. The model was tested with several stimuli from the neurophysiological literature and reproduces, partially even quantitatively, results about action-selective neurons in the STS and premotor cortex. Specifically, the model reproduces visual tuning properties and the view-dependence of mirror neurons in premotor cortex and makes additional predictions, which can be easily tested in electrophysiological experiments.

Authors: Giese, Martin A.; Caggiano, Vittorio Casile, Antonino Fleischer, Falk
Research Areas: Uncategorized
Type of Publication: In Collection
Fleischer, F., Casile, A. & Giese, M. A (2009). Invariant recognition of goal-directed hand actions: a physiologically plausible neural model Perception 38 ECVP Abstract Supplement, 51.
Invariant recognition of goal-directed hand actions: a physiologically plausible neural model
Abstract:

Invariant recognition of goal-directed hand actions: a physiologically plausible neural model The recognition of transitive, goal-directed actions requires highly selective processing of shape details of effector and goal object, and high robustness with respect to image transformations at the same time. The neural mechanisms required for solving this challenging recognition task remain largely unknown. We propose a neurophysiologically-inspired model for the recognition of transitive grasping actions, which combines high selectivity for different grips with strong position invariance. The model is based on well-established physiologically plausible simple neural mechanisms. Invariance is accomplished by combining nonlinear pooling (by maximum operations) and a specific neural representation of the relative position of object and effector based on a gain-field like mechanism. The proposed architecture accomplishes accurate recognition of different grip types on real video data and reproduces correctly several properties of action-selective neurons in occipital, parietal and premotor areas. In addition, the model shows that the accurate recognition of goal-directed actions can be accomplished without an explicit reconstruction of the 3-D structure of effectors and objects, as assumed in many technical systems for the recognitions of hand actions.

Authors: Fleischer, Falk Casile, Antonino Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Christensen, A., Ilg, W., Karnath, H. O. & Giese, M. A (2009). Temporal Synchrony as Critical Factor for Faciliation and Interference of Action Recognition In: GNS Congress, Goettingen, Germany.
Temporal Synchrony as Critical Factor for Faciliation and Interference of Action Recognition
Authors: Christensen, Andrea Ilg, Winfried; Karnath, H. O. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Jastorff, J., Kourtzi, Z. & Giese, M. A. (2009). Visual learning shapes the processing of complex movement stimuli in the human brain. Journal of Neuroscience, Vol. 29 No. 44, pp. 14026-38.
Visual learning shapes the processing of complex movement stimuli in the human brain
Authors: Jastorff, J. Kourtzi, Zoe Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Giese, M. A., Mukovskiy, A., Park, A.-N., Omlor, L. & Slotine, J.-J. (2009). Real-Time Synthesis of Body Movements Based on Learned Primitives. In Cremers D, Rosenhahn B, Yuille A L (eds): Statistical and Geometrical Approaches to Visual Motion Analysis, Lecture Notes in Computer Science, 5604, 107-127.
Real-Time Synthesis of Body Movements Based on Learned Primitives
Authors: Giese, Martin A.; Mukovskiy, Albert; Park, Aee-Ni Omlor, Lars Slotine, Jean-Jacques E.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Christensen, A., Ilg, W., Karnath, H. O. & Giese, M. A (2009). Influence of spatial and temporal congruency between executed and observed movements of the recognition of biological motion Journal of Vision, 9(8), 614.
Influence of spatial and temporal congruency between executed and observed movements of the recognition of biological motion
Authors: Christensen, Andrea Ilg, Winfried; Karnath, H. O. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Endres, D. & Giese, M. A. (2009). Temporal Segmentation with Bayesian Binning. NIPS 2009 workshop on temporal segmentation.
Temporal Segmentation with Bayesian Binning
Abstract:

Bayesian Binning (BB) is an exact inference technique which was originally developed for applications in Computational Neuroscience, e.g. modeling spike count distributions or estimating peri-stimulus time histograms (PSTH). BB encodes a (conditional) probability distribution (or density) which is piecewise constant in the domain of interest. This suggests that BB might be useful for retrospective temporal segmentation tasks, too. We illustrate the potential usefulness of BB for temporal segmentation on two examples. First, we segment neural spike train data, demonstrating that BB is able to locate change points in the PSTH correctly. Second, we employ BB for (human) action sequence segmentation. We show that BB accurately identifies the transition points in the action sequence (e.g. a change from ’walking’ to ’jumping’).

Authors: Endres, Dominik Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Christensen, A., Ilg, W., Karnath, H. O. & Giese, M. A (2009). Specific influences of self-motion on the detection of biological motion Perception 38 ECVP Abstract Supplement, page: 85..
Specific influences of self-motion on the detection of biological motion
Authors: Christensen, Andrea Ilg, Winfried; Karnath, H. O. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Barliya, A., Omlor, L., Giese, M. A. & Flash, T. (2009). An analytical formulation of the law of intersegmental coordination during human locomotion. Experimental Brain Research, 193(3), 371-385.
An analytical formulation of the law of intersegmental coordination during human locomotion
Authors: Barliya, Avi Omlor, Lars Giese, Martin A.; Flash, Tamar
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Endres, D. & Földiák, P. (2009). Interpreting the Neural Code with Formal Concept Analysis. Advances in Neural Information Processing Systems, 21, 425-432.
Interpreting the Neural Code with Formal Concept Analysis
Abstract:

We propose a novel application of Formal Concept Analysis (FCA) to neural decoding: instead of just trying to figure out which stimulus was presented, we demonstrate how to explore the semantic relationships in the neural representation of large sets of stimuli. FCA provides a way of displaying and interpreting such relationships via concept lattices. We explore the effects of neural code sparsity on the lattice. We then analyze neurophysiological data from high-level visual cortical area STSa, using an exact Bayesian approach to construct the formal context needed by FCA. Prominent features of the resulting concept lattices are discussed, including hierarchical face representation and indications for a product-of-experts code in real neurons.

Authors: Endres, Dominik Földiák, Peter
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Giese, M. A., Ilg, W., Golla, H. & Thier, P. (2009). System und Verfahren zum Bestimmen einer Bewegungskategorie sowie deren Ausprägungsgrad. Patent No. 10 2004 060 602.1-35. Deutsches Patentamt, M\"unchen.
System und Verfahren zum Bestimmen einer Bewegungskategorie sowie deren Ausprägungsgrad
Authors: Giese, Martin A.; Ilg, Winfried; Golla, Heidrun Thier, Peter
Research Areas: Uncategorized
Type of Publication: Patent
Patent number: 10 2004 060 602.1-35
Filing date: 0000-00-00
Issue date: 0000-00-00
Filing date: 0000-00-00
Issue date: 0000-00-00
Roether, C. L., Omlor, L. & Giese, M. A. (2009). Features in the Recognition of Emotions from Dynamic Bodily Expression. In: Mason G. , Ilg U.J. (eds): Dynamics of Visual Motion Processing: Neuronal, Behavioral and Computational Approaches, 3, 313-340.
Features in the Recognition of Emotions from Dynamic Bodily Expression
Authors: Roether, C. L. Omlor, Lars Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Endres, D., Priss, U. & Földiák, P (2009). Interpreting the Neural Code with Formal Concept Analysis Perception 38 ECVP Abstract Supplement, page 127.
Interpreting the Neural Code with Formal Concept Analysis
Authors: Endres, Dominik Priss, Uta Földiák, Peter
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Endres, D., Földiák, P. & Priss, U. (2009). An Application of Formal Concept Analysis to Neural Decoding. The 6th international conference on Concept Lattices and their Applications (CLA 2008), Olomouc, Czech Republic., CEUR-WS, 433, 181-192.
An Application of Formal Concept Analysis to Neural Decoding
Abstract:

This paper proposes a novel application of Formal Concept Analysis (FCA) to neural decoding: the semantic relationships between the neural representations of large sets of stimuli are explored using concept lattices. In particular, the effects of neural code sparsity are modelled using the lattices. An exact Bayesian approach is employed to construct the formal context needed by FCA. This method is explained using an example of neurophysiological data from the high-level visual cortical area STSa. Prominent features of the resulting concept lattices are discussed, including indications for a product-of-experts code in real neurons.

Authors: Endres, Dominik Földiák, Peter Priss, Uta
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Fleischer, F., Casile, A. & Giese, M. A. (2009). Bio-inspired approach for the recognition of goal-directed hand actions. In X. Jiang and N. Petkov (Eds.): Int. Conf. on Computer Analysis of Images and Patterns (CAIP) 2009, LNCS, 5702, 714-722.
Bio-inspired approach for the recognition of goal-directed hand actions
Authors: Fleischer, Falk Casile, Antonino Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Fleischer, F., Casile, A. & Giese, M. A. (2009). View-independent recognition of grasping actions with cortex-inspired model. 9th IEEE-RAS Int Conf on Humanoid Robots (Humanoids) 2009, Paris, France, 514-519.
View-independent recognition of grasping actions with cortex-inspired model
Authors: Fleischer, Falk Casile, Antonino Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Park, A.-N., Mukovskiy, A., Slotine, J.-J. & Giese, M. A. (2009). Design of dynamical stability properties in character animation. In: The 6th Workshop on Virtual Reality Interaction and Physical Simulation. ,VRIPHYS 09, Nov 5-6, Karlsruhe,Germany, 85-94.
Design of dynamical stability properties in character animation
Authors: Park, Aee-Ni Mukovskiy, Albert; Slotine, Jean-Jacques E. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Roether, C. L., Omlor, L., Christensen, A. & Giese, M. A. (2009). Critical features for the perception of emotion from gait. Journal of Vision, 9(6), 1-32.
Critical features for the perception of emotion from gait
Authors: Roether, C. L. Omlor, Lars Christensen, Andrea Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version
Timmann, D., Konczak, J., Ilg, W., Donchin, O., Hermsdörfer, J., Gizewski, E. R. et al. (2009). Current advances in lesion-symptom mapping of the human cerebellum. Neuroscience, 162(3), 836-851.
Current advances in lesion-symptom mapping of the human cerebellum
Authors: Timmann, Dagmar Konczak, J\"urgen Ilg, Winfried; Donchin, Opher Hermsdörfer, J. Gizewski, Elke R. Schoch, Beate
Research Areas: Uncategorized
Type of Publication: Article
Omlor, L. & Slotine, J.-J. (2009). Continuous Non-Negative Matrix Factorization For Time-Dependent Data. In Proceedings of the European Signal Processing Conference , Glasgow, UK, 2009.
Continuous Non-Negative Matrix Factorization For Time-Dependent Data
Authors: Omlor, Lars Slotine, Jean-Jacques E.
Research Areas: Uncategorized
Type of Publication: Article
Full text: Online version

Year: 2008

Benali, A., Weiler, E., Benali, Y., Dinse, H. R. & Eysel, U. T. (2008). Excitation and inhibition jointly regulate cortical reorganization in adult rats. J Neurosci, 28, 12284-12293.
Excitation and inhibition jointly regulate cortical reorganization in adult rats
Authors: Benali, Alia; Weiler, E Benali, Y Dinse, H. R Eysel, U. T
Type of Publication: Article
Christensen, A., Ilg, W., Karnath, H. O. & Giese, M. A (2008). Faciliation of action recognition by motor programs is critically dependent on timing Perception 37 ECVP Abstract Supplement. page: 25 (TRAVEL AWARD).
Faciliation of action recognition by motor programs is critically dependent on timing
Authors: Christensen, Andrea Ilg, Winfried; Karnath, H. O. Giese, Martin A.
Research Areas: Uncategorized
Type of Publication: In Collection
Full text: Online version
Endres, D., Oram, M., Schindelin, J. & Földiák, P. (2008). Bayesian Binning Beats Approximate Alternatives: Estimating Peri-stimulus Time Histograms. Advances in Neural Information Processing Systems, 20, 393-400.
Bayesian Binning Beats Approximate Alternatives: Estimating Peri-stimulus Time Histograms
Authors: Endres, Dominik Oram, Mike Schindelin, Johannes Földiák, Peter
Research Areas: Uncategorized
Type of Publication: Article
Full text: PDF | Online version

Information

All images and videos displayed on this webpage are protected by copyright law. These copyrights are owned by Computational Sensomotorics.

If you wish to use any of the content featured on this webpage for purposes other than personal viewing, please contact us for permission.

Social Media

We use cookies

We use cookies on our website. Some of them are essential for the operation of the site, while others help us to improve this site and the user experience (tracking cookies). You can decide for yourself whether you want to allow cookies or not. Please note that if you reject them, you may not be able to use all the functionalities of the site.