Temporal segmentation of action streams

Research Area

Neural and Computational Principles of Action and Social Processing

Description

 

Movement primitives are usually assumed to extend over short temporal segments only, which begets the question of how these segments can be identified or defined. We developed  a motion segmentation algorithm based on Bayesian Binning. For this algorithm, we devised an observation model for each segment which encodes continuously varying functions. This new model predicts Gaussian-distributed observations with a mean that has a polynomial time dependence, and each segment has its own covariance matrix. The parameters of this observation model are learned with exact conjugate Gauss-Wishart posterior updates. We chose the polynomial time dependence, because in addition to the classic  power laws, certain human movements were shown to be well-captured by optimization models that maximize the smoothness of the trajectories. This can be mathematically expressed by the minimization of integrated jerk or by other time derivatives of position, e.g., acceleration, or snap, crackle etc. Such models imply that the trajectories will be well captured by polynomials of orders 3 (acceleration), 5 (jerk) and 7 (snap).

Information

All images and videos displayed on this webpage are protected by copyright law. These copyrights are owned by Computational Sensomotorics.

If you wish to use any of the content featured on this webpage for purposes other than personal viewing, please contact us for permission.

Social Media

We use cookies

We use cookies on our website. Some of them are essential for the operation of the site, while others help us to improve this site and the user experience (tracking cookies). You can decide for yourself whether you want to allow cookies or not. Please note that if you reject them, you may not be able to use all the functionalities of the site.