Temporal segmentation of action streams

  

Description:

 

Movement primitives are usually assumed to extend over short temporal segments only, which begets the question of how these segments can be identified or defined. We developed  a motion segmentation algorithm based on Bayesian Binning. For this algorithm, we devised an observation model for each segment which encodes continuously varying functions. This new model predicts Gaussian-distributed observations with a mean that has a polynomial time dependence, and each segment has its own covariance matrix. The parameters of this observation model are learned with exact conjugate Gauss-Wishart posterior updates. We chose the polynomial time dependence, because in addition to the classic  power laws, certain human movements were shown to be well-captured by optimization models that maximize the smoothness of the trajectories. This can be mathematically expressed by the minimization of integrated jerk or by other time derivatives of position, e.g., acceleration, or snap, crackle etc. Such models imply that the trajectories will be well captured by polynomials of orders 3 (acceleration), 5 (jerk) and 7 (snap).

Publications

Endres, D., Christensen, A., Omlor, L. & Giese, M. A. (2011). Segmentation of Action Streams: Human Observers vs. Bayesian Binning. KI 2011: Advances in Artificial Intelligence, LNAI 7006, Springer, BEST APPLIED PAPER AWARD, 75, 8. [More] 
Endres, D., Christensen, A., Omlor, L. & Giese, M. A. (2011). Emulating Human Observers with Bayesian Binning: Segmentation of Action Streams. ACM Transactions on Applied Perception (TAP), 8(3), 16:1-12. [More] 
Endres, D., Beck, T., Bouecke, J. D., Omlor, L., Neumann, H. & Giese, M. A (2010). Segmentation of Action Streams: Comparison between Human and Statistically Optimal Performance Vision Sciences Society Congress, VSS 2010 and Journal of Vision, vol. 10 no. 7 article 807, 2010.. [More] 
Endres, D. & Giese, M. A. (2009). Temporal Segmentation with Bayesian Binning. NIPS 2009 workshop on temporal segmentation. [More]