Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamics

Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamics

Yongyi Tang, Lin Ma, Wei Liu, Wei-Shi Zheng

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
Main track. Pages 935-941. https://doi.org/10.24963/ijcai.2018/130

Human motion prediction aims at generating future frames of human motion based on an observed sequence of skeletons. Recent methods employ the latest hidden states of a recurrent neural network (RNN) to encode the historical skeletons, which can only address short-term prediction. In this work, we propose a motion context modeling by summarizing the historical human motion with respect to the current prediction. A modified highway unit (MHU) is proposed for efficiently eliminating motionless joints and estimating next pose given the motion context. Furthermore, we enhance the motion dynamic by minimizing the gram matrix loss for long-term motion prediction. Experimental results show that the proposed model can promisingly forecast the human future movements, which yields superior performances over related state-of-the-art approaches. Moreover, specifying the motion context with the activity labels enables our model to perform human motion transfer.
Keywords:
Computer Vision: Motion and Tracking
Computer Vision: Video: Events, Activities and Surveillance