LSTM-based early recognition of motion patterns

Markus Weber, Marcus Liwicki, Didier Stricker, Christopher Scholzel, Seiichi Uchida

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

In this paper a method for Early Recognition (ER) of Motion Templates (MTs) is presented. We define ER as an algorithm to provide recognition results before a motion sequence is completed. In our experiments we apply Long Short-Term Memory (LSTM) and optimize the training for the task of recognizing the motion template as early as possible. The evaluation has shown that the recognition accuracy for a frame-by-frame classification the LSTM achieves a recognition accuracy of 88% if no training data of the person him/herself is included, and 92% if the training data also contains motion sequences of the person. Furthermore, the average earliness - the number of time frames it takes before the LSTM correctly classifies a motion pattern - is around 24.77 frames, which is less than a second with the used tracking technology, i.e., the Microsoft Kinect.

Original languageEnglish
Title of host publicationProceedings - International Conference on Pattern Recognition
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3552-3557
Number of pages6
ISBN (Electronic)9781479952083
DOIs
Publication statusPublished - Jan 1 2014
Event22nd International Conference on Pattern Recognition, ICPR 2014 - Stockholm, Sweden
Duration: Aug 24 2014Aug 28 2014

Other

Other22nd International Conference on Pattern Recognition, ICPR 2014
CountrySweden
CityStockholm
Period8/24/148/28/14

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'LSTM-based early recognition of motion patterns'. Together they form a unique fingerprint.

  • Cite this

    Weber, M., Liwicki, M., Stricker, D., Scholzel, C., & Uchida, S. (2014). LSTM-based early recognition of motion patterns. In Proceedings - International Conference on Pattern Recognition (pp. 3552-3557). [6977323] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICPR.2014.611