Cooking gesture recognition using local feature and depth image

Yanli Ji, Yoshiyasu Ko, Atsushi Shimada, Hajime Nagahara, Rin-Ichiro Taniguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

In this paper, we propose a method combining visual local features and depth image information to recognize cooking gestures. We employ the feature calculation method [2] which used extended FAST detector and a compact descriptor CHOG3D to calculate visual local features. We pack the local features by BoW in frame sequences to represent the cooking gestures. In addition, the depth images of hands gestures are extracted and integrated spatio-temporally to represent the position and trajectory information of cooking gestures. The two kinds of features are used to describe cooking gestures, and recognition is realized by employing the SVM. In our method, we determine the gesture class for each frame in cooking sequences. By analyzing the results of frames, we recognize cooking gestures in a continue frame sequences of cooking menus, and find the temporal positions of the recognized gestures.

Original languageEnglish
Title of host publicationCEA 2012 - Proceedings of the 2012 ACM Workshop on Multimedia for Cooking and Eating Activities, Co-located with ACM Multimedia 2012
Pages37-42
Number of pages6
DOIs
Publication statusPublished - 2012
EventACM Multimedia 2012 4th Workshop on Multimedia for Cooking and Eating Activities, CEA 2012 - Nara, Japan
Duration: Nov 2 2012Nov 2 2012

Other

OtherACM Multimedia 2012 4th Workshop on Multimedia for Cooking and Eating Activities, CEA 2012
CountryJapan
CityNara
Period11/2/1211/2/12

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Cooking gesture recognition using local feature and depth image'. Together they form a unique fingerprint.

  • Cite this

    Ji, Y., Ko, Y., Shimada, A., Nagahara, H., & Taniguchi, R-I. (2012). Cooking gesture recognition using local feature and depth image. In CEA 2012 - Proceedings of the 2012 ACM Workshop on Multimedia for Cooking and Eating Activities, Co-located with ACM Multimedia 2012 (pp. 37-42) https://doi.org/10.1145/2390776.2390785