TY - GEN
T1 - Cooking gesture recognition using local feature and depth image
AU - Ji, Yanli
AU - Ko, Yoshiyasu
AU - Shimada, Atsushi
AU - Nagahara, Hajime
AU - Taniguchi, Rin ichiro
PY - 2012
Y1 - 2012
N2 - In this paper, we propose a method combining visual local features and depth image information to recognize cooking gestures. We employ the feature calculation method [2] which used extended FAST detector and a compact descriptor CHOG3D to calculate visual local features. We pack the local features by BoW in frame sequences to represent the cooking gestures. In addition, the depth images of hands gestures are extracted and integrated spatio-temporally to represent the position and trajectory information of cooking gestures. The two kinds of features are used to describe cooking gestures, and recognition is realized by employing the SVM. In our method, we determine the gesture class for each frame in cooking sequences. By analyzing the results of frames, we recognize cooking gestures in a continue frame sequences of cooking menus, and find the temporal positions of the recognized gestures.
AB - In this paper, we propose a method combining visual local features and depth image information to recognize cooking gestures. We employ the feature calculation method [2] which used extended FAST detector and a compact descriptor CHOG3D to calculate visual local features. We pack the local features by BoW in frame sequences to represent the cooking gestures. In addition, the depth images of hands gestures are extracted and integrated spatio-temporally to represent the position and trajectory information of cooking gestures. The two kinds of features are used to describe cooking gestures, and recognition is realized by employing the SVM. In our method, we determine the gesture class for each frame in cooking sequences. By analyzing the results of frames, we recognize cooking gestures in a continue frame sequences of cooking menus, and find the temporal positions of the recognized gestures.
UR - http://www.scopus.com/inward/record.url?scp=84870484052&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84870484052&partnerID=8YFLogxK
U2 - 10.1145/2390776.2390785
DO - 10.1145/2390776.2390785
M3 - Conference contribution
AN - SCOPUS:84870484052
SN - 9781450315920
T3 - CEA 2012 - Proceedings of the 2012 ACM Workshop on Multimedia for Cooking and Eating Activities, Co-located with ACM Multimedia 2012
SP - 37
EP - 42
BT - CEA 2012 - Proceedings of the 2012 ACM Workshop on Multimedia for Cooking and Eating Activities, Co-located with ACM Multimedia 2012
T2 - ACM Multimedia 2012 4th Workshop on Multimedia for Cooking and Eating Activities, CEA 2012
Y2 - 2 November 2012 through 2 November 2012
ER -