Spatiotemporal auto-correlation of grayscale gradient with importance map for cooking gesture recognition

Wataru Ohyama, Soichiro Hotta, Tetsushi Wakabayashi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a gesture recognition method employing spatiotemporal auto-correlation of grayscale gradient for image sequences capturing cooking activities. Recognizing gestures in housework activities is a key technology for realizing sophisticated household devices, energy saving as well as supporting elder or handicapped people. The proposed method employs Cubic Gradient Local Auto Correlation (Cubic GLAC) to describe shape of objects and its temporal change in a video sequence. Human gestures are able to be recognized by not only appearance and motion but environmental objects. Actually, cooking gestures also have strong relationship to surrounding kitchen utensils. To utilize this observation for gesture recognition, we introduce the importance map that restricts regions of interest for recognition. Support vector machine with linear kernel is employed to classify the extracted feature among 10 gesture classes. Performance evaluation experiment using "Actions for Cooking Eggs (ACE)" Dataset, which is an open dataset for context-based gesture recognition, shows that the proposed method outperforms recognition methods using similar spatiotemporal features.

Original languageEnglish
Title of host publicationProceedings - 3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages166-170
Number of pages5
ISBN (Electronic)9781479961009
DOIs
Publication statusPublished - Jun 7 2016
Event3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015 - Kuala Lumpur, Malaysia
Duration: Nov 3 2016Nov 6 2016

Publication series

NameProceedings - 3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015

Other

Other3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015
CountryMalaysia
CityKuala Lumpur
Period11/3/1611/6/16

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Spatiotemporal auto-correlation of grayscale gradient with importance map for cooking gesture recognition'. Together they form a unique fingerprint.

  • Cite this

    Ohyama, W., Hotta, S., & Wakabayashi, T. (2016). Spatiotemporal auto-correlation of grayscale gradient with importance map for cooking gesture recognition. In Proceedings - 3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015 (pp. 166-170). [7486487] (Proceedings - 3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ACPR.2015.7486487