Gesture recognition based on spatiotemporal histogram of oriented gradient variation

Seiji Kojima, Wataru Oyama, Tetsushi Wakabayashi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

A fine-grained gesture recognition method based on spatiotemporal representation for cooking activities is proposed. Cooking is one of common housework activity in daily life. Supporting cooking using video-based gesture recognition can contribute to improve our quality of life. A cooking gesture recognition method which employs a spatiotemporal representation for both appearance of a cooker and surrounding kitchen utensils. Our proposed method employs Spatio-Temporal extension of Histogram of Oriented Gradient Variation (ST-HOGV) which can represent not only appearance and temporal change of independent objects but locations of these objects. Performance evaluation experiment using ACE dataset shows that recognition accuracy of 76.4% is obtained and the KSCGR evaluation score achieves 73.5%. While the proposed method does not require any a priori knowledge, the performance is comparative other gesture recognition method with a priori knowledge.

Original languageEnglish
Title of host publication2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-4
Number of pages4
ISBN (Electronic)9781538610220
DOIs
Publication statusPublished - Apr 16 2018
Event6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017 - Himeji, Japan
Duration: Sep 1 2017Sep 3 2017

Publication series

Name2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017
Volume2018-January

Other

Other6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017
CountryJapan
CityHimeji
Period9/1/179/3/17

Fingerprint

Gesture recognition
Gestures
Cooking
Kitchens
Housekeeping
Quality of Life
Experiments

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Information Systems
  • Biomedical Engineering
  • Media Technology
  • Health Informatics

Cite this

Kojima, S., Oyama, W., & Wakabayashi, T. (2018). Gesture recognition based on spatiotemporal histogram of oriented gradient variation. In 2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017 (pp. 1-4). [8338581] (2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017; Vol. 2018-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICIEV.2017.8338581

Gesture recognition based on spatiotemporal histogram of oriented gradient variation. / Kojima, Seiji; Oyama, Wataru; Wakabayashi, Tetsushi.

2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017. Institute of Electrical and Electronics Engineers Inc., 2018. p. 1-4 8338581 (2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017; Vol. 2018-January).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kojima, S, Oyama, W & Wakabayashi, T 2018, Gesture recognition based on spatiotemporal histogram of oriented gradient variation. in 2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017., 8338581, 2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017, vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 1-4, 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017, Himeji, Japan, 9/1/17. https://doi.org/10.1109/ICIEV.2017.8338581
Kojima S, Oyama W, Wakabayashi T. Gesture recognition based on spatiotemporal histogram of oriented gradient variation. In 2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1-4. 8338581. (2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017). https://doi.org/10.1109/ICIEV.2017.8338581
Kojima, Seiji ; Oyama, Wataru ; Wakabayashi, Tetsushi. / Gesture recognition based on spatiotemporal histogram of oriented gradient variation. 2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1-4 (2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017).
@inproceedings{25bacc6d477b4d2ca1621905d1e21041,
title = "Gesture recognition based on spatiotemporal histogram of oriented gradient variation",
abstract = "A fine-grained gesture recognition method based on spatiotemporal representation for cooking activities is proposed. Cooking is one of common housework activity in daily life. Supporting cooking using video-based gesture recognition can contribute to improve our quality of life. A cooking gesture recognition method which employs a spatiotemporal representation for both appearance of a cooker and surrounding kitchen utensils. Our proposed method employs Spatio-Temporal extension of Histogram of Oriented Gradient Variation (ST-HOGV) which can represent not only appearance and temporal change of independent objects but locations of these objects. Performance evaluation experiment using ACE dataset shows that recognition accuracy of 76.4{\%} is obtained and the KSCGR evaluation score achieves 73.5{\%}. While the proposed method does not require any a priori knowledge, the performance is comparative other gesture recognition method with a priori knowledge.",
author = "Seiji Kojima and Wataru Oyama and Tetsushi Wakabayashi",
year = "2018",
month = "4",
day = "16",
doi = "10.1109/ICIEV.2017.8338581",
language = "English",
series = "2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1--4",
booktitle = "2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017",
address = "United States",

}

TY - GEN

T1 - Gesture recognition based on spatiotemporal histogram of oriented gradient variation

AU - Kojima, Seiji

AU - Oyama, Wataru

AU - Wakabayashi, Tetsushi

PY - 2018/4/16

Y1 - 2018/4/16

N2 - A fine-grained gesture recognition method based on spatiotemporal representation for cooking activities is proposed. Cooking is one of common housework activity in daily life. Supporting cooking using video-based gesture recognition can contribute to improve our quality of life. A cooking gesture recognition method which employs a spatiotemporal representation for both appearance of a cooker and surrounding kitchen utensils. Our proposed method employs Spatio-Temporal extension of Histogram of Oriented Gradient Variation (ST-HOGV) which can represent not only appearance and temporal change of independent objects but locations of these objects. Performance evaluation experiment using ACE dataset shows that recognition accuracy of 76.4% is obtained and the KSCGR evaluation score achieves 73.5%. While the proposed method does not require any a priori knowledge, the performance is comparative other gesture recognition method with a priori knowledge.

AB - A fine-grained gesture recognition method based on spatiotemporal representation for cooking activities is proposed. Cooking is one of common housework activity in daily life. Supporting cooking using video-based gesture recognition can contribute to improve our quality of life. A cooking gesture recognition method which employs a spatiotemporal representation for both appearance of a cooker and surrounding kitchen utensils. Our proposed method employs Spatio-Temporal extension of Histogram of Oriented Gradient Variation (ST-HOGV) which can represent not only appearance and temporal change of independent objects but locations of these objects. Performance evaluation experiment using ACE dataset shows that recognition accuracy of 76.4% is obtained and the KSCGR evaluation score achieves 73.5%. While the proposed method does not require any a priori knowledge, the performance is comparative other gesture recognition method with a priori knowledge.

UR - http://www.scopus.com/inward/record.url?scp=85051118758&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051118758&partnerID=8YFLogxK

U2 - 10.1109/ICIEV.2017.8338581

DO - 10.1109/ICIEV.2017.8338581

M3 - Conference contribution

T3 - 2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017

SP - 1

EP - 4

BT - 2017 6th International Conference on Informatics, Electronics and Vision and 2017 7th International Symposium in Computational Medical and Health Technology, ICIEV-ISCMHT 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -