Classification of spectators' state in video sequences by voting of facial expressions and face directions

Tetsu Matsukawa, Akinori Hidaka, Takio Kurita

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, we proposed a classification method of spectators' state in video sequences by voting of facial expressions and face directions. The task of this paper is to classify the state of the spectators in a given video sequence into "Positive Scene" or "Negative Scene", and "Watching Seriously" or "Not Watching Seriously". The proposed classifier is designed by a "bag-of-visual-words" approach based on face recognitions. First, the multiview (left-profile, front, rightprofile) faces are detected from each image in the given video sequence. Then the detected faces are classified into the two expressions, smile or not smile. The classification results of the face directions and the facial expressions are voted to each classes' histogram over the video sequence. Finally, the state of the spectators is classified by using the kernel SVM on the voted histograms. We conducted experiments using spectators' video sequences captured from TV. Our approach demonstrated promising results for classifications of "Positive Scene" and "Negative Scene" or "Watching Seriously" and "Not Watching Seriously". It was also ascertained that the facial expression is important in the classification of "Positive" and "Negative". On the other hand, face direction is important to classify whether the spectators are "Watching Seriously" or "Not".

Original languageEnglish
Title of host publicationProceedings of the 11th IAPR Conference on Machine Vision Applications, MVA 2009
Pages426-430
Number of pages5
Publication statusPublished - Dec 1 2009
Externally publishedYes
Event11th IAPR Conference on Machine Vision Applications, MVA 2009 - Yokohama, Japan
Duration: May 20 2009May 22 2009

Publication series

NameProceedings of the 11th IAPR Conference on Machine Vision Applications, MVA 2009

Other

Other11th IAPR Conference on Machine Vision Applications, MVA 2009
CountryJapan
CityYokohama
Period5/20/095/22/09

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Classification of spectators' state in video sequences by voting of facial expressions and face directions'. Together they form a unique fingerprint.

Cite this