Head pose estimation and movement analysis for speech scene

Rinko Komiya, Takeshi Saitoh, Miharu Fuyuno, Yuko Yamashita, Yoshitaka Nakajima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

Original languageEnglish
Title of host publication2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings
EditorsKuniaki Uehara, Masahide Nakamura
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509008063
DOIs
Publication statusPublished - Aug 23 2016
Event15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016 - Okayama, Japan
Duration: Jun 26 2016Jun 29 2016

Publication series

Name2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

Other

Other15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016
CountryJapan
CityOkayama
Period6/26/166/29/16

Fingerprint

Pose Estimation
Motion Analysis
Range of data
Contact
Motion
Speech
Movement
Motion analysis
Evaluate
Skills

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Energy Engineering and Power Technology
  • Control and Optimization

Cite this

Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., & Nakajima, Y. (2016). Head pose estimation and movement analysis for speech scene. In K. Uehara, & M. Nakamura (Eds.), 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings [7550793] (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICIS.2016.7550793

Head pose estimation and movement analysis for speech scene. / Komiya, Rinko; Saitoh, Takeshi; Fuyuno, Miharu; Yamashita, Yuko; Nakajima, Yoshitaka.

2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. ed. / Kuniaki Uehara; Masahide Nakamura. Institute of Electrical and Electronics Engineers Inc., 2016. 7550793 (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Komiya, R, Saitoh, T, Fuyuno, M, Yamashita, Y & Nakajima, Y 2016, Head pose estimation and movement analysis for speech scene. in K Uehara & M Nakamura (eds), 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings., 7550793, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016, Okayama, Japan, 6/26/16. https://doi.org/10.1109/ICIS.2016.7550793
Komiya R, Saitoh T, Fuyuno M, Yamashita Y, Nakajima Y. Head pose estimation and movement analysis for speech scene. In Uehara K, Nakamura M, editors, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2016. 7550793. (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings). https://doi.org/10.1109/ICIS.2016.7550793
Komiya, Rinko ; Saitoh, Takeshi ; Fuyuno, Miharu ; Yamashita, Yuko ; Nakajima, Yoshitaka. / Head pose estimation and movement analysis for speech scene. 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings. editor / Kuniaki Uehara ; Masahide Nakamura. Institute of Electrical and Electronics Engineers Inc., 2016. (2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings).
@inproceedings{7a3dca4de5f74900b8e6a2e3940dc5cb,
title = "Head pose estimation and movement analysis for speech scene",
abstract = "Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.",
author = "Rinko Komiya and Takeshi Saitoh and Miharu Fuyuno and Yuko Yamashita and Yoshitaka Nakajima",
year = "2016",
month = "8",
day = "23",
doi = "10.1109/ICIS.2016.7550793",
language = "English",
series = "2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
editor = "Kuniaki Uehara and Masahide Nakamura",
booktitle = "2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings",
address = "United States",

}

TY - GEN

T1 - Head pose estimation and movement analysis for speech scene

AU - Komiya, Rinko

AU - Saitoh, Takeshi

AU - Fuyuno, Miharu

AU - Yamashita, Yuko

AU - Nakajima, Yoshitaka

PY - 2016/8/23

Y1 - 2016/8/23

N2 - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

AB - Public speaking is an essential skill for a large variety of professions and in everyday life. However, it is difficult to master the skills. This paper focuses on the automatic assessment of nonverbal facial behavior of public speaking and proposes simple and efficient method of head pose estimation and motion analysis. We collected nine speech scenes of the recitation contest in a Japanese high school, and applied the proposed method to evaluate the performance. As for the head pose estimation, our method was obtained acceptable accuracy for the speech scene. Proposed motion analysis method can be calculated frequencies and moving ranges of head motion. As the result, it was found that there is correlation between the moving range and eye contact score.

UR - http://www.scopus.com/inward/record.url?scp=84988019765&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988019765&partnerID=8YFLogxK

U2 - 10.1109/ICIS.2016.7550793

DO - 10.1109/ICIS.2016.7550793

M3 - Conference contribution

AN - SCOPUS:84988019765

T3 - 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

BT - 2016 IEEE/ACIS 15th International Conference on Computer and Information Science, ICIS 2016 - Proceedings

A2 - Uehara, Kuniaki

A2 - Nakamura, Masahide

PB - Institute of Electrical and Electronics Engineers Inc.

ER -