Developing a face monitoring robot for a desk worker

Ryosuke Kondo, Yutaka Deguchi, Einoshin Suzuki

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

We have developed an autonomous mobile robot which monitors the face of a desk worker. The robot uses three kinds of information observed with its Kinect to search for the desk worker and adjusts its position for monitoring. The monitoring is based on incremental clustering of the faces. Our experiments revealed that not only Animation Units (AUs) features, which represent deviations from the neutral face, but also the pitch angle of the face normalized in a new way are necessary for a valid clustering under specific conditions. Our robot lost sight of a desk worker only once in experiments for 8 persons for about 50 minutes. The resulting clusters correspond to "yawning", "smiling", and "reading" for a half of the desk workers with high NMI (normalized mutual information), which is an evaluation measure often used in clustering.

Original languageEnglish
Pages (from-to)226-241
Number of pages16
JournalLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8850
DOIs
Publication statusPublished - Jan 1 2014

Fingerprint

Robot
Face
Robots
Monitoring
Clustering
Animation
Mobile robots
Experiments
Observed Information
Autonomous Mobile Robot
Mutual Information
Experiment
Person
Monitor
Deviation
Valid
Angle
Unit
Necessary
Evaluation

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

@article{18c2007852de4dc1a7d673aa5eab08da,
title = "Developing a face monitoring robot for a desk worker",
abstract = "We have developed an autonomous mobile robot which monitors the face of a desk worker. The robot uses three kinds of information observed with its Kinect to search for the desk worker and adjusts its position for monitoring. The monitoring is based on incremental clustering of the faces. Our experiments revealed that not only Animation Units (AUs) features, which represent deviations from the neutral face, but also the pitch angle of the face normalized in a new way are necessary for a valid clustering under specific conditions. Our robot lost sight of a desk worker only once in experiments for 8 persons for about 50 minutes. The resulting clusters correspond to {"}yawning{"}, {"}smiling{"}, and {"}reading{"} for a half of the desk workers with high NMI (normalized mutual information), which is an evaluation measure often used in clustering.",
author = "Ryosuke Kondo and Yutaka Deguchi and Einoshin Suzuki",
year = "2014",
month = "1",
day = "1",
doi = "10.1007/978-3-319-14112-1_19",
language = "English",
volume = "8850",
pages = "226--241",
journal = "Lecture Notes in Computer Science",
issn = "0302-9743",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - Developing a face monitoring robot for a desk worker

AU - Kondo, Ryosuke

AU - Deguchi, Yutaka

AU - Suzuki, Einoshin

PY - 2014/1/1

Y1 - 2014/1/1

N2 - We have developed an autonomous mobile robot which monitors the face of a desk worker. The robot uses three kinds of information observed with its Kinect to search for the desk worker and adjusts its position for monitoring. The monitoring is based on incremental clustering of the faces. Our experiments revealed that not only Animation Units (AUs) features, which represent deviations from the neutral face, but also the pitch angle of the face normalized in a new way are necessary for a valid clustering under specific conditions. Our robot lost sight of a desk worker only once in experiments for 8 persons for about 50 minutes. The resulting clusters correspond to "yawning", "smiling", and "reading" for a half of the desk workers with high NMI (normalized mutual information), which is an evaluation measure often used in clustering.

AB - We have developed an autonomous mobile robot which monitors the face of a desk worker. The robot uses three kinds of information observed with its Kinect to search for the desk worker and adjusts its position for monitoring. The monitoring is based on incremental clustering of the faces. Our experiments revealed that not only Animation Units (AUs) features, which represent deviations from the neutral face, but also the pitch angle of the face normalized in a new way are necessary for a valid clustering under specific conditions. Our robot lost sight of a desk worker only once in experiments for 8 persons for about 50 minutes. The resulting clusters correspond to "yawning", "smiling", and "reading" for a half of the desk workers with high NMI (normalized mutual information), which is an evaluation measure often used in clustering.

UR - http://www.scopus.com/inward/record.url?scp=84952712936&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84952712936&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-14112-1_19

DO - 10.1007/978-3-319-14112-1_19

M3 - Article

AN - SCOPUS:84952712936

VL - 8850

SP - 226

EP - 241

JO - Lecture Notes in Computer Science

JF - Lecture Notes in Computer Science

SN - 0302-9743

ER -