Marker-less facial motion capture based on the recognition of the parts

Yasuhiro Akagi, Ryo Furukawa, Ryusuke Sagawa, Koichi Ogawara, Hiroshi Kawasaki

Research output: Contribution to journalArticle

Abstract

In this paper, we propose a marker-less motion capture method for a human face. We detect the movement of a face as the deformation from the initial pose to other poses. In such cases, the non-rigid registration algorithms are commonly used to detect the movement of an object. However, since the features of the movement of a face vary in each facial part, it complicates the registration problem. In our method, we recognize the facial parts by using Random Forest algorithm to be simplified to solve the registration problem. Then, we classify the facial parts into five types: nose, mouth, eye, cheek and obstacle. And we define the feature vector of each point of the face by using Fast Point Feature Histograms and a normalized position. We train the Random Forest based on the feature vector to recognize the facial parts from an arbitrary point set data. After the recognition of the facial parts, we detect the movement of the each part by using a non-rigid registration algorithm. Finally, we combine the translations of the each point as the deformation of the face by using the deformation technique based on a Radial Basis Function. In our results, we show that the proposed method enable us to detect the motion of the face more accurately.

Original languageEnglish
Pages (from-to)1152-1158
Number of pages7
JournalSeimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering
Volume79
Issue number11
DOIs
Publication statusPublished - Jan 1 2013
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Mechanical Engineering

Cite this

Marker-less facial motion capture based on the recognition of the parts. / Akagi, Yasuhiro; Furukawa, Ryo; Sagawa, Ryusuke; Ogawara, Koichi; Kawasaki, Hiroshi.

In: Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering, Vol. 79, No. 11, 01.01.2013, p. 1152-1158.

Research output: Contribution to journalArticle

Akagi, Yasuhiro ; Furukawa, Ryo ; Sagawa, Ryusuke ; Ogawara, Koichi ; Kawasaki, Hiroshi. / Marker-less facial motion capture based on the recognition of the parts. In: Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering. 2013 ; Vol. 79, No. 11. pp. 1152-1158.
@article{fbf3a0a4b2a84a2eb6d410096d46e410,
title = "Marker-less facial motion capture based on the recognition of the parts",
abstract = "In this paper, we propose a marker-less motion capture method for a human face. We detect the movement of a face as the deformation from the initial pose to other poses. In such cases, the non-rigid registration algorithms are commonly used to detect the movement of an object. However, since the features of the movement of a face vary in each facial part, it complicates the registration problem. In our method, we recognize the facial parts by using Random Forest algorithm to be simplified to solve the registration problem. Then, we classify the facial parts into five types: nose, mouth, eye, cheek and obstacle. And we define the feature vector of each point of the face by using Fast Point Feature Histograms and a normalized position. We train the Random Forest based on the feature vector to recognize the facial parts from an arbitrary point set data. After the recognition of the facial parts, we detect the movement of the each part by using a non-rigid registration algorithm. Finally, we combine the translations of the each point as the deformation of the face by using the deformation technique based on a Radial Basis Function. In our results, we show that the proposed method enable us to detect the motion of the face more accurately.",
author = "Yasuhiro Akagi and Ryo Furukawa and Ryusuke Sagawa and Koichi Ogawara and Hiroshi Kawasaki",
year = "2013",
month = "1",
day = "1",
doi = "10.2493/jjspe.79.1152",
language = "English",
volume = "79",
pages = "1152--1158",
journal = "Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering",
issn = "0912-0289",
publisher = "Japan Society for Precision Engineering",
number = "11",

}

TY - JOUR

T1 - Marker-less facial motion capture based on the recognition of the parts

AU - Akagi, Yasuhiro

AU - Furukawa, Ryo

AU - Sagawa, Ryusuke

AU - Ogawara, Koichi

AU - Kawasaki, Hiroshi

PY - 2013/1/1

Y1 - 2013/1/1

N2 - In this paper, we propose a marker-less motion capture method for a human face. We detect the movement of a face as the deformation from the initial pose to other poses. In such cases, the non-rigid registration algorithms are commonly used to detect the movement of an object. However, since the features of the movement of a face vary in each facial part, it complicates the registration problem. In our method, we recognize the facial parts by using Random Forest algorithm to be simplified to solve the registration problem. Then, we classify the facial parts into five types: nose, mouth, eye, cheek and obstacle. And we define the feature vector of each point of the face by using Fast Point Feature Histograms and a normalized position. We train the Random Forest based on the feature vector to recognize the facial parts from an arbitrary point set data. After the recognition of the facial parts, we detect the movement of the each part by using a non-rigid registration algorithm. Finally, we combine the translations of the each point as the deformation of the face by using the deformation technique based on a Radial Basis Function. In our results, we show that the proposed method enable us to detect the motion of the face more accurately.

AB - In this paper, we propose a marker-less motion capture method for a human face. We detect the movement of a face as the deformation from the initial pose to other poses. In such cases, the non-rigid registration algorithms are commonly used to detect the movement of an object. However, since the features of the movement of a face vary in each facial part, it complicates the registration problem. In our method, we recognize the facial parts by using Random Forest algorithm to be simplified to solve the registration problem. Then, we classify the facial parts into five types: nose, mouth, eye, cheek and obstacle. And we define the feature vector of each point of the face by using Fast Point Feature Histograms and a normalized position. We train the Random Forest based on the feature vector to recognize the facial parts from an arbitrary point set data. After the recognition of the facial parts, we detect the movement of the each part by using a non-rigid registration algorithm. Finally, we combine the translations of the each point as the deformation of the face by using the deformation technique based on a Radial Basis Function. In our results, we show that the proposed method enable us to detect the motion of the face more accurately.

UR - http://www.scopus.com/inward/record.url?scp=84888244769&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84888244769&partnerID=8YFLogxK

U2 - 10.2493/jjspe.79.1152

DO - 10.2493/jjspe.79.1152

M3 - Article

AN - SCOPUS:84888244769

VL - 79

SP - 1152

EP - 1158

JO - Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering

JF - Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering

SN - 0912-0289

IS - 11

ER -