Local feature evaluation for a constrained local model framework

Maiya Hori, Shogo Kawai, Hiroki Yoshimura, Yoshio Iwai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present local feature evaluation for a constrained local model (CLM) framework. We target facial images captured by a mobile camera such as a smartphone. When recognizing facial images captured by a mobile camera, changes in lighting conditions and image degrada- tion from motion blur are considerable problems. CLM is effective for recognizing a facial expression because partial occlusions can be han- dled easily. In the CLM framework, the optimization strategy is local expert-based deformable model fitting. The likelihood of alignment at a particular landmark location is acquired beforehand using the local features of a large number of images and is used for estimating model parameters. In this learning phase, the features and classifiers used have a great influence on the accuracy of estimation in landmark locations. In our study, tracking accuracy can be improved by changing the features and classifiers for parts of the face. In the experiments, the likelihood map was generated using various features and classifiers, and the accuracy of landmark locations was compared with the conventional method.

Original languageEnglish
Title of host publicationFace and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers
EditorsGang Hua, Qiang Ji, Thomas B. Moeslund, Kamal Nasrollahi
PublisherSpringer Verlag
Pages11-19
Number of pages9
ISBN (Electronic)9783319137360
DOIs
Publication statusPublished - Jan 1 2015
Externally publishedYes
EventInternational Workshop on Face and Facial Expression Recognition from Real World Videos, FFER 2014 held in conjunction with 22nd International Conference on Pattern Recognition, 2014 - Stockholm, Sweden
Duration: Aug 24 2014Aug 24 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8912
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

OtherInternational Workshop on Face and Facial Expression Recognition from Real World Videos, FFER 2014 held in conjunction with 22nd International Conference on Pattern Recognition, 2014
CountrySweden
CityStockholm
Period8/24/148/24/14

Fingerprint

Local Features
Landmarks
Classifier
Evaluation
Classifiers
Likelihood
Camera
Motion Blur
Deformable Models
Cameras
Model Fitting
Facial Expression
Occlusion
Model
Smartphones
Alignment
Face
Partial
Lighting
Target

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Hori, M., Kawai, S., Yoshimura, H., & Iwai, Y. (2015). Local feature evaluation for a constrained local model framework. In G. Hua, Q. Ji, T. B. Moeslund, & K. Nasrollahi (Eds.), Face and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers (pp. 11-19). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8912). Springer Verlag. https://doi.org/10.1007/978-3-319-13737-7_2

Local feature evaluation for a constrained local model framework. / Hori, Maiya; Kawai, Shogo; Yoshimura, Hiroki; Iwai, Yoshio.

Face and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers. ed. / Gang Hua; Qiang Ji; Thomas B. Moeslund; Kamal Nasrollahi. Springer Verlag, 2015. p. 11-19 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8912).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hori, M, Kawai, S, Yoshimura, H & Iwai, Y 2015, Local feature evaluation for a constrained local model framework. in G Hua, Q Ji, TB Moeslund & K Nasrollahi (eds), Face and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8912, Springer Verlag, pp. 11-19, International Workshop on Face and Facial Expression Recognition from Real World Videos, FFER 2014 held in conjunction with 22nd International Conference on Pattern Recognition, 2014, Stockholm, Sweden, 8/24/14. https://doi.org/10.1007/978-3-319-13737-7_2
Hori M, Kawai S, Yoshimura H, Iwai Y. Local feature evaluation for a constrained local model framework. In Hua G, Ji Q, Moeslund TB, Nasrollahi K, editors, Face and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers. Springer Verlag. 2015. p. 11-19. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-13737-7_2
Hori, Maiya ; Kawai, Shogo ; Yoshimura, Hiroki ; Iwai, Yoshio. / Local feature evaluation for a constrained local model framework. Face and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers. editor / Gang Hua ; Qiang Ji ; Thomas B. Moeslund ; Kamal Nasrollahi. Springer Verlag, 2015. pp. 11-19 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{b50589836ff8489e93e1fcdb227e6266,
title = "Local feature evaluation for a constrained local model framework",
abstract = "We present local feature evaluation for a constrained local model (CLM) framework. We target facial images captured by a mobile camera such as a smartphone. When recognizing facial images captured by a mobile camera, changes in lighting conditions and image degrada- tion from motion blur are considerable problems. CLM is effective for recognizing a facial expression because partial occlusions can be han- dled easily. In the CLM framework, the optimization strategy is local expert-based deformable model fitting. The likelihood of alignment at a particular landmark location is acquired beforehand using the local features of a large number of images and is used for estimating model parameters. In this learning phase, the features and classifiers used have a great influence on the accuracy of estimation in landmark locations. In our study, tracking accuracy can be improved by changing the features and classifiers for parts of the face. In the experiments, the likelihood map was generated using various features and classifiers, and the accuracy of landmark locations was compared with the conventional method.",
author = "Maiya Hori and Shogo Kawai and Hiroki Yoshimura and Yoshio Iwai",
year = "2015",
month = "1",
day = "1",
doi = "10.1007/978-3-319-13737-7_2",
language = "English",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "11--19",
editor = "Gang Hua and Qiang Ji and Moeslund, {Thomas B.} and Kamal Nasrollahi",
booktitle = "Face and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers",
address = "Germany",

}

TY - GEN

T1 - Local feature evaluation for a constrained local model framework

AU - Hori, Maiya

AU - Kawai, Shogo

AU - Yoshimura, Hiroki

AU - Iwai, Yoshio

PY - 2015/1/1

Y1 - 2015/1/1

N2 - We present local feature evaluation for a constrained local model (CLM) framework. We target facial images captured by a mobile camera such as a smartphone. When recognizing facial images captured by a mobile camera, changes in lighting conditions and image degrada- tion from motion blur are considerable problems. CLM is effective for recognizing a facial expression because partial occlusions can be han- dled easily. In the CLM framework, the optimization strategy is local expert-based deformable model fitting. The likelihood of alignment at a particular landmark location is acquired beforehand using the local features of a large number of images and is used for estimating model parameters. In this learning phase, the features and classifiers used have a great influence on the accuracy of estimation in landmark locations. In our study, tracking accuracy can be improved by changing the features and classifiers for parts of the face. In the experiments, the likelihood map was generated using various features and classifiers, and the accuracy of landmark locations was compared with the conventional method.

AB - We present local feature evaluation for a constrained local model (CLM) framework. We target facial images captured by a mobile camera such as a smartphone. When recognizing facial images captured by a mobile camera, changes in lighting conditions and image degrada- tion from motion blur are considerable problems. CLM is effective for recognizing a facial expression because partial occlusions can be han- dled easily. In the CLM framework, the optimization strategy is local expert-based deformable model fitting. The likelihood of alignment at a particular landmark location is acquired beforehand using the local features of a large number of images and is used for estimating model parameters. In this learning phase, the features and classifiers used have a great influence on the accuracy of estimation in landmark locations. In our study, tracking accuracy can be improved by changing the features and classifiers for parts of the face. In the experiments, the likelihood map was generated using various features and classifiers, and the accuracy of landmark locations was compared with the conventional method.

UR - http://www.scopus.com/inward/record.url?scp=84925310356&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84925310356&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-13737-7_2

DO - 10.1007/978-3-319-13737-7_2

M3 - Conference contribution

AN - SCOPUS:84925310356

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 11

EP - 19

BT - Face and Facial Expression Recognition from Real World Videos - International Workshop, Revised Selected Papers

A2 - Hua, Gang

A2 - Ji, Qiang

A2 - Moeslund, Thomas B.

A2 - Nasrollahi, Kamal

PB - Springer Verlag

ER -