Augmented blendshapes for real-time simultaneous 3D head modeling and facial motion capture

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

13 被引用数 (Scopus)

抄録

We propose a method to build in real-time animated 3D head models using a consumer-grade RGB-D camera. Our framework is the first one to provide simultaneously comprehensive facial motion tracking and a detailed 3D model of the user's head. Anyone's head can be instantly reconstructed and his facial motion captured without requiring any training or pre-scanning. The user starts facing the camera with a neutral expression in the first frame, but is free to move, talk and change his face expression as he wills otherwise. The facial motion is tracked using a blendshape representation while the fine geometric details are captured using a Bump image mapped over the template mesh. We propose an efficient algorithm to grow and refine the 3D model of the head on-the-fly and in real-time. We demonstrate robust and high-fidelity simultaneous facial motion tracking and 3D head modeling results on a wide range of subjects with various head poses and facial expressions. Our proposed method offers interesting possibilities for animation production and 3D video telecommunications.

本文言語英語
ホスト出版物のタイトル2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016
出版社IEEE Computer Society
ページ3299-3308
ページ数10
ISBN(電子版)9781467388511
出版ステータス出版済み - 1 1 2016
イベント2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016 - Las Vegas, 米国
継続期間: 6 26 20167 1 2016

出版物シリーズ

名前Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
2016-January
ISSN(印刷版)1063-6919

その他

その他2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016
国/地域米国
CityLas Vegas
Period6/26/167/1/16

All Science Journal Classification (ASJC) codes

  • ソフトウェア
  • コンピュータ ビジョンおよびパターン認識

フィンガープリント

「Augmented blendshapes for real-time simultaneous 3D head modeling and facial motion capture」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル