PPG3D: Does 3D head tracking improve camera-based PPG estimation?

Genki Nagamatsu, Ewa Magdalena Nowara, Amruta Pai, Ashok Veeraraghavan, Hiroshi Kawasaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Over the last few years, camera-based estimation of vital signs referred to as imaging photoplethysmography (iPPG) has garnered significant attention due to the relative simplicity, ease, unobtrusiveness and flexibility offered by such measurements. It is expected that iPPG may be integrated into a host of emerging applications in areas as diverse as autonomous cars, neonatal monitoring, and telemedicine. In spite of this potential, the primary challenge of non-contact camera-based measurements is the relative motion between the camera and the subjects. Current techniques employ 2D feature tracking to reduce the effect of subject and camera motion but they are limited to handling translational and in-plane motion. In this paper, we study, for the first-time, the utility of 3D face tracking to allow iPPG to retain robust performance even in presence of out-of-plane and large relative motions. We use a RGB-D camera to obtain 3D information from the subjects and use the spatial and depth information to fit a 3D face model and track the model over the video frames. This allows us to estimate correspondence over the entire video with pixel-level accuracy, even in the presence of out-of-plane or large motions. We then estimate iPPG from the warped video data that ensures per-pixel correspondence over the entire window-length used for estimation. Our experiments demonstrate improvement in robustness when head motion is large.

Original languageEnglish
Title of host publication42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
Subtitle of host publicationEnabling Innovative Technologies for Global Healthcare, EMBC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1194-1197
Number of pages4
ISBN (Electronic)9781728119908
DOIs
Publication statusPublished - Jul 2020
Event42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 - Montreal, Canada
Duration: Jul 20 2020Jul 24 2020

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2020-July
ISSN (Print)1557-170X

Conference

Conference42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
CountryCanada
CityMontreal
Period7/20/207/24/20

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint Dive into the research topics of 'PPG3D: Does 3D head tracking improve camera-based PPG estimation?'. Together they form a unique fingerprint.

Cite this