Dynamic photometric stereo method using multi-tap CMOS image sensor

Takuya Yoda, Hajime Nagahara, Rin-Ichiro Taniguchi, Keiichiro Kagawa, Keita Yasutomi, Shoji Kawahito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Photometric stereo enables the estimation of surface normals from images that were captured using different known lighting directions. The classical photometric stereo method requires at least three images to determine the normals of a given scene. This method therefore cannot be applied to a dynamic scene, because it is assumed that the scene should remain static while the required images are captured. We present a dynamic photometric stereo method to estimate the surface normals in a dynamic scene. We use a multi-tap complementary metal-oxide-semiconductor (CMOS) image sensor to capture the input images for the photometric stereo method. The image sensor can divide the electrons from the photodiode of a single pixel into different taps of exposures, and can therefore capture multiple images under different lighting conditions with almost the same timing. We implemented a prototype camera that was synchronized with a lighting system, and subsequently realized photometric stereo of a dynamic scene.

Original languageEnglish
Title of host publication2016 23rd International Conference on Pattern Recognition, ICPR 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2356-2361
Number of pages6
ISBN (Electronic)9781509048472
DOIs
Publication statusPublished - Jan 1 2016
Event23rd International Conference on Pattern Recognition, ICPR 2016 - Cancun, Mexico
Duration: Dec 4 2016Dec 8 2016

Publication series

NameProceedings - International Conference on Pattern Recognition
Volume0
ISSN (Print)1051-4651

Other

Other23rd International Conference on Pattern Recognition, ICPR 2016
CountryMexico
CityCancun
Period12/4/1612/8/16

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Cite this

Yoda, T., Nagahara, H., Taniguchi, R-I., Kagawa, K., Yasutomi, K., & Kawahito, S. (2016). Dynamic photometric stereo method using multi-tap CMOS image sensor. In 2016 23rd International Conference on Pattern Recognition, ICPR 2016 (pp. 2356-2361). [7899988] (Proceedings - International Conference on Pattern Recognition; Vol. 0). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICPR.2016.7899988