Reflectance and shape estimation with a light field camera under natural illumination

Thanh Trung Ngo, Hajime Nagahara, Ko Nishino, Rin Ichiro Taniguchi, Yasushi Yagi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Reflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional shape recovery is pervasive with varieties of approaches and practical applications, reflectance recovery has only emerged recently. Reflectance recovery is a challenging task that is usually conducted in controlled environments, such as a laboratory environment with a special apparatus. However, it is desirable that the reflectance be recovered in the field with a handy camera so that reflectance can be jointly recovered with the shape. To that end, we present a solution that simultaneously recovers the reflectance and shape (i.e., dense depth and normal maps) of an object under natural illumination with commercially available handy cameras. We employ a light field camera to capture one light field image of the object, and a 360-degree camera to capture the illumination. The proposed method provides promising results in simulation and real-world experiments.

Original languageEnglish
Title of host publicationBritish Machine Vision Conference 2017, BMVC 2017
PublisherBMVA Press
ISBN (Electronic)190172560X, 9781901725605
DOIs
Publication statusPublished - 2017
Event28th British Machine Vision Conference, BMVC 2017 - London, United Kingdom
Duration: Sep 4 2017Sep 7 2017

Publication series

NameBritish Machine Vision Conference 2017, BMVC 2017

Conference

Conference28th British Machine Vision Conference, BMVC 2017
CountryUnited Kingdom
CityLondon
Period9/4/179/7/17

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Reflectance and shape estimation with a light field camera under natural illumination'. Together they form a unique fingerprint.

  • Cite this

    Ngo, T. T., Nagahara, H., Nishino, K., Taniguchi, R. I., & Yagi, Y. (2017). Reflectance and shape estimation with a light field camera under natural illumination. In British Machine Vision Conference 2017, BMVC 2017 (British Machine Vision Conference 2017, BMVC 2017). BMVA Press. https://doi.org/10.5244/c.31.110