Reflectance and shape estimation with a light field camera under natural illumination

Thanh Trung Ngo, Hajime Nagahara, Ko Nishino, Rin Ichiro Taniguchi, Yasushi Yagi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Reflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional shape recovery is pervasive with varieties of approaches and practical applications, reflectance recovery has only emerged recently. Reflectance recovery is a challenging task that is usually conducted in controlled environments, such as a laboratory environment with a special apparatus. However, it is desirable that the reflectance be recovered in the field with a handy camera so that reflectance can be jointly recovered with the shape. To that end, we present a solution that simultaneously recovers the reflectance and shape (i.e., dense depth and normal maps) of an object under natural illumination with commercially available handy cameras. We employ a light field camera to capture one light field image of the object, and a 360-degree camera to capture the illumination. The proposed method provides promising results in simulation and real-world experiments.

Original languageEnglish
Title of host publicationBritish Machine Vision Conference 2017, BMVC 2017
PublisherBMVA Press
ISBN (Electronic)190172560X, 9781901725605
Publication statusPublished - Jan 1 2017
Event28th British Machine Vision Conference, BMVC 2017 - London, United Kingdom
Duration: Sep 4 2017Sep 7 2017

Publication series

NameBritish Machine Vision Conference 2017, BMVC 2017

Conference

Conference28th British Machine Vision Conference, BMVC 2017
CountryUnited Kingdom
CityLondon
Period9/4/179/7/17

Fingerprint

Lighting
Cameras
Recovery
Computer vision
Experiments

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Cite this

Ngo, T. T., Nagahara, H., Nishino, K., Taniguchi, R. I., & Yagi, Y. (2017). Reflectance and shape estimation with a light field camera under natural illumination. In British Machine Vision Conference 2017, BMVC 2017 (British Machine Vision Conference 2017, BMVC 2017). BMVA Press.

Reflectance and shape estimation with a light field camera under natural illumination. / Ngo, Thanh Trung; Nagahara, Hajime; Nishino, Ko; Taniguchi, Rin Ichiro; Yagi, Yasushi.

British Machine Vision Conference 2017, BMVC 2017. BMVA Press, 2017. (British Machine Vision Conference 2017, BMVC 2017).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ngo, TT, Nagahara, H, Nishino, K, Taniguchi, RI & Yagi, Y 2017, Reflectance and shape estimation with a light field camera under natural illumination. in British Machine Vision Conference 2017, BMVC 2017. British Machine Vision Conference 2017, BMVC 2017, BMVA Press, 28th British Machine Vision Conference, BMVC 2017, London, United Kingdom, 9/4/17.
Ngo TT, Nagahara H, Nishino K, Taniguchi RI, Yagi Y. Reflectance and shape estimation with a light field camera under natural illumination. In British Machine Vision Conference 2017, BMVC 2017. BMVA Press. 2017. (British Machine Vision Conference 2017, BMVC 2017).
Ngo, Thanh Trung ; Nagahara, Hajime ; Nishino, Ko ; Taniguchi, Rin Ichiro ; Yagi, Yasushi. / Reflectance and shape estimation with a light field camera under natural illumination. British Machine Vision Conference 2017, BMVC 2017. BMVA Press, 2017. (British Machine Vision Conference 2017, BMVC 2017).
@inproceedings{c727281228c142c8b9fe8b368bcfdf54,
title = "Reflectance and shape estimation with a light field camera under natural illumination",
abstract = "Reflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional shape recovery is pervasive with varieties of approaches and practical applications, reflectance recovery has only emerged recently. Reflectance recovery is a challenging task that is usually conducted in controlled environments, such as a laboratory environment with a special apparatus. However, it is desirable that the reflectance be recovered in the field with a handy camera so that reflectance can be jointly recovered with the shape. To that end, we present a solution that simultaneously recovers the reflectance and shape (i.e., dense depth and normal maps) of an object under natural illumination with commercially available handy cameras. We employ a light field camera to capture one light field image of the object, and a 360-degree camera to capture the illumination. The proposed method provides promising results in simulation and real-world experiments.",
author = "Ngo, {Thanh Trung} and Hajime Nagahara and Ko Nishino and Taniguchi, {Rin Ichiro} and Yasushi Yagi",
year = "2017",
month = "1",
day = "1",
language = "English",
series = "British Machine Vision Conference 2017, BMVC 2017",
publisher = "BMVA Press",
booktitle = "British Machine Vision Conference 2017, BMVC 2017",

}

TY - GEN

T1 - Reflectance and shape estimation with a light field camera under natural illumination

AU - Ngo, Thanh Trung

AU - Nagahara, Hajime

AU - Nishino, Ko

AU - Taniguchi, Rin Ichiro

AU - Yagi, Yasushi

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Reflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional shape recovery is pervasive with varieties of approaches and practical applications, reflectance recovery has only emerged recently. Reflectance recovery is a challenging task that is usually conducted in controlled environments, such as a laboratory environment with a special apparatus. However, it is desirable that the reflectance be recovered in the field with a handy camera so that reflectance can be jointly recovered with the shape. To that end, we present a solution that simultaneously recovers the reflectance and shape (i.e., dense depth and normal maps) of an object under natural illumination with commercially available handy cameras. We employ a light field camera to capture one light field image of the object, and a 360-degree camera to capture the illumination. The proposed method provides promising results in simulation and real-world experiments.

AB - Reflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional shape recovery is pervasive with varieties of approaches and practical applications, reflectance recovery has only emerged recently. Reflectance recovery is a challenging task that is usually conducted in controlled environments, such as a laboratory environment with a special apparatus. However, it is desirable that the reflectance be recovered in the field with a handy camera so that reflectance can be jointly recovered with the shape. To that end, we present a solution that simultaneously recovers the reflectance and shape (i.e., dense depth and normal maps) of an object under natural illumination with commercially available handy cameras. We employ a light field camera to capture one light field image of the object, and a 360-degree camera to capture the illumination. The proposed method provides promising results in simulation and real-world experiments.

UR - http://www.scopus.com/inward/record.url?scp=85072380748&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072380748&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85072380748

T3 - British Machine Vision Conference 2017, BMVC 2017

BT - British Machine Vision Conference 2017, BMVC 2017

PB - BMVA Press

ER -