Variational estimation of inhomogeneous specular reflectance and illumination from a single view

Hara Kenji, Ko Nishino

Research output: Contribution to journalReview article

8 Citations (Scopus)

Abstract

Estimating the illumination and the reflectance properties of an object surface from a few images is an important but challenging problem. The problem becomes even more challenging if we wish to deal with real-world objects that naturally have spatially inhomogeneous reflectance. In this paper, we derive a novel method for estimating the spatially varying specular reflectance properties of a surface of known geometry as well as the illumination distribution of a scene from a specular-only image, for instance, recovered from two images captured with a polarizer to separate reflection components. Unlike previous work, we do not assume the illumination to be a single point light source. We model specular reflection with a spherical statistical distribution and encode its spatial variation with a radial basis function (RBF) network of their parameter values, which allows us to formulate the simultaneous estimation of spatially varying specular reflectance and illumination as a constrained optimization based on the I-divergence measure. To solve it, we derive a variational algorithm based on the expectation maximization principle. At the same time, we estimate optimal encoding of the specular reflectance properties by learning the number, centers, and widths of the RBF hidden units. We demonstrate the effectiveness of the method on images of synthetic and real-world objects.

Original languageEnglish
Pages (from-to)136-146
Number of pages11
JournalJournal of the Optical Society of America A: Optics and Image Science, and Vision
Volume28
Issue number2
DOIs
Publication statusPublished - Jan 1 2011

Fingerprint

Lighting
illumination
reflectance
estimating
specular reflection
polarizers
statistical distributions
learning
Radial basis function networks
divergence
light sources
coding
Constrained optimization
Light sources
optimization
estimates
geometry
Geometry

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Computer Vision and Pattern Recognition

Cite this

@article{715b5ab17b8942c3b652f4040dc51e37,
title = "Variational estimation of inhomogeneous specular reflectance and illumination from a single view",
abstract = "Estimating the illumination and the reflectance properties of an object surface from a few images is an important but challenging problem. The problem becomes even more challenging if we wish to deal with real-world objects that naturally have spatially inhomogeneous reflectance. In this paper, we derive a novel method for estimating the spatially varying specular reflectance properties of a surface of known geometry as well as the illumination distribution of a scene from a specular-only image, for instance, recovered from two images captured with a polarizer to separate reflection components. Unlike previous work, we do not assume the illumination to be a single point light source. We model specular reflection with a spherical statistical distribution and encode its spatial variation with a radial basis function (RBF) network of their parameter values, which allows us to formulate the simultaneous estimation of spatially varying specular reflectance and illumination as a constrained optimization based on the I-divergence measure. To solve it, we derive a variational algorithm based on the expectation maximization principle. At the same time, we estimate optimal encoding of the specular reflectance properties by learning the number, centers, and widths of the RBF hidden units. We demonstrate the effectiveness of the method on images of synthetic and real-world objects.",
author = "Hara Kenji and Ko Nishino",
year = "2011",
month = "1",
day = "1",
doi = "10.1364/JOSAA.28.000136",
language = "English",
volume = "28",
pages = "136--146",
journal = "Journal of the Optical Society of America A: Optics and Image Science, and Vision",
issn = "1084-7529",
publisher = "The Optical Society",
number = "2",

}

TY - JOUR

T1 - Variational estimation of inhomogeneous specular reflectance and illumination from a single view

AU - Kenji, Hara

AU - Nishino, Ko

PY - 2011/1/1

Y1 - 2011/1/1

N2 - Estimating the illumination and the reflectance properties of an object surface from a few images is an important but challenging problem. The problem becomes even more challenging if we wish to deal with real-world objects that naturally have spatially inhomogeneous reflectance. In this paper, we derive a novel method for estimating the spatially varying specular reflectance properties of a surface of known geometry as well as the illumination distribution of a scene from a specular-only image, for instance, recovered from two images captured with a polarizer to separate reflection components. Unlike previous work, we do not assume the illumination to be a single point light source. We model specular reflection with a spherical statistical distribution and encode its spatial variation with a radial basis function (RBF) network of their parameter values, which allows us to formulate the simultaneous estimation of spatially varying specular reflectance and illumination as a constrained optimization based on the I-divergence measure. To solve it, we derive a variational algorithm based on the expectation maximization principle. At the same time, we estimate optimal encoding of the specular reflectance properties by learning the number, centers, and widths of the RBF hidden units. We demonstrate the effectiveness of the method on images of synthetic and real-world objects.

AB - Estimating the illumination and the reflectance properties of an object surface from a few images is an important but challenging problem. The problem becomes even more challenging if we wish to deal with real-world objects that naturally have spatially inhomogeneous reflectance. In this paper, we derive a novel method for estimating the spatially varying specular reflectance properties of a surface of known geometry as well as the illumination distribution of a scene from a specular-only image, for instance, recovered from two images captured with a polarizer to separate reflection components. Unlike previous work, we do not assume the illumination to be a single point light source. We model specular reflection with a spherical statistical distribution and encode its spatial variation with a radial basis function (RBF) network of their parameter values, which allows us to formulate the simultaneous estimation of spatially varying specular reflectance and illumination as a constrained optimization based on the I-divergence measure. To solve it, we derive a variational algorithm based on the expectation maximization principle. At the same time, we estimate optimal encoding of the specular reflectance properties by learning the number, centers, and widths of the RBF hidden units. We demonstrate the effectiveness of the method on images of synthetic and real-world objects.

UR - http://www.scopus.com/inward/record.url?scp=79751511530&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79751511530&partnerID=8YFLogxK

U2 - 10.1364/JOSAA.28.000136

DO - 10.1364/JOSAA.28.000136

M3 - Review article

VL - 28

SP - 136

EP - 146

JO - Journal of the Optical Society of America A: Optics and Image Science, and Vision

JF - Journal of the Optical Society of America A: Optics and Image Science, and Vision

SN - 1084-7529

IS - 2

ER -