Range image registration using a photometric metric under unknown lighting

Diego Thomas, Akihiro Sugimoto

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Based on the spherical harmonics representation of image formation, we derive a new photometric metric for evaluating the correctness of a given rigid transformation aligning two overlapping range images captured under unknown, distant, and general illumination. We estimate the surrounding illumination and albedo values of points of the two range images from the point correspondences induced by the input transformation. We then synthesize the color of both range images using albedo values transferred using the point correspondences to compute the photometric reprojection error. This way allows us to accurately register two range images by finding the transformation that minimizes the photometric reprojection error. We also propose a practical method using the proposed photometric metric to register pairs of range images devoid of salient geometric features, captured under unknown lighting. Our method uses a hypothesize-and-test strategy to search for the transformation that minimizes our photometric metric. Transformation candidates are efficiently generated by employing the spherical representation of each range image. Experimental results using both synthetic and real data demonstrate the usefulness of the proposed metric.

Original languageEnglish
Article number6412673
Pages (from-to)2252-2269
Number of pages18
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume35
Issue number9
DOIs
Publication statusPublished - Aug 5 2013
Externally publishedYes

Fingerprint

Range Image
Image registration
Image Registration
Lighting
Metric
Unknown
Illumination
Image processing
Correspondence
Color
Minimise
Spherical Harmonics
Overlapping
Correctness
Experimental Results
Estimate
Demonstrate

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Cite this

Range image registration using a photometric metric under unknown lighting. / Thomas, Diego; Sugimoto, Akihiro.

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, No. 9, 6412673, 05.08.2013, p. 2252-2269.

Research output: Contribution to journalArticle

@article{cf40e5ee5e914e8e929f0c4bdc1ffb2f,
title = "Range image registration using a photometric metric under unknown lighting",
abstract = "Based on the spherical harmonics representation of image formation, we derive a new photometric metric for evaluating the correctness of a given rigid transformation aligning two overlapping range images captured under unknown, distant, and general illumination. We estimate the surrounding illumination and albedo values of points of the two range images from the point correspondences induced by the input transformation. We then synthesize the color of both range images using albedo values transferred using the point correspondences to compute the photometric reprojection error. This way allows us to accurately register two range images by finding the transformation that minimizes the photometric reprojection error. We also propose a practical method using the proposed photometric metric to register pairs of range images devoid of salient geometric features, captured under unknown lighting. Our method uses a hypothesize-and-test strategy to search for the transformation that minimizes our photometric metric. Transformation candidates are efficiently generated by employing the spherical representation of each range image. Experimental results using both synthetic and real data demonstrate the usefulness of the proposed metric.",
author = "Diego Thomas and Akihiro Sugimoto",
year = "2013",
month = "8",
day = "5",
doi = "10.1109/TPAMI.2013.21",
language = "English",
volume = "35",
pages = "2252--2269",
journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
issn = "0162-8828",
publisher = "IEEE Computer Society",
number = "9",

}

TY - JOUR

T1 - Range image registration using a photometric metric under unknown lighting

AU - Thomas, Diego

AU - Sugimoto, Akihiro

PY - 2013/8/5

Y1 - 2013/8/5

N2 - Based on the spherical harmonics representation of image formation, we derive a new photometric metric for evaluating the correctness of a given rigid transformation aligning two overlapping range images captured under unknown, distant, and general illumination. We estimate the surrounding illumination and albedo values of points of the two range images from the point correspondences induced by the input transformation. We then synthesize the color of both range images using albedo values transferred using the point correspondences to compute the photometric reprojection error. This way allows us to accurately register two range images by finding the transformation that minimizes the photometric reprojection error. We also propose a practical method using the proposed photometric metric to register pairs of range images devoid of salient geometric features, captured under unknown lighting. Our method uses a hypothesize-and-test strategy to search for the transformation that minimizes our photometric metric. Transformation candidates are efficiently generated by employing the spherical representation of each range image. Experimental results using both synthetic and real data demonstrate the usefulness of the proposed metric.

AB - Based on the spherical harmonics representation of image formation, we derive a new photometric metric for evaluating the correctness of a given rigid transformation aligning two overlapping range images captured under unknown, distant, and general illumination. We estimate the surrounding illumination and albedo values of points of the two range images from the point correspondences induced by the input transformation. We then synthesize the color of both range images using albedo values transferred using the point correspondences to compute the photometric reprojection error. This way allows us to accurately register two range images by finding the transformation that minimizes the photometric reprojection error. We also propose a practical method using the proposed photometric metric to register pairs of range images devoid of salient geometric features, captured under unknown lighting. Our method uses a hypothesize-and-test strategy to search for the transformation that minimizes our photometric metric. Transformation candidates are efficiently generated by employing the spherical representation of each range image. Experimental results using both synthetic and real data demonstrate the usefulness of the proposed metric.

UR - http://www.scopus.com/inward/record.url?scp=84880864649&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84880864649&partnerID=8YFLogxK

U2 - 10.1109/TPAMI.2013.21

DO - 10.1109/TPAMI.2013.21

M3 - Article

C2 - 23868783

AN - SCOPUS:84880864649

VL - 35

SP - 2252

EP - 2269

JO - IEEE Transactions on Pattern Analysis and Machine Intelligence

JF - IEEE Transactions on Pattern Analysis and Machine Intelligence

SN - 0162-8828

IS - 9

M1 - 6412673

ER -