FreeCam3D: Snapshot Structured Light 3D with Freely-Moving Cameras

Yicheng Wu, Vivek Boominathan, Xuan Zhao, Jacob T. Robinson, Hiroshi Kawasaki, Aswin Sankaranarayanan, Ashok Veeraraghavan

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

抄録

A 3D imaging and mapping system that can handle both multiple-viewers and dynamic-objects is attractive for many applications. We propose a freeform structured light system that does not rigidly constrain camera(s) to the projector. By introducing an optimized phase-coded aperture in the projector, we transform the projector pattern to encode depth in its defocus robustly; this allows a camera to estimate depth, in projector coordinates, using local information. Additionally, we project a Kronecker-multiplexed pattern that provides global context to establish correspondence between camera and projector pixels. Together with aperture coding and projected pattern, the projector offers a unique 3D labeling for every location of the scene. The projected pattern can be observed in part or full by any camera, to reconstruct both the 3D map of the scene and the camera pose in the projector coordinates. This system is optimized using a fully differentiable rendering model and a CNN-based reconstruction. We build a prototype and demonstrate high-quality 3D reconstruction with an unconstrained camera, for both dynamic scenes and multi-camera systems.

本文言語英語
ホスト出版物のタイトルComputer Vision – ECCV 2020 - 16th European Conference, 2020, Proceedings
編集者Andrea Vedaldi, Horst Bischof, Thomas Brox, Jan-Michael Frahm
出版社Springer Science and Business Media Deutschland GmbH
ページ309-325
ページ数17
ISBN(印刷版)9783030585822
DOI
出版ステータス出版済み - 2020
イベント16th European Conference on Computer Vision, ECCV 2020 - Glasgow, 英国
継続期間: 8 23 20208 28 2020

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
12372 LNCS
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

会議

会議16th European Conference on Computer Vision, ECCV 2020
国/地域英国
CityGlasgow
Period8/23/208/28/20

All Science Journal Classification (ASJC) codes

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)

フィンガープリント

「FreeCam3D: Snapshot Structured Light 3D with Freely-Moving Cameras」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル