4D Capture Using Visibility Information of Multiple Projector Camera System

Ryusuke Sagawa, Nozomu Kasuya, Yoshinori Oki, Hiroshi Kawasaki, Yoshio Matsumoto, Ryo Furukawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In this paper, we propose a method with multiple cameras and projectors for 4D capture of moving objects. The issues of previous 4D capture systems are that the number of cameras are limited, and the number of images is very large to capture the sequence at high frame rate. We propose a multiple projector-camera system to tackle this problem. One of the issues of multi-view stereo is to determine visibility of cameras for each point of the surface. While estimating the scene geometry and its visibility is a chicken-and-egg problem for passive multi-view stereo, it was solved by, for example, iterative approach conducting the estimation of visibility and the reconstruction of the scene geometry repeatedly. With our method, since visibility problem is independently solved by using the projected pattern, shapes are recovered efficiently without considering visibility problem. Further, the visibility information is not only used for multi-view stereo reconstruction, but also for merging 3D shapes to eliminate inconsistency between devices. The efficiency of the proposed method is tested in the experiments, proving the merged mesh is suitable for 4Dreconstruction.

Original languageEnglish
Title of host publicationProceedings - 2014 International Conference on 3D Vision Workshops, 3DV 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages14-21
Number of pages8
ISBN (Electronic)9781479970018
DOIs
Publication statusPublished - Aug 7 2015
Externally publishedYes
Event2nd International Conference on 3D Vision Workshops, 3DV 2014 - Tokyo, Japan
Duration: Dec 8 2014Dec 11 2014

Publication series

NameProceedings - 2014 International Conference on 3D Vision Workshops, 3DV 2014

Other

Other2nd International Conference on 3D Vision Workshops, 3DV 2014
CountryJapan
CityTokyo
Period12/8/1412/11/14

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of '4D Capture Using Visibility Information of Multiple Projector Camera System'. Together they form a unique fingerprint.

  • Cite this

    Sagawa, R., Kasuya, N., Oki, Y., Kawasaki, H., Matsumoto, Y., & Furukawa, R. (2015). 4D Capture Using Visibility Information of Multiple Projector Camera System. In Proceedings - 2014 International Conference on 3D Vision Workshops, 3DV 2014 (pp. 14-21). [7182712] (Proceedings - 2014 International Conference on 3D Vision Workshops, 3DV 2014). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/3DV.2014.70