3D Body and Background Reconstruction in a Large-scale Indoor Scene using Multiple Depth Cameras

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

抜粋

3D reconstruction of indoor scenes that contain non-rigidly moving human body using depth cameras is a task of extraordinary difficulty. Despite intensive efforts from the researchers in the 3D vision community, existing methods are still limited to reconstruct small scale scenes. This is because of the difficulty to track the camera motion when a target person moves in a totally different direction. Due to the narrow field of view (FoV) of consumer-grade red-green-blue-depth (RGB-D) cameras, a target person (generally put at about 2-3 meters from the camera) covers most of the FoV of the camera. Therefore, there are not enough features from the static background to track the motion of the camera. In this paper, we propose a system which reconstructs a moving human body and the background of an indoor scene using multiple depth cameras. Our system is composed of three Kinects that are approximately set in the same line and facing the same direction so that their FoV do not overlap (to avoid interference). Owing to this setup, we capture images of a person moving in a large scale indoor scene. The three Kinect cameras are calibrated with a robust method that uses three large non parallel planes. A moving person is detected by using human skeleton information, and is reconstructed separately from the static background. By separating the human body and the background, static 3D reconstruction can be adopted for the static background area while a method specialized for the human body area can be used to reconstruct the 3D model of the moving person. The experimental result shows the performance of proposed system for human body in a large-scale indoor scene.

元の言語英語
ホスト出版物のタイトルProceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019
編集者Dongdong Weng, Liwei Chan, Youngho Lee, Xiaohui Liang, Nobuchika Sakata
出版者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子版)9781728115719
DOI
出版物ステータス出版済み - 5 7 2019
イベント12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019 - Ikoma, Nara, 日本
継続期間: 3 28 20193 29 2019

出版物シリーズ

名前Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019

会議

会議12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019
日本
Ikoma, Nara
期間3/28/193/29/19

All Science Journal Classification (ASJC) codes

  • Education
  • Sociology and Political Science
  • Communication
  • Marketing
  • Strategy and Management
  • Computer Networks and Communications
  • Information Systems and Management
  • Social Psychology

フィンガープリント 3D Body and Background Reconstruction in a Large-scale Indoor Scene using Multiple Depth Cameras' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Kobayashi, D., Thomas, D. G. F., Uchiyama, H., & Taniguchi, R-I. (2019). 3D Body and Background Reconstruction in a Large-scale Indoor Scene using Multiple Depth Cameras. : D. Weng, L. Chan, Y. Lee, X. Liang, & N. Sakata (版), Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019 [8709280] (Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/APMAR.2019.8709280