Dense 3D reconstruction from high frame-rate video using a static grid pattern

Ryusuke Sagawa, Ryo Furukawa, Hiroshi Kawasaki

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

Dense 3D reconstruction of fast moving objects could contribute to various applications such as body structure analysis, accident avoidance, and so on. In this paper, we propose a technique based on a one-shot scanning method, which reconstructs 3D shapes for each frame of a high frame-rate video capturing the scenes projected by a static pattern. To avoid instability of image processing, we restrict the number of colors used in the pattern to less than two. The proposed technique comprises (1) an efficient algorithm to eliminate ambiguity of projected parallel-line patterns by using intersection points, (2) a batch reconstruction algorithm of multiple frames by using spatio-temporal constraints, and (3) an efficient detection method of color-encoded grid pattern based on de Bruijn sequence. In the experiments, the line detection algorithm worked effectively and the dense reconstruction algorithm produces accurate and robust results. We also show the improved results by using temporal constraints. Finally, the dense reconstructions of fast moving objects in a high frame-rate video are presented.

Original languageEnglish
Article number6714483
Pages (from-to)1733-1747
Number of pages15
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume36
Issue number9
DOIs
Publication statusPublished - Jan 1 2014

Fingerprint

3D Reconstruction
Grid
Temporal Constraints
Reconstruction Algorithm
Moving Objects
De Bruijn Sequences
Line Detection
Color
3D shape
Accidents
Batch
Scanning
Image Processing
Image processing
Eliminate
Efficient Algorithms
Intersection
Line
Experiment
Experiments

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Cite this

Dense 3D reconstruction from high frame-rate video using a static grid pattern. / Sagawa, Ryusuke; Furukawa, Ryo; Kawasaki, Hiroshi.

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 36, No. 9, 6714483, 01.01.2014, p. 1733-1747.

Research output: Contribution to journalArticle

@article{0ce8515983a143ceb6e9bb0788be8f8a,
title = "Dense 3D reconstruction from high frame-rate video using a static grid pattern",
abstract = "Dense 3D reconstruction of fast moving objects could contribute to various applications such as body structure analysis, accident avoidance, and so on. In this paper, we propose a technique based on a one-shot scanning method, which reconstructs 3D shapes for each frame of a high frame-rate video capturing the scenes projected by a static pattern. To avoid instability of image processing, we restrict the number of colors used in the pattern to less than two. The proposed technique comprises (1) an efficient algorithm to eliminate ambiguity of projected parallel-line patterns by using intersection points, (2) a batch reconstruction algorithm of multiple frames by using spatio-temporal constraints, and (3) an efficient detection method of color-encoded grid pattern based on de Bruijn sequence. In the experiments, the line detection algorithm worked effectively and the dense reconstruction algorithm produces accurate and robust results. We also show the improved results by using temporal constraints. Finally, the dense reconstructions of fast moving objects in a high frame-rate video are presented.",
author = "Ryusuke Sagawa and Ryo Furukawa and Hiroshi Kawasaki",
year = "2014",
month = "1",
day = "1",
doi = "10.1109/TPAMI.2014.2300490",
language = "English",
volume = "36",
pages = "1733--1747",
journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
issn = "0162-8828",
publisher = "IEEE Computer Society",
number = "9",

}

TY - JOUR

T1 - Dense 3D reconstruction from high frame-rate video using a static grid pattern

AU - Sagawa, Ryusuke

AU - Furukawa, Ryo

AU - Kawasaki, Hiroshi

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Dense 3D reconstruction of fast moving objects could contribute to various applications such as body structure analysis, accident avoidance, and so on. In this paper, we propose a technique based on a one-shot scanning method, which reconstructs 3D shapes for each frame of a high frame-rate video capturing the scenes projected by a static pattern. To avoid instability of image processing, we restrict the number of colors used in the pattern to less than two. The proposed technique comprises (1) an efficient algorithm to eliminate ambiguity of projected parallel-line patterns by using intersection points, (2) a batch reconstruction algorithm of multiple frames by using spatio-temporal constraints, and (3) an efficient detection method of color-encoded grid pattern based on de Bruijn sequence. In the experiments, the line detection algorithm worked effectively and the dense reconstruction algorithm produces accurate and robust results. We also show the improved results by using temporal constraints. Finally, the dense reconstructions of fast moving objects in a high frame-rate video are presented.

AB - Dense 3D reconstruction of fast moving objects could contribute to various applications such as body structure analysis, accident avoidance, and so on. In this paper, we propose a technique based on a one-shot scanning method, which reconstructs 3D shapes for each frame of a high frame-rate video capturing the scenes projected by a static pattern. To avoid instability of image processing, we restrict the number of colors used in the pattern to less than two. The proposed technique comprises (1) an efficient algorithm to eliminate ambiguity of projected parallel-line patterns by using intersection points, (2) a batch reconstruction algorithm of multiple frames by using spatio-temporal constraints, and (3) an efficient detection method of color-encoded grid pattern based on de Bruijn sequence. In the experiments, the line detection algorithm worked effectively and the dense reconstruction algorithm produces accurate and robust results. We also show the improved results by using temporal constraints. Finally, the dense reconstructions of fast moving objects in a high frame-rate video are presented.

UR - http://www.scopus.com/inward/record.url?scp=84905595057&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905595057&partnerID=8YFLogxK

U2 - 10.1109/TPAMI.2014.2300490

DO - 10.1109/TPAMI.2014.2300490

M3 - Article

AN - SCOPUS:84905595057

VL - 36

SP - 1733

EP - 1747

JO - IEEE Transactions on Pattern Analysis and Machine Intelligence

JF - IEEE Transactions on Pattern Analysis and Machine Intelligence

SN - 0162-8828

IS - 9

M1 - 6714483

ER -