Incremental 3D cuboid modeling with drift compensation

Masashi Mishima, Hideaki Uchiyama, Diego Thomas, Rin Ichiro Taniguchi, Rafael Roberto, João Paulo Lima, Veronica Teichrieb

Research output: Contribution to journalArticle

Abstract

This paper presents a framework of incremental 3D cuboid modeling by using the mapping results of an RGB-D camera based simultaneous localization and mapping (SLAM) system. This framework is useful in accurately creating cuboid CAD models from a point cloud in an online manner. While performing the RGB-D SLAM, planes are incrementally reconstructed from a point cloud in each frame to create a plane map. Then, cuboids are detected in the plane map by analyzing the positional relationships between the planes, such as orthogonality, convexity, and proximity. Finally, the position, pose, and size of a cuboid are determined by computing the intersection of three perpendicular planes. To suppress the false detection of the cuboids, the cuboid shapes are incrementally updated with sequential measurements to check the uncertainty of the cuboids. In addition, the drift error of the SLAM is compensated by the registration of the cuboids. As an application of our framework, an augmented reality-based interactive cuboid modeling system was developed. In the evaluation at cluttered environments, the precision and recall of the cuboid detection were investigated, compared with a batch-based cuboid detection method, so that the advantages of our proposed method were clarified.

Original languageEnglish
Article number178
JournalSensors (Switzerland)
Volume19
Issue number1
DOIs
Publication statusPublished - Jan 1 2019

Fingerprint

Uncertainty
convexity
Augmented reality
orthogonality
computer aided design
intersections
proximity
Computer aided design
Cameras
cameras
Compensation and Redress
evaluation

All Science Journal Classification (ASJC) codes

  • Analytical Chemistry
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering

Cite this

Incremental 3D cuboid modeling with drift compensation. / Mishima, Masashi; Uchiyama, Hideaki; Thomas, Diego; Taniguchi, Rin Ichiro; Roberto, Rafael; Lima, João Paulo; Teichrieb, Veronica.

In: Sensors (Switzerland), Vol. 19, No. 1, 178, 01.01.2019.

Research output: Contribution to journalArticle

Mishima, Masashi ; Uchiyama, Hideaki ; Thomas, Diego ; Taniguchi, Rin Ichiro ; Roberto, Rafael ; Lima, João Paulo ; Teichrieb, Veronica. / Incremental 3D cuboid modeling with drift compensation. In: Sensors (Switzerland). 2019 ; Vol. 19, No. 1.
@article{e8478a5b456f44b39d2050958cc2129a,
title = "Incremental 3D cuboid modeling with drift compensation",
abstract = "This paper presents a framework of incremental 3D cuboid modeling by using the mapping results of an RGB-D camera based simultaneous localization and mapping (SLAM) system. This framework is useful in accurately creating cuboid CAD models from a point cloud in an online manner. While performing the RGB-D SLAM, planes are incrementally reconstructed from a point cloud in each frame to create a plane map. Then, cuboids are detected in the plane map by analyzing the positional relationships between the planes, such as orthogonality, convexity, and proximity. Finally, the position, pose, and size of a cuboid are determined by computing the intersection of three perpendicular planes. To suppress the false detection of the cuboids, the cuboid shapes are incrementally updated with sequential measurements to check the uncertainty of the cuboids. In addition, the drift error of the SLAM is compensated by the registration of the cuboids. As an application of our framework, an augmented reality-based interactive cuboid modeling system was developed. In the evaluation at cluttered environments, the precision and recall of the cuboid detection were investigated, compared with a batch-based cuboid detection method, so that the advantages of our proposed method were clarified.",
author = "Masashi Mishima and Hideaki Uchiyama and Diego Thomas and Taniguchi, {Rin Ichiro} and Rafael Roberto and Lima, {Jo{\~a}o Paulo} and Veronica Teichrieb",
year = "2019",
month = "1",
day = "1",
doi = "10.3390/s19010178",
language = "English",
volume = "19",
journal = "Sensors",
issn = "1424-3210",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "1",

}

TY - JOUR

T1 - Incremental 3D cuboid modeling with drift compensation

AU - Mishima, Masashi

AU - Uchiyama, Hideaki

AU - Thomas, Diego

AU - Taniguchi, Rin Ichiro

AU - Roberto, Rafael

AU - Lima, João Paulo

AU - Teichrieb, Veronica

PY - 2019/1/1

Y1 - 2019/1/1

N2 - This paper presents a framework of incremental 3D cuboid modeling by using the mapping results of an RGB-D camera based simultaneous localization and mapping (SLAM) system. This framework is useful in accurately creating cuboid CAD models from a point cloud in an online manner. While performing the RGB-D SLAM, planes are incrementally reconstructed from a point cloud in each frame to create a plane map. Then, cuboids are detected in the plane map by analyzing the positional relationships between the planes, such as orthogonality, convexity, and proximity. Finally, the position, pose, and size of a cuboid are determined by computing the intersection of three perpendicular planes. To suppress the false detection of the cuboids, the cuboid shapes are incrementally updated with sequential measurements to check the uncertainty of the cuboids. In addition, the drift error of the SLAM is compensated by the registration of the cuboids. As an application of our framework, an augmented reality-based interactive cuboid modeling system was developed. In the evaluation at cluttered environments, the precision and recall of the cuboid detection were investigated, compared with a batch-based cuboid detection method, so that the advantages of our proposed method were clarified.

AB - This paper presents a framework of incremental 3D cuboid modeling by using the mapping results of an RGB-D camera based simultaneous localization and mapping (SLAM) system. This framework is useful in accurately creating cuboid CAD models from a point cloud in an online manner. While performing the RGB-D SLAM, planes are incrementally reconstructed from a point cloud in each frame to create a plane map. Then, cuboids are detected in the plane map by analyzing the positional relationships between the planes, such as orthogonality, convexity, and proximity. Finally, the position, pose, and size of a cuboid are determined by computing the intersection of three perpendicular planes. To suppress the false detection of the cuboids, the cuboid shapes are incrementally updated with sequential measurements to check the uncertainty of the cuboids. In addition, the drift error of the SLAM is compensated by the registration of the cuboids. As an application of our framework, an augmented reality-based interactive cuboid modeling system was developed. In the evaluation at cluttered environments, the precision and recall of the cuboid detection were investigated, compared with a batch-based cuboid detection method, so that the advantages of our proposed method were clarified.

UR - http://www.scopus.com/inward/record.url?scp=85059795656&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059795656&partnerID=8YFLogxK

U2 - 10.3390/s19010178

DO - 10.3390/s19010178

M3 - Article

C2 - 30621340

AN - SCOPUS:85059795656

VL - 19

JO - Sensors

JF - Sensors

SN - 1424-3210

IS - 1

M1 - 178

ER -