Automatic feature extraction using CNN for robust active one-shot scanning

Ryusuke Sagawa, Yuki Shiba, Takuto Hirukawa, Satoshi Ono, Hiroshi Kawasaki, Ryo Furukawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Active one-shot scanning techniques have been widely used for various applications. Stereo-based active one-shot scanning embeds a positional information regarding the image plane of a projector onto a projected pattern to retrieve correspondences entirely from a captured image. Many combinations of patterns and decoding algorithms for active one-shot scanning have been proposed. If the capturing environment lacks the assumed conditions, such as the absence of strong external lights, then reconstruction using those methods is degraded, because the pattern decoding fails. In this paper, we propose a general reconstruction algorithm that can be used for any kind of patterns without strict assumptions. The technique is based on an efficient feature extraction function that can drastically reduce redundant information from the raw pixel values of patches of captured images. Shapes are reconstructed by efficiently finding correspondences between a captured image and the pattern using low-dimensional feature vectors. Such a function is created automatically by a convolutional neural network using a large database of pattern images that are efficiently synthesized by using GPU with wide variation of depth and surface orientation. Experimental results show that our technique can be used for several existing patterns without any ad hoc algorithm or information regarding the scene or the sensor.

Original languageEnglish
Title of host publication2016 23rd International Conference on Pattern Recognition, ICPR 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages234-239
Number of pages6
ISBN (Electronic)9781509048472
DOIs
Publication statusPublished - Apr 13 2017
Externally publishedYes
Event23rd International Conference on Pattern Recognition, ICPR 2016 - Cancun, Mexico
Duration: Dec 4 2016Dec 8 2016

Other

Other23rd International Conference on Pattern Recognition, ICPR 2016
CountryMexico
CityCancun
Period12/4/1612/8/16

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Cite this

Sagawa, R., Shiba, Y., Hirukawa, T., Ono, S., Kawasaki, H., & Furukawa, R. (2017). Automatic feature extraction using CNN for robust active one-shot scanning. In 2016 23rd International Conference on Pattern Recognition, ICPR 2016 (pp. 234-239). [7899639] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICPR.2016.7899639