Tissue shape acquisition with a hybrid structured light and photometric stereo endoscopic system

Marco Visentini-Scarzanella, Tatsuya Hanayama, Ryunosuke Masutani, Shigeto Yoshida, Yoko Kominami, Yoji Sanomura, Shinji Tanaka, Ryo Furukawa, Hiroshi Kawasaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In situ 3D reconstruction from endoscopic images is important to determine the correct course of action for, e.g., treatment of abnormal growths. Currently, the endoscopist has to rely solely on visual cues in order to infer the growth’s shape and size and determine an appropriate treatment. However, tissue uniformity and scale ambiguity from traditional monocular endoscopes make this visual assessment prone to errors and time consuming. We propose a practical system to densely reconstruct both shape and size of tissues with minimal modifications to a standard endoscope. We present a custom single-fiber structured light probe projecting a wave pattern on the tissue surface that allows semidense reconstruction with few ambiguities. Based on the coarse reconstruction, we retrieve the surface reflectance parameters according to a hybrid diffuse/specular model which are used to initialise a close-range Photometric Stereo reconstruction. By taking into account the tissue characteristics and the light fall-off, our Photometric Stereo formulation provides dense metric 3D shape information without the need for surface normal integration. A preliminary study was carried out both on phantoms and ex vivo samples of human tissue.

Original languageEnglish
Title of host publicationComputer-Assisted and Robotic Endoscopy - 2nd International Workshop, CARE 2015, Held in Conjunction with MICCAI 2015, Revised Selected Papers
EditorsTobias Reichl, Austin Reiter, Xiongbiao Luo, Gian-Luca Mariottini, Xiongbiao Luo
PublisherSpringer Verlag
Pages46-58
Number of pages13
ISBN (Print)9783319299648
DOIs
Publication statusPublished - 2016
Externally publishedYes
Event2nd International Workshop on Computer-Assisted and Robotic Endoscopy, CARE 2015 - Munich, Germany
Duration: Oct 5 2015Oct 5 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9515
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other2nd International Workshop on Computer-Assisted and Robotic Endoscopy, CARE 2015
CountryGermany
CityMunich
Period10/5/1510/5/15

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Tissue shape acquisition with a hybrid structured light and photometric stereo endoscopic system'. Together they form a unique fingerprint.

Cite this