Auto-calibration Method for Active 3D Endoscope System Using Silhouette of Pattern Projector

Ryo Furukawa, Masahito Naito, Daisuke Miyazaki, Masahi Baba, Shinsaku Hiura, Yoji Sanomura, Shinji Tanaka, Hiroshi Kawasaki

研究成果: 書籍/レポート タイプへの寄稿会議への寄与


In this paper, we develop an active stereo system for endoscope which requires auto-calibration, because a micro pattern projector is inserted through the instrument channel during an operation and cannot be fixed to the endoscope. For solution, a new auto-calibration technique with full 6-DOF estimation of an active stereo system without any extra devices nor extra pattern projections is proposed. In the technique, the pattern projector itself is simultaneously captured with a target scene by an endoscope camera and the silhouette of the pattern projector is used to conduct 2D-3D matching by using the knowledge of the shape of the projector. In addition, the markers which is included in the projection pattern are extracted and the distances from the closest epipolar lines are calculated as for the cost function. To enhance the robustness of the reconstruction, we also propose a simple high dynamic range (HDR) imaging system for an endoscope by alternating the input power of the pattern projector ON and OFF to blink the pattern so that exposure time will vary with beat frequency, realizing a virtual multi-exposure camera. By applying our auto calibration technique with HDR imaging system, we achieved a robust and accurate reconstruction of tissue in metric 3D under practical operation of the endoscopic system, such as reconstruction of the inside of a real stomach of a pig.

ホスト出版物のタイトルImage and Video Technology - 8th Pacific-Rim Symposium, PSIVT 2017, Revised Selected Papers
編集者Carlos Hitoshi, Manoranjan Paul, Qingming Huang
出版社Springer Verlag
出版ステータス出版済み - 2018
イベント8th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2017 - Wuhan, 中国
継続期間: 11月 20 201711月 24 2017


名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
10749 LNCS


その他8th Pacific-Rim Symposium on Image and Video Technology, PSIVT 2017

!!!All Science Journal Classification (ASJC) codes

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)


「Auto-calibration Method for Active 3D Endoscope System Using Silhouette of Pattern Projector」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。