2-DOF auto-calibration for a 3D endoscope system based on active stereo

Ryo Furukawa, Ryunosuke Masutani, Daisuke Miyazaki, Masashi Baba, Shinsaku Hiura, Marco Visentini-Scarzanella, Hiroki Morinaga, Hiroshi Kawasaki, Ryusuke Sagawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

For endoscopic medical treatment, measuring the size and shape of lesions, such as tumors, is important. We are developing a 3D endoscope system to measure the shape and size of living tissues based on active stereo. In previous works, our group attached a pattern projector outside the endoscope head. Since this increased the diameter of the endoscope, the burden and the risks of the patients would increase. In this paper, we set the pattern projector inside the instrument channel of the endoscope instead of mounting it outside, so that it can be deployed whenever required. This does not increase the size of the endoscope and facilitates the measuring process. However, since the projector is not physically fixed to the endoscope anymore prior to the operation, we propose an 'auto-calibration' technique where extrinsic parameters are calibrated intra-operatively from a point marker on the projector observed simultaneously on the target surface. In the experiment, we show that the external parameters were successfully calibrated to obtain 3D reconstructions properly with the overall systems. The accuracy of the auto-calibration was validated by confirming that the epipolar constraints were kept, and a 3D reconstruction of a human tissue was demonstrated.

Original languageEnglish
Title of host publication2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages7937-7941
Number of pages5
ISBN (Electronic)9781424492718
DOIs
Publication statusPublished - Nov 4 2015
Externally publishedYes
Event37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 - Milan, Italy
Duration: Aug 25 2015Aug 29 2015

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2015-November
ISSN (Print)1557-170X

Other

Other37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
CountryItaly
CityMilan
Period8/25/158/29/15

Fingerprint

Endoscopy
Endoscopes
Calibration
Tissue
Mountings
Tumors
Head
Neoplasms
Experiments

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Cite this

Furukawa, R., Masutani, R., Miyazaki, D., Baba, M., Hiura, S., Visentini-Scarzanella, M., ... Sagawa, R. (2015). 2-DOF auto-calibration for a 3D endoscope system based on active stereo. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 (pp. 7937-7941). [7320233] (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2015-November). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2015.7320233

2-DOF auto-calibration for a 3D endoscope system based on active stereo. / Furukawa, Ryo; Masutani, Ryunosuke; Miyazaki, Daisuke; Baba, Masashi; Hiura, Shinsaku; Visentini-Scarzanella, Marco; Morinaga, Hiroki; Kawasaki, Hiroshi; Sagawa, Ryusuke.

2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 7937-7941 7320233 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2015-November).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Furukawa, R, Masutani, R, Miyazaki, D, Baba, M, Hiura, S, Visentini-Scarzanella, M, Morinaga, H, Kawasaki, H & Sagawa, R 2015, 2-DOF auto-calibration for a 3D endoscope system based on active stereo. in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015., 7320233, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, vol. 2015-November, Institute of Electrical and Electronics Engineers Inc., pp. 7937-7941, 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015, Milan, Italy, 8/25/15. https://doi.org/10.1109/EMBC.2015.7320233
Furukawa R, Masutani R, Miyazaki D, Baba M, Hiura S, Visentini-Scarzanella M et al. 2-DOF auto-calibration for a 3D endoscope system based on active stereo. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 7937-7941. 7320233. (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). https://doi.org/10.1109/EMBC.2015.7320233
Furukawa, Ryo ; Masutani, Ryunosuke ; Miyazaki, Daisuke ; Baba, Masashi ; Hiura, Shinsaku ; Visentini-Scarzanella, Marco ; Morinaga, Hiroki ; Kawasaki, Hiroshi ; Sagawa, Ryusuke. / 2-DOF auto-calibration for a 3D endoscope system based on active stereo. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 7937-7941 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS).
@inproceedings{7b43848b66cd4ecfa75402f30afcdbea,
title = "2-DOF auto-calibration for a 3D endoscope system based on active stereo",
abstract = "For endoscopic medical treatment, measuring the size and shape of lesions, such as tumors, is important. We are developing a 3D endoscope system to measure the shape and size of living tissues based on active stereo. In previous works, our group attached a pattern projector outside the endoscope head. Since this increased the diameter of the endoscope, the burden and the risks of the patients would increase. In this paper, we set the pattern projector inside the instrument channel of the endoscope instead of mounting it outside, so that it can be deployed whenever required. This does not increase the size of the endoscope and facilitates the measuring process. However, since the projector is not physically fixed to the endoscope anymore prior to the operation, we propose an 'auto-calibration' technique where extrinsic parameters are calibrated intra-operatively from a point marker on the projector observed simultaneously on the target surface. In the experiment, we show that the external parameters were successfully calibrated to obtain 3D reconstructions properly with the overall systems. The accuracy of the auto-calibration was validated by confirming that the epipolar constraints were kept, and a 3D reconstruction of a human tissue was demonstrated.",
author = "Ryo Furukawa and Ryunosuke Masutani and Daisuke Miyazaki and Masashi Baba and Shinsaku Hiura and Marco Visentini-Scarzanella and Hiroki Morinaga and Hiroshi Kawasaki and Ryusuke Sagawa",
year = "2015",
month = "11",
day = "4",
doi = "10.1109/EMBC.2015.7320233",
language = "English",
series = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "7937--7941",
booktitle = "2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015",
address = "United States",

}

TY - GEN

T1 - 2-DOF auto-calibration for a 3D endoscope system based on active stereo

AU - Furukawa, Ryo

AU - Masutani, Ryunosuke

AU - Miyazaki, Daisuke

AU - Baba, Masashi

AU - Hiura, Shinsaku

AU - Visentini-Scarzanella, Marco

AU - Morinaga, Hiroki

AU - Kawasaki, Hiroshi

AU - Sagawa, Ryusuke

PY - 2015/11/4

Y1 - 2015/11/4

N2 - For endoscopic medical treatment, measuring the size and shape of lesions, such as tumors, is important. We are developing a 3D endoscope system to measure the shape and size of living tissues based on active stereo. In previous works, our group attached a pattern projector outside the endoscope head. Since this increased the diameter of the endoscope, the burden and the risks of the patients would increase. In this paper, we set the pattern projector inside the instrument channel of the endoscope instead of mounting it outside, so that it can be deployed whenever required. This does not increase the size of the endoscope and facilitates the measuring process. However, since the projector is not physically fixed to the endoscope anymore prior to the operation, we propose an 'auto-calibration' technique where extrinsic parameters are calibrated intra-operatively from a point marker on the projector observed simultaneously on the target surface. In the experiment, we show that the external parameters were successfully calibrated to obtain 3D reconstructions properly with the overall systems. The accuracy of the auto-calibration was validated by confirming that the epipolar constraints were kept, and a 3D reconstruction of a human tissue was demonstrated.

AB - For endoscopic medical treatment, measuring the size and shape of lesions, such as tumors, is important. We are developing a 3D endoscope system to measure the shape and size of living tissues based on active stereo. In previous works, our group attached a pattern projector outside the endoscope head. Since this increased the diameter of the endoscope, the burden and the risks of the patients would increase. In this paper, we set the pattern projector inside the instrument channel of the endoscope instead of mounting it outside, so that it can be deployed whenever required. This does not increase the size of the endoscope and facilitates the measuring process. However, since the projector is not physically fixed to the endoscope anymore prior to the operation, we propose an 'auto-calibration' technique where extrinsic parameters are calibrated intra-operatively from a point marker on the projector observed simultaneously on the target surface. In the experiment, we show that the external parameters were successfully calibrated to obtain 3D reconstructions properly with the overall systems. The accuracy of the auto-calibration was validated by confirming that the epipolar constraints were kept, and a 3D reconstruction of a human tissue was demonstrated.

UR - http://www.scopus.com/inward/record.url?scp=84953226331&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84953226331&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2015.7320233

DO - 10.1109/EMBC.2015.7320233

M3 - Conference contribution

C2 - 26738133

AN - SCOPUS:84953226331

T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

SP - 7937

EP - 7941

BT - 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -