Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography: Application to 20 clinical cases

Kozo Konishi, Makoto Hashizume, Masahiko Nakamoto, Yoshihiro Kakeji, Ichiro Yoshino, Akinobu Taketomi, Yoshinobu Sato, Shinichi Tamura, Yoshihiko Maehara

Research output: Contribution to journalArticle

17 Citations (Scopus)

Abstract

In the endoscopic surgical fields, more information which could be used intraoperatively is strongly demanded. Three-dimensional reconstructed images are useful imaging modalities to assist the surgeon in endoscopic surgery. We expected a new magneto-optic hybrid 3-D sensor configuration, and have developed an augmented reality navigation system using an accurate three-dimensional sensory system that can be utilized in endoscopic surgery. The system has accommodated oblique endoscope, real-time distortion correction of magnetic fields. We have preliminary established 'combined' navigation system. The complete system consists of a laparoscope, two (magnetic and optic) 3D digitizers, ultrasonographic device, a laparoscopic US probe, and a workstation with a volume rendering accelerator. Augmented reality (AR) visualization, which superimposed the visualized 3D-US images and segmented and rendered CT-based images on captured laparoscopic live images, was achieved. We applied our system to various clinical cases. The system provides us real-time anatomical information which cannot be visualized without navigation system. 3D-US as an imaging modality has the advantage that real-time imaging is acquirable, regardless of organ shift or distortion.

Original languageEnglish
Pages (from-to)537-542
Number of pages6
JournalInternational Congress Series
Volume1281
DOIs
Publication statusPublished - May 1 2005

Fingerprint

Tomography
Laparoscopes
Three-Dimensional Imaging
Endoscopes
Magnetic Fields
Equipment and Supplies
Surgeons

All Science Journal Classification (ASJC) codes

  • Medicine(all)

Cite this

Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography : Application to 20 clinical cases. / Konishi, Kozo; Hashizume, Makoto; Nakamoto, Masahiko; Kakeji, Yoshihiro; Yoshino, Ichiro; Taketomi, Akinobu; Sato, Yoshinobu; Tamura, Shinichi; Maehara, Yoshihiko.

In: International Congress Series, Vol. 1281, 01.05.2005, p. 537-542.

Research output: Contribution to journalArticle

Konishi, Kozo ; Hashizume, Makoto ; Nakamoto, Masahiko ; Kakeji, Yoshihiro ; Yoshino, Ichiro ; Taketomi, Akinobu ; Sato, Yoshinobu ; Tamura, Shinichi ; Maehara, Yoshihiko. / Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography : Application to 20 clinical cases. In: International Congress Series. 2005 ; Vol. 1281. pp. 537-542.
@article{b89c3694665440c1ba681f3ce7ac256f,
title = "Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography: Application to 20 clinical cases",
abstract = "In the endoscopic surgical fields, more information which could be used intraoperatively is strongly demanded. Three-dimensional reconstructed images are useful imaging modalities to assist the surgeon in endoscopic surgery. We expected a new magneto-optic hybrid 3-D sensor configuration, and have developed an augmented reality navigation system using an accurate three-dimensional sensory system that can be utilized in endoscopic surgery. The system has accommodated oblique endoscope, real-time distortion correction of magnetic fields. We have preliminary established 'combined' navigation system. The complete system consists of a laparoscope, two (magnetic and optic) 3D digitizers, ultrasonographic device, a laparoscopic US probe, and a workstation with a volume rendering accelerator. Augmented reality (AR) visualization, which superimposed the visualized 3D-US images and segmented and rendered CT-based images on captured laparoscopic live images, was achieved. We applied our system to various clinical cases. The system provides us real-time anatomical information which cannot be visualized without navigation system. 3D-US as an imaging modality has the advantage that real-time imaging is acquirable, regardless of organ shift or distortion.",
author = "Kozo Konishi and Makoto Hashizume and Masahiko Nakamoto and Yoshihiro Kakeji and Ichiro Yoshino and Akinobu Taketomi and Yoshinobu Sato and Shinichi Tamura and Yoshihiko Maehara",
year = "2005",
month = "5",
day = "1",
doi = "10.1016/j.ics.2005.03.234",
language = "English",
volume = "1281",
pages = "537--542",
journal = "International Congress Series",
issn = "0531-5131",
publisher = "Elsevier BV",

}

TY - JOUR

T1 - Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography

T2 - Application to 20 clinical cases

AU - Konishi, Kozo

AU - Hashizume, Makoto

AU - Nakamoto, Masahiko

AU - Kakeji, Yoshihiro

AU - Yoshino, Ichiro

AU - Taketomi, Akinobu

AU - Sato, Yoshinobu

AU - Tamura, Shinichi

AU - Maehara, Yoshihiko

PY - 2005/5/1

Y1 - 2005/5/1

N2 - In the endoscopic surgical fields, more information which could be used intraoperatively is strongly demanded. Three-dimensional reconstructed images are useful imaging modalities to assist the surgeon in endoscopic surgery. We expected a new magneto-optic hybrid 3-D sensor configuration, and have developed an augmented reality navigation system using an accurate three-dimensional sensory system that can be utilized in endoscopic surgery. The system has accommodated oblique endoscope, real-time distortion correction of magnetic fields. We have preliminary established 'combined' navigation system. The complete system consists of a laparoscope, two (magnetic and optic) 3D digitizers, ultrasonographic device, a laparoscopic US probe, and a workstation with a volume rendering accelerator. Augmented reality (AR) visualization, which superimposed the visualized 3D-US images and segmented and rendered CT-based images on captured laparoscopic live images, was achieved. We applied our system to various clinical cases. The system provides us real-time anatomical information which cannot be visualized without navigation system. 3D-US as an imaging modality has the advantage that real-time imaging is acquirable, regardless of organ shift or distortion.

AB - In the endoscopic surgical fields, more information which could be used intraoperatively is strongly demanded. Three-dimensional reconstructed images are useful imaging modalities to assist the surgeon in endoscopic surgery. We expected a new magneto-optic hybrid 3-D sensor configuration, and have developed an augmented reality navigation system using an accurate three-dimensional sensory system that can be utilized in endoscopic surgery. The system has accommodated oblique endoscope, real-time distortion correction of magnetic fields. We have preliminary established 'combined' navigation system. The complete system consists of a laparoscope, two (magnetic and optic) 3D digitizers, ultrasonographic device, a laparoscopic US probe, and a workstation with a volume rendering accelerator. Augmented reality (AR) visualization, which superimposed the visualized 3D-US images and segmented and rendered CT-based images on captured laparoscopic live images, was achieved. We applied our system to various clinical cases. The system provides us real-time anatomical information which cannot be visualized without navigation system. 3D-US as an imaging modality has the advantage that real-time imaging is acquirable, regardless of organ shift or distortion.

UR - http://www.scopus.com/inward/record.url?scp=33646464562&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33646464562&partnerID=8YFLogxK

U2 - 10.1016/j.ics.2005.03.234

DO - 10.1016/j.ics.2005.03.234

M3 - Article

AN - SCOPUS:33646464562

VL - 1281

SP - 537

EP - 542

JO - International Congress Series

JF - International Congress Series

SN - 0531-5131

ER -