Novel imaging using a touchless display for computer-assisted hepato-biliary surgery

Yukio Oshiro, Kenoki Ohuchida, Toshiyuki Okada, Makoto Hashizume, Nobuhiro Ohkohchi

Research output: Contribution to journalArticle

Abstract

Purpose: We developed a touchless display system that allows the user to control the medical imaging software via hand gestures in the air. We conducted this study to verify the effectiveness of this novel touchless display system as a tool for assisting with surgical imaging. Methods: The patient’s computed tomography (CT) data are generally observed on a display during surgery. The “Dr. aeroTAP” touchless display system was developed to generate virtual mouse events based on the position of one hand. We conducted comparative analyses of using the Dr. aeroTAP vs. using a regular mouse (control group) by measuring the time to select a 3D image from 24 thumbnail images on a screen (study 1) and to then see the CT image on the DICOM viewer (study 2). Results: We used the Dr. aeroTAP in 31 hepato-biliary operative procedures performed at our hospital. In study 1, which measured the time required to select one of 24 thumbnails, there were significant differences between the mouse and Dr. aeroTAP groups for all five surgeons who participated (P < 0.001). In study 2, there were also significant differences in the time required for CT DICOM images to be displayed (P < 0.001). Conclusions: The touchless interface proved efficient for allowing the observation of surgical images while maintaining a sterile field during surgery.

Original languageEnglish
Pages (from-to)1512-1518
Number of pages7
JournalSurgery today
Volume47
Issue number12
DOIs
Publication statusPublished - Dec 1 2017

Fingerprint

Tomography
Hand
Gestures
Operative Surgical Procedures
Diagnostic Imaging
Software
Air
Observation
Control Groups
Surgeons

All Science Journal Classification (ASJC) codes

  • Surgery

Cite this

Novel imaging using a touchless display for computer-assisted hepato-biliary surgery. / Oshiro, Yukio; Ohuchida, Kenoki; Okada, Toshiyuki; Hashizume, Makoto; Ohkohchi, Nobuhiro.

In: Surgery today, Vol. 47, No. 12, 01.12.2017, p. 1512-1518.

Research output: Contribution to journalArticle

Oshiro, Yukio ; Ohuchida, Kenoki ; Okada, Toshiyuki ; Hashizume, Makoto ; Ohkohchi, Nobuhiro. / Novel imaging using a touchless display for computer-assisted hepato-biliary surgery. In: Surgery today. 2017 ; Vol. 47, No. 12. pp. 1512-1518.
@article{7d0b214418a74e959b8d6112391a44d2,
title = "Novel imaging using a touchless display for computer-assisted hepato-biliary surgery",
abstract = "Purpose: We developed a touchless display system that allows the user to control the medical imaging software via hand gestures in the air. We conducted this study to verify the effectiveness of this novel touchless display system as a tool for assisting with surgical imaging. Methods: The patient’s computed tomography (CT) data are generally observed on a display during surgery. The “Dr. aeroTAP” touchless display system was developed to generate virtual mouse events based on the position of one hand. We conducted comparative analyses of using the Dr. aeroTAP vs. using a regular mouse (control group) by measuring the time to select a 3D image from 24 thumbnail images on a screen (study 1) and to then see the CT image on the DICOM viewer (study 2). Results: We used the Dr. aeroTAP in 31 hepato-biliary operative procedures performed at our hospital. In study 1, which measured the time required to select one of 24 thumbnails, there were significant differences between the mouse and Dr. aeroTAP groups for all five surgeons who participated (P < 0.001). In study 2, there were also significant differences in the time required for CT DICOM images to be displayed (P < 0.001). Conclusions: The touchless interface proved efficient for allowing the observation of surgical images while maintaining a sterile field during surgery.",
author = "Yukio Oshiro and Kenoki Ohuchida and Toshiyuki Okada and Makoto Hashizume and Nobuhiro Ohkohchi",
year = "2017",
month = "12",
day = "1",
doi = "10.1007/s00595-017-1541-7",
language = "English",
volume = "47",
pages = "1512--1518",
journal = "Surgery Today",
issn = "0941-1291",
publisher = "Springer Japan",
number = "12",

}

TY - JOUR

T1 - Novel imaging using a touchless display for computer-assisted hepato-biliary surgery

AU - Oshiro, Yukio

AU - Ohuchida, Kenoki

AU - Okada, Toshiyuki

AU - Hashizume, Makoto

AU - Ohkohchi, Nobuhiro

PY - 2017/12/1

Y1 - 2017/12/1

N2 - Purpose: We developed a touchless display system that allows the user to control the medical imaging software via hand gestures in the air. We conducted this study to verify the effectiveness of this novel touchless display system as a tool for assisting with surgical imaging. Methods: The patient’s computed tomography (CT) data are generally observed on a display during surgery. The “Dr. aeroTAP” touchless display system was developed to generate virtual mouse events based on the position of one hand. We conducted comparative analyses of using the Dr. aeroTAP vs. using a regular mouse (control group) by measuring the time to select a 3D image from 24 thumbnail images on a screen (study 1) and to then see the CT image on the DICOM viewer (study 2). Results: We used the Dr. aeroTAP in 31 hepato-biliary operative procedures performed at our hospital. In study 1, which measured the time required to select one of 24 thumbnails, there were significant differences between the mouse and Dr. aeroTAP groups for all five surgeons who participated (P < 0.001). In study 2, there were also significant differences in the time required for CT DICOM images to be displayed (P < 0.001). Conclusions: The touchless interface proved efficient for allowing the observation of surgical images while maintaining a sterile field during surgery.

AB - Purpose: We developed a touchless display system that allows the user to control the medical imaging software via hand gestures in the air. We conducted this study to verify the effectiveness of this novel touchless display system as a tool for assisting with surgical imaging. Methods: The patient’s computed tomography (CT) data are generally observed on a display during surgery. The “Dr. aeroTAP” touchless display system was developed to generate virtual mouse events based on the position of one hand. We conducted comparative analyses of using the Dr. aeroTAP vs. using a regular mouse (control group) by measuring the time to select a 3D image from 24 thumbnail images on a screen (study 1) and to then see the CT image on the DICOM viewer (study 2). Results: We used the Dr. aeroTAP in 31 hepato-biliary operative procedures performed at our hospital. In study 1, which measured the time required to select one of 24 thumbnails, there were significant differences between the mouse and Dr. aeroTAP groups for all five surgeons who participated (P < 0.001). In study 2, there were also significant differences in the time required for CT DICOM images to be displayed (P < 0.001). Conclusions: The touchless interface proved efficient for allowing the observation of surgical images while maintaining a sterile field during surgery.

UR - http://www.scopus.com/inward/record.url?scp=85019871079&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019871079&partnerID=8YFLogxK

U2 - 10.1007/s00595-017-1541-7

DO - 10.1007/s00595-017-1541-7

M3 - Article

C2 - 28528461

AN - SCOPUS:85019871079

VL - 47

SP - 1512

EP - 1518

JO - Surgery Today

JF - Surgery Today

SN - 0941-1291

IS - 12

ER -