TY - GEN
T1 - Visual and somatic sensory feedback of brain activity for intuitive surgical robot manipulation
AU - Miura, Satoshi
AU - Matsumoto, Yuya
AU - Kobayashi, Yo
AU - Kawamura, Kazuya
AU - Nakashima, Yasutaka
AU - Fujie, Masakatsu G.
PY - 2015/11/4
Y1 - 2015/11/4
N2 - This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p<0.05) when compared with moving with closed eyes or only gazing among all participants. In conclusion, the brain can activate according to visual and somatic sensory feedback agreement.
AB - This paper presents a method to evaluate the hand-eye coordination of the master-slave surgical robot by measuring the activation of the intraparietal sulcus in users brain activity during controlling virtual manipulation. The objective is to examine the changes in activity of the intraparietal sulcus when the user's visual or somatic feedback is passed through or intercepted. The hypothesis is that the intraparietal sulcus activates significantly when both the visual and somatic sense pass feedback, but deactivates when either visual or somatic is intercepted. The brain activity of three subjects was measured by the functional near-infrared spectroscopic-topography brain imaging while they used a hand controller to move a virtual arm of a surgical simulator. The experiment was performed several times with three conditions: (i) the user controlled the virtual arm naturally under both visual and somatic feedback passed, (ii) the user moved with closed eyes under only somatic feedback passed, (iii) the user only gazed at the screen under only visual feedback passed. Brain activity showed significantly better control of the virtual arm naturally (p<0.05) when compared with moving with closed eyes or only gazing among all participants. In conclusion, the brain can activate according to visual and somatic sensory feedback agreement.
UR - http://www.scopus.com/inward/record.url?scp=84953216111&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84953216111&partnerID=8YFLogxK
U2 - 10.1109/EMBC.2015.7318250
DO - 10.1109/EMBC.2015.7318250
M3 - Conference contribution
C2 - 26736190
AN - SCOPUS:84953216111
T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
SP - 17
EP - 20
BT - 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
Y2 - 25 August 2015 through 29 August 2015
ER -