TY - JOUR
T1 - Neural decoding of electrocorticographic signals using dynamic mode decomposition
AU - Shiraishi, Yoshiyuki
AU - Kawahara, Yoshinobu
AU - Yamashita, Okito
AU - Fukuma, Ryohei
AU - Yamamoto, Shota
AU - Saitoh, Youichi
AU - Kishima, Haruhiko
AU - Yanagisawa, Takufumi
N1 - Funding Information:
Original content from this work may be used under the terms of the . Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI. Contract research with the National Institute of Information and Communications Technology 209 Japan Society for the Promotion of Science http://dx.doi.org/10.13039/501100001691 JP15H05710 JP17H06032 JP18H03287 NIBIOHN SIP (Innovative AI Hospital System) Precursory Research for Embryonic Science and Technology http://dx.doi.org/10.13039/501100009023 JPMJPR1506 Core Research for Evolutional Science and Technology http://dx.doi.org/10.13039/501100003382 JPMJCR18A5 JPMJCR1913 Exploratory Research for Advanced Technology http://dx.doi.org/10.13039/501100009024 JPMJER1801 Japan Agency for Medical Research and Development http://dx.doi.org/10.13039/100009619 19dm0207070h0001 JP19de0107001 JP19dm0307009 JP19dm0307103 Canon Foundation for Scientific Research http://dx.doi.org/10.13039/100009851 yes � 2020 The Author(s). Published by IOP Publishing Ltd Creative Commons Attribution 4.0 license
Publisher Copyright:
© 2020 The Author(s). Published by IOP Publishing Ltd.
PY - 2020/6
Y1 - 2020/6
N2 - Objective. Brain-computer interfaces (BCIs) using electrocorticographic (ECoG) signals have been developed to restore the communication function of severely paralyzed patients. However, the limited amount of information derived from ECoG signals hinders their clinical applications. We aimed to develop a method to decode ECoG signals using spatiotemporal patterns characterizing movement types to increase the amount of information gained from these signals. Approach. Previous studies have demonstrated that motor information could be decoded using powers of specific frequency bands of the ECoG signals estimated by fast Fourier transform (FFT) or wavelet analysis. However, because FFT is evaluated for each channel, the temporal and spatial patterns among channels are difficult to evaluate. Here, we used dynamic mode decomposition (DMD) to evaluate the spatiotemporal pattern of ECoG signals and evaluated the accuracy of motor decoding with the DMD modes. We used ECoG signals during three types of hand movements, which were recorded from 11 patients implanted with subdural electrodes. From the signals at the time of the movements, the modes and powers were evaluated by DMD and FFT and were decoded using support vector machine. We used the Grassmann kernel to evaluate the distance between modes estimated by DMD (DMD mode). In addition, we decoded the DMD modes, in which the phase components were shuffled, to compare the classification accuracy. Main results. The decoding accuracy using DMD modes was significantly better than that using FFT powers. The accuracy significantly decreased when the phases of the DMD mode were shuffled. Among the frequency bands, the DMD mode at approximately 100 Hz demonstrated the highest classification accuracy. Significance. DMD successfully captured the spatiotemporal patterns characterizing the movement types and contributed to improving the decoding accuracy. This method can be applied to improve BCIs to help severely paralyzed patients communicate.
AB - Objective. Brain-computer interfaces (BCIs) using electrocorticographic (ECoG) signals have been developed to restore the communication function of severely paralyzed patients. However, the limited amount of information derived from ECoG signals hinders their clinical applications. We aimed to develop a method to decode ECoG signals using spatiotemporal patterns characterizing movement types to increase the amount of information gained from these signals. Approach. Previous studies have demonstrated that motor information could be decoded using powers of specific frequency bands of the ECoG signals estimated by fast Fourier transform (FFT) or wavelet analysis. However, because FFT is evaluated for each channel, the temporal and spatial patterns among channels are difficult to evaluate. Here, we used dynamic mode decomposition (DMD) to evaluate the spatiotemporal pattern of ECoG signals and evaluated the accuracy of motor decoding with the DMD modes. We used ECoG signals during three types of hand movements, which were recorded from 11 patients implanted with subdural electrodes. From the signals at the time of the movements, the modes and powers were evaluated by DMD and FFT and were decoded using support vector machine. We used the Grassmann kernel to evaluate the distance between modes estimated by DMD (DMD mode). In addition, we decoded the DMD modes, in which the phase components were shuffled, to compare the classification accuracy. Main results. The decoding accuracy using DMD modes was significantly better than that using FFT powers. The accuracy significantly decreased when the phases of the DMD mode were shuffled. Among the frequency bands, the DMD mode at approximately 100 Hz demonstrated the highest classification accuracy. Significance. DMD successfully captured the spatiotemporal patterns characterizing the movement types and contributed to improving the decoding accuracy. This method can be applied to improve BCIs to help severely paralyzed patients communicate.
UR - http://www.scopus.com/inward/record.url?scp=85085715328&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85085715328&partnerID=8YFLogxK
U2 - 10.1088/1741-2552/ab8910
DO - 10.1088/1741-2552/ab8910
M3 - Article
C2 - 32289756
AN - SCOPUS:85085715328
SN - 1741-2560
VL - 17
JO - Journal of Neural Engineering
JF - Journal of Neural Engineering
IS - 3
M1 - 036009
ER -