Guy Hotson1, David P McMullen2, Matthew S Fifer3, Matthew S Johannes4, Kapil D Katyal4, Matthew P Para4, Robert Armiger4, William S Anderson2, Nitish V Thakor3, Brock A Wester4, Nathan E Crone5. 1. Department of Electrical and Computer Engineering, Johns Hopkins University, 3400 N Charles, Baltimore, MD 21218, USA. 2. Department of Neurosurgery, Johns Hopkins University, 600 N Wolfe, Baltimore, MD 21205, USA. 3. Department of Biomedical Engineering, Johns Hopkins University, 600 N Wolfe, Baltimore, MD 21205, USA. 4. Applied Neuroscience, JHU Applied Physics Laboratory, 7701 Montpelier Rd, Laurel, MD 20723, USA. 5. Department of Neurology, Johns Hopkins University, 600 N Wolfe, Baltimore, MD 21205, USA.
Abstract
OBJECTIVE: We used native sensorimotor representations of fingers in a brain-machine interface (BMI) to achieve immediate online control of individual prosthetic fingers. APPROACH: Using high gamma responses recorded with a high-density electrocorticography (ECoG) array, we rapidly mapped the functional anatomy of cued finger movements. We used these cortical maps to select ECoG electrodes for a hierarchical linear discriminant analysis classification scheme to predict: (1) if any finger was moving, and, if so, (2) which digit was moving. To account for sensory feedback, we also mapped the spatiotemporal activation elicited by vibrotactile stimulation. Finally, we used this prediction framework to provide immediate online control over individual fingers of the Johns Hopkins University Applied Physics Laboratory modular prosthetic limb. MAIN RESULTS: The balanced classification accuracy for detection of movements during the online control session was 92% (chance: 50%). At the onset of movement, finger classification was 76% (chance: 20%), and 88% (chance: 25%) if the pinky and ring finger movements were coupled. Balanced accuracy of fully flexing the cued finger was 64%, and 77% had we combined pinky and ring commands. Offline decoding yielded a peak finger decoding accuracy of 96.5% (chance: 20%) when using an optimized selection of electrodes. Offline analysis demonstrated significant finger-specific activations throughout sensorimotor cortex. Activations either prior to movement onset or during sensory feedback led to discriminable finger control. SIGNIFICANCE: Our results demonstrate the ability of ECoG-based BMIs to leverage the native functional anatomy of sensorimotor cortical populations to immediately control individual finger movements in real time.
OBJECTIVE: We used native sensorimotor representations of fingers in a brain-machine interface (BMI) to achieve immediate online control of individual prosthetic fingers. APPROACH: Using high gamma responses recorded with a high-density electrocorticography (ECoG) array, we rapidly mapped the functional anatomy of cued finger movements. We used these cortical maps to select ECoG electrodes for a hierarchical linear discriminant analysis classification scheme to predict: (1) if any finger was moving, and, if so, (2) which digit was moving. To account for sensory feedback, we also mapped the spatiotemporal activation elicited by vibrotactile stimulation. Finally, we used this prediction framework to provide immediate online control over individual fingers of the Johns Hopkins University Applied Physics Laboratory modular prosthetic limb. MAIN RESULTS: The balanced classification accuracy for detection of movements during the online control session was 92% (chance: 50%). At the onset of movement, finger classification was 76% (chance: 20%), and 88% (chance: 25%) if the pinky and ring finger movements were coupled. Balanced accuracy of fully flexing the cued finger was 64%, and 77% had we combined pinky and ring commands. Offline decoding yielded a peak finger decoding accuracy of 96.5% (chance: 20%) when using an optimized selection of electrodes. Offline analysis demonstrated significant finger-specific activations throughout sensorimotor cortex. Activations either prior to movement onset or during sensory feedback led to discriminable finger control. SIGNIFICANCE: Our results demonstrate the ability of ECoG-based BMIs to leverage the native functional anatomy of sensorimotor cortical populations to immediately control individual finger movements in real time.
Authors: Kai J Miller; Gerwin Schalk; Eberhard E Fetz; Marcel den Nijs; Jeffrey G Ojemann; Rajesh P N Rao Journal: Proc Natl Acad Sci U S A Date: 2010-02-16 Impact factor: 11.205
Authors: Jeroen C W Siero; Dora Hermes; Hans Hoogduin; Peter R Luijten; Nick F Ramsey; Natalia Petridou Journal: Neuroimage Date: 2014-07-12 Impact factor: 6.556
Authors: Matthew S Fifer; Guy Hotson; Brock A Wester; David P McMullen; Yujing Wang; Matthew S Johannes; Kapil D Katyal; John B Helder; Matthew P Para; R Jacob Vogelstein; William S Anderson; Nitish V Thakor; Nathan E Crone Journal: IEEE Trans Neural Syst Rehabil Eng Date: 2013-10-24 Impact factor: 3.802
Authors: Leigh R Hochberg; Daniel Bacher; Beata Jarosiewicz; Nicolas Y Masse; John D Simeral; Joern Vogel; Sami Haddadin; Jie Liu; Sydney S Cash; Patrick van der Smagt; John P Donoghue Journal: Nature Date: 2012-05-16 Impact factor: 49.962
Authors: Samuel R Nason; Alex K Vaskov; Matthew S Willsey; Elissa J Welle; Hyochan An; Philip P Vu; Autumn J Bullard; Chrono S Nu; Jonathan C Kao; Krishna V Shenoy; Taekwang Jang; Hun-Seok Kim; David Blaauw; Parag G Patil; Cynthia A Chestek Journal: Nat Biomed Eng Date: 2020-07-27 Impact factor: 25.671
Authors: Tessy M Thomas; Daniel N Candrea; Matthew S Fifer; David P McMullen; William S Anderson; Nitish V Thakor; Nathan E Crone Journal: IEEE Trans Neural Syst Rehabil Eng Date: 2019-01-07 Impact factor: 3.802
Authors: Alan D Degenhart; James Eles; Richard Dum; Jessica L Mischel; Ivan Smalianchuk; Bridget Endler; Robin C Ashmore; Elizabeth C Tyler-Kabara; Nicholas G Hatsopoulos; Wei Wang; Aaron P Batista; X Tracy Cui Journal: J Neural Eng Date: 2016-06-28 Impact factor: 5.379
Authors: Omid G Sani; Yuxiao Yang; Morgan B Lee; Heather E Dawes; Edward F Chang; Maryam M Shanechi Journal: Nat Biotechnol Date: 2018-09-10 Impact factor: 54.908
Authors: Karen E Schroeder; Zachary T Irwin; Autumn J Bullard; David E Thompson; J Nicole Bentley; William C Stacey; Parag G Patil; Cynthia A Chestek Journal: J Neural Eng Date: 2017-08 Impact factor: 5.379