OBJECTIVE: Making mistakes is inevitable, but identifying them allows us to correct or adapt our behavior to improve future performance. Current brain-machine interfaces (BMIs) make errors that need to be explicitly corrected by the user, thereby consuming time and thus hindering performance. We hypothesized that neural correlates of the user perceiving the mistake could be used by the BMI to automatically correct errors. However, it was unknown whether intracortical outcome error signals were present in the premotor and primary motor cortices, brain regions successfully used for intracortical BMIs. APPROACH: We report here for the first time a putative outcome error signal in spiking activity within these cortices when rhesus macaques performed an intracortical BMI computer cursor task. MAIN RESULTS: We decoded BMI trial outcomes shortly after and even before a trial ended with 96% and 84% accuracy, respectively. This led us to develop and implement in real-time a first-of-its-kind intracortical BMI error 'detect-and-act' system that attempts to automatically 'undo' or 'prevent' mistakes. The detect-and-act system works independently and in parallel to a kinematic BMI decoder. In a challenging task that resulted in substantial errors, this approach improved the performance of a BMI employing two variants of the ubiquitous Kalman velocity filter, including a state-of-the-art decoder (ReFIT-KF). SIGNIFICANCE: Detecting errors in real-time from the same brain regions that are commonly used to control BMIs should improve the clinical viability of BMIs aimed at restoring motor function to people with paralysis.
OBJECTIVE: Making mistakes is inevitable, but identifying them allows us to correct or adapt our behavior to improve future performance. Current brain-machine interfaces (BMIs) make errors that need to be explicitly corrected by the user, thereby consuming time and thus hindering performance. We hypothesized that neural correlates of the user perceiving the mistake could be used by the BMI to automatically correct errors. However, it was unknown whether intracortical outcome error signals were present in the premotor and primary motor cortices, brain regions successfully used for intracortical BMIs. APPROACH: We report here for the first time a putative outcome error signal in spiking activity within these cortices when rhesus macaques performed an intracortical BMI computer cursor task. MAIN RESULTS: We decoded BMI trial outcomes shortly after and even before a trial ended with 96% and 84% accuracy, respectively. This led us to develop and implement in real-time a first-of-its-kind intracortical BMI error 'detect-and-act' system that attempts to automatically 'undo' or 'prevent' mistakes. The detect-and-act system works independently and in parallel to a kinematic BMI decoder. In a challenging task that resulted in substantial errors, this approach improved the performance of a BMI employing two variants of the ubiquitous Kalman velocity filter, including a state-of-the-art decoder (ReFIT-KF). SIGNIFICANCE: Detecting errors in real-time from the same brain regions that are commonly used to control BMIs should improve the clinical viability of BMIs aimed at restoring motor function to people with paralysis.
Authors: Paul Nuyujukian; Jonathan C Kao; Joline M Fan; Sergey D Stavisky; Stephen I Ryu; Krishna V Shenoy Journal: J Neural Eng Date: 2014-10-13 Impact factor: 5.379
Authors: Risa Kawai; Timothy Markman; Rajesh Poddar; Raymond Ko; Antoniu L Fantana; Ashesh K Dhawale; Adam R Kampff; Bence P Ölveczky Journal: Neuron Date: 2015-04-16 Impact factor: 17.173
Authors: Chad E Bouton; Ammar Shaikhouni; Nicholas V Annetta; Marcia A Bockbrader; David A Friedenberg; Dylan M Nielson; Gaurav Sharma; Per B Sederberg; Bradley C Glenn; W Jerry Mysiw; Austin G Morgan; Milind Deogaonkar; Ali R Rezai Journal: Nature Date: 2016-04-13 Impact factor: 49.962
Authors: Chethan Pandarinath; K Cora Ames; Abigail A Russo; Ali Farshchian; Lee E Miller; Eva L Dyer; Jonathan C Kao Journal: J Neurosci Date: 2018-10-31 Impact factor: 6.167
Authors: Nir Even-Chen; Dante G Muratore; Sergey D Stavisky; Leigh R Hochberg; Jaimie M Henderson; Boris Murmann; Krishna V Shenoy Journal: Nat Biomed Eng Date: 2020-08-03 Impact factor: 25.671
Authors: Sumner L Norman; David Maresca; Vassilios N Christopoulos; Whitney S Griggs; Charlie Demene; Mickael Tanter; Mikhail G Shapiro; Richard A Andersen Journal: Neuron Date: 2021-03-22 Impact factor: 17.173