Disha Gupta1, N Jeremy Hill, Peter Brunner, Aysegul Gunduz, Anthony L Ritaccio, Gerwin Schalk. 1. Wadsworth Center, New York State Department of Health, Albany, NY, USA. Department of Neurology, Albany Medical College, Albany, NY, USA. Early Brain Injury Recovery Program, Burke-Cornell Medical Research Institute, White Plains, NY, USA.
Abstract
OBJECTIVE: Real-time monitoring of the brain is potentially valuable for performance monitoring, communication, training or rehabilitation. In natural situations, the brain performs a complex mix of various sensory, motor or cognitive functions. Thus, real-time brain monitoring would be most valuable if (a) it could decode information from multiple brain systems simultaneously, and (b) this decoding of each brain system were robust to variations in the activity of other (unrelated) brain systems. Previous studies showed that it is possible to decode some information from different brain systems in retrospect and/or in isolation. In our study, we set out to determine whether it is possible to simultaneously decode important information about a user from different brain systems in real time, and to evaluate the impact of concurrent activity in different brain systems on decoding performance. APPROACH: We study these questions using electrocorticographic signals recorded in humans. We first document procedures for generating stable decoding models given little training data, and then report their use for offline and for real-time decoding from 12 subjects (six for offline parameter optimization, six for online experimentation). The subjects engage in tasks that involve movement intention, movement execution and auditory functions, separately, and then simultaneously. Main Results: Our real-time results demonstrate that our system can identify intention and movement periods in single trials with an accuracy of 80.4% and 86.8%, respectively (where 50% would be expected by chance). Simultaneously, the decoding of the power envelope of an auditory stimulus resulted in an average correlation coefficient of 0.37 between the actual and decoded power envelopes. These decoders were trained separately and executed simultaneously in real time. SIGNIFICANCE: This study yielded the first demonstration that it is possible to decode simultaneously the functional activity of multiple independent brain systems. Our comparison of univariate and multivariate decoding strategies, and our analysis of the influence of their decoding parameters, provides benchmarks and guidelines for future research on this topic.
OBJECTIVE: Real-time monitoring of the brain is potentially valuable for performance monitoring, communication, training or rehabilitation. In natural situations, the brain performs a complex mix of various sensory, motor or cognitive functions. Thus, real-time brain monitoring would be most valuable if (a) it could decode information from multiple brain systems simultaneously, and (b) this decoding of each brain system were robust to variations in the activity of other (unrelated) brain systems. Previous studies showed that it is possible to decode some information from different brain systems in retrospect and/or in isolation. In our study, we set out to determine whether it is possible to simultaneously decode important information about a user from different brain systems in real time, and to evaluate the impact of concurrent activity in different brain systems on decoding performance. APPROACH: We study these questions using electrocorticographic signals recorded in humans. We first document procedures for generating stable decoding models given little training data, and then report their use for offline and for real-time decoding from 12 subjects (six for offline parameter optimization, six for online experimentation). The subjects engage in tasks that involve movement intention, movement execution and auditory functions, separately, and then simultaneously. Main Results: Our real-time results demonstrate that our system can identify intention and movement periods in single trials with an accuracy of 80.4% and 86.8%, respectively (where 50% would be expected by chance). Simultaneously, the decoding of the power envelope of an auditory stimulus resulted in an average correlation coefficient of 0.37 between the actual and decoded power envelopes. These decoders were trained separately and executed simultaneously in real time. SIGNIFICANCE: This study yielded the first demonstration that it is possible to decode simultaneously the functional activity of multiple independent brain systems. Our comparison of univariate and multivariate decoding strategies, and our analysis of the influence of their decoding parameters, provides benchmarks and guidelines for future research on this topic.
Authors: Alon Sinai; Christopher W Bowers; Ciprian M Crainiceanu; Dana Boatman; Barry Gordon; Ronald P Lesser; Frederick A Lenz; Nathan E Crone Journal: Brain Date: 2005-04-07 Impact factor: 13.501
Authors: Aysegul Gunduz; Peter Brunner; Amy Daitch; Eric C Leuthardt; Anthony L Ritaccio; Bijan Pesaran; Gerwin Schalk Journal: Neuroimage Date: 2012-02-16 Impact factor: 6.556
Authors: Cynthia A Chestek; Vikash Gilja; Paul Nuyujukian; Ryan J Kier; Florian Solzbacher; Stephen I Ryu; Reid R Harrison; Krishna V Shenoy Journal: IEEE Trans Neural Syst Rehabil Eng Date: 2009-06-02 Impact factor: 3.802
Authors: Leigh R Hochberg; Daniel Bacher; Beata Jarosiewicz; Nicolas Y Masse; John D Simeral; Joern Vogel; Sami Haddadin; Jie Liu; Sydney S Cash; Patrick van der Smagt; John P Donoghue Journal: Nature Date: 2012-05-16 Impact factor: 49.962
Authors: Jonathan Viventi; Dae-Hyeong Kim; Leif Vigeland; Eric S Frechette; Justin A Blanco; Yun-Soung Kim; Andrew E Avrin; Vineet R Tiruvadi; Suk-Won Hwang; Ann C Vanleer; Drausin F Wulsin; Kathryn Davis; Casey E Gelber; Larry Palmer; Jan Van der Spiegel; Jian Wu; Jianliang Xiao; Yonggang Huang; Diego Contreras; John A Rogers; Brian Litt Journal: Nat Neurosci Date: 2011-11-13 Impact factor: 24.884