Literature DB >> 20204164

Brain-Computer Interfaces for Speech Communication.

Jonathan S Brumberg1, Alfonso Nieto-Castanon, Philip R Kennedy, Frank H Guenther.   

Abstract

This paper briefly reviews current silent speech methodologies for normal and disabled individuals. Current techniques utilizing electromyographic (EMG) recordings of vocal tract movements are useful for physically healthy individuals but fail for tetraplegic individuals who do not have accurate voluntary control over the speech articulators. Alternative methods utilizing EMG from other body parts (e.g., hand, arm, or facial muscles) or electroencephalography (EEG) can provide capable silent communication to severely paralyzed users, though current interfaces are extremely slow relative to normal conversation rates and require constant attention to a computer screen that provides visual feedback and/or cueing. We present a novel approach to the problem of silent speech via an intracortical microelectrode brain computer interface (BCI) to predict intended speech information directly from the activity of neurons involved in speech production. The predicted speech is synthesized and acoustically fed back to the user with a delay under 50 ms. We demonstrate that the Neurotrophic Electrode used in the BCI is capable of providing useful neural recordings for over 4 years, a necessary property for BCIs that need to remain viable over the lifespan of the user. Other design considerations include neural decoding techniques based on previous research involving BCIs for computer cursor or robotic arm control via prediction of intended movement kinematics from motor cortical signals in monkeys and humans. Initial results from a study of continuous speech production with instantaneous acoustic feedback show the BCI user was able to improve his control over an artificial speech synthesizer both within and across recording sessions. The success of this initial trial validates the potential of the intracortical microelectrode-based approach for providing a speech prosthesis that can allow much more rapid communication rates.

Entities:  

Year:  2010        PMID: 20204164      PMCID: PMC2829990          DOI: 10.1016/j.specom.2010.01.001

Source DB:  PubMed          Journal:  Speech Commun        ISSN: 0167-6393            Impact factor:   2.017


  53 in total

1.  Long-term neural recording characteristics of wire microelectrode arrays implanted in cerebral cortex.

Authors:  J C Williams; R L Rennaker; D R Kipke
Journal:  Brain Res Brain Res Protoc       Date:  1999-12

2.  Chronic, multisite, multielectrode recordings in macaque monkeys.

Authors:  Miguel A L Nicolelis; Dragan Dimitrov; Jose M Carmena; Roy Crist; Gary Lehew; Jerald D Kralik; Steven P Wise
Journal:  Proc Natl Acad Sci U S A       Date:  2003-09-05       Impact factor: 11.205

3.  Behavioral correlates of action potentials recorded chronically inside the Cone Electrode.

Authors:  P R Kennedy; R A Bakay; S M Sharpe
Journal:  Neuroreport       Date:  1992-07       Impact factor: 1.837

4.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects.

Authors:  Wilson Truccolo; Uri T Eden; Matthew R Fellows; John P Donoghue; Emery N Brown
Journal:  J Neurophysiol       Date:  2004-09-08       Impact factor: 2.714

5.  Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials.

Authors:  Leonard J Trejo; Roman Rosipal; Bryan Matthews
Journal:  IEEE Trans Neural Syst Rehabil Eng       Date:  2006-06       Impact factor: 3.802

6.  Towards an independent brain-computer interface using steady state visual evoked potentials.

Authors:  Brendan Z Allison; Dennis J McFarland; Gerwin Schalk; Shi Dong Zheng; Melody Moore Jackson; Jonathan R Wolpaw
Journal:  Clin Neurophysiol       Date:  2008-02       Impact factor: 3.708

Review 7.  Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena.

Authors:  U Mitzdorf
Journal:  Physiol Rev       Date:  1985-01       Impact factor: 37.312

8.  A brain-computer interface (BCI) for the locked-in: comparison of different EEG classifications for the thought translation device.

Authors:  Thilo Hinterberger; Andrea Kübler; Jochen Kaiser; Nicola Neumann; Niels Birbaumer
Journal:  Clin Neurophysiol       Date:  2003-03       Impact factor: 3.708

9.  The cone electrode: ultrastructural studies following long-term recording in rat and monkey cortex.

Authors:  P R Kennedy; S S Mirra; R A Bakay
Journal:  Neurosci Lett       Date:  1992-08-03       Impact factor: 3.046

10.  A wireless brain-machine interface for real-time speech synthesis.

Authors:  Frank H Guenther; Jonathan S Brumberg; E Joseph Wright; Alfonso Nieto-Castanon; Jason A Tourville; Mikhail Panko; Robert Law; Steven A Siebert; Jess L Bartels; Dinal S Andreasen; Princewill Ehirim; Hui Mao; Philip R Kennedy
Journal:  PLoS One       Date:  2009-12-09       Impact factor: 3.240

View more
  40 in total

1.  Control of a visual keyboard using an electrocorticographic brain-computer interface.

Authors:  Dean J Krusienski; Jerry J Shih
Journal:  Neurorehabil Neural Repair       Date:  2010-10-04       Impact factor: 3.919

2.  Determining the Optimal Number of MEG Trials: A Machine Learning and Speech Decoding Perspective.

Authors:  Debadatta Dash; Paul Ferrari; Saleem Malik; Albert Montillo; Joseph A Maldjian; Jun Wang
Journal:  Brain Inform (2018)       Date:  2018-12-07

3.  Motor-Induced Suppression of the N100 Event-Related Potential During Motor Imagery Control of a Speech Synthesizer Brain-Computer Interface.

Authors:  Jonathan S Brumberg; Kevin M Pitt
Journal:  J Speech Lang Hear Res       Date:  2019-07-15       Impact factor: 2.297

4.  Virtual active touch using randomly patterned intracortical microstimulation.

Authors:  Joseph E O'Doherty; Mikhail A Lebedev; Zheng Li; Miguel A L Nicolelis
Journal:  IEEE Trans Neural Syst Rehabil Eng       Date:  2011-12-27       Impact factor: 3.802

Review 5.  Nonspeech Oral Movements and Oral Motor Disorders: A Narrative Review.

Authors:  Ray D Kent
Journal:  Am J Speech Lang Pathol       Date:  2015-11       Impact factor: 2.408

6.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array.

Authors:  J D Simeral; S-P Kim; M J Black; J P Donoghue; L R Hochberg
Journal:  J Neural Eng       Date:  2011-03-24       Impact factor: 5.379

7.  Differential Representation of Articulatory Gestures and Phonemes in Precentral and Inferior Frontal Gyri.

Authors:  Emily M Mugler; Matthew C Tate; Karen Livescu; Jessica W Templer; Matthew A Goldrick; Marc W Slutzky
Journal:  J Neurosci       Date:  2018-09-26       Impact factor: 6.167

Review 8.  The use of intracranial recordings to decode human language: Challenges and opportunities.

Authors:  Stephanie Martin; José Del R Millán; Robert T Knight; Brian N Pasley
Journal:  Brain Lang       Date:  2016-07-01       Impact factor: 2.381

9.  A Noninvasive Brain-Computer Interface for Real-Time Speech Synthesis: The Importance of Multimodal Feedback.

Authors:  Jonathan S Brumberg; Kevin M Pitt; Jeremy D Burnison
Journal:  IEEE Trans Neural Syst Rehabil Eng       Date:  2018-04       Impact factor: 3.802

Review 10.  Decoding speech for understanding and treating aphasia.

Authors:  Brian N Pasley; Robert T Knight
Journal:  Prog Brain Res       Date:  2013       Impact factor: 2.453

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.