Literature DB >> 26949710

Identifying the Attended Speaker Using Electrocorticographic (ECoG) Signals.

K Dijkstra1, P Brunner2, A Gunduz3, W Coon4, A L Ritaccio5, J Farquhar6, G Schalk7.   

Abstract

People affected by severe neuro-degenerative diseases (e.g., late-stage amyotrophic lateral sclerosis (ALS) or locked-in syndrome) eventually lose all muscular control. Thus, they cannot use traditional assistive communication devices that depend on muscle control, or brain-computer interfaces (BCIs) that depend on the ability to control gaze. While auditory and tactile BCIs can provide communication to such individuals, their use typically entails an artificial mapping between the stimulus and the communication intent. This makes these BCIs difficult to learn and use. In this study, we investigated the use of selective auditory attention to natural speech as an avenue for BCI communication. In this approach, the user communicates by directing his/her attention to one of two simultaneously presented speakers. We used electrocorticographic (ECoG) signals in the gamma band (70-170 Hz) to infer the identity of attended speaker, thereby removing the need to learn such an artificial mapping. Our results from twelve human subjects show that a single cortical location over superior temporal gyrus or pre-motor cortex is typically sufficient to identify the attended speaker within 10 s and with 77% accuracy (50% accuracy due to chance). These results lay the groundwork for future studies that may determine the real-time performance of BCIs based on selective auditory attention to speech.

Entities:  

Keywords:  Auditory Attention; Brain-Computer Interface (BCI); Cocktail Party; Electrocorticography (ECoG)

Year:  2015        PMID: 26949710      PMCID: PMC4776341          DOI: 10.1080/2326263X.2015.1063363

Source DB:  PubMed          Journal:  Brain Comput Interfaces (Abingdon)        ISSN: 2326-2621


  44 in total

Review 1.  Brain-computer interfaces for communication and control.

Authors:  Jonathan R Wolpaw; Niels Birbaumer; Dennis J McFarland; Gert Pfurtscheller; Theresa M Vaughan
Journal:  Clin Neurophysiol       Date:  2002-06       Impact factor: 3.708

2.  Cortical activity during motor execution, motor imagery, and imagery-based online feedback.

Authors:  Kai J Miller; Gerwin Schalk; Eberhard E Fetz; Marcel den Nijs; Jeffrey G Ojemann; Rajesh P N Rao
Journal:  Proc Natl Acad Sci U S A       Date:  2010-02-16       Impact factor: 11.205

3.  Review lecture. The blood-brain barrier.

Authors:  H Davson
Journal:  J Physiol       Date:  1976-02       Impact factor: 5.182

4.  Gain of the human dura in vivo and its effects on invasive brain signal feature detection.

Authors:  Aldemar Torres Valderrama; Robert Oostenveld; Mariska J Vansteensel; Geertjan M Huiskamp; Nicolas Franciscus Ramsey
Journal:  J Neurosci Methods       Date:  2010-01-28       Impact factor: 2.390

5.  Spatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing.

Authors:  Cristhian Potes; Peter Brunner; Aysegul Gunduz; Robert T Knight; Gerwin Schalk
Journal:  Neuroimage       Date:  2014-04-21       Impact factor: 6.556

6.  P300 audio-visual speller.

Authors:  A Belitski; J Farquhar; P Desain
Journal:  J Neural Eng       Date:  2011-03-24       Impact factor: 5.379

7.  Speech recognition with primarily temporal cues.

Authors:  R V Shannon; F G Zeng; V Kamath; J Wygonski; M Ekelid
Journal:  Science       Date:  1995-10-13       Impact factor: 47.728

8.  Toward a high-throughput auditory P300-based brain-computer interface.

Authors:  D S Klobassa; T M Vaughan; P Brunner; N E Schwartz; J R Wolpaw; C Neuper; E W Sellers
Journal:  Clin Neurophysiol       Date:  2009-07-01       Impact factor: 3.708

9.  An online brain-computer interface based on shifting attention to concurrent streams of auditory stimuli.

Authors:  N J Hill; B Schölkopf
Journal:  J Neural Eng       Date:  2012-02-15       Impact factor: 5.379

10.  Reconstructing speech from human auditory cortex.

Authors:  Brian N Pasley; Stephen V David; Nima Mesgarani; Adeen Flinker; Shihab A Shamma; Nathan E Crone; Robert T Knight; Edward F Chang
Journal:  PLoS Biol       Date:  2012-01-31       Impact factor: 8.029

View more
  9 in total

1.  Neural decoding of attentional selection in multi-speaker environments without access to clean sources.

Authors:  James O'Sullivan; Zhuo Chen; Jose Herrero; Guy M McKhann; Sameer A Sheth; Ashesh D Mehta; Nima Mesgarani
Journal:  J Neural Eng       Date:  2017-08-04       Impact factor: 5.379

2.  Alpha power indexes task-related networks on large and small scales: A multimodal ECoG study in humans and a non-human primate.

Authors:  A de Pesters; W G Coon; P Brunner; A Gunduz; A L Ritaccio; N M Brunet; P de Weerd; M J Roberts; R Oostenveld; P Fries; G Schalk
Journal:  Neuroimage       Date:  2016-04-05       Impact factor: 6.556

3.  A testbed for optimizing electrodes embedded in the skull or in artificial skull replacement pieces used after injury.

Authors:  JingLe Jiang; Amar R Marathe; Jennifer C Keene; Dawn M Taylor
Journal:  J Neurosci Methods       Date:  2016-12-12       Impact factor: 2.390

4.  Decoding spatial attention with EEG and virtual acoustic space.

Authors:  Yue Dong; Kaan E Raif; Sarah C Determan; Yan Gai
Journal:  Physiol Rep       Date:  2017-11

5.  Intracranial Electrophysiology of Auditory Selective Attention Associated with Speech Classification Tasks.

Authors:  Kirill V Nourski; Mitchell Steinschneider; Ariane E Rhone; Matthew A Howard Iii
Journal:  Front Hum Neurosci       Date:  2017-01-10       Impact factor: 3.169

6.  Identification of Auditory Object-Specific Attention from Single-Trial Electroencephalogram Signals via Entropy Measures and Machine Learning.

Authors:  Yun Lu; Mingjiang Wang; Qiquan Zhang; Yufei Han
Journal:  Entropy (Basel)       Date:  2018-05-21       Impact factor: 2.524

7.  Brain-informed speech separation (BISS) for enhancement of target speaker in multitalker speech perception.

Authors:  Enea Ceolini; Jens Hjortkjær; Daniel D E Wong; James O'Sullivan; Vinay S Raghavan; Jose Herrero; Ashesh D Mehta; Shih-Chii Liu; Nima Mesgarani
Journal:  Neuroimage       Date:  2020-08-20       Impact factor: 6.556

Review 8.  Auditory processing in the human cortex: An intracranial electrophysiology perspective.

Authors:  Kirill V Nourski
Journal:  Laryngoscope Investig Otolaryngol       Date:  2017-04-12

9.  Including Measures of High Gamma Power Can Improve the Decoding of Natural Speech From EEG.

Authors:  Shyanthony R Synigal; Emily S Teoh; Edmund C Lalor
Journal:  Front Hum Neurosci       Date:  2020-04-29       Impact factor: 3.169

  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.