Literature DB >> 22522927

Selective cortical representation of attended speaker in multi-talker speech perception.

Nima Mesgarani1, Edward F Chang.   

Abstract

Humans possess a remarkable ability to attend to a single speaker's voice in a multi-talker background. How the auditory system manages to extract intelligible speech under such acoustically complex and adverse listening conditions is not known, and, indeed, it is not clear how attended speech is internally represented. Here, using multi-electrode surface recordings from the cortex of subjects engaged in a listening task with two simultaneous speakers, we demonstrate that population responses in non-primary human auditory cortex encode critical features of attended speech: speech spectrograms reconstructed based on cortical responses to the mixture of speakers reveal the salient spectral and temporal features of the attended speaker, as if subjects were listening to that speaker alone. A simple classifier trained solely on examples of single speakers can decode both attended words and speaker identity. We find that task performance is well predicted by a rapid increase in attention-modulated neural selectivity across both single-electrode and population-level cortical responses. These findings demonstrate that the cortical representation of speech does not merely reflect the external acoustic environment, but instead gives rise to the perceptual aspects relevant for the listener's intended goal.

Entities:  

Mesh:

Year:  2012        PMID: 22522927      PMCID: PMC3870007          DOI: 10.1038/nature11020

Source DB:  PubMed          Journal:  Nature        ISSN: 0028-0836            Impact factor:   49.962


  23 in total

1.  A speech corpus for multitalker communications research.

Authors:  R S Bolia; W T Nelson; M A Ericson; B D Simpson
Journal:  J Acoust Soc Am       Date:  2000-02       Impact factor: 1.840

2.  Spectrotemporal analysis of evoked and induced electroencephalographic responses in primary auditory cortex (A1) of the awake monkey.

Authors:  Mitchell Steinschneider; Yonatan I Fishman; Joseph C Arezzo
Journal:  Cereb Cortex       Date:  2007-06-22       Impact factor: 5.357

3.  Object-based auditory and visual attention.

Authors:  Barbara G Shinn-Cunningham
Journal:  Trends Cogn Sci       Date:  2008-04-07       Impact factor: 20.229

4.  Influence of context and behavior on stimulus reconstruction from neural activity in primary auditory cortex.

Authors:  Nima Mesgarani; Stephen V David; Jonathan B Fritz; Shihab A Shamma
Journal:  J Neurophysiol       Date:  2009-09-16       Impact factor: 2.714

5.  Auditory grouping.

Authors:  C J Darwin
Journal:  Trends Cogn Sci       Date:  1997-12       Impact factor: 20.229

6.  Tuning of the human neocortex to the temporal dynamics of attended events.

Authors:  Julien Besle; Catherine A Schevon; Ashesh D Mehta; Peter Lakatos; Robert R Goodman; Guy M McKhann; Ronald G Emerson; Charles E Schroeder
Journal:  J Neurosci       Date:  2011-03-02       Impact factor: 6.167

7.  Perceptual restoration of missing speech sounds.

Authors:  R M Warren
Journal:  Science       Date:  1970-01-23       Impact factor: 47.728

Review 8.  The neuroanatomical and functional organization of speech perception.

Authors:  Sophie K Scott; Ingrid S Johnsrude
Journal:  Trends Neurosci       Date:  2003-02       Impact factor: 13.837

Review 9.  The cocktail party problem: what is it? How can it be solved? And why should animal behaviorists study it?

Authors:  Mark A Bee; Christophe Micheyl
Journal:  J Comp Psychol       Date:  2008-08       Impact factor: 2.231

10.  Reconstructing speech from human auditory cortex.

Authors:  Brian N Pasley; Stephen V David; Nima Mesgarani; Adeen Flinker; Shihab A Shamma; Nathan E Crone; Robert T Knight; Edward F Chang
Journal:  PLoS Biol       Date:  2012-01-31       Impact factor: 8.029

View more
  296 in total

1.  Neural decoding of attentional selection in multi-speaker environments without access to clean sources.

Authors:  James O'Sullivan; Zhuo Chen; Jose Herrero; Guy M McKhann; Sameer A Sheth; Ashesh D Mehta; Nima Mesgarani
Journal:  J Neural Eng       Date:  2017-08-04       Impact factor: 5.379

2.  Emergence of neural encoding of auditory objects while listening to competing speakers.

Authors:  Nai Ding; Jonathan Z Simon
Journal:  Proc Natl Acad Sci U S A       Date:  2012-07-02       Impact factor: 11.205

3.  Rapid Task-Related Plasticity of Spectrotemporal Receptive Fields in the Auditory Midbrain.

Authors:  Sean J Slee; Stephen V David
Journal:  J Neurosci       Date:  2015-09-23       Impact factor: 6.167

4.  Effects of Spectral Degradation on Attentional Modulation of Cortical Auditory Responses to Continuous Speech.

Authors:  Ying-Yee Kong; Ala Somarowthu; Nai Ding
Journal:  J Assoc Res Otolaryngol       Date:  2015-09-11

5.  Single-sensor multispeaker listening with acoustic metamaterials.

Authors:  Yangbo Xie; Tsung-Han Tsai; Adam Konneker; Bogdan-Ioan Popa; David J Brady; Steven A Cummer
Journal:  Proc Natl Acad Sci U S A       Date:  2015-08-10       Impact factor: 11.205

6.  Membrane potential dynamics of populations of cortical neurons during auditory streaming.

Authors:  Brandon J Farley; Arnaud J Noreña
Journal:  J Neurophysiol       Date:  2015-08-12       Impact factor: 2.714

7.  Neural correlates of sine-wave speech intelligibility in human frontal and temporal cortex.

Authors:  Sattar Khoshkhoo; Matthew K Leonard; Nima Mesgarani; Edward F Chang
Journal:  Brain Lang       Date:  2018-02-04       Impact factor: 2.381

Review 8.  Adaptive auditory computations.

Authors:  Shihab Shamma; Jonathan Fritz
Journal:  Curr Opin Neurobiol       Date:  2014-02-11       Impact factor: 6.627

9.  Feature-Selective Attention Adaptively Shifts Noise Correlations in Primary Auditory Cortex.

Authors:  Joshua D Downer; Brittany Rapone; Jessica Verhein; Kevin N O'Connor; Mitchell L Sutter
Journal:  J Neurosci       Date:  2017-04-21       Impact factor: 6.167

10.  Switching auditory attention using spatial and non-spatial features recruits different cortical networks.

Authors:  Eric Larson; Adrian K C Lee
Journal:  Neuroimage       Date:  2013-10-03       Impact factor: 6.556

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.