Literature DB >> 18988858

"Who" is saying "what"? Brain-based decoding of human voice and speech.

Elia Formisano1, Federico De Martino, Milene Bonte, Rainer Goebel.   

Abstract

Can we decipher speech content ("what" is being said) and speaker identity ("who" is saying it) from observations of brain activity of a listener? Here, we combine functional magnetic resonance imaging with a data-mining algorithm and retrieve what and whom a person is listening to from the neural fingerprints that speech and voice signals elicit in the listener's auditory cortex. These cortical fingerprints are spatially distributed and insensitive to acoustic variations of the input so as to permit the brain-based recognition of learned speech from unknown speakers and of learned voices from previously unheard utterances. Our findings unravel the detailed cortical layout and computational properties of the neural populations at the basis of human speech recognition and speaker identification.

Entities:  

Mesh:

Year:  2008        PMID: 18988858     DOI: 10.1126/science.1164318

Source DB:  PubMed          Journal:  Science        ISSN: 0036-8075            Impact factor:   47.728


  179 in total

1.  You had me at "Hello": Rapid extraction of dialect information from spoken words.

Authors:  Mathias Scharinger; Philip J Monahan; William J Idsardi
Journal:  Neuroimage       Date:  2011-04-12       Impact factor: 6.556

2.  Bilateral reorganization of posterior temporal cortices in post-lingual deafness and its relation to cochlear implant outcome.

Authors:  Diane S Lazard; Hyo-Jeong Lee; Eric Truy; Anne-Lise Giraud
Journal:  Hum Brain Mapp       Date:  2012-01-30       Impact factor: 5.038

3.  Predicting vocal emotion expressions from the human brain.

Authors:  Sonja A Kotz; Christian Kalberlah; Jörg Bahlmann; Angela D Friederici; John-D Haynes
Journal:  Hum Brain Mapp       Date:  2012-02-27       Impact factor: 5.038

4.  Predicting visual stimuli on the basis of activity in auditory cortices.

Authors:  Kaspar Meyer; Jonas T Kaplan; Ryan Essex; Cecelia Webber; Hanna Damasio; Antonio Damasio
Journal:  Nat Neurosci       Date:  2010-05-02       Impact factor: 24.884

5.  Nonstimulated early visual areas carry information about surrounding context.

Authors:  Fraser W Smith; Lars Muckli
Journal:  Proc Natl Acad Sci U S A       Date:  2010-11-01       Impact factor: 11.205

6.  Voice cells in the primate temporal lobe.

Authors:  Catherine Perrodin; Christoph Kayser; Nikos K Logothetis; Christopher I Petkov
Journal:  Curr Biol       Date:  2011-08-11       Impact factor: 10.834

7.  Multivariate sensitivity to voice during auditory categorization.

Authors:  Yune Sang Lee; Jonathan E Peelle; David Kraemer; Samuel Lloyd; Richard Granger
Journal:  J Neurophysiol       Date:  2015-08-05       Impact factor: 2.714

8.  Single-sensor multispeaker listening with acoustic metamaterials.

Authors:  Yangbo Xie; Tsung-Han Tsai; Adam Konneker; Bogdan-Ioan Popa; David J Brady; Steven A Cummer
Journal:  Proc Natl Acad Sci U S A       Date:  2015-08-10       Impact factor: 11.205

9.  Determining the Optimal Number of MEG Trials: A Machine Learning and Speech Decoding Perspective.

Authors:  Debadatta Dash; Paul Ferrari; Saleem Malik; Albert Montillo; Joseph A Maldjian; Jun Wang
Journal:  Brain Inform (2018)       Date:  2018-12-07

10.  Domain general change detection accounts for "dishabituation" effects in temporal-parietal regions in functional magnetic resonance imaging studies of speech perception.

Authors:  Jason D Zevin; Jianfeng Yang; Jeremy I Skipper; Bruce D McCandliss
Journal:  J Neurosci       Date:  2010-01-20       Impact factor: 6.167

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.