Literature DB >> 27834730

Statistics of natural reverberation enable perceptual separation of sound and space.

James Traer1, Josh H McDermott2.   

Abstract

In everyday listening, sound reaches our ears directly from a source as well as indirectly via reflections known as reverberation. Reverberation profoundly distorts the sound from a source, yet humans can both identify sound sources and distinguish environments from the resulting sound, via mechanisms that remain unclear. The core computational challenge is that the acoustic signatures of the source and environment are combined in a single signal received by the ear. Here we ask whether our recognition of sound sources and spaces reflects an ability to separate their effects and whether any such separation is enabled by statistical regularities of real-world reverberation. To first determine whether such statistical regularities exist, we measured impulse responses (IRs) of 271 spaces sampled from the distribution encountered by humans during daily life. The sampled spaces were diverse, but their IRs were tightly constrained, exhibiting exponential decay at frequency-dependent rates: Mid frequencies reverberated longest whereas higher and lower frequencies decayed more rapidly, presumably due to absorptive properties of materials and air. To test whether humans leverage these regularities, we manipulated IR decay characteristics in simulated reverberant audio. Listeners could discriminate sound sources and environments from these signals, but their abilities degraded when reverberation characteristics deviated from those of real-world environments. Subjectively, atypical IRs were mistaken for sound sources. The results suggest the brain separates sound into contributions from the source and the environment, constrained by a prior on natural reverberation. This separation process may contribute to robust recognition while providing information about spaces around us.

Entities:  

Keywords:  auditory scene analysis; environmental acoustics; natural scene statistics; psychoacoustics; psychophysics

Mesh:

Year:  2016        PMID: 27834730      PMCID: PMC5137703          DOI: 10.1073/pnas.1612524113

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  34 in total

1.  Auditory distance perception in rooms.

Authors:  A W Bronkhorst; T Houtgast
Journal:  Nature       Date:  1999-02-11       Impact factor: 49.962

2.  Effects of reverberation on spatial, prosodic, and vocal-tract size cues to selective attention.

Authors:  C J Darwin; R W Hukin
Journal:  J Acoust Soc Am       Date:  2000-07       Impact factor: 1.840

3.  Evaluation of decay times in coupled spaces: Bayesian parameter estimation.

Authors:  N Xiang; P M Goggans
Journal:  J Acoust Soc Am       Date:  2001-09       Impact factor: 1.840

4.  Direct-to-reverberant energy ratio sensitivity.

Authors:  Pavel Zahorik
Journal:  J Acoust Soc Am       Date:  2002-11       Impact factor: 1.840

5.  Revisiting perceptual compensation for effects of reverberation in speech identification.

Authors:  Jens Bo Nielsen; Torsten Dau
Journal:  J Acoust Soc Am       Date:  2010-11       Impact factor: 1.840

6.  Recovering sound sources from embedded repetition.

Authors:  Josh H McDermott; David Wrobleski; Andrew J Oxenham
Journal:  Proc Natl Acad Sci U S A       Date:  2011-01-03       Impact factor: 11.205

7.  Perceptual compensation for effects of reverberation in speech identification.

Authors:  Anthony J Watkins
Journal:  J Acoust Soc Am       Date:  2005-07       Impact factor: 1.840

8.  The subjective duration of ramped and damped sounds.

Authors:  Massimo Grassi; Christopher J Darwin
Journal:  Percept Psychophys       Date:  2006-11

9.  Mechanisms of noise robust representation of speech in primary auditory cortex.

Authors:  Nima Mesgarani; Stephen V David; Jonathan B Fritz; Shihab A Shamma
Journal:  Proc Natl Acad Sci U S A       Date:  2014-04-21       Impact factor: 11.205

Review 10.  Neural processing of natural sounds.

Authors:  Frédéric E Theunissen; Julie E Elie
Journal:  Nat Rev Neurosci       Date:  2014-06       Impact factor: 34.870

View more
  17 in total

1.  Predicting the Partition of Behavioral Variability in Speed Perception with Naturalistic Stimuli.

Authors:  Benjamin M Chin; Johannes Burge
Journal:  J Neurosci       Date:  2019-11-26       Impact factor: 6.167

2.  Headphone screening to facilitate web-based auditory experiments.

Authors:  Kevin J P Woods; Max H Siegel; James Traer; Josh H McDermott
Journal:  Atten Percept Psychophys       Date:  2017-10       Impact factor: 2.199

3.  Cortical adaptation to sound reverberation.

Authors:  Ben D B Willmore; Kerry M M Walker; Nicol S Harper; Aleksandar Z Ivanov; Andrew J King
Journal:  Elife       Date:  2022-05-26       Impact factor: 8.713

4.  Deep neural network models of sound localization reveal how perception is adapted to real-world environments.

Authors:  Andrew Francl; Josh H McDermott
Journal:  Nat Hum Behav       Date:  2022-01-27

5.  Ecological origins of perceptual grouping principles in the auditory system.

Authors:  Wiktor Młynarski; Josh H McDermott
Journal:  Proc Natl Acad Sci U S A       Date:  2019-11-21       Impact factor: 11.205

6.  Auditory Brainstem Models: Adapting Cochlear Nuclei Improve Spatial Encoding by the Medial Superior Olive in Reverberation.

Authors:  Andrew Brughera; Jason Mikiel-Hunter; Mathias Dietz; David McAlpine
Journal:  J Assoc Res Otolaryngol       Date:  2021-04-16

7.  Context-Dependent Effect of Reverberation on Material Perception from Impact Sound.

Authors:  Takuya Koumura; Shigeto Furukawa
Journal:  Sci Rep       Date:  2017-11-28       Impact factor: 4.379

8.  Egocentric and allocentric representations in auditory cortex.

Authors:  Stephen M Town; W Owen Brimijoin; Jennifer K Bizley
Journal:  PLoS Biol       Date:  2017-06-15       Impact factor: 8.029

9.  Hearing Scenes: A Neuromagnetic Signature of Auditory Source and Reverberant Space Separation.

Authors:  Santani Teng; Verena R Sommer; Dimitrios Pantazis; Aude Oliva
Journal:  eNeuro       Date:  2017-03-01

10.  A common periodic representation of interaural time differences in mammalian cortex.

Authors:  Nelli H Salminen; Simon J Jones; Gestur B Christianson; Torsten Marquardt; David McAlpine
Journal:  Neuroimage       Date:  2017-11-07       Impact factor: 6.556

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.