Literature DB >> 35048159

Can visual capture of sound separate auditory streams?

Chiara Valzolgher1,2, Elena Giovanelli3, Roberta Sorio4, Giuseppe Rabini3, Francesco Pavani3,5,4.   

Abstract

In noisy contexts, sound discrimination improves when the auditory sources are separated in space. This phenomenon, named Spatial Release from Masking (SRM), arises from the interaction between the auditory information reaching the ear and spatial attention resources. To examine the relative contribution of these two factors, we exploited an audio-visual illusion in a hearing-in-noise task to create conditions in which the initial stimulation to the ears is held constant, while the perceived separation between speech and masker is changed illusorily (visual capture of sound). In two experiments, we asked participants to identify a string of five digits pronounced by a female voice, embedded in either energetic (Experiment 1) or informational (Experiment 2) noise, before reporting the perceived location of the heard digits. Critically, the distance between target digits and masking noise was manipulated both physically (from 22.5 to 75.0 degrees) and illusorily, by pairing target sounds with visual stimuli either at same (audio-visual congruent) or different positions (15 degrees offset, leftward or rightward: audio-visual incongruent). The proportion of correctly reported digits increased with the physical separation between the target and masker, as expected from SRM. However, despite effective visual capture of sounds, performance was not modulated by illusory changes of target sound position. Our results are compatible with a limited role of central factors in the SRM phenomenon, at least in our experimental setting. Moreover, they add to the controversial literature on the limited effects of audio-visual capture in auditory stream separation.
© 2021. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.

Entities:  

Keywords:  Hearing in noise; Sound localization; Spatial release from masking; Visual capture of sound

Mesh:

Year:  2022        PMID: 35048159     DOI: 10.1007/s00221-021-06281-8

Source DB:  PubMed          Journal:  Exp Brain Res        ISSN: 0014-4819            Impact factor:   1.972


  45 in total

1.  Auditory localization of nearby sources. II. Localization of a broadband source.

Authors:  D S Brungart; N I Durlach; W M Rabinowitz
Journal:  J Acoust Soc Am       Date:  1999-10       Impact factor: 1.840

2.  Informational and energetic masking effects in the perception of multiple simultaneous talkers.

Authors:  D S Brungart; B D Simpson; M A Ericson; K R Scott
Journal:  J Acoust Soc Am       Date:  2001-11       Impact factor: 1.840

3.  The effect of spatial separation on informational and energetic masking of speech.

Authors:  Tanya L Arbogast; Christine R Mason; Gerald Kidd
Journal:  J Acoust Soc Am       Date:  2002-11       Impact factor: 1.840

Review 4.  How the brain separates sounds.

Authors:  Robert P Carlyon
Journal:  Trends Cogn Sci       Date:  2004-10       Impact factor: 20.229

5.  Spatial release from masking in normally hearing and hearing-impaired listeners as a function of the temporal overlap of competing talkers.

Authors:  Virginia Best; Christine R Mason; Gerald Kidd
Journal:  J Acoust Soc Am       Date:  2011-03       Impact factor: 1.840

6.  Audio and visual cues in a two-talker divided attention speech-monitoring task.

Authors:  Douglas S Brungart; Alexander J Kordik; Brian D Simpson
Journal:  Hum Factors       Date:  2005       Impact factor: 2.888

7.  Visually-guided attention enhances target identification in a complex auditory scene.

Authors:  Virginia Best; Erol J Ozmeral; Barbara G Shinn-Cunningham
Journal:  J Assoc Res Otolaryngol       Date:  2007-02-14

Review 8.  Intersensory binding across space and time: a tutorial review.

Authors:  Lihan Chen; Jean Vroomen
Journal:  Atten Percept Psychophys       Date:  2013-07       Impact factor: 2.199

9.  Ventriloquist effect reinstates responsiveness to auditory stimuli in the 'ignored' space in patients with hemispatial neglect.

Authors:  N Soroker; N Calamaro; M S Myslobodsky
Journal:  J Clin Exp Neuropsychol       Date:  1995-04       Impact factor: 2.475

10.  Feedback Modulates Audio-Visual Spatial Recalibration.

Authors:  Alexander Kramer; Brigitte Röder; Patrick Bruns
Journal:  Front Integr Neurosci       Date:  2020-01-17
View more
  1 in total

1.  Best Distance Perception in Virtual Audiovisual Environment.

Authors:  Hui Song; Ke Ma
Journal:  Comput Intell Neurosci       Date:  2022-06-28
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.