Literature DB >> 18831650

Facilitation of multisensory integration by the "unity effect" reveals that speech is special.

Argiro Vatakis1, Asif A Ghazanfar, Charles Spence.   

Abstract

Whenever two or more sensory inputs are highly consistent in one or more dimension(s), observers will be more likely to perceive them as a single multisensory event rather than as separate unimodal events. For audiovisual speech, but not for other noncommunicative events, participants exhibit a "unity effect," whereby they are less sensitive to temporal asynchrony (i.e., that are more likely to bind the multisensory signals together) for matched (than for mismatched) speech events. This finding suggests that the modulation of multisensory integration by the unity effect in humans may be specific to speech. To test this hypothesis directly, we investigated whether the unity effect would also influence the multisensory integration of vocalizations from another primate species, the rhesus monkey. Human participants made temporal order judgments for both matched and mismatched audiovisual stimuli presented at a range of stimulus-onset asynchronies. The unity effect was examined with (1) a single call-type across two different monkeys, (2) two different call-types from the same monkey, (3) human versus monkey "cooing," and (4) speech sounds produced by a male and a female human. The results show that the unity effect only influenced participants' performance for the speech stimuli; no effect was observed for monkey vocalizations or for the human imitations of monkey calls. These findings suggest that the facilitation of multisensory integration by the unity effect is specific to human speech signals.

Entities:  

Mesh:

Year:  2008        PMID: 18831650     DOI: 10.1167/8.9.14

Source DB:  PubMed          Journal:  J Vis        ISSN: 1534-7362            Impact factor:   2.240


  28 in total

1.  Multistage audiovisual integration of speech: dissociating identification and detection.

Authors:  Kasper Eskelund; Jyrki Tuomainen; Tobias S Andersen
Journal:  Exp Brain Res       Date:  2010-12-25       Impact factor: 1.972

2.  The plausibility of visual information for hand ownership modulates multisensory synchrony perception.

Authors:  Regine Zopf; Jason Friedman; Mark A Williams
Journal:  Exp Brain Res       Date:  2015-05-17       Impact factor: 1.972

3.  Preschoolers benefit from visually salient speech cues.

Authors:  Kaylah Lalonde; Rachael Frush Holt
Journal:  J Speech Lang Hear Res       Date:  2015-02       Impact factor: 2.297

Review 4.  Prediction and constraint in audiovisual speech perception.

Authors:  Jonathan E Peelle; Mitchell S Sommers
Journal:  Cortex       Date:  2015-03-20       Impact factor: 4.027

5.  Timing of audiovisual inputs to the prefrontal cortex and multisensory integration.

Authors:  L M Romanski; J Hwang
Journal:  Neuroscience       Date:  2012-04-16       Impact factor: 3.590

6.  The Stolen Voice Illusion.

Authors:  David Brang
Journal:  Perception       Date:  2019-07-02       Impact factor: 1.490

7.  Aging Impairs Temporal Sensitivity, but not Perceptual Synchrony, Across Modalities.

Authors:  Alexandra N Scurry; Tiziana Vercillo; Alexis Nicholson; Michael Webster; Fang Jiang
Journal:  Multisens Res       Date:  2019-01-01       Impact factor: 2.286

8.  Multisensory integration of drumming actions: musical expertise affects perceived audiovisual asynchrony.

Authors:  Karin Petrini; Sofia Dahl; Davide Rocchesso; Carl Haakon Waadeland; Federico Avanzini; Aina Puce; Frank E Pollick
Journal:  Exp Brain Res       Date:  2009-04-30       Impact factor: 1.972

9.  The effects of visual training on multisensory temporal processing.

Authors:  Ryan A Stevenson; Magdalena M Wilson; Albert R Powers; Mark T Wallace
Journal:  Exp Brain Res       Date:  2013-01-10       Impact factor: 1.972

10.  Tolerance for audiovisual asynchrony is enhanced by the spectrotemporal fidelity of the speaker's mouth movements and speech.

Authors:  Antoine J Shahin; Stanley Shen; Jess R Kerlin
Journal:  Lang Cogn Neurosci       Date:  2017-02-06       Impact factor: 2.331

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.