Literature DB >> 20551353

Seeing a singer helps comprehension of the song's lyrics.

Alexandra Jesse1, Dominic W Massaro.   

Abstract

When listening to speech, we often benefit when also seeing the speaker's face. If this advantage is not domain specific for speech, the recognition of sung lyrics should also benefit from seeing the singer's face. By independently varying the sight and sound of the lyrics, we found a substantial comprehension benefit of seeing a singer. This benefit was robust across participants, lyrics, and repetition of the test materials. This benefit was much larger than the benefit for sung lyrics obtained in previous research, which had not provided the visual information normally present in singing. Given that the comprehension of sung lyrics benefits from seeing the singer, just like speech comprehension benefits from seeing the speaker, both speech and music perception appear to be multisensory processes.

Entities:  

Mesh:

Year:  2010        PMID: 20551353     DOI: 10.3758/PBR.17.3.323

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  17 in total

1.  Learned audio-visual cross-modal associations in observed piano playing activate the left planum temporale. An fMRI study.

Authors:  Takehiro Hasegawa; Ken-Ichi Matsuki; Takashi Ueno; Yasuhiro Maeda; Yoshihiko Matsue; Yukuo Konishi; Norihiro Sadato
Journal:  Brain Res Cogn Brain Res       Date:  2004-08

2.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

3.  Facing the music.

Authors:  William Forde Thompson; Frank A Russo
Journal:  Psychol Sci       Date:  2007-09

4.  The temporal distribution of information in audiovisual spoken-word identification.

Authors:  Alexandra Jesse; Dominic W Massaro
Journal:  Atten Percept Psychophys       Date:  2010-01       Impact factor: 2.199

5.  A perceptual study of the influence of pitch on the intelligibility of sung vowels.

Authors:  N Scotto Di Carlo; A Germain
Journal:  Phonetica       Date:  1985       Impact factor: 1.759

6.  Predicting audiovisual consonant recognition performance of hearing-impaired adults.

Authors:  B E Walden; R A Prosek; D W Worthington
Journal:  J Speech Hear Res       Date:  1974-06

7.  Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task.

Authors:  Argiro Vatakis; Charles Spence
Journal:  Neurosci Lett       Date:  2005-10-06       Impact factor: 3.046

8.  Visual influences on auditory pluck and bow judgments.

Authors:  H M Saldaña; L D Rosenblum
Journal:  Percept Psychophys       Date:  1993-09

9.  Detection and resolution of audio-visual incompatibility in the perception of vowels.

Authors:  Q Summerfield; M McGrath
Journal:  Q J Exp Psychol A       Date:  1984-02

10.  Cross-modal interactions in the perception of musical performance.

Authors:  Bradley W Vines; Carol L Krumhansl; Marcelo M Wanderley; Daniel J Levitin
Journal:  Cognition       Date:  2005-11-09
View more
  2 in total

1.  Eye of the Beholder: Stage Entrance Behavior and Facial Expression Affect Continuous Quality Ratings in Music Performance.

Authors:  George Waddell; Aaron Williamon
Journal:  Front Psychol       Date:  2017-04-25

2.  Making myself understood: perceived factors affecting the intelligibility of sung text.

Authors:  Philip A Fine; Jane Ginsborg
Journal:  Front Psychol       Date:  2014-09-04
  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.