Literature DB >> 26501928

Head movements encode emotions during speech and song.

Steven R Livingstone1, Caroline Palmer1.   

Abstract

When speaking or singing, vocalists often move their heads in an expressive fashion, yet the influence of emotion on vocalists' head motion is unknown. Using a comparative speech/song task, we examined whether vocalists' intended emotions influence head movements and whether those movements influence the perceived emotion. In Experiment 1, vocalists were recorded with motion capture while speaking and singing each statement with different emotional intentions (very happy, happy, neutral, sad, very sad). Functional data analyses showed that head movements differed in translational and rotational displacement across emotional intentions, yet were similar across speech and song, transcending differences in F0 (varied freely in speech, fixed in song) and lexical variability. Head motion specific to emotional state occurred before and after vocalizations, as well as during sound production, confirming that some aspects of movement were not simply a by-product of sound production. In Experiment 2, observers accurately identified vocalists' intended emotion on the basis of silent, face-occluded videos of head movements during speech and song. These results provide the first evidence that head movements encode a vocalist's emotional intent and that observers decode emotional information from these movements. We discuss implications for models of head motion during vocalizations and applied outcomes in social robotics and automated emotion recognition. (c) 2016 APA, all rights reserved).

Mesh:

Year:  2015        PMID: 26501928     DOI: 10.1037/emo0000106

Source DB:  PubMed          Journal:  Emotion        ISSN: 1528-3542


  6 in total

1.  Audio and visual speech emotion activate the left pre-supplementary motor area.

Authors:  Joseph Rovetti; Fran Copelli; Frank A Russo
Journal:  Cogn Affect Behav Neurosci       Date:  2021-11-22       Impact factor: 3.282

2.  A Public Database of Immersive VR Videos with Corresponding Ratings of Arousal, Valence, and Correlations between Head Movements and Self Report Measures.

Authors:  Benjamin J Li; Jeremy N Bailenson; Adam Pines; Walter J Greenleaf; Leanne M Williams
Journal:  Front Psychol       Date:  2017-12-05

3.  Features and Extra-Striate Body Area Representations of Diagnostic Body Parts in Anger and Fear Perception.

Authors:  Jie Ren; Rui Ding; Shuaixia Li; Mingming Zhang; Dongtao Wei; Chunliang Feng; Pengfei Xu; Wenbo Luo
Journal:  Brain Sci       Date:  2022-03-31

4.  The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English.

Authors:  Steven R Livingstone; Frank A Russo
Journal:  PLoS One       Date:  2018-05-16       Impact factor: 3.240

5.  How Live Music Moves Us: Head Movement Differences in Audiences to Live Versus Recorded Music.

Authors:  Dana Swarbrick; Dan Bosnyak; Steven R Livingstone; Jotthi Bansal; Susan Marsh-Rollo; Matthew H Woolhouse; Laurel J Trainor
Journal:  Front Psychol       Date:  2019-01-11

6.  The lived body (Der Leib) as a diagnostic and therapeutic instrument in general practice.

Authors:  Wolf Axel Langewitz
Journal:  Wien Klin Wochenschr       Date:  2021-07-23       Impact factor: 2.275

  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.