Literature DB >> 33643106

When Gesture "Takes Over": Speech-Embedded Nonverbal Depictions in Multimodal Interaction.

Hui-Chieh Hsu1, Geert Brône1, Kurt Feyaerts1.   

Abstract

The framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: "speech-embedded nonverbal depictions," namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance.
Copyright © 2021 Hsu, Brône and Feyaerts.

Entities:  

Keywords:  depiction; embedding; gesture; iconicity; multimodality

Year:  2021        PMID: 33643106      PMCID: PMC7906077          DOI: 10.3389/fpsyg.2020.552533

Source DB:  PubMed          Journal:  Front Psychol        ISSN: 1664-1078


  10 in total

1.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960.

Authors:  William C Stokoe
Journal:  J Deaf Stud Deaf Educ       Date:  2005

2.  Visible embodiment: gestures as simulated action.

Authors:  Autumn B Hostetter; Martha W Alibali
Journal:  Psychon Bull Rev       Date:  2008-06

3.  From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics.

Authors:  Michael A Arbib
Journal:  Behav Brain Sci       Date:  2005-04       Impact factor: 12.579

4.  How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis.

Authors:  Sotaro Kita; Martha W Alibali; Mingyuan Chu
Journal:  Psychol Rev       Date:  2017-02-27       Impact factor: 8.934

Review 5.  Depicting as a method of communication.

Authors:  Herbert H Clark
Journal:  Psychol Rev       Date:  2016-02-08       Impact factor: 8.934

6.  Lexicalisation and de-lexicalisation processes in sign languages: Comparing depicting constructions and viewpoint gestures.

Authors:  Kearsy Cormier; David Quinto-Pozos; Zed Sevcikova; Adam Schembri
Journal:  Lang Commun       Date:  2012-10

7.  Iconicity as a general property of language: evidence from spoken and signed languages.

Authors:  Pamela Perniss; Robin L Thompson; Gabriella Vigliocco
Journal:  Front Psychol       Date:  2010-12-31

8.  Demonstration and Pantomime in the Evolution of Teaching.

Authors:  Peter Gärdenfors
Journal:  Front Psychol       Date:  2017-03-22

9.  Language as Description, Indication, and Depiction.

Authors:  Lindsay Ferrara; Gabrielle Hodge
Journal:  Front Psychol       Date:  2018-05-23

Review 10.  Gesture and Sign: Cataclysmic Break or Dynamic Relations?

Authors:  Cornelia Müller
Journal:  Front Psychol       Date:  2018-09-10
  10 in total
  3 in total

1.  Iconicity as Multimodal, Polysemiotic, and Plurifunctional.

Authors:  Gabrielle Hodge; Lindsay Ferrara
Journal:  Front Psychol       Date:  2022-06-13

Review 2.  Show Me What You've B/Seen: A Brief History of Depiction.

Authors:  Inez Beukeleers; Myriam Vermeerbergen
Journal:  Front Psychol       Date:  2022-07-11

3.  How is emotional resonance achieved in storytellings of sadness/distress?

Authors:  Christoph Rühlemann
Journal:  Front Psychol       Date:  2022-09-29
  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.