Literature DB >> 21303711

I see what you're saying: the integration of complex speech and scenes during language comprehension.

Richard Andersson1, Fernanda Ferreira, John M Henderson.   

Abstract

The effect of language-driven eye movements in a visual scene with concurrent speech was examined using complex linguistic stimuli and complex scenes. The processing demands were manipulated using speech rate and the temporal distance between mentioned objects. This experiment differs from previous research by using complex photographic scenes, three-sentence utterances and mentioning four target objects. The main finding was that objects that are more slowly mentioned, more evenly placed and isolated in the speech stream are more likely to be fixated after having been mentioned and are fixated faster. Surprisingly, even objects mentioned in the most demanding conditions still show an effect of language-driven eye-movements. This supports research using concurrent speech and visual scenes, and shows that the behavior of matching visual and linguistic information is likely to generalize to language situations of high information load.
Copyright © 2011. Published by Elsevier B.V.

Mesh:

Year:  2011        PMID: 21303711     DOI: 10.1016/j.actpsy.2011.01.007

Source DB:  PubMed          Journal:  Acta Psychol (Amst)        ISSN: 0001-6918


  10 in total

1.  Integrating mechanisms of visual guidance in naturalistic language production.

Authors:  Moreno I Coco; Frank Keller
Journal:  Cogn Process       Date:  2014-11-23

2.  Eye movements while viewing narrated, captioned, and silent videos.

Authors:  Nicholas M Ross; Eileen Kowler
Journal:  J Vis       Date:  2013-03-01       Impact factor: 2.240

3.  The pictures who shall not be named: Empirical support for benefits of preview in the Visual World Paradigm.

Authors:  Keith S Apfelbaum; Jamie Klein-Packard; Bob McMurray
Journal:  J Mem Lang       Date:  2021-07-10       Impact factor: 3.059

4.  Look at that: Spatial deixis reveals experience-related differences in prediction.

Authors:  Tracy Reuter; Mia Sullivan; Casey Lew-Williams
Journal:  Lang Acquis       Date:  2021-07-30

5.  Adults and children predict in complex and variable referential contexts.

Authors:  Tracy Reuter; Kavindya Dalawella; Casey Lew-Williams
Journal:  Lang Cogn Neurosci       Date:  2020-11-23       Impact factor: 2.331

6.  Interaction between image and text during the process of biblical art reception.

Authors:  Gregor Hardiess; Caecilie Weissert
Journal:  J Eye Mov Res       Date:  2021-03-12       Impact factor: 0.957

Review 7.  Visual attention during spatial language comprehension.

Authors:  Michele Burigo; Pia Knoeferle
Journal:  PLoS One       Date:  2015-01-21       Impact factor: 3.240

Review 8.  Impairments of Speech Comprehension in Patients with Tinnitus-A Review.

Authors:  Daniela Ivansic; Orlando Guntinas-Lichius; Boris Müller; Gerd F Volk; Gerlind Schneider; Christian Dobel
Journal:  Front Aging Neurosci       Date:  2017-07-11       Impact factor: 5.750

9.  Language-driven anticipatory eye movements in virtual reality.

Authors:  Nicole Eichert; David Peeters; Peter Hagoort
Journal:  Behav Res Methods       Date:  2018-06

10.  Understanding Events by Eye and Ear: Agent and Verb Drive Non-anticipatory Eye Movements in Dynamic Scenes.

Authors:  Roberto G de Almeida; Julia Di Nardo; Caitlyn Antal; Michael W von Grünau
Journal:  Front Psychol       Date:  2019-10-10
  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.