Literature DB >> 31372846

Texts and pictures serve different functions in conjoint mental model construction and adaptation.

Fang Zhao1, Wolfgang Schnotz2, Inga Wagner2, Robert Gaschler3,4.   

Abstract

In this study we examined the different functions of text and pictures during text-picture integration in multimedia learning. In Study 1, 144 secondary school students (age = 11 to 14 years; 72 females, 72 males) received six text-picture units under two conditions. In the delayed-question condition, students first read the units without a specific question (no-question phase), to stimulate initial coherence-oriented mental model construction. Afterward the question was presented (question-answering phase), to stimulate task-adaptive mental model specification. In the preposed-question condition, students received a specific question from the beginning, stimulating both kinds of processing. Analyses of the participants' eye movement patterns confirmed the assumption that students allocated a higher percentage of available resources to text processing during the initial mental model construction than during adaptive model specification. Conversely, students allocated a higher percentage of available resources to picture processing during adaptive mental model specification than during the initial mental model construction. In Study 2 (N = 12, age = 12 to 16; seven females, five males), we ruled out that these findings were due to the effect of rereading, by implementing a no-question phase either once or twice. To sum up, texts seem to provide more explicit conceptual guidance in mental model construction than pictures do, whereas pictures support mental model adaptation more than text does, by providing flexible access to specific information for task-oriented updates.

Entities:  

Keywords:  Adaptive mental model specification; Eye tracking; Initial mental model construction; Text–picture integration

Year:  2020        PMID: 31372846     DOI: 10.3758/s13421-019-00962-0

Source DB:  PubMed          Journal:  Mem Cognit        ISSN: 0090-502X


  8 in total

1.  Visual imagery can impede reasoning.

Authors:  Markus Knauff; P N Johnson-Laird
Journal:  Mem Cognit       Date:  2002-04

Review 2.  A multimodal parallel architecture: A cognitive framework for multimodal interactions.

Authors:  Neil Cohn
Journal:  Cognition       Date:  2015-11-09

3.  Resource allocation during the rereading of scientific texts.

Authors:  K K Millis; S Simon; N S tenBroek
Journal:  Mem Cognit       Date:  1998-03

4.  Mental animation in the visuospatial sketchpad: evidence from dual-task studies.

Authors:  V K Sims; M Hegarty
Journal:  Mem Cognit       Date:  1997-05

5.  Examining competing hypotheses for the effects of diagrams on recall for text.

Authors:  Francesca R Ortegren; Michael J Serra; Benjamin D England
Journal:  Mem Cognit       Date:  2015-01

6.  Goal-directed visual attention drives health goal priming: An eye-tracking experiment.

Authors:  Laura N van der Laan; Esther K Papies; Ignace T C Hooge; Paul A M Smeets
Journal:  Health Psychol       Date:  2016-09-15       Impact factor: 4.267

7.  A theory of reading: from eye fixations to comprehension.

Authors:  M A Just; P A Carpenter
Journal:  Psychol Rev       Date:  1980-07       Impact factor: 8.934

8.  Utilization of Illustrations during Learning of Science Textbook Passages among Low- and High-Ability Children.

Authors: 
Journal:  Contemp Educ Psychol       Date:  1999-04
  8 in total
  1 in total

1.  Which Tools in Multimedia Are Best for Learning Outcomes? A Study Grounded in Cognitive Load Structures.

Authors:  Glenn-Egil Torgersen; Ole Boe
Journal:  Front Psychol       Date:  2021-07-02
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.