Literature DB >> 21626414

Computing an optimal time window of audiovisual integration in focused attention tasks: illustrated by studies on effect of age and prior knowledge.

Hans Colonius1, Adele Diederich.   

Abstract

The concept of a "time window of integration" holds that information from different sensory modalities must not be perceived too far apart in time in order to be integrated into a multisensory perceptual event. Empirical estimates of window width differ widely, however, ranging from 40 to 600 ms depending on context and experimental paradigm. Searching for theoretical derivation of window width, Colonius and Diederich (Front Integr Neurosci 2010) developed a decision-theoretic framework using a decision rule that is based on the prior probability of a common source, the likelihood of temporal disparities between the unimodal signals, and the payoff for making right or wrong decisions. Here, this framework is extended to the focused attention task where subjects are asked to respond to signals from a target modality only. Evoking the framework of the time-window-of-integration (TWIN) model, an explicit expression for optimal window width is obtained. The approach is probed on two published focused attention studies. The first is a saccadic reaction time study assessing the efficiency with which multisensory integration varies as a function of aging. Although the window widths for young and older adults differ by nearly 200 ms, presumably due to their different peripheral processing speeds, neither of them deviates significantly from the optimal values. In the second study, head saccadic reactions times to a perfectly aligned audiovisual stimulus pair had been shown to depend on the prior probability of spatial alignment. Intriguingly, they reflected the magnitude of the time-window widths predicted by our decision-theoretic framework, i.e., a larger time window is associated with a higher prior probability.

Mesh:

Year:  2011        PMID: 21626414     DOI: 10.1007/s00221-011-2732-x

Source DB:  PubMed          Journal:  Exp Brain Res        ISSN: 0014-4819            Impact factor:   1.972


  54 in total

Review 1.  On the neuronal basis for multisensory convergence: a brief overview.

Authors:  M Alex Meredith
Journal:  Brain Res Cogn Brain Res       Date:  2002-06

2.  Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli.

Authors:  Yoshiyuki Sato; Taro Toyoizumi; Kazuyuki Aihara
Journal:  Neural Comput       Date:  2007-12       Impact factor: 2.026

3.  Age-related multisensory enhancement in a simple audiovisual detection task.

Authors:  Ann M Peiffer; Jennifer L Mozolic; Christina E Hugenschmidt; Paul J Laurienti
Journal:  Neuroreport       Date:  2007-07-02       Impact factor: 1.837

4.  Assessing age-related multisensory enhancement with the time-window-of-integration model.

Authors:  Adele Diederich; Hans Colonius; Annette Schomburg
Journal:  Neuropsychologia       Date:  2008-04-12       Impact factor: 3.139

5.  Is inefficient multisensory processing associated with falls in older people?

Authors:  Annalisa Setti; Kate E Burke; Rose Anne Kenny; Fiona N Newell
Journal:  Exp Brain Res       Date:  2011-02-04       Impact factor: 1.972

6.  Perception of auditory-visual temporal synchrony in human infants.

Authors:  D J Lewkowicz
Journal:  J Exp Psychol Hum Percept Perform       Date:  1996-10       Impact factor: 3.332

7.  The influence of auditory and visual distractors on human orienting gaze shifts.

Authors:  B D Corneil; D P Munoz
Journal:  J Neurosci       Date:  1996-12-15       Impact factor: 6.167

8.  Infant perception of audio-visual speech synchrony.

Authors:  David J Lewkowicz
Journal:  Dev Psychol       Date:  2010-01

9.  Age-related increase in cross-sensory noise in resting and steady-state cerebral perfusion.

Authors:  Christina E Hugenschmidt; Jennifer L Mozolic; Huan Tan; Robert A Kraft; Paul J Laurienti
Journal:  Brain Topogr       Date:  2009-05-05       Impact factor: 3.020

10.  Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration.

Authors:  Neil W Roach; James Heron; Paul V McGraw
Journal:  Proc Biol Sci       Date:  2006-09-07       Impact factor: 5.349

View more
  14 in total

Review 1.  On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model.

Authors:  Miguel A García-Pérez; Rocío Alcalá-Quintana
Journal:  Psychon Bull Rev       Date:  2012-10

Review 2.  The construct of the multisensory temporal binding window and its dysregulation in developmental disabilities.

Authors:  Mark T Wallace; Ryan A Stevenson
Journal:  Neuropsychologia       Date:  2014-08-13       Impact factor: 3.139

3.  Prior knowledge of spatiotemporal configuration facilitates crossmodal saccadic response : A TWIN analysis.

Authors:  Adele Diederich; Hans Colonius; Farid I Kandil
Journal:  Exp Brain Res       Date:  2016-03-15       Impact factor: 1.972

4.  Multisensory integration of redundant trisensory stimulation.

Authors:  Carl Erick Hagmann; Natalie Russo
Journal:  Atten Percept Psychophys       Date:  2016-11       Impact factor: 2.199

5.  Does hearing aid use affect audiovisual integration in mild hearing impairment?

Authors:  Anja Gieseler; Maike A S Tahden; Christiane M Thiel; Hans Colonius
Journal:  Exp Brain Res       Date:  2018-02-16       Impact factor: 1.972

6.  Interactions between space and effectiveness in human multisensory performance.

Authors:  Aaron R Nidiffer; Ryan A Stevenson; Juliane Krueger Fister; Zachary P Barnett; Mark T Wallace
Journal:  Neuropsychologia       Date:  2016-01-27       Impact factor: 3.139

7.  Multisensory integration, aging, and the sound-induced flash illusion.

Authors:  Denton J DeLoss; Russell S Pierce; George J Andersen
Journal:  Psychol Aging       Date:  2013-08-26

8.  Saccadic reaction times to audiovisual stimuli show effects of oscillatory phase reset.

Authors:  Adele Diederich; Annette Schomburg; Hans Colonius
Journal:  PLoS One       Date:  2012-10-03       Impact factor: 3.240

9.  Internet video telephony allows speech reading by deaf individuals and improves speech perception by cochlear implant users.

Authors:  Georgios Mantokoudis; Claudia Dähler; Patrick Dubach; Martin Kompis; Marco D Caversaccio; Pascal Senn
Journal:  PLoS One       Date:  2013-01-24       Impact factor: 3.240

10.  Focused attention vs. crossmodal signals paradigm: deriving predictions from the time-window-of-integration model.

Authors:  Hans Colonius; Adele Diederich
Journal:  Front Integr Neurosci       Date:  2012-08-29
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.