Literature DB >> 23423817

Auditory rhythms are systemically associated with spatial-frequency and density information in visual scenes.

Aleksandra Sherman1, Marcia Grabowecky, Satoru Suzuki.   

Abstract

A variety of perceptual correspondences between auditory and visual features have been reported, but few studies have investigated how rhythm, an auditory feature defined purely by dynamics relevant to speech and music, interacts with visual features. Here, we demonstrate a novel crossmodal association between auditory rhythm and visual clutter. Participants were shown a variety of visual scenes from diverse categories and asked to report the auditory rhythm that perceptually matched each scene by adjusting the rate of amplitude modulation (AM) of a sound. Participants matched each scene to a specific AM rate with surprising consistency. A spatial-frequency analysis showed that scenes with greater contrast energy in midrange spatial frequencies were matched to faster AM rates. Bandpass-filtering the scenes indicated that greater contrast energy in this spatial-frequency range was associated with an abundance of object boundaries and contours, suggesting that participants matched more cluttered scenes to faster AM rates. Consistent with this hypothesis, AM-rate matches were strongly correlated with perceived clutter. Additional results indicated that both AM-rate matches and perceived clutter depend on object-based (cycles per object) rather than retinal (cycles per degree of visual angle) spatial frequency. Taken together, these results suggest a systematic crossmodal association between auditory rhythm, representing density in the temporal domain, and visual clutter, representing object-based density in the spatial domain. This association may allow for the use of auditory rhythm to influence how visual clutter is perceived and attended.

Entities:  

Mesh:

Year:  2013        PMID: 23423817      PMCID: PMC3706496          DOI: 10.3758/s13423-013-0399-y

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  24 in total

1.  Neural representations of sinusoidal amplitude and frequency modulations in the primary auditory cortex of awake primates.

Authors:  Li Liang; Thomas Lu; Xiaoqin Wang
Journal:  J Neurophysiol       Date:  2002-05       Impact factor: 2.714

Review 2.  Communication of emotions in vocal expression and music performance: different channels, same code?

Authors:  Patrik N Juslin; Petri Laukka
Journal:  Psychol Bull       Date:  2003-09       Impact factor: 17.737

3.  Parsing pain perception between nociceptive representation and magnitude estimation.

Authors:  M N Baliki; P Y Geha; A V Apkarian
Journal:  J Neurophysiol       Date:  2008-12-10       Impact factor: 2.714

4.  Changes in auditory frequency guide visual-spatial attention.

Authors:  Julia A Mossbridge; Marcia Grabowecky; Satoru Suzuki
Journal:  Cognition       Date:  2011-07-08

5.  Representation of amplitude modulation in the auditory cortex of the cat. I. The anterior auditory field (AAF).

Authors:  C E Schreiner; J V Urbas
Journal:  Hear Res       Date:  1986       Impact factor: 3.208

6.  Laughter exaggerates happy and sad faces depending on visual context.

Authors:  Aleksandra Sherman; Timothy D Sweeny; Marcia Grabowecky; Satoru Suzuki
Journal:  Psychon Bull Rev       Date:  2012-04

7.  On cross-modal similarity: auditory-visual interactions in speeded discrimination.

Authors:  L E Marks
Journal:  J Exp Psychol Hum Percept Perform       Date:  1987-08       Impact factor: 3.332

8.  The sound of motion in spoken language: visual information conveyed by acoustic properties of speech.

Authors:  Hadas Shintel; Howard C Nusbaum
Journal:  Cognition       Date:  2006-12-28

9.  Visual cortex neurons in monkeys and cats: detection, discrimination, and identification.

Authors:  W S Geisler; D G Albrecht
Journal:  Vis Neurosci       Date:  1997 Sep-Oct       Impact factor: 3.241

10.  Characteristic sounds make you look at target objects more quickly.

Authors:  Lucica Iordanescu; Marcia Grabowecky; Steven Franconeri; Jan Theeuwes; Satoru Suzuki
Journal:  Atten Percept Psychophys       Date:  2010-10       Impact factor: 2.199

View more
  2 in total

1.  Drawing sounds: representing tones and chords spatially.

Authors:  Alejandro Salgado-Montejo; Fernando Marmolejo-Ramos; Jorge A Alvarado; Juan Camilo Arboleda; Daniel R Suarez; Charles Spence
Journal:  Exp Brain Res       Date:  2016-08-08       Impact factor: 1.972

2.  Using Oscillating Sounds to Manipulate Sleep Spindles.

Authors:  James W Antony; Ken A Paller
Journal:  Sleep       Date:  2017-03-01       Impact factor: 5.849

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.