Literature DB >> 24307250

The eyes grasp, the hands see: metric category knowledge transfers between vision and touch.

Christian Wallraven1, Heinrich H Bülthoff, Steffen Waterkamp, Loes van Dam, Nina Gaissert.   

Abstract

Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computer-generated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically. We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.

Entities:  

Mesh:

Year:  2014        PMID: 24307250     DOI: 10.3758/s13423-013-0563-4

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  15 in total

1.  Categorical perception of familiar objects.

Authors:  Fiona N Newell; Heinrich H Bülthoff
Journal:  Cognition       Date:  2002-09

2.  Categorical perception for unfamiliar faces. The effect of covert and overt face learning.

Authors:  M Kikutani; D Roberson; J R Hanley
Journal:  Psychol Sci       Date:  2010-05-18

3.  Vision and touch: multiple or multisensory representations of objects?

Authors:  Simon Lacey; Christine Campbell; K Sathian
Journal:  Perception       Date:  2007       Impact factor: 1.490

4.  Perceptual equivalence between vision and touch is complexity dependent.

Authors:  F Phillips; E J L Egan; B N Perry
Journal:  Acta Psychol (Amst)       Date:  2009-08-18

5.  Cross-Modal Transfer in Visual and Haptic Face Recognition.

Authors:  L Dopjans; C Wallraven; H H Bulthoff
Journal:  IEEE Trans Haptics       Date:  2009-05-26       Impact factor: 2.487

6.  Toward a universal law of generalization for psychological science.

Authors:  R N Shepard
Journal:  Science       Date:  1987-09-11       Impact factor: 47.728

7.  Visual and haptic perceptual spaces show high similarity in humans.

Authors:  Nina Gaissert; Christian Wallraven; Heinrich H Bülthoff
Journal:  J Vis       Date:  2010-09-02       Impact factor: 2.240

8.  Transfer of object category knowledge across visual and haptic modalities: experimental and computational studies.

Authors:  Ilker Yildirim; Robert A Jacobs
Journal:  Cognition       Date:  2012-10-25

9.  The visual and haptic perception of natural object shape.

Authors:  J Farley Norman; Hideko F Norman; Anna Marie Clayton; Joann Lianekhammy; Gina Zielke
Journal:  Percept Psychophys       Date:  2004-02

10.  Renewing the respect for similarity.

Authors:  Shimon Edelman; Reza Shahbazi
Journal:  Front Comput Neurosci       Date:  2012-07-13       Impact factor: 2.380

View more
  12 in total

1.  Learning multisensory representations for auditory-visual transfer of sequence category knowledge: a probabilistic language of thought approach.

Authors:  Ilker Yildirim; Robert A Jacobs
Journal:  Psychon Bull Rev       Date:  2014-10-23

2.  "Can touch this": Cross-modal shape categorization performance is associated with microstructural characteristics of white matter association pathways.

Authors:  Haemy Lee Masson; Christian Wallraven; Laurent Petit
Journal:  Hum Brain Mapp       Date:  2016-10-03       Impact factor: 5.038

3.  Perceived similarity ratings predict generalization success after traditional category learning and a new paired-associate learning task.

Authors:  Stefania R Ashby; Caitlin R Bowman; Dagmar Zeithamova
Journal:  Psychon Bull Rev       Date:  2020-08

4.  Mutual Information and Categorical Perception.

Authors:  Jacob Feldman
Journal:  Psychol Sci       Date:  2021-07-20

5.  Does presentation format influence visual size discrimination in tufted capuchin monkeys (Sapajus spp.)?

Authors:  Valentina Truppa; Paola Carducci; Cinzia Trapanese; Daniel Hanus
Journal:  PLoS One       Date:  2015-04-30       Impact factor: 3.240

6.  Perceptual advantage for category-relevant perceptual dimensions: the case of shape and motion.

Authors:  Jonathan R Folstein; Thomas J Palmeri; Isabel Gauthier
Journal:  Front Psychol       Date:  2014-12-01

Review 7.  The contributions of vision and haptics to reaching and grasping.

Authors:  Kayla D Stone; Claudia L R Gonzalez
Journal:  Front Psychol       Date:  2015-09-16

8.  Women's Preferences for Penis Size: A New Research Method Using Selection among 3D Models.

Authors:  Nicole Prause; Jaymie Park; Shannon Leung; Geoffrey Miller
Journal:  PLoS One       Date:  2015-09-02       Impact factor: 3.240

Review 9.  Visuo-haptic multisensory object recognition, categorization, and representation.

Authors:  Simon Lacey; K Sathian
Journal:  Front Psychol       Date:  2014-07-17

10.  From Sensory Signals to Modality-Independent Conceptual Representations: A Probabilistic Language of Thought Approach.

Authors:  Goker Erdogan; Ilker Yildirim; Robert A Jacobs
Journal:  PLoS Comput Biol       Date:  2015-11-10       Impact factor: 4.475

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.