Literature DB >> 33096039

Early Emergence of Solid Shape Coding in Natural and Deep Network Vision.

Ramanujan Srinath1, Alexandriya Emonds2, Qingyang Wang1, Augusto A Lempel1, Erika Dunn-Weiss1, Charles E Connor3, Kristina J Nielsen4.   

Abstract

Area V4 is the first object-specific processing stage in the ventral visual pathway, just as area MT is the first motion-specific processing stage in the dorsal pathway. For almost 50 years, coding of object shape in V4 has been studied and conceived in terms of flat pattern processing, given its early position in the transformation of 2D visual images. Here, however, in awake monkey recording experiments, we found that roughly half of V4 neurons are more tuned and responsive to solid, 3D shape-in-depth, as conveyed by shading, specularity, reflection, refraction, or disparity cues in images. Using 2-photon functional microscopy, we found that flat- and solid-preferring neurons were segregated into separate modules across the surface of area V4. These findings should impact early shape-processing theories and models, which have focused on 2D pattern processing. In fact, our analyses of early object processing in AlexNet, a standard visual deep network, revealed a similar distribution of sensitivities to flat and solid shape in layer 3. Early processing of solid shape, in parallel with flat shape, could represent a computational advantage discovered by both primate brain evolution and deep-network training.
Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.

Entities:  

Keywords:  3D; V4; cortex; deep network; neural coding; object; primate; shape; ventral pathway; vision

Mesh:

Year:  2020        PMID: 33096039      PMCID: PMC7856003          DOI: 10.1016/j.cub.2020.09.076

Source DB:  PubMed          Journal:  Curr Biol        ISSN: 0960-9822            Impact factor:   10.834


  89 in total

Review 1.  Maps in the brain: what can we learn from them?

Authors:  Dmitri B Chklovskii; Alexei A Koulakov
Journal:  Annu Rev Neurosci       Date:  2004       Impact factor: 12.449

2.  Representation of stereoscopic depth based on relative disparity in macaque area V4.

Authors:  Kazumasa Umeda; Seiji Tanabe; Ichiro Fujita
Journal:  J Neurophysiol       Date:  2007-05-16       Impact factor: 2.714

3.  Image statistics do not explain the perception of gloss and lightness.

Authors:  Barton L Anderson; Juno Kim
Journal:  J Vis       Date:  2009-10-09       Impact factor: 2.240

4.  The perception of gloss depends on highlight congruence with surface shading.

Authors:  Juno Kim; Phillip Marlow; Barton L Anderson
Journal:  J Vis       Date:  2011-08-12       Impact factor: 2.240

Review 5.  Ferrier lecture. Functional architecture of macaque monkey visual cortex.

Authors:  D H Hubel; T N Wiesel
Journal:  Proc R Soc Lond B Biol Sci       Date:  1977-07-28

6.  Optical imaging of functional organization in the monkey inferotemporal cortex.

Authors:  G Wang; K Tanaka; M Tanifuji
Journal:  Science       Date:  1996-06-14       Impact factor: 47.728

7.  The role of visual area V4 in the discrimination of partially occluded shapes.

Authors:  Yoshito Kosai; Yasmine El-Shamayleh; Amber M Fyall; Anitha Pasupathy
Journal:  J Neurosci       Date:  2014-06-18       Impact factor: 6.167

8.  Receptive fields and functional architecture of monkey striate cortex.

Authors:  D H Hubel; T N Wiesel
Journal:  J Physiol       Date:  1968-03       Impact factor: 5.182

9.  A motion direction map in macaque V2.

Authors:  Haidong D Lu; Gang Chen; Hisashi Tanigawa; Anna W Roe
Journal:  Neuron       Date:  2010-12-09       Impact factor: 17.173

10.  A channel for 3D environmental shape in anterior inferotemporal cortex.

Authors:  Siavash Vaziri; Eric T Carlson; Zhihong Wang; Charles E Connor
Journal:  Neuron       Date:  2014-09-18       Impact factor: 17.173

View more
  5 in total

1.  Function-specific projections from V2 to V4 in macaques.

Authors:  Chen Fang; Kun Yan; Chen Liang; Jiayu Wang; Xingya Cai; Rui Zhang; Haidong D Lu
Journal:  Brain Struct Funct       Date:  2022-01-03       Impact factor: 3.270

2.  Will We Ever Have Conscious Machines?

Authors:  Patrick Krauss; Andreas Maier
Journal:  Front Comput Neurosci       Date:  2020-12-22       Impact factor: 2.380

3.  The Role of Specular Reflections and Illumination in the Perception of Thickness in Solid Transparent Objects.

Authors:  Masakazu Ohara; Juno Kim; Kowa Koida
Journal:  Front Psychol       Date:  2022-02-17

4.  Processing of visual statistics of naturalistic videos in macaque visual areas V1 and V4.

Authors:  Gaku Hatanaka; Mikio Inagaki; Ryosuke F Takeuchi; Shinji Nishimoto; Koji Ikezoe; Ichiro Fujita
Journal:  Brain Struct Funct       Date:  2022-03-14       Impact factor: 3.748

5.  Binocular vision supports the development of scene segmentation capabilities: Evidence from a deep learning model.

Authors:  Ross Goutcher; Christian Barrington; Paul B Hibbard; Bruce Graham
Journal:  J Vis       Date:  2021-07-06       Impact factor: 2.240

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.