Literature DB >> 29686476

A Compact VLSI System for Bio-Inspired Visual Motion Estimation.

Cong Shi1, Gang Luo1.   

Abstract

This paper proposes a bio-inspired visual motion estimation algorithm based on motion energy, along with its compact very-large-scale integration (VLSI) architecture using low-cost embedded systems. The algorithm mimics motion perception functions of retina, V1, and MT neurons in a primate visual system. It involves operations of ternary edge extraction, spatiotemporal filtering, motion energy extraction, and velocity integration. Moreover, we propose the concept of confidence map to indicate the reliability of estimation results on each probing location. Our algorithm involves only additions and multiplications during runtime, which is suitable for low-cost hardware implementation. The proposed VLSI architecture employs multiple (frame, pixel, and operation) levels of pipeline and massively parallel processing arrays to boost the system performance. The array unit circuits are optimized to minimize hardware resource consumption. We have prototyped the proposed architecture on a low-cost field-programmable gate array platform (Zynq 7020) running at 53-MHz clock frequency. It achieved 30-frame/s real-time performance for velocity estimation on 160 × 120 probing locations. A comprehensive evaluation experiment showed that the estimated velocity by our prototype has relatively small errors (average endpoint error < 0.5 pixel and angular error < 10°) for most motion cases.

Entities:  

Keywords:  Bio-inspired motion estimation; motion energy; multiple levels of pipeline; optical flow; spatiotemporal filtering; very-large-scale integration (VLSI) architecture

Year:  2016        PMID: 29686476      PMCID: PMC5909735          DOI: 10.1109/TCSVT.2016.2630848

Source DB:  PubMed          Journal:  IEEE Trans Circuits Syst Video Technol        ISSN: 1051-8215            Impact factor:   4.685


  17 in total

1.  Representing retinal image speed in visual cortex.

Authors:  E P Simoncelli; D J Heeger
Journal:  Nat Neurosci       Date:  2001-05       Impact factor: 24.884

2.  Speed skills: measuring the visual speed analyzing properties of primate MT neurons.

Authors:  J A Perrone; A Thiele
Journal:  Nat Neurosci       Date:  2001-05       Impact factor: 24.884

3.  The Applicability of Spatiotemporal Oriented Energy Features to Region Tracking.

Authors:  Kevin J Cannons; Richard P Wildes
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2014-04       Impact factor: 6.226

4.  Time-to-Collision estimation from motion based on primate visual processing.

Authors:  John M Galbraith; Garrett T Kenyon; Richard W Ziolkowski
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2005-08       Impact factor: 6.226

5.  Recognition of dynamic video contents with global probabilistic models of visual motion.

Authors:  Gwenaëlle Piriou; Patrick Bouthemy; Jian-Feng Yao
Journal:  IEEE Trans Image Process       Date:  2006-11       Impact factor: 10.856

6.  A new diamond search algorithm for fast block-matching motion estimation.

Authors:  S Zhu; K K Ma
Journal:  IEEE Trans Image Process       Date:  2000       Impact factor: 10.856

7.  A model for the estimate of local image velocity by cells in the visual cortex.

Authors:  N M Grzywacz; A L Yuille
Journal:  Proc R Soc Lond B Biol Sci       Date:  1990-03-22

8.  Spatiotemporal energy models for the perception of motion.

Authors:  E H Adelson; J R Bergen
Journal:  J Opt Soc Am A       Date:  1985-02       Impact factor: 2.129

9.  Quantification of blood flow in internal cerebral artery by optical flow method on digital subtraction angiography in comparison with time-of-flight magnetic resonance angiography.

Authors:  Tzung-Chi Huang; Chih-Kai Chang; Chun-Han Liao; Yung-Jen Ho
Journal:  PLoS One       Date:  2013-01-24       Impact factor: 3.240

10.  Optimal speed estimation in natural image movies predicts human performance.

Authors:  Johannes Burge; Wilson S Geisler
Journal:  Nat Commun       Date:  2015-08-04       Impact factor: 14.919

View more
  1 in total

1.  Without low spatial frequencies, high resolution vision would be detrimental to motion perception.

Authors:  Cong Shi; Shrinivas Pundlik; Gang Luo
Journal:  J Vis       Date:  2020-08-03       Impact factor: 2.240

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.