Literature DB >> 33022605

Wireless steerable vision for live insects and insect-scale robots.

Vikram Iyer1,2, Ali Najafi3, Johannes James4, Sawyer Fuller4, Shyamnath Gollakota1,2,4.   

Abstract

Vision serves as an essential sensory input for insects but consumes substantial energy resources. The cost to support sensitive photoreceptors has led many insects to develop high visual acuity in only small retinal regions and evolve to move their visual systems independent of their bodies through head motion. By understanding the trade-offs made by insect vision systems in nature, we can design better vision systems for insect-scale robotics in a way that balances energy, computation, and mass. Here, we report a fully wireless, power-autonomous, mechanically steerable vision system that imitates head motion in a form factor small enough to mount on the back of a live beetle or a similarly sized terrestrial robot. Our electronics and actuator weigh 248 milligrams and can steer the camera over 60° based on commands from a smartphone. The camera streams "first person" 160 pixels-by-120 pixels monochrome video at 1 to 5 frames per second (fps) to a Bluetooth radio from up to 120 meters away. We mounted this vision system on two species of freely walking live beetles, demonstrating that triggering image capture using an onboard accelerometer achieves operational times of up to 6 hours with a 10-milliamp hour battery. We also built a small, terrestrial robot (1.6 centimeters by 2 centimeters) that can move at up to 3.5 centimeters per second, support vision, and operate for 63 to 260 minutes. Our results demonstrate that steerable vision can enable object tracking and wide-angle views for 26 to 84 times lower energy than moving the whole robot.
Copyright © 2020 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works.

Year:  2020        PMID: 33022605     DOI: 10.1126/scirobotics.abb0839

Source DB:  PubMed          Journal:  Sci Robot        ISSN: 2470-9476


  3 in total

1.  Complementary feedback control enables effective gaze stabilization in animals.

Authors:  Benjamin Cellini; Wael Salem; Jean-Michel Mongeau
Journal:  Proc Natl Acad Sci U S A       Date:  2022-05-03       Impact factor: 12.779

2.  Miniature optoelectronic compound eye camera.

Authors:  Zhi-Yong Hu; Yong-Lai Zhang; Chong Pan; Jian-Yu Dou; Zhen-Ze Li; Zhen-Nan Tian; Jiang-Wei Mao; Qi-Dai Chen; Hong-Bo Sun
Journal:  Nat Commun       Date:  2022-09-26       Impact factor: 17.694

3.  Estimating the effect of tracking tag weight on insect movement using video analysis: A case study with a flightless orthopteran.

Authors:  Oto Kaláb; David Musiolek; Pavel Rusnok; Petr Hurtik; Martin Tomis; Petr Kočárek
Journal:  PLoS One       Date:  2021-07-22       Impact factor: 3.240

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.