| Literature DB >> 36248665 |
Michael Ehrlich1, Yuval Zaidel1, Patrice L Weiss2,3, Arie Melamed Yekel3, Naomi Gefen3, Lazar Supic4, Elishai Ezra Tsur1.
Abstract
Wheelchair-mounted robotic arms support people with upper extremity disabilities with various activities of daily living (ADL). However, the associated cost and the power consumption of responsive and adaptive assistive robotic arms contribute to the fact that such systems are in limited use. Neuromorphic spiking neural networks can be used for a real-time machine learning-driven control of robots, providing an energy efficient framework for adaptive control. In this work, we demonstrate a neuromorphic adaptive control of a wheelchair-mounted robotic arm deployed on Intel's Loihi chip. Our algorithm design uses neuromorphically represented and integrated velocity readings to derive the arm's current state. The proposed controller provides the robotic arm with adaptive signals, guiding its motion while accounting for kinematic changes in real-time. We pilot-tested the device with an able-bodied participant to evaluate its accuracy while performing ADL-related trajectories. We further demonstrated the capacity of the controller to compensate for unexpected inertia-generating payloads using online learning. Videotaped recordings of ADL tasks performed by the robot were viewed by caregivers; data summarizing their feedback on the user experience and the potential benefit of the system is reported.Entities:
Keywords: Neural Engineering Framework (NEF); clinical robotic study; neuromorphic control; neurorehabilitation; online learning; prescribed error sensitivity
Year: 2022 PMID: 36248665 PMCID: PMC9559600 DOI: 10.3389/fnins.2022.1007736
Source DB: PubMed Journal: Front Neurosci ISSN: 1662-453X Impact factor: 5.152
FIGURE 1Acceleration-mediated adaptive control of a wheelchair mounted robotic arm. (A) The complete system where the accelerator is embedded within the stereo camera, which is mounter on the arm’s end-effector; demonstrated by Yuval Zaidel (author; published with permission); (B) control framework schematic: accelerometer-driven velocity readings are neuromorphically integrated with spiking neurons, allowing the derivation of the arm’s position. The arm’s position is compared to its desired state providing error correcting adaptive signals. Adaptive signals are introduced to the controller for accurate final positioning.
FIGURE 2(A) Screenshots from the various stages of the robotic assisted activities of daily living (ADL) demonstration. A video is available as a Supplementary Information; demonstrated by Yuval Zaidel (author; published with permission); (B) motion guidance of a wheelchair mountet robotic arm using both manual control and automatic motion guidance (auto pilot) to reach several ADL-related key points.
FIGURE 3Control evaluation [error distribution and convergence, and episode length (steps to target)] with a neuromorphic integrator featuring 100, 1,000, and 5,000 neurons per dimension, three unidimensional integrators or one 3D integrator and three synaptic constants: 0.01, 0.1 and 1 s. Results were obtained from reaching 100 randomly positioned target points.
FIGURE 4Adaptively controlled robotic arm, while manipulating a 2 kg payload, using acceleration-derived positioning feedback. (A) System’s schematic: (B) error (distance from target) distribution, evaluated on 100 target points; (C) example of reaching four target points with and without adaptive control.