Literature DB >> 34898436

Improving the Learning Rate, Accuracy, and Workspace of Reinforcement Learning Controllers for a Musculoskeletal Model of the Human Arm.

Douglas C Crowder, Jessica Abreu, Robert F Kirsch.   

Abstract

Cervical spinal cord injuries frequently cause paralysis of all four limbs - a medical condition known as tetraplegia. Functional electrical stimulation (FES), when combined with an appropriate controller, can be used to restore motor function by electrically stimulating the neuromuscular system. Previous works have demonstrated that reinforcement learning can be used to successfully train FES controllers. Here, we demonstrate that transfer learning and curriculum learning can be used to improve the learning rates, accuracies, and workspaces of FES controllers that are trained using reinforcement learning.

Entities:  

Mesh:

Year:  2022        PMID: 34898436      PMCID: PMC8847021          DOI: 10.1109/TNSRE.2021.3135471

Source DB:  PubMed          Journal:  IEEE Trans Neural Syst Rehabil Eng        ISSN: 1534-4320            Impact factor:   3.802


  11 in total

1.  Computational nature of human adaptive control during learning of reaching movements in force fields.

Authors:  N Bhushan; R Shadmehr
Journal:  Biol Cybern       Date:  1999-07       Impact factor: 2.086

2.  The functional impact of the Freehand System on tetraplegic hand function. Clinical Results.

Authors:  P Taylor; J Esnouf; J Hobby
Journal:  Spinal Cord       Date:  2002-11       Impact factor: 2.772

3.  The role of multisensor data fusion in neuromuscular control of a sagittal arm with a pair of muscles using actor-critic reinforcement learning method.

Authors:  V Golkhou; M Parnianpour; C Lucas
Journal:  Technol Health Care       Date:  2004       Impact factor: 1.285

4.  Joint angle control by FES using a feedback error learning controller.

Authors:  Kenji Kurosawa; Ryoko Futami; Takashi Watanabe; Nozomu Hoshimiya
Journal:  IEEE Trans Neural Syst Rehabil Eng       Date:  2005-09       Impact factor: 3.802

5.  Multi-muscle FES force control of the human arm for arbitrary goals.

Authors:  Eric M Schearer; Yu-Wei Liao; Eric J Perreault; Matthew C Tresch; William D Memberg; Robert F Kirsch; Kevin M Lynch
Journal:  IEEE Trans Neural Syst Rehabil Eng       Date:  2013-10-07       Impact factor: 3.802

6.  Training an Actor-Critic Reinforcement Learning Controller for Arm Movement Using Human-Generated Rewards.

Authors:  Kathleen M Jagodnik; Philip S Thomas; Antonie J van den Bogert; Michael S Branicky; Robert F Kirsch
Journal:  IEEE Trans Neural Syst Rehabil Eng       Date:  2017-05-02       Impact factor: 3.802

7.  An optimized proportional-derivative controller for the human upper extremity with gravity.

Authors:  Kathleen M Jagodnik; Dimitra Blana; Antonie J van den Bogert; Robert F Kirsch
Journal:  J Biomech       Date:  2015-08-29       Impact factor: 2.712

8.  Combined feedforward and feedback control of a redundant, nonlinear, dynamic musculoskeletal system.

Authors:  Dimitra Blana; Robert F Kirsch; Edward K Chadwick
Journal:  Med Biol Eng Comput       Date:  2009-04-03       Impact factor: 2.602

9.  Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration.

Authors:  A Bolu Ajiboye; Francis R Willett; Daniel R Young; William D Memberg; Brian A Murphy; Jonathan P Miller; Benjamin L Walter; Jennifer A Sweet; Harry A Hoyen; Michael W Keith; P Hunter Peckham; John D Simeral; John P Donoghue; Leigh R Hochberg; Robert F Kirsch
Journal:  Lancet       Date:  2017-03-28       Impact factor: 79.321

10.  Hindsight Experience Replay Improves Reinforcement Learning for Control of a MIMO Musculoskeletal Model of the Human Arm.

Authors:  Douglas C Crowder; Jessica Abreu; Robert F Kirsch
Journal:  IEEE Trans Neural Syst Rehabil Eng       Date:  2021-05-17       Impact factor: 3.802

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.