Literature DB >> 33981047

High-performance brain-to-text communication via handwriting.

Francis R Willett1,2,3, Donald T Avansino4, Leigh R Hochberg5,6,7,8, Jaimie M Henderson9,10,11, Krishna V Shenoy4,12,10,11,13,14.   

Abstract

Brain-computer interfaces (BCIs) can restore communication to people who have lost the ability to move or speak. So far, a major focus of BCI research has been on restoring gross motor skills, such as reaching and grasping1-5 or point-and-click typing with a computer cursor6,7. However, rapid sequences of highly dexterous behaviours, such as handwriting or touch typing, might enable faster rates of communication. Here we developed an intracortical BCI that decodes attempted handwriting movements from neural activity in the motor cortex and translates it to text in real time, using a recurrent neural network decoding approach. With this BCI, our study participant, whose hand was paralysed from spinal cord injury, achieved typing speeds of 90 characters per minute with 94.1% raw accuracy online, and greater than 99% accuracy offline with a general-purpose autocorrect. To our knowledge, these typing speeds exceed those reported for any other BCI, and are comparable to typical smartphone typing speeds of individuals in the age group of our participant (115 characters per minute)8. Finally, theoretical considerations explain why temporally complex movements, such as handwriting, may be fundamentally easier to decode than point-to-point movements. Our results open a new approach for BCIs and demonstrate the feasibility of accurately decoding rapid, dexterous movements years after paralysis.

Entities:  

Mesh:

Year:  2021        PMID: 33981047      PMCID: PMC8163299          DOI: 10.1038/s41586-021-03506-2

Source DB:  PubMed          Journal:  Nature        ISSN: 0028-0836            Impact factor:   49.962


  1 in total

1.  The Argo: a high channel count recording system for neural recording in vivo.

Authors:  Kunal Sahasrabuddhe; Aamir A Khan; Aditya P Singh; Tyler M Stern; Yeena Ng; Aleksandar Tadić; Peter Orel; Chris LaReau; Daniel Pouzzner; Kurtis Nishimura; Kevin M Boergens; Sashank Shivakumar; Matthew S Hopper; Bryan Kerr; Mina-Elraheb S Hanna; Robert J Edgington; Ingrid McNamara; Devin Fell; Peng Gao; Amir Babaie-Fishani; Sampsa Veijalainen; Alexander V Klekachev; Alison M Stuckey; Bert Luyssaert; Takashi D Y Kozai; Chong Xie; Vikash Gilja; Bart Dierickx; Yifan Kong; Malgorzata Straka; Harbaljit S Sohal; Matthew R Angle
Journal:  J Neural Eng       Date:  2021-02-24       Impact factor: 5.379

  1 in total
  39 in total

1.  The brain-reading devices helping paralysed people to move, talk and touch.

Authors:  Liam Drew
Journal:  Nature       Date:  2022-04       Impact factor: 49.962

2.  Categorizing objects from MEG signals using EEGNet.

Authors:  Ran Shi; Yanyu Zhao; Zhiyuan Cao; Chunyu Liu; Yi Kang; Jiacai Zhang
Journal:  Cogn Neurodyn       Date:  2021-09-17       Impact factor: 5.082

3.  Visual percepts evoked with an intracortical 96-channel microelectrode array inserted in human occipital cortex.

Authors:  Eduardo Fernández; Arantxa Alfaro; Cristina Soto-Sánchez; Pablo Gonzalez-Lopez; Antonio M Lozano; Sebastian Peña; Maria Dolores Grima; Alfonso Rodil; Bernardeta Gómez; Xing Chen; Pieter R Roelfsema; John D Rolston; Tyler S Davis; Richard A Normann
Journal:  J Clin Invest       Date:  2021-12-01       Impact factor: 14.808

Review 4.  The science and engineering behind sensitized brain-controlled bionic hands.

Authors:  Chethan Pandarinath; Sliman J Bensmaia
Journal:  Physiol Rev       Date:  2021-09-20       Impact factor: 37.312

5.  Brain-Computer Interfaces for Treatment of Focal Dystonia.

Authors:  Kristina Simonyan; Stefan K Ehrlich; Richard Andersen; Jonathan Brumberg; Frank Guenther; Mark Hallett; Matthew A Howard; José Del R Millán; Richard B Reilly; Tanja Schultz; Davide Valeriani
Journal:  Mov Disord       Date:  2022-08-10       Impact factor: 9.698

6.  Local field potentials reflect cortical population dynamics in a region-specific and frequency-dependent manner.

Authors:  Cecilia Gallego-Carracedo; Matthew G Perich; Raeed H Chowdhury; Lee E Miller; Juan Álvaro Gallego
Journal:  Elife       Date:  2022-08-15       Impact factor: 8.713

7.  Decoding spoken English from intracortical electrode arrays in dorsal precentral gyrus.

Authors:  Guy H Wilson; Sergey D Stavisky; Francis R Willett; Donald T Avansino; Jessica N Kelemen; Leigh R Hochberg; Jaimie M Henderson; Shaul Druckmann; Krishna V Shenoy
Journal:  J Neural Eng       Date:  2020-11-25       Impact factor: 5.379

8.  The Argo: a high channel count recording system for neural recording in vivo.

Authors:  Kunal Sahasrabuddhe; Aamir A Khan; Aditya P Singh; Tyler M Stern; Yeena Ng; Aleksandar Tadić; Peter Orel; Chris LaReau; Daniel Pouzzner; Kurtis Nishimura; Kevin M Boergens; Sashank Shivakumar; Matthew S Hopper; Bryan Kerr; Mina-Elraheb S Hanna; Robert J Edgington; Ingrid McNamara; Devin Fell; Peng Gao; Amir Babaie-Fishani; Sampsa Veijalainen; Alexander V Klekachev; Alison M Stuckey; Bert Luyssaert; Takashi D Y Kozai; Chong Xie; Vikash Gilja; Bart Dierickx; Yifan Kong; Malgorzata Straka; Harbaljit S Sohal; Matthew R Angle
Journal:  J Neural Eng       Date:  2021-02-24       Impact factor: 5.379

9.  Neural interface translates thoughts into type.

Authors:  Pavithra Rajeswaran; Amy L Orsborn
Journal:  Nature       Date:  2021-05       Impact factor: 69.504

10.  The neuroethics of disorders of consciousness: a brief history of evolving ideas.

Authors:  Michael J Young; Yelena G Bodien; Joseph T Giacino; Joseph J Fins; Robert D Truog; Leigh R Hochberg; Brian L Edlow
Journal:  Brain       Date:  2021-12-16       Impact factor: 13.501

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.