Literature DB >> 27377299

The use of intracranial recordings to decode human language: Challenges and opportunities.

Stephanie Martin1, José Del R Millán2, Robert T Knight3, Brian N Pasley4.   

Abstract

Decoding speech from intracranial recordings serves two main purposes: understanding the neural correlates of speech processing and decoding speech features for targeting speech neuroprosthetic devices. Intracranial recordings have high spatial and temporal resolution, and thus offer a unique opportunity to investigate and decode the electrophysiological dynamics underlying speech processing. In this review article, we describe current approaches to decoding different features of speech perception and production - such as spectrotemporal, phonetic, phonotactic, semantic, and articulatory components - using intracranial recordings. A specific section is devoted to the decoding of imagined speech, and potential applications to speech prosthetic devices. We outline the challenges in decoding human language, as well as the opportunities in scientific and neuroengineering applications.
Copyright © 2016 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  Electrocorticography; Imagined speech; Intracranial recording; Neuroprosthetics; Spatio-temporal pattern of brain activity; Speech decoding; Time course

Mesh:

Year:  2016        PMID: 27377299      PMCID: PMC5203979          DOI: 10.1016/j.bandl.2016.06.003

Source DB:  PubMed          Journal:  Brain Lang        ISSN: 0093-934X            Impact factor:   2.381


  92 in total

1.  Decoding semantic information from human electrocorticographic (ECoG) signals.

Authors:  Wei Wang; Alan D Degenhart; Gustavo P Sudre; Dean A Pomerleau; Elizabeth C Tyler-Kabara
Journal:  Conf Proc IEEE Eng Med Biol Soc       Date:  2011

Review 2.  The cortical organization of speech processing.

Authors:  Gregory Hickok; David Poeppel
Journal:  Nat Rev Neurosci       Date:  2007-04-13       Impact factor: 34.870

3.  Stable online control of an electrocorticographic brain-computer interface using a static decoder.

Authors:  Robin C Ashmore; Bridget M Endler; Ivan Smalianchuk; Alan D Degenhart; Nicholas G Hatsopoulos; Elizabeth C Tyler-Kabara; Aaron P Batista; Wei Wang
Journal:  Conf Proc IEEE Eng Med Biol Soc       Date:  2012

4.  Brain-Computer Interfaces for Speech Communication.

Authors:  Jonathan S Brumberg; Alfonso Nieto-Castanon; Philip R Kennedy; Frank H Guenther
Journal:  Speech Commun       Date:  2010-04-01       Impact factor: 2.017

5.  Selective cortical representation of attended speaker in multi-talker speech perception.

Authors:  Nima Mesgarani; Edward F Chang
Journal:  Nature       Date:  2012-05-10       Impact factor: 49.962

Review 6.  Encoding and decoding in fMRI.

Authors:  Thomas Naselaris; Kendrick N Kay; Shinji Nishimoto; Jack L Gallant
Journal:  Neuroimage       Date:  2010-08-04       Impact factor: 6.556

7.  A brain-computer interface using electrocorticographic signals in humans.

Authors:  Eric C Leuthardt; Gerwin Schalk; Jonathan R Wolpaw; Jeffrey G Ojemann; Daniel W Moran
Journal:  J Neural Eng       Date:  2004-06-14       Impact factor: 5.379

8.  Language networks in semantic dementia.

Authors:  Federica Agosta; Roland G Henry; Raffaella Migliaccio; John Neuhaus; Bruce L Miller; Nina F Dronkers; Simona M Brambati; Massimo Filippi; Jennifer M Ogar; Stephen M Wilson; Maria Luisa Gorno-Tempini
Journal:  Brain       Date:  2009-09-16       Impact factor: 13.501

9.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm.

Authors:  Leigh R Hochberg; Daniel Bacher; Beata Jarosiewicz; Nicolas Y Masse; John D Simeral; Joern Vogel; Sami Haddadin; Jie Liu; Sydney S Cash; Patrick van der Smagt; John P Donoghue
Journal:  Nature       Date:  2012-05-16       Impact factor: 49.962

10.  Temporal evolution of gamma activity in human cortex during an overt and covert word repetition task.

Authors:  Eric C Leuthardt; Xiao-Mei Pei; Jonathan Breshears; Charles Gaona; Mohit Sharma; Zac Freudenberg; Dennis Barbour; Gerwin Schalk
Journal:  Front Hum Neurosci       Date:  2012-05-03       Impact factor: 3.169

View more
  4 in total

1.  Speech synthesis from ECoG using densely connected 3D convolutional neural networks.

Authors:  Miguel Angrick; Christian Herff; Emily Mugler; Matthew C Tate; Marc W Slutzky; Dean J Krusienski; Tanja Schultz
Journal:  J Neural Eng       Date:  2019-03-04       Impact factor: 5.379

2.  Surgical Training for the Implantation of Neocortical Microelectrode Arrays Using a Formaldehyde-fixed Human Cadaver Model.

Authors:  Pierre Mégevand; Alain Woodtli; Aude Yulzari; G Rees Cosgrove; Shahan Momjian; Bojan V Stimec; Marco V Corniola; Jean H D Fasel
Journal:  J Vis Exp       Date:  2017-11-19       Impact factor: 1.355

3.  Differentiation of speech-induced artifacts from physiological high gamma activity in intracranial recordings.

Authors:  Alan Bush; Anna Chrabaszcz; Victoria Peterson; Varun Saravanan; Christina Dastolfo-Hromack; Witold J Lipski; R Mark Richardson
Journal:  Neuroimage       Date:  2022-02-02       Impact factor: 6.556

4.  Open multimodal iEEG-fMRI dataset from naturalistic stimulation with a short audiovisual film.

Authors:  Julia Berezutskaya; Mariska J Vansteensel; Erik J Aarnoutse; Zachary V Freudenburg; Giovanni Piantoni; Mariana P Branco; Nick F Ramsey
Journal:  Sci Data       Date:  2022-03-21       Impact factor: 6.444

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.