Literature DB >> 35921434

A hierarchy of linguistic predictions during natural language comprehension.

Micha Heilbron1,2, Kristijan Armeni1, Jan-Mathijs Schoffelen1, Peter Hagoort1,2, Floris P de Lange1.   

Abstract

Understanding spoken language requires transforming ambiguous acoustic streams into a hierarchy of representations, from phonemes to meaning. It has been suggested that the brain uses prediction to guide the interpretation of incoming input. However, the role of prediction in language processing remains disputed, with disagreement about both the ubiquity and representational nature of predictions. Here, we address both issues by analyzing brain recordings of participants listening to audiobooks, and using a deep neural network (GPT-2) to precisely quantify contextual predictions. First, we establish that brain responses to words are modulated by ubiquitous predictions. Next, we disentangle model-based predictions into distinct dimensions, revealing dissociable neural signatures of predictions about syntactic category (parts of speech), phonemes, and semantics. Finally, we show that high-level (word) predictions inform low-level (phoneme) predictions, supporting hierarchical predictive processing. Together, these results underscore the ubiquity of prediction in language processing, showing that the brain spontaneously predicts upcoming language at multiple levels of abstraction.

Entities:  

Keywords:  EEG; MEG; computational modeling; language; prediction

Mesh:

Year:  2022        PMID: 35921434      PMCID: PMC9371745          DOI: 10.1073/pnas.2201968119

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   12.779


  71 in total

Review 1.  Thinking ahead: the role and roots of prediction in language comprehension.

Authors:  Kara D Federmeier
Journal:  Psychophysiology       Date:  2007-05-22       Impact factor: 4.016

2.  Modelling the N400 brain potential as change in a probabilistic representation of meaning.

Authors:  Milena Rabovsky; Steven S Hansen; James L McClelland
Journal:  Nat Hum Behav       Date:  2018-08-27

3.  Low-frequency cortical responses to natural speech reflect probabilistic phonotactics.

Authors:  Giovanni M Di Liberto; Daniel Wong; Gerda Ana Melnik; Alain de Cheveigné
Journal:  Neuroimage       Date:  2019-04-13       Impact factor: 6.556

4.  Language ERPs reflect learning through prediction error propagation.

Authors:  Hartmut Fitz; Franklin Chang
Journal:  Cogn Psychol       Date:  2019-03-25       Impact factor: 3.468

5.  Limits on lexical prediction during reading.

Authors:  Steven G Luke; Kiel Christianson
Journal:  Cogn Psychol       Date:  2016-07-01       Impact factor: 3.468

6.  Language structure in the brain: A fixation-related fMRI study of syntactic surprisal in reading.

Authors:  John M Henderson; Wonil Choi; Matthew W Lowder; Fernanda Ferreira
Journal:  Neuroimage       Date:  2016-02-22       Impact factor: 6.556

7.  FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data.

Authors:  Robert Oostenveld; Pascal Fries; Eric Maris; Jan-Mathijs Schoffelen
Journal:  Comput Intell Neurosci       Date:  2010-12-23

8.  Prediction Errors but Not Sharpened Signals Simulate Multivoxel fMRI Patterns during Speech Perception.

Authors:  Helen Blank; Matthew H Davis
Journal:  PLoS Biol       Date:  2016-11-15       Impact factor: 8.029

9.  An Approximation of the Error Backpropagation Algorithm in a Predictive Coding Network with Local Hebbian Synaptic Plasticity.

Authors:  James C R Whittington; Rafal Bogacz
Journal:  Neural Comput       Date:  2017-03-23       Impact factor: 2.026

10.  A hierarchy of time-scales and the brain.

Authors:  Stefan J Kiebel; Jean Daunizeau; Karl J Friston
Journal:  PLoS Comput Biol       Date:  2008-11-14       Impact factor: 4.475

View more
  2 in total

1.  A hierarchy of linguistic predictions during natural language comprehension.

Authors:  Micha Heilbron; Kristijan Armeni; Jan-Mathijs Schoffelen; Peter Hagoort; Floris P de Lange
Journal:  Proc Natl Acad Sci U S A       Date:  2022-08-03       Impact factor: 12.779

2.  Robust effects of working memory demand during naturalistic language comprehension in language-selective cortex.

Authors:  Cory Shain; Idan A Blank; Evelina Fedorenko; Edward Gibson; William Schuler
Journal:  J Neurosci       Date:  2022-08-23       Impact factor: 6.709

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.