Literature DB >> 28940969

Decoding the neural representation of story meanings across languages.

Morteza Dehghani1, Reihane Boghrati1, Kingson Man1, Joe Hoover1, Sarah I Gimbel1, Ashish Vaswani2, Jason D Zevin1, Mary Helen Immordino-Yang1, Andrew S Gordon1, Antonio Damasio1, Jonas T Kaplan1.   

Abstract

Drawing from a common lexicon of semantic units, humans fashion narratives whose meaning transcends that of their individual utterances. However, while brain regions that represent lower-level semantic units, such as words and sentences, have been identified, questions remain about the neural representation of narrative comprehension, which involves inferring cumulative meaning. To address these questions, we exposed English, Mandarin, and Farsi native speakers to native language translations of the same stories during fMRI scanning. Using a new technique in natural language processing, we calculated the distributed representations of these stories (capturing the meaning of the stories in high-dimensional semantic space), and demonstrate that using these representations we can identify the specific story a participant was reading from the neural data. Notably, this was possible even when the distributed representations were calculated using stories in a different language than the participant was reading. Our results reveal that identification relied on a collection of brain regions most prominently located in the default mode network. These results demonstrate that neuro-semantic encoding of narratives happens at levels higher than individual semantic units and that this encoding is systematic across both individuals and languages. Hum Brain Mapp 38:6096-6106, 2017.
© 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Entities:  

Keywords:  knowledge representation; language neuroscience; machine learning; natural language processing; semantics

Mesh:

Year:  2017        PMID: 28940969      PMCID: PMC6867091          DOI: 10.1002/hbm.23814

Source DB:  PubMed          Journal:  Hum Brain Mapp        ISSN: 1065-9471            Impact factor:   5.038


  50 in total

Review 1.  The brain's default network: anatomy, function, and relevance to disease.

Authors:  Randy L Buckner; Jessica R Andrews-Hanna; Daniel L Schacter
Journal:  Ann N Y Acad Sci       Date:  2008-03       Impact factor: 5.691

Review 2.  The brain's default mode network.

Authors:  Marcus E Raichle
Journal:  Annu Rev Neurosci       Date:  2015-05-04       Impact factor: 12.449

Review 3.  The science of mind wandering: empirically navigating the stream of consciousness.

Authors:  Jonathan Smallwood; Jonathan W Schooler
Journal:  Annu Rev Psychol       Date:  2014-09-29       Impact factor: 24.137

4.  The role of knowledge in discourse comprehension: a construction-integration model.

Authors:  W Kintsch
Journal:  Psychol Rev       Date:  1988-04       Impact factor: 8.934

5.  Mental time travel and default-mode network functional connectivity in the developing brain.

Authors:  Ylva Østby; Kristine B Walhovd; Christian K Tamnes; Håkon Grydeland; Lars Tjelta Westlye; Anders M Fjell
Journal:  Proc Natl Acad Sci U S A       Date:  2012-10-01       Impact factor: 11.205

6.  Identifying bilingual semantic neural representations across languages.

Authors:  Augusto Buchweitz; Svetlana V Shinkareva; Robert A Mason; Tom M Mitchell; Marcel Adam Just
Journal:  Brain Lang       Date:  2011-10-05       Impact factor: 2.381

Review 7.  Hierarchical process memory: memory as an integral component of information processing.

Authors:  Uri Hasson; Janice Chen; Christopher J Honey
Journal:  Trends Cogn Sci       Date:  2015-05-14       Impact factor: 20.229

8.  EEG decoding of spoken words in bilingual listeners: from words to language invariant semantic-conceptual representations.

Authors:  João M Correia; Bernadette Jansma; Lars Hausfeld; Sanne Kikkert; Milene Bonte
Journal:  Front Psychol       Date:  2015-02-06

9.  Shared memories reveal shared structure in neural activity across individuals.

Authors:  Janice Chen; Yuan Chang Leong; Christopher J Honey; Chung H Yong; Kenneth A Norman; Uri Hasson
Journal:  Nat Neurosci       Date:  2016-12-05       Impact factor: 24.884

10.  A neurosemantic theory of concrete noun representation based on the underlying brain codes.

Authors:  Marcel Adam Just; Vladimir L Cherkassky; Sandesh Aryal; Tom M Mitchell
Journal:  PLoS One       Date:  2010-01-13       Impact factor: 3.240

View more
  10 in total

Review 1.  The default mode network: where the idiosyncratic self meets the shared social world.

Authors:  Yaara Yeshurun; Mai Nguyen; Uri Hasson
Journal:  Nat Rev Neurosci       Date:  2021-01-22       Impact factor: 34.870

2.  fMRI reveals language-specific predictive coding during naturalistic sentence comprehension.

Authors:  Cory Shain; Idan Asher Blank; Marten van Schijndel; William Schuler; Evelina Fedorenko
Journal:  Neuropsychologia       Date:  2019-12-24       Impact factor: 3.139

3.  Narrative event segmentation in the cortical reservoir.

Authors:  Peter Ford Dominey
Journal:  PLoS Comput Biol       Date:  2021-10-07       Impact factor: 4.475

4.  Incremental Language Comprehension Difficulty Predicts Activity in the Language Network but Not the Multiple Demand Network.

Authors:  Leila Wehbe; Idan Asher Blank; Cory Shain; Richard Futrell; Roger Levy; Titus von der Malsburg; Nathaniel Smith; Edward Gibson; Evelina Fedorenko
Journal:  Cereb Cortex       Date:  2021-07-29       Impact factor: 4.861

5.  Groups and Emotional Arousal Mediate Neural Synchrony and Perceived Ritual Efficacy.

Authors:  Philip S Cho; Nicolas Escoffier; Yinan Mao; April Ching; Christopher Green; Jonathan Jong; Harvey Whitehouse
Journal:  Front Psychol       Date:  2018-10-26

6.  Similarities and differences in the neural representations of abstract concepts across English and Mandarin.

Authors:  Robert Vargas; Marcel Adam Just
Journal:  Hum Brain Mapp       Date:  2022-03-28       Impact factor: 5.399

7.  Deep language algorithms predict semantic comprehension from brain activity.

Authors:  Charlotte Caucheteux; Alexandre Gramfort; Jean-Rémi King
Journal:  Sci Rep       Date:  2022-09-29       Impact factor: 4.996

8.  Functional Brain Connectivity During Narrative Processing Relates to Transportation and Story Influence.

Authors:  Anthony G Vaccaro; Brandon Scott; Sarah I Gimbel; Jonas T Kaplan
Journal:  Front Hum Neurosci       Date:  2021-07-05       Impact factor: 3.169

9.  Transition From Sublexical to Lexico-Semantic Stimulus Processing.

Authors:  Frederick Benjamin Junker; Lara Schlaffke; Christian Bellebaum; Marta Ghio; Stefanie Brühl; Nikolai Axmacher; Tobias Schmidt-Wilcke
Journal:  Front Syst Neurosci       Date:  2020-10-30

Review 10.  Movies and narratives as naturalistic stimuli in neuroimaging.

Authors:  Iiro P Jääskeläinen; Mikko Sams; Enrico Glerean; Jyrki Ahveninen
Journal:  Neuroimage       Date:  2020-10-12       Impact factor: 6.556

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.