Literature DB >> 31840577

Studying language in context using the temporal generalization method.

Alona Fyshe1.   

Abstract

The temporal generalization method (TGM) is a data analysis technique that can be used to test if the brain's representation for particular stimuli (e.g. sounds, images) is maintained, or if it changes as a function of time (King J-R, Dehaene S. 2014 Characterizing the dynamics of mental representations: the temporal generalization method. Trends Cogn. Sci. 18, 203-210. (doi:10.1016/j.tics.2014.01.002)). The TGM involves training models to predict the stimuli or condition using a time window from a recording of brain activity, and testing the resulting models at all possible time windows. This is repeated for all possible training windows to create a full matrix of accuracy for every combination of train/test window. The results of a TGM indicate when brain activity patterns are consistent (i.e. the trained model performs well even when tested on a different time window), and when they are inconsistent, allowing us to track neural representations over time. The TGM has been used to study the representation of images and sounds during a variety of tasks, but has been less readily applied to studies of language. Here, we give an overview of the method itself, discuss how the TGM has been used to analyse two studies of language in context and explore how the TGM could be applied to further our understanding of semantic composition. This article is part of the theme issue 'Towards mechanistic models of meaning composition'.

Keywords:  language; machine learning; magnetoencephalography; semantics; temporal generalization method

Mesh:

Year:  2019        PMID: 31840577      PMCID: PMC6939359          DOI: 10.1098/rstb.2018.0531

Source DB:  PubMed          Journal:  Philos Trans R Soc Lond B Biol Sci        ISSN: 0962-8436            Impact factor:   6.237


  21 in total

Review 1.  The brain basis of syntactic processes: functional imaging and lesion studies.

Authors:  Angela D Friederici; Sonja A Kotz
Journal:  Neuroimage       Date:  2003-11       Impact factor: 6.556

Review 2.  Circular analysis in systems neuroscience: the dangers of double dipping.

Authors:  Nikolaus Kriegeskorte; W Kyle Simmons; Patrick S F Bellgowan; Chris I Baker
Journal:  Nat Neurosci       Date:  2009-05       Impact factor: 24.884

3.  Predicting human brain activity associated with the meanings of nouns.

Authors:  Tom M Mitchell; Svetlana V Shinkareva; Andrew Carlson; Kai-Min Chang; Vicente L Malave; Robert A Mason; Marcel Adam Just
Journal:  Science       Date:  2008-05-30       Impact factor: 47.728

4.  Extrapolating human judgments from skip-gram vector representations of word meaning.

Authors:  Geoff Hollis; Chris Westbury; Lianne Lefsrud
Journal:  Q J Exp Psychol (Hove)       Date:  2016-06-24       Impact factor: 2.143

Review 5.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP).

Authors:  Marta Kutas; Kara D Federmeier
Journal:  Annu Rev Psychol       Date:  2011       Impact factor: 24.137

6.  Tracking neural coding of perceptual and semantic features of concrete nouns.

Authors:  Gustavo Sudre; Dean Pomerleau; Mark Palatucci; Leila Wehbe; Alona Fyshe; Riitta Salmelin; Tom Mitchell
Journal:  Neuroimage       Date:  2012-05-04       Impact factor: 6.556

7.  Simultaneously uncovering the patterns of brain regions involved in different story reading subprocesses.

Authors:  Leila Wehbe; Brian Murphy; Partha Talukdar; Alona Fyshe; Aaditya Ramdas; Tom Mitchell
Journal:  PLoS One       Date:  2014-11-26       Impact factor: 3.240

8.  Bilingual Language Switching in the Laboratory versus in the Wild: The Spatiotemporal Dynamics of Adaptive Language Control.

Authors:  Esti Blanco-Elorrieta; Liina Pylkkänen
Journal:  J Neurosci       Date:  2017-08-16       Impact factor: 6.167

9.  As Soon as You Taste It: Evidence for Sequential and Parallel Processing of Gustatory Information.

Authors:  Raphael Wallroth; Kathrin Ohla
Journal:  eNeuro       Date:  2018-10-23

10.  Characterizing the dynamics of mental representations: the temporal generalization method.

Authors:  J-R King; S Dehaene
Journal:  Trends Cogn Sci       Date:  2014-03-02       Impact factor: 20.229

View more
  2 in total

1.  Modelling meaning composition from formalism to mechanism.

Authors:  Andrea E Martin; Giosuè Baggio
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2019-12-16       Impact factor: 6.237

2.  Neural representation of words within phrases: Temporal evolution of color-adjectives and object-nouns during simple composition.

Authors:  Maryam Honari-Jahromi; Brea Chouinard; Esti Blanco-Elorrieta; Liina Pylkkänen; Alona Fyshe
Journal:  PLoS One       Date:  2021-03-04       Impact factor: 3.240

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.