| Literature DB >> 35422527 |
Gabriel Grand1,2, Idan Asher Blank3,4, Francisco Pereira5, Evelina Fedorenko6,7.
Abstract
How is knowledge about word meaning represented in the mental lexicon? Current computational models infer word meanings from lexical co-occurrence patterns. They learn to represent words as vectors in a multidimensional space, wherein words that are used in more similar linguistic contexts-that is, are more semantically related-are located closer together. However, whereas inter-word proximity captures only overall relatedness, human judgements are highly context dependent. For example, dolphins and alligators are similar in size but differ in dangerousness. Here, we use a domain-general method to extract context-dependent relationships from word embeddings: 'semantic projection' of word-vectors onto lines that represent features such as size (the line connecting the words 'small' and 'big') or danger ('safe' to 'dangerous'), analogous to 'mental scales'. This method recovers human judgements across various object categories and properties. Thus, the geometry of word embeddings explicitly represents a wealth of context-dependent world knowledge.Entities:
Mesh:
Year: 2022 PMID: 35422527 DOI: 10.1038/s41562-022-01316-8
Source DB: PubMed Journal: Nat Hum Behav ISSN: 2397-3374