| Literature DB >> 21278332 |
Steven T Piantadosi1, Harry Tily, Edward Gibson.
Abstract
We demonstrate a substantial improvement on one of the most celebrated empirical laws in the study of language, Zipf's 75-y-old theory that word length is primarily determined by frequency of use. In accord with rational theories of communication, we show across 10 languages that average information content is a much better predictor of word length than frequency. This indicates that human lexicons are efficiently structured for communication by taking into account interword statistical dependencies. Lexical systems result from an optimization of communicative pressures, coding meanings efficiently given the complex statistics of natural language use.Entities:
Mesh:
Year: 2011 PMID: 21278332 PMCID: PMC3048148 DOI: 10.1073/pnas.1012551108
Source DB: PubMed Journal: Proc Natl Acad Sci U S A ISSN: 0027-8424 Impact factor: 11.205