Literature DB >> 28950565

Dependence of exponents on text length versus finite-size scaling for word-frequency distributions.

Álvaro Corral1,2,3,4, Francesc Font-Clos5.   

Abstract

Some authors have recently argued that a finite-size scaling law for the text-length dependence of word-frequency distributions cannot be conceptually valid. Here we give solid quantitative evidence for the validity of this scaling law, using both careful statistical tests and analytical arguments based on the generalized central-limit theorem applied to the moments of the distribution (and obtaining a novel derivation of Heaps' law as a by-product). We also find that the picture of word-frequency distributions with power-law exponents that decrease with text length [X. Yan and P. Minnhagen, Physica A 444, 828 (2016)PHYADX0378-437110.1016/j.physa.2015.10.082] does not stand with rigorous statistical analysis. Instead, we show that the distributions are perfectly described by power-law tails with stable exponents, whose values are close to 2, in agreement with the classical Zipf's law. Some misconceptions about scaling are also clarified.

Year:  2017        PMID: 28950565     DOI: 10.1103/PhysRevE.96.022318

Source DB:  PubMed          Journal:  Phys Rev E        ISSN: 2470-0045            Impact factor:   2.529


  4 in total

1.  From Boltzmann to Zipf through Shannon and Jaynes.

Authors:  Álvaro Corral; Montserrat García Del Muro
Journal:  Entropy (Basel)       Date:  2020-02-05       Impact factor: 2.524

2.  The Brevity Law as a Scaling Law, and a Possible Origin of Zipf's Law for Word Frequencies.

Authors:  Álvaro Corral; Isabel Serra
Journal:  Entropy (Basel)       Date:  2020-02-17       Impact factor: 2.524

3.  Scaling laws in natural conversations among elderly people.

Authors:  Masato S Abe; Mihoko Otake-Matsuura
Journal:  PLoS One       Date:  2021-02-19       Impact factor: 3.240

4.  Lognormals, power laws and double power laws in the distribution of frequencies of harmonic codewords from classical music.

Authors:  Marc Serra-Peralta; Joan Serrà; Álvaro Corral
Journal:  Sci Rep       Date:  2022-02-16       Impact factor: 4.379

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.