Literature DB >> 33285857

Approximating Information Measures for Fields.

Łukasz Dębowski1.   

Abstract

We supply corrected proofs of the invariance of completion and the chain rule for the Shannon information measures of arbitrary fields, as stated by Dębowski in 2009. Our corrected proofs rest on a number of auxiliary approximation results for Shannon information measures, which may be of an independent interest. As also discussed briefly in this article, the generalized calculus of Shannon information measures for fields, including the invariance of completion and the chain rule, is useful in particular for studying the ergodic decomposition of stationary processes and its links with statistical modeling of natural language.

Entities:  

Keywords:  Shannon information measures; chain rule; fields; invariance of completion

Year:  2020        PMID: 33285857      PMCID: PMC7516512          DOI: 10.3390/e22010079

Source DB:  PubMed          Journal:  Entropy (Basel)        ISSN: 1099-4300            Impact factor:   2.524


  3 in total

1.  Regularities unseen, randomness observed: levels of entropy convergence.

Authors:  James P Crutchfield; David P Feldman
Journal:  Chaos       Date:  2003-03       Impact factor: 3.642

2.  Signatures of infinity: Nonergodicity and resource scaling in prediction, complexity, and learning.

Authors:  James P Crutchfield; Sarah Marzen
Journal:  Phys Rev E Stat Nonlin Soft Matter Phys       Date:  2015-05-27

3.  Proof of the Ergodic Theorem.

Authors:  G D Birkhoff
Journal:  Proc Natl Acad Sci U S A       Date:  1931-12       Impact factor: 11.205

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.