Literature DB >> 32422799

When Shannon and Khinchin meet Shore and Johnson: Equivalence of information theory and statistical inference axiomatics.

Petr Jizba1, Jan Korbel1,2,3.   

Abstract

We propose a unified framework for both Shannon-Khinchin and Shore-Johnson axiomatic systems. We do it by rephrasing Shannon-Khinchine axioms in terms of generalized arithmetics of Kolmogorov and Nagumo. We prove that the two axiomatic schemes yield identical classes of entropic functionals-the Uffink class of entropies. This allows to re-establish the entropic parallelism between information theory and statistical inference that has seemed to be "broken" by the use of non-Shannonian entropies.

Entities:  

Year:  2020        PMID: 32422799     DOI: 10.1103/PhysRevE.101.042126

Source DB:  PubMed          Journal:  Phys Rev E        ISSN: 2470-0045            Impact factor:   2.529


  5 in total

Review 1.  Greater than the parts: a review of the information decomposition approach to causal emergence.

Authors:  Pedro A M Mediano; Fernando E Rosas; Andrea I Luppi; Henrik J Jensen; Anil K Seth; Adam B Barrett; Robin L Carhart-Harris; Daniel Bor
Journal:  Philos Trans A Math Phys Eng Sci       Date:  2022-05-23       Impact factor: 4.019

2.  Unifying Aspects of Generalized Calculus.

Authors:  Marek Czachor
Journal:  Entropy (Basel)       Date:  2020-10-19       Impact factor: 2.524

3.  Thermodynamics of structure-forming systems.

Authors:  Jan Korbel; Simon David Lindner; Rudolf Hanel; Stefan Thurner
Journal:  Nat Commun       Date:  2021-02-18       Impact factor: 14.919

4.  Calibration Invariance of the MaxEnt Distribution in the Maximum Entropy Principle.

Authors:  Jan Korbel
Journal:  Entropy (Basel)       Date:  2021-01-11       Impact factor: 2.524

5.  Causal Inference in Time Series in Terms of Rényi Transfer Entropy.

Authors:  Petr Jizba; Hynek Lavička; Zlata Tabachová
Journal:  Entropy (Basel)       Date:  2022-06-22       Impact factor: 2.738

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.