Literature DB >> 24708368

On criticality in high-dimensional data.

Saeed Saremi1, Terrence J Sejnowski.   

Abstract

Data sets with high dimensionality such as natural images, speech, and text have been analyzed with methods from condensed matter physics. Here we compare recent approaches taken to relate the scale invariance of natural images to critical phenomena. We also examine the method of studying high-dimensional data through specific heat curves by applying the analysis to noncritical systems: 1D samples taken from natural images and 2D binary pink noise. Through these examples, we concluded that due to small sample sizes, specific heat is not a reliable measure for gauging whether high-dimensional data are critical. We argue that identifying order parameters and universality classes is a more reliable way to identify criticality in high-dimensional data.

Entities:  

Mesh:

Year:  2014        PMID: 24708368      PMCID: PMC4764512          DOI: 10.1162/NECO_a_00607

Source DB:  PubMed          Journal:  Neural Comput        ISSN: 0899-7667            Impact factor:   2.026


  10 in total

Review 1.  Natural image statistics and neural representation.

Authors:  E P Simoncelli; B A Olshausen
Journal:  Annu Rev Neurosci       Date:  2001       Impact factor: 12.449

2.  Statistics of natural images: Scaling in the woods.

Authors: 
Journal:  Phys Rev Lett       Date:  1994-08-08       Impact factor: 9.161

3.  Weak pairwise correlations imply strongly correlated network states in a neural population.

Authors:  Elad Schneidman; Michael J Berry; Ronen Segev; William Bialek
Journal:  Nature       Date:  2006-04-09       Impact factor: 49.962

4.  Reducing the dimensionality of data with neural networks.

Authors:  G E Hinton; R R Salakhutdinov
Journal:  Science       Date:  2006-07-28       Impact factor: 47.728

5.  Common input explains higher-order correlations and entropy in a simple model of neural population activity.

Authors:  Jakob H Macke; Manfred Opper; Matthias Bethge
Journal:  Phys Rev Lett       Date:  2011-05-17       Impact factor: 9.161

6.  Sparse low-order interaction network underlies a highly correlated and learnable neural population code.

Authors:  Elad Ganmor; Ronen Segev; Elad Schneidman
Journal:  Proc Natl Acad Sci U S A       Date:  2011-05-20       Impact factor: 11.205

7.  Independent component filters of natural images compared with simple cells in primary visual cortex.

Authors:  J H van Hateren; A van der Schaaf
Journal:  Proc Biol Sci       Date:  1998-03-07       Impact factor: 5.349

8.  Hierarchical model of natural images and the origin of scale invariance.

Authors:  Saeed Saremi; Terrence J Sejnowski
Journal:  Proc Natl Acad Sci U S A       Date:  2013-02-04       Impact factor: 11.205

9.  Statistical thermodynamics of natural images.

Authors:  Greg J Stephens; Thierry Mora; Gašper Tkačik; William Bialek
Journal:  Phys Rev Lett       Date:  2013-01-02       Impact factor: 9.161

10.  Relations between the statistics of natural images and the response properties of cortical cells.

Authors:  D J Field
Journal:  J Opt Soc Am A       Date:  1987-12       Impact factor: 2.129

  10 in total
  4 in total

1.  Correlated Percolation, Fractal Structures, and Scale-Invariant Distribution of Clusters in Natural Images.

Authors:  Saeed Saremi; Terrence J Sejnowski
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2015-09-23       Impact factor: 6.226

2.  Zipf's Law Arises Naturally When There Are Underlying, Unobserved Variables.

Authors:  Laurence Aitchison; Nicola Corradi; Peter E Latham
Journal:  PLoS Comput Biol       Date:  2016-12-20       Impact factor: 4.475

3.  Optimal Encoding in Stochastic Latent-Variable Models.

Authors:  Michael E Rule; Martino Sorbaro; Matthias H Hennig
Journal:  Entropy (Basel)       Date:  2020-06-28       Impact factor: 2.524

4.  Signatures of criticality arise from random subsampling in simple population models.

Authors:  Marcel Nonnenmacher; Christian Behrens; Philipp Berens; Matthias Bethge; Jakob H Macke
Journal:  PLoS Comput Biol       Date:  2017-10-03       Impact factor: 4.475

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.