Literature DB >> 33267275

Learning Coefficient of Vandermonde Matrix-Type Singularities in Model Selection.

Miki Aoyagi1.   

Abstract

In recent years, selecting appropriate learning models has become more important with the increased need to analyze learning systems, and many model selection methods have been developed. The learning coefficient in Bayesian estimation, which serves to measure the learning efficiency in singular learning models, has an important role in several information criteria. The learning coefficient in regular models is known as the dimension of the parameter space over two, while that in singular models is smaller and varies in learning models. The learning coefficient is known mathematically as the log canonical threshold. In this paper, we provide a new rational blowing-up method for obtaining these coefficients. In the application to Vandermonde matrix-type singularities, we show the efficiency of such methods.

Entities:  

Keywords:  Kullback function; learning coefficient; resolution of singularities; singular learning machine

Year:  2019        PMID: 33267275      PMCID: PMC7515050          DOI: 10.3390/e21060561

Source DB:  PubMed          Journal:  Entropy (Basel)        ISSN: 1099-4300            Impact factor:   2.524


  7 in total

1.  Algebraic analysis for nonidentifiable learning machines.

Authors:  S Watanabe
Journal:  Neural Comput       Date:  2001-04       Impact factor: 2.026

2.  Algebraic geometrical methods for hierarchical learning machines.

Authors:  S Watanabe
Journal:  Neural Netw       Date:  2001-10

3.  Learning coefficient of generalization error in Bayesian estimation and vandermonde matrix-type singularity.

Authors:  Miki Aoyagi; Kenji Nagata
Journal:  Neural Comput       Date:  2012-02-01       Impact factor: 2.026

4.  Stochastic complexities of reduced rank regression in Bayesian estimation.

Authors:  Miki Aoyagi; Sumio Watanabe
Journal:  Neural Netw       Date:  2005-09

5.  Equations of states in singular statistical estimation.

Authors:  Sumio Watanabe
Journal:  Neural Netw       Date:  2009-08-15

6.  Asymptotic analysis of Bayesian generalization error with Newton diagram.

Authors:  Keisuke Yamazaki; Miki Aoyagi; Sumio Watanabe
Journal:  Neural Netw       Date:  2009-08-07

7.  Asymptotic behavior of exchange ratio in exchange Monte Carlo method.

Authors:  Kenji Nagata; Sumio Watanabe
Journal:  Neural Netw       Date:  2008-02-12
  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.