Literature DB >> 33859446

ENTRYWISE EIGENVECTOR ANALYSIS OF RANDOM MATRICES WITH LOW EXPECTED RANK.

Emmanuel Abbe1, Jianqing Fan2, Kaizheng Wang2, Yiqiao Zhong2.   

Abstract

Recovering low-rank structures via eigenvector perturbation analysis is a common problem in statistical machine learning, such as in factor analysis, community detection, ranking, matrix completion, among others. While a large variety of bounds are available for average errors between empirical and population statistics of eigenvectors, few results are tight for entrywise analyses, which are critical for a number of problems such as community detection. This paper investigates entrywise behaviors of eigenvectors for a large class of random matrices whose expectations are low-rank, which helps settle the conjecture in Abbe et al. (2014b) that the spectral algorithm achieves exact recovery in the stochastic block model without any trimming or cleaning steps. The key is a first-order approximation of eigenvectors under the ℓ ∞ norm: u k ≈ A u k * λ k * , where {u k } and { u k * } are eigenvectors of a random matrix A and its expectation E A , respectively. The fact that the approximation is both tight and linear in A facilitates sharp comparisons between u k and u k * . In particular, it allows for comparing the signs of u k and u k * even if ‖ u k - u k * ‖ ∞ is large. The results are further extended to perturbations of eigenspaces, yielding new ℓ ∞-type bounds for synchronization ( ℤ 2 -spiked Wigner model) and noisy matrix completion.

Entities:  

Keywords:  62H12; Primary 62H25; community detection; eigenvector perturbation; low-rank structures; matrix completion; random matrices; secondary 60B20; spectral analysis; synchronization

Year:  2020        PMID: 33859446      PMCID: PMC8046180          DOI: 10.1214/19-aos1854

Source DB:  PubMed          Journal:  Ann Stat        ISSN: 0090-5364            Impact factor:   4.028


  6 in total

1.  ASYMMETRY HELPS: EIGENVALUE AND EIGENVECTOR ANALYSES OF ASYMMETRICALLY PERTURBED LOW-RANK MATRICES.

Authors:  Yuxin Chen; Chen Cheng; Jianqing Fan
Journal:  Ann Stat       Date:  2021-01-29       Impact factor: 4.028

2.  NOISY MATRIX COMPLETION: UNDERSTANDING STATISTICAL GUARANTEES FOR CONVEX RELAXATION VIA NONCONVEX OPTIMIZATION.

Authors:  Yuxin Chen; Yuejie Chi; Jianqing Fan; Cong Ma; Yuling Yan
Journal:  SIAM J Optim       Date:  2020-10-28       Impact factor: 2.850

3.  Robust high dimensional factor models with applications to statistical machine learning.

Authors:  Jianqing Fan; Kaizheng Wang; Yiqiao Zhong; Ziwei Zhu
Journal:  Stat Sci       Date:  2021-04-19       Impact factor: 2.901

4.  MODEL ASSISTED VARIABLE CLUSTERING: MINIMAX-OPTIMAL RECOVERY AND ALGORITHMS.

Authors:  Florentina Bunea; Christophe Giraud; Xi Luo; Martin Royer; Nicolas Verzelen
Journal:  Ann Stat       Date:  2020-02-17       Impact factor: 4.904

5.  Asymptotic Theory of Eigenvectors for Random Matrices with Diverging Spikes.

Authors:  Jianqing Fan; Yingying Fan; Xiao Han; Jinchi Lv
Journal:  J Am Stat Assoc       Date:  2020-12-08       Impact factor: 4.369

6.  A Useful Criterion on Studying Consistent Estimation in Community Detection.

Authors:  Huan Qing
Journal:  Entropy (Basel)       Date:  2022-08-09       Impact factor: 2.738

  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.