Literature DB >> 36148268

BRIDGING CONVEX AND NONCONVEX OPTIMIZATION IN ROBUST PCA: NOISE, OUTLIERS, AND MISSING DATA.

Yuxin Chen1, Jianqing Fan2, Cong Ma3, Yuling Yan2.   

Abstract

This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as robust principal component analysis (robust PCA), finds applications in various domains. Despite the wide applicability of convex relaxation, the available statistical support (particularly the stability analysis vis-à-vis random noise) remains highly suboptimal, which we strengthen in this paper. When the unknown matrix is well-conditioned, incoherent, and of constant rank, we demonstrate that a principled convex program achieves near-optimal statistical accuracy, in terms of both the Euclidean loss and the ℓ ∞ loss. All of this happens even when nearly a constant fraction of observations are corrupted by outliers with arbitrary magnitudes. The key analysis idea lies in bridging the convex program in use and an auxiliary nonconvex optimization algorithm, and hence the title of this paper.

Entities:  

Keywords:  Primary 62F10; convex relaxation; leave-one-out analysis; robust principal component analysis; secondary 62B10; ℓ∞ guarantees

Year:  2021        PMID: 36148268      PMCID: PMC9491514          DOI: 10.1214/21-aos2066

Source DB:  PubMed          Journal:  Ann Stat        ISSN: 0090-5364            Impact factor:   4.904


  5 in total

1.  Robust Covariance Estimation for Approximate Factor Models.

Authors:  Jianqing Fan; Weichen Wang; Yiqiao Zhong
Journal:  J Econom       Date:  2018-10-06       Impact factor: 2.388

2.  NOISY MATRIX COMPLETION: UNDERSTANDING STATISTICAL GUARANTEES FOR CONVEX RELAXATION VIA NONCONVEX OPTIMIZATION.

Authors:  Yuxin Chen; Yuejie Chi; Jianqing Fan; Cong Ma; Yuling Yan
Journal:  SIAM J Optim       Date:  2020-10-28       Impact factor: 2.850

3.  Angular Synchronization by Eigenvectors and Semidefinite Programming.

Authors:  A Singer
Journal:  Appl Comput Harmon Anal       Date:  2011-01-30       Impact factor: 3.055

4.  Spectral Regularization Algorithms for Learning Large Incomplete Matrices.

Authors:  Rahul Mazumder; Trevor Hastie; Robert Tibshirani
Journal:  J Mach Learn Res       Date:  2010-03-01       Impact factor: 3.654

5.  Gradient Descent with Random Initialization: Fast Global Convergence for Nonconvex Phase Retrieval.

Authors:  Yuxin Chen; Yuejie Chi; Jianqing Fan; Cong Ma
Journal:  Math Program       Date:  2019-02-04       Impact factor: 3.995

  5 in total
  1 in total

1.  Sample-Efficient Reinforcement Learning for Linearly-Parameterized MDPs with a Generative Model.

Authors:  Bingyan Wang; Yuling Yan; Jianqing Fan
Journal:  Adv Neural Inf Process Syst       Date:  2021-12
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.