Literature DB >> 34305368

NOISY MATRIX COMPLETION: UNDERSTANDING STATISTICAL GUARANTEES FOR CONVEX RELAXATION VIA NONCONVEX OPTIMIZATION.

Yuxin Chen1, Yuejie Chi2, Jianqing Fan3, Cong Ma2, Yuling Yan2.   

Abstract

This paper studies noisy low-rank matrix completion: given partial and noisy entries of a large low-rank matrix, the goal is to estimate the underlying matrix faithfully and efficiently. Arguably one of the most popular paradigms to tackle this problem is convex relaxation, which achieves remarkable efficacy in practice. However, the theoretical support of this approach is still far from optimal in the noisy setting, falling short of explaining its empirical success. We make progress towards demystifying the practical efficacy of convex relaxation vis-à-vis random noise. When the rank and the condition number of the unknown matrix are bounded by a constant, we demonstrate that the convex programming approach achieves near-optimal estimation errors - in terms of the Euclidean loss, the entrywise loss, and the spectral norm loss - for a wide range of noise levels. All of this is enabled by bridging convex relaxation with the nonconvex Burer-Monteiro approach, a seemingly distinct algorithmic paradigm that is provably robust against noise. More specifically, we show that an approximate critical point of the nonconvex formulation serves as an extremely tight approximation of the convex solution, thus allowing us to transfer the desired statistical guarantees of the nonconvex approach to its convex counterpart.

Keywords:  90C25; 90C26; Burer–Monteiro approach; convex relaxation; matrix completion; minimaxity; nonconvex optimization; stability

Year:  2020        PMID: 34305368      PMCID: PMC8300474          DOI: 10.1137/19m1290000

Source DB:  PubMed          Journal:  SIAM J Optim        ISSN: 1052-6234            Impact factor:   2.850


  15 in total

1.  Sufficient Forecasting Using Factor Models.

Authors:  Jianqing Fan; Lingzhou Xue; Jiawei Yao
Journal:  J Econom       Date:  2017-08-26       Impact factor: 2.388

2.  A Nonconvex Optimization Framework for Low Rank Matrix Estimation.

Authors:  Tuo Zhao; Zhaoran Wang; Han Liu
Journal:  Adv Neural Inf Process Syst       Date:  2015

3.  Accelerating parameter mapping with a locally low rank constraint.

Authors:  Tao Zhang; John M Pauly; Ives R Levesque
Journal:  Magn Reson Med       Date:  2014-02-05       Impact factor: 4.668

4.  Angular Synchronization by Eigenvectors and Semidefinite Programming.

Authors:  A Singer
Journal:  Appl Comput Harmon Anal       Date:  2011-01-30       Impact factor: 3.055

5.  Spectral Regularization Algorithms for Learning Large Incomplete Matrices.

Authors:  Rahul Mazumder; Trevor Hastie; Robert Tibshirani
Journal:  J Mach Learn Res       Date:  2010-03-01       Impact factor: 3.654

6.  Gradient Descent with Random Initialization: Fast Global Convergence for Nonconvex Phase Retrieval.

Authors:  Yuxin Chen; Yuejie Chi; Jianqing Fan; Cong Ma
Journal:  Math Program       Date:  2019-02-04       Impact factor: 3.995

7.  Estimating False Discovery Proportion Under Arbitrary Covariance Dependence.

Authors:  Jianqing Fan; Xu Han; Weijie Gu
Journal:  J Am Stat Assoc       Date:  2012       Impact factor: 5.033

8.  Factor-Adjusted Regularized Model Selection.

Authors:  Jianqing Fan; Yuan Ke; Kaizheng Wang
Journal:  J Econom       Date:  2020-02-07       Impact factor: 2.388

9.  Inference and uncertainty quantification for noisy matrix completion.

Authors:  Yuxin Chen; Jianqing Fan; Cong Ma; Yuling Yan
Journal:  Proc Natl Acad Sci U S A       Date:  2019-10-30       Impact factor: 11.205

View more
  2 in total

1.  Sample-Efficient Reinforcement Learning for Linearly-Parameterized MDPs with a Generative Model.

Authors:  Bingyan Wang; Yuling Yan; Jianqing Fan
Journal:  Adv Neural Inf Process Syst       Date:  2021-12

2.  BRIDGING CONVEX AND NONCONVEX OPTIMIZATION IN ROBUST PCA: NOISE, OUTLIERS, AND MISSING DATA.

Authors:  Yuxin Chen; Jianqing Fan; Cong Ma; Yuling Yan
Journal:  Ann Stat       Date:  2021-11-12       Impact factor: 4.904

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.