Literature DB >> 31598016

SPECTRAL METHOD AND REGULARIZED MLE ARE BOTH OPTIMAL FOR TOP-K RANKING.

Yuxin Chen1, Jianqing Fan2, Cong Ma3, Kaizheng Wang4.   

Abstract

This paper is concerned with the problem of top-K ranking from pairwise comparisons. Given a collection of n items and a few pairwise comparisons across them, one wishes to identify the set of K items that receive the highest ranks. To tackle this problem, we adopt the logistic parametric model - the Bradley-Terry-Luce model, where each item is assigned a latent preference score, and where the outcome of each pairwise comparison depends solely on the relative scores of the two items involved. Recent works have made significant progress towards characterizing the performance (e.g. the mean square error for estimating the scores) of several classical methods, including the spectral method and the maximum likelihood estimator (MLE). However, where they stand regarding top-K ranking remains unsettled. We demonstrate that under a natural random sampling model, the spectral method alone, or the regularized MLE alone, is minimax optimal in terms of the sample complexity - the number of paired comparisons needed to ensure exact top-K identification, for the fixed dynamic range regime. This is accomplished via optimal control of the entrywise error of the score estimates. We complement our theoretical studies by numerical experiments, confirming that both methods yield low entrywise errors for estimating the underlying scores. Our theory is established via a novel leave-one-out trick, which proves effective for analyzing both iterative and non-iterative procedures. Along the way, we derive an elementary eigenvector perturbation bound for probability transition matrices, which parallels the Davis-Kahan Θ theorem for symmetric matrices. This also allows us to close the gap between the l 2 error upper bound for the spectral method and the minimax lower limit.

Entities:  

Keywords:  entrywise perturbation; leave-one-out analysis; pairwise comparisons; regularized MLE; reversible Markov chains; spectral method; top-K ranking

Year:  2019        PMID: 31598016      PMCID: PMC6785035          DOI: 10.1214/18-AOS1745

Source DB:  PubMed          Journal:  Ann Stat        ISSN: 0090-5364            Impact factor:   4.028


  4 in total

1.  ASYMMETRY HELPS: EIGENVALUE AND EIGENVECTOR ANALYSES OF ASYMMETRICALLY PERTURBED LOW-RANK MATRICES.

Authors:  Yuxin Chen; Chen Cheng; Jianqing Fan
Journal:  Ann Stat       Date:  2021-01-29       Impact factor: 4.028

2.  NOISY MATRIX COMPLETION: UNDERSTANDING STATISTICAL GUARANTEES FOR CONVEX RELAXATION VIA NONCONVEX OPTIMIZATION.

Authors:  Yuxin Chen; Yuejie Chi; Jianqing Fan; Cong Ma; Yuling Yan
Journal:  SIAM J Optim       Date:  2020-10-28       Impact factor: 2.850

3.  Spectral State Compression of Markov Processes.

Authors:  Anru Zhang; Mengdi Wang
Journal:  IEEE Trans Inf Theory       Date:  2019-11-29       Impact factor: 2.501

4.  Sample-Efficient Reinforcement Learning for Linearly-Parameterized MDPs with a Generative Model.

Authors:  Bingyan Wang; Yuling Yan; Jianqing Fan
Journal:  Adv Neural Inf Process Syst       Date:  2021-12
  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.