Literature DB >> 25580039

ADAPTIVE ROBUST VARIABLE SELECTION.

Jianqing Fan1, Yingying Fan1, Emre Barut1.   

Abstract

Heavy-tailed high-dimensional data are commonly encountered in various scientific fields and pose great challenges to modern statistical analysis. A natural procedure to address this problem is to use penalized quantile regression with weighted L1-penalty, called weighted robust Lasso (WR-Lasso), in which weights are introduced to ameliorate the bias problem induced by the L1-penalty. In the ultra-high dimensional setting, where the dimensionality can grow exponentially with the sample size, we investigate the model selection oracle property and establish the asymptotic normality of the WR-Lasso. We show that only mild conditions on the model error distribution are needed. Our theoretical results also reveal that adaptive choice of the weight vector is essential for the WR-Lasso to enjoy these nice asymptotic properties. To make the WR-Lasso practically feasible, we propose a two-step procedure, called adaptive robust Lasso (AR-Lasso), in which the weight vector in the second step is constructed based on the L1-penalized quantile regression estimate from the first step. This two-step procedure is justified theoretically to possess the oracle property and the asymptotic normality. Numerical studies demonstrate the favorable finite-sample performance of the AR-Lasso.

Entities:  

Keywords:  Adaptive weighted L1; High dimensions; Oracle properties; Robust regularization

Year:  2014        PMID: 25580039      PMCID: PMC4286898          DOI: 10.1214/13-AOS1191

Source DB:  PubMed          Journal:  Ann Stat        ISSN: 0090-5364            Impact factor:   4.028


  4 in total

1.  Non-Concave Penalized Likelihood with NP-Dimensionality.

Authors:  Jianqing Fan; Jinchi Lv
Journal:  IEEE Trans Inf Theory       Date:  2011-08       Impact factor: 2.501

2.  Penalized Composite Quasi-Likelihood for Ultrahigh-Dimensional Variable Selection.

Authors:  Jelena Bradic; Jianqing Fan; Weiwei Wang
Journal:  J R Stat Soc Series B Stat Methodol       Date:  2011-06       Impact factor: 4.488

3.  One-step Sparse Estimates in Nonconcave Penalized Likelihood Models.

Authors:  Hui Zou; Runze Li
Journal:  Ann Stat       Date:  2008-08-01       Impact factor: 4.028

4.  Quantile Regression for Analyzing Heterogeneity in Ultra-high Dimension.

Authors:  Lan Wang; Yichao Wu; Runze Li
Journal:  J Am Stat Assoc       Date:  2012-06-11       Impact factor: 5.033

  4 in total
  14 in total

1.  LARGE COVARIANCE ESTIMATION THROUGH ELLIPTICAL FACTOR MODELS.

Authors:  Jianqing Fan; Han Liu; Weichen Wang
Journal:  Ann Stat       Date:  2018-06-27       Impact factor: 4.028

2.  Analysis of cancer gene expression data with an assisted robust marker identification approach.

Authors:  Hao Chai; Xingjie Shi; Qingzhao Zhang; Qing Zhao; Yuan Huang; Shuangge Ma
Journal:  Genet Epidemiol       Date:  2017-09-14       Impact factor: 2.135

3.  Robust semiparametric gene-environment interaction analysis using sparse boosting.

Authors:  Mengyun Wu; Shuangge Ma
Journal:  Stat Med       Date:  2019-07-29       Impact factor: 2.373

4.  Estimation of high dimensional mean regression in the absence of symmetry and light tail assumptions.

Authors:  Jianqing Fan; Quefeng Li; Yuyan Wang
Journal:  J R Stat Soc Series B Stat Methodol       Date:  2016-04-14       Impact factor: 4.488

5.  SOFAR: Large-Scale Association Network Learning.

Authors:  Yoshimasa Uematsu; Yingying Fan; Kun Chen; Jinchi Lv; Wei Lin
Journal:  IEEE Trans Inf Theory       Date:  2019-04-11       Impact factor: 2.501

6.  False discovery rate control for high dimensional networks of quantile associations conditioning on covariates.

Authors:  Jichun Xie; Ruosha Li
Journal:  J R Stat Soc Series B Stat Methodol       Date:  2018-07-19       Impact factor: 4.488

7.  Regularized Quantile Regression and Robust Feature Screening for Single Index Models.

Authors:  Wei Zhong; Liping Zhu; Runze Li; Hengjian Cui
Journal:  Stat Sin       Date:  2016-01       Impact factor: 1.261

8.  HIGH DIMENSIONAL CENSORED QUANTILE REGRESSION.

Authors:  Qi Zheng; Limin Peng; Xuming He
Journal:  Ann Stat       Date:  2018-02-22       Impact factor: 4.028

9.  GLOBALLY ADAPTIVE QUANTILE REGRESSION WITH ULTRA-HIGH DIMENSIONAL DATA.

Authors:  Qi Zheng; Limin Peng; Xuming He
Journal:  Ann Stat       Date:  2015-10-01       Impact factor: 4.028

Review 10.  A selective review of robust variable selection with applications in bioinformatics.

Authors:  Cen Wu; Shuangge Ma
Journal:  Brief Bioinform       Date:  2014-12-05       Impact factor: 13.994

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.