Modified Cross-Validation for Penalized High-Dimensional Linear Regression Models

REFERENCES

• Chen, J., and Chen, Z. (2008), “Extended Bayesian Information Criteria for Model Selection With Large Model Spaces,” Biometrika, 95, 759–771.
   Web of Science ®Google Scholar
• Chen, S., and Donoho, D. (1994), “Basis Pursuit,” Signals, Systems and Computers, 1994. 1994 Conference Record of the Twenty-Eighth Asilomar Conference on, . 1, pp. 41–44.
   Google Scholar
• Chiang, A.P., Beck, J.S., Yen, H.J., Tayeh, M.K., Scheetz, T.E., Swiderski, R.E., Nishimura, D.Y., Braun, T.A., Kim, K. Y.A., Huang, J., Elbedour, K., Carmi, R., Slusarski, D.C., Casavant, T.L., Stone, E.M., and Sheffield, V.C. (2006), “Homozygosity Mapping With SNP Arrays Identifies TRIM32, an E3 Ubiquitin Ligase, as a Bardet–Biedl Syndrome Gene (BBS11),” Proceedings of the National Academy of Sciences, 103, 6287–6292.
   PubMed Web of Science ®Google Scholar
• Efron, B. (1983), “Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation, and the Repeated Learning-Testing Methods,” Biometrika, 78, 316–331.
   Google Scholar
• ——— (1986), “How Biased is the Apparent Error Rate of a Prediction Rule?” Journal of the American Statistical Association, 81, 461–470.
   Web of Science ®Google Scholar
• Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression” (with discussion), The Annals of Statistics, 32, 407–499.
   Web of Science ®Google Scholar
• Fan, J., Feng, Y., and Song, R. (2011), “Nonparametric Independence Screening Nonparametric Independence Screening in Sparse Ultra-High Dimensional Additive Models,” Journal of the American Statistical Association, 106, 544–557.
   PubMed Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection Via Nonconcave Penalized Likelihood and its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.
   Web of Science ®Google Scholar
• Feng, Y., and Yu, Y. (2013), “Consistent Cross-Validation for Tuning Parameter Selection in High-Dimensional Variable Selection,” Arxiv Preprint 1308.5390v1.
   Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2007), “Pathwise Coordinate Optimization,” The Annals of Statistics, 1, 302–332.
   Web of Science ®Google Scholar
• ——— (2010), “Regularization Paths for Generalized Linear Models Via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
   PubMedGoogle Scholar
• Fu, W. (1998), “Penalized Regressions: The Bridge Versus the Lasso,” Journal of Computational and Graphical Statistics, 7, 397–416.
   Web of Science ®Google Scholar
• Huang, J., Horowitz, J.L., and Wei, F. (2010), “Variable Selection in Nonparametric Additive Models,” The Annals of Statistics, 38, 2282–2313.
   PubMed Web of Science ®Google Scholar
• Irizarry, R.A., Hobbs, B., Collin, F., Beazer-Barclay, Y.D., Antonellis, K.J., Scherf, U., and Speed, T.P. (2003), “Exploration, Normalization, and Summaries of High Density Oligonucleotide Array Probe Level Data,” Biostatistics, 4, 249–264.
   PubMed Web of Science ®Google Scholar
• Luo, X., Stefanski, L.A., and Boos, D.D. (2006), “Tuning Variable Selection Procedures by Adding Noise,” Technometrics, 48, 165–175.
   Web of Science ®Google Scholar
• Meinshausen, N. (2007), “Relaxed Lasso,” Computational Statistics and Data Analysis, 52, 374–393.
   Web of Science ®Google Scholar
• Meinshausen, N., and Bühlmann, P. (2010), “Stability Selection,” Journal of the Royal Statistical Society, Series B, 72, 417–473.
   Google Scholar
• Nishii, R. (1984), “Asymptotic Properties of Criteria for Selection of Variables Asymptotic Properties of Criteria for Selection of Variables in Multiple Regression,” The Annals of Statistics, 12, 758–765.
   Web of Science ®Google Scholar
• Osborne, M., Presnell, B., and Turlach, B. (2000), “A New Approach to Variable Selection in Least Squares Problems,” IMA Journal of Numerical Analysis, 20, 389–404.
   Web of Science ®Google Scholar
• Park, M.Y., and Hastie, T. (2007), “An l1 Regularization-Path Algorithm for Generalized Linear Models,” Journal of the Royal Statistical Society, Series B, 69, 659–677.
   Google Scholar
• Picard, R.R., and Cook, R.D. (1984), “Cross-Validation of Regression Models,” Journal of the American Statistical Association, 79, 575–583.
   Web of Science ®Google Scholar
• Scheetz, T. E., Kim, K. Y. A., Swiderski, R. E., Philp, A. R., Braun, T. A., Knudtson, K. L., Dorrance, A. M., DiBona, G. F., Huang, J., Casavant, T. L., Sheffield, V. C., and Stone, E. M. (2006), “Regulation of Gene Expression in the Mammalian Eye and its Relevance to Eye Disease,” Proceedings of the National Academy of Sciences, 103, 14,429–14,434.
   Web of Science ®Google Scholar
• Shao, J. (1993), “Linear Model Selection by Cross-Validation,” Journal of the American Statistical Association, 88, 486–494.
   Web of Science ®Google Scholar
• Stone, M. (1977), “An Asymptotic Equivalence of Choice of Model by Cross-Validation and Akaike’s Criterion,” Journal of the Royal Statistical Society, Series B, 39, 44–47.
   Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection Via the Lasso,” Journal of the Royal Statistical Society, Series B, 9, 1135–1151.
   Google Scholar
• Wang, H., Li, B., and Leng, C. (2009), “Shrinkage Tuning Parameter Selection With a Diverging Number of Parameters,” Journal of the Royal Statistical Society, Series B, 71, 671–683.
   Google Scholar
• Wu, Y., Boos, D.D., and Stefanski, L.A. (2007), “Controlling Variable Selection by the Addition of Pseudo Variables,” Journal of the American Statistical Association, 102, 235–243.
   Web of Science ®Google Scholar
• Zhang, C.H. (2010), “Nearly Unbiased Variable Selection Under Minimax Concave Penalty,” The Annals of Statistics, 38, 894–942.
   Web of Science ®Google Scholar
• Zhang, C.H., and Huang, J. (2008), “The Sparsity and Bias of the Lasso Selection in High-Dimensional Regression,” The Annals of Statistics, 36, 1567–1594.
   Web of Science ®Google Scholar
• Zhang, P. (1993), “Model Selection Via Multifold Cross Validation,” The Annals of Statistics, 21, 299–313.
   Web of Science ®Google Scholar
• Zhang, Y., Li, R., and Tsai, C.L. (2010), “Regularization Parameter Selections Via Generalized Information Criterion,” Journal of American Statistical Association, 105, 312–323.
   PubMed Web of Science ®Google Scholar
• Zou, H. (2006), “The Adaptive Lasso and its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429.
   Web of Science ®Google Scholar
• Zou, H., and Hastie, T. (2005), “Regularization and Variable Selection Via the Elastic Net,” Journal of the Royal Statistical Society, Series B, 67, 301–320.
   Google Scholar
• Zou, H., Hastie, T., and Tibshirani, R. (2007), “On the ”Degrees of Freedom” of the Lasso,” The Annals of Statistics, 35, 2173–2192.
   Web of Science ®Google Scholar
• Zou, H., and Li, R. (2008), “One-Step Sparse Estimates in Nonconcave Penalized Likelihood Models,” The Annals of Statistics, 38, 1509–1533.
   Web of Science ®Google Scholar