Model Selection for High-Dimensional Quadratic Regression via Regularization

References

• Bien, J., Taylor, J., and Tibshirani, R. (2013), “A Lasso for Hierarchical Interactions,” The Annals of Statistics, 41, 1111–1141.
   PubMed Web of Science ®Google Scholar
• Chen, J., and Chen, Z. (2008), “Extended Bayesian Information Criteria for Model Selection with Large Model Spaces,” Biometrika, 95, 759–771.
   Web of Science ®Google Scholar
• Cheng, M.-Y., Honda, T., Li, J., and Peng, H. (2014), “Nonparametric Independence Screening and Structure Identification for Ultra-High Dimensional Longitudinal Data,” The Annals of Statistics, 42, 1819–1849.
   Web of Science ®Google Scholar
• Chipman, H., Hamada, M., and Wu, C. F. J. (1997), “A Bayesian Variable-Selection Approach for Analyzing Designed Experiments with Complex Aliasing,” Technometrics, 39, 372–381.
   Web of Science ®Google Scholar
• Choi, N. H., Li, W., and Zhu, J. (2010), “Variable Selection with the Strong Heredity Constraint and its Oracle Property,” Journal of the American Statistical Association, 105, 354–364.
   Web of Science ®Google Scholar
• Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression,” The Annals of Statistics, 32, 407–451.
   Web of Science ®Google Scholar
• Fan, J., Feng, Y., and Song, R. (2011), “Nonparametric Independence Screening in Sparse Ultra-High Dimensional Additive Models,” Journal of the American Statistical Association, 106, 544–557.
   PubMed Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.
   Web of Science ®Google Scholar
• Fan, J., and Lv, J. (2008), “Sure Independence Screening for Ultrahigh Dimensional Feature Space,” Journal of the Royal Statistical Society, Series B, 70, 849–911.
   Google Scholar
• ——— (2011), “Nonconcave Penalized Likelihood with np-Dimensionality,” IEEE Transactions on Information Theory, 57, 5467–5484.
   PubMed Web of Science ®Google Scholar
• Fan, Y., Kong, Y., Li, D., and Lv, J. (2016), “Interaction Pursuit with Feature Screening and Selection,” arXiv:1605.08933.
   Google Scholar
• Fan, Y., Kong, Y., Li, D., and Zheng, Z. (2015), “Innovated Interaction Screening for High-Dimensional Nonlinear Classification,” The Annals of Statistics, 43, 1243–1272.
   Web of Science ®Google Scholar
• Fan, Y., and Lv, J. (2013), “Asymptotic Equivalence of Regularization methods in Thresholded Parameter Space,” Journal of the American Statistical Association, 108, 1044–1061.
   Web of Science ®Google Scholar
• Fan, Y., and Tang, C. Y. (2013), “Tuning Parameter Selection in High Dimensional Penalized Likelihood,” Journal of the Royal Statistical Society, Series B, 75, 531–552.
   Google Scholar
• Friedman, J., Hastie, T., Höfling, H., and Tibshirani, R. (2007), “Pathwise Coordinate Optimization,” Annals of Applied Statistics, 1, 302–332.
   Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2010), “Regularization Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
   PubMed Web of Science ®Google Scholar
• Hamada, M., and Wu, C. F. J. (1992), “Analysis of Designed Experiments with Complex Aliasing,” Journal of Quality Technology, 24, 130–137.
   Web of Science ®Google Scholar
• Hao, N., and Zhang, H. H. (2014), “Interaction Screening for Ultra-High Dimensional Data,” Journal of the American Statistical Association, 109, 1285–1301.
   PubMed Web of Science ®Google Scholar
• ——— (2017), “A Note on High Dimensional Linear Regression with Interactions,” The American Statistician, to appear.
   Web of Science ®Google Scholar
• Jiang, B., and Liu, J. S. (2014), “Variable Selection for General Index Models via Sliced Inverse Regression,” The Annals of Statistics, 42, 1751–1786.
   Web of Science ®Google Scholar
• Kong, Y., Li, D., Fan, Y., and Lv, J. (2016), “Interaction Pursuit in High-Dimensional Multi-Response Regression via Distance Correlation,” The Annals of Statistics, 45, 897–922.
   Web of Science ®Google Scholar
• McCullagh, P., and Nelder, J. (1989), Generalized Linear Models (Monographs on Statistics and Applied Probability), Boca Raton, FL: Chapman and Hall.
   Google Scholar
• Nelder, J. A. (1977), “A Reformulation of Linear Models,” Journal of the Royal Statistical Society, Series A, 140, 48–77.
   Google Scholar
• Park, M. Y., and Hastie, T. (2007), “L1-Regularization Path Algorithm for Generalized Linear Models,” Journal of the Royal Statistical Society, Series B, 69, 659–677.
   Google Scholar
• Peixoto, J. L. (1987), “Hierarchical Variable Selection in Polynomial Regression Models,” The American Statistician, 41, 311–313.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• Wainwright, M. J. (2009), “Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using-Constrained Quadratic Programming (lasso),” IEEE Transactions on Information Theory, 55, 2183–2202.
   Web of Science ®Google Scholar
• Wang, H. (2009), “Forward Regression for Ultra-High Dimensional Variable Screening,” Journal of the American Statistical Association, 104, 1512–1524.
   Web of Science ®Google Scholar
• Wu, T. T., Chen, Y. F., Hastie, T., Sobel, E., and Lange, K. (2009), “Genome-Wide Association Analysis by Lasso Penalized Logistic Regression,” Bioinformatics, 25, 714–721.
   PubMed Web of Science ®Google Scholar
• Wu, T. T., and Lange, K. (2008), “Coordinate Descent Algorithms for Lasso Penalized Regression,” Annals of Applied Statistics, 2, 224–244.
   Web of Science ®Google Scholar
• Wu, Y. (2011), “An Ordinary Differential Equation-Based Solution Path Algorithm,” Journal of Nonparametric Statistics, 23, 185–199.
   PubMed Web of Science ®Google Scholar
• Yu, Y., and Feng, Y. (2014), “Apple: Approximate Path for Penalized Likelihood Estimators,” Statistics and Computing, 24, 803–819.
   Web of Science ®Google Scholar
• Yuan, M., Joseph, V. R., and Zou, H. (2009), “Structured Variable Selection and Estimation,” Annals of Applied Statistics, 3, 1738–1757.
   Web of Science ®Google Scholar
• Zhang, C.-H. (2010), “Nearly Unbiased Variable Selection under Minimax Concave Penalty,” Annals of Statistics, 38, 894–942.
   Web of Science ®Google Scholar
• Zhao, P., Rocha, G., and Yu, B. (2009), “The Composite Absolute Penalties Family for Grouped and Hierarchical Variable Selection,” Annals of Statistics, 37, 3468–3497.
   Web of Science ®Google Scholar
• Zhao, P., and Yu, B. (2006), “On Model Selection Consistency of Lasso,” Journal of Machine Learning Research, 7, 2541–2563.
   Web of Science ®Google Scholar
• Zhou, H., and Wu, Y. (2014), “A Generic Path Algorithm for Regularized Statistical Estimation,” Journal of the American Statistical Association, 109, 686–699.
   PubMed Web of Science ®Google Scholar
• Zou, H., and Hastie, T. (2005), “Regularization and Variable Selection via the Elastic Net,” Journal of the Royal Statistical Society, Series B, 67, 301–320.
   Google Scholar