Parsimonious Model Averaging With a Diverging Number of Parameters

References

• Ando, T., and Li, K.-C. (2014), “A Model-Averaging Approach for High-Dimensional Regression,” Journal of the American Statistical Association, 109, 254–265. DOI: 10.1080/01621459.2013.838168.
   Web of Science ®Google Scholar
• Ando, T., and Li, K.-C. (2017), “A Weight-Relaxed Model Averaging Approach for High-Dimensional Generalized Linear Models,” The Annals of Statistics, 45, 2654–2679. DOI: 10.1214/17-AOS1538.
   Web of Science ®Google Scholar
• Andrews, D. (1991), “Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation,” Econometrica, 59, 817–858. DOI: 10.2307/2938229.
   Web of Science ®Google Scholar
• Buckland, S., Burnham, K., and Augustin, N. (1997), “Model Selection: An Integral Part of Inference,” Biometrics, 53, 603–618. DOI: 10.2307/2533961.
   Web of Science ®Google Scholar
• Claeskens, G., Croux, C., and van Kerckhoven, J. (2006), “Variable Selection for Logistic Regression Using a Prediction-Focused Information Criterion,” Biometrics, 62, 972–979. DOI: 10.1111/j.1541-0420.2006.00567.x.
   PubMed Web of Science ®Google Scholar
• Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression,” The Annals of Statistics, 32, 407–499. DOI: 10.1214/009053604000000067.
   Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360. DOI: 10.1198/016214501753382273.
   Web of Science ®Google Scholar
• Hansen, B. E. (2007), “Least Squares Model Averaging,” Econometrica, 75, 1175–1189. DOI: 10.1111/j.1468-0262.2007.00785.x.
   Web of Science ®Google Scholar
• Hansen, B. E. (2014), “Model Averaging, Asymptotic Risk, and Regressor Groups,” Quantitative Economics, 5, 495–530.
   Web of Science ®Google Scholar
• Hansen, B. E., and Racine, J. (2012), “Jacknife Model Averaging,” Journal of Econometrics, 167, 38–46. DOI: 10.1016/j.jeconom.2011.06.019.
   Web of Science ®Google Scholar
• Hjort, N., and Claeskens, G. (2003), “Frequentist Model Average Estimators,” Journal of the American Statistical Association, 98, 879–899. DOI: 10.1198/016214503000000828.
   Web of Science ®Google Scholar
• Hoeting, J. A., Madigan, D., Raftery, A. E., and Volinsky, C. T. (1999), “Bayesian Model Averaging: A Tutorial,” Statistical Science, 14, 382–417.
   Web of Science ®Google Scholar
• Huang, J., Ma, S. G., and Zhang, C. (2008), “Adaptive Lasso for Sparse High-Dimensional Regression Models,” Statistica Sinica, 18, 1603–1618.
   Web of Science ®Google Scholar
• Ishwaran, H., and Rao, J. S. (2003), “Detecting Differentially Expressed Genes in Microarrays Using Bayesian Model Selection,” Journal of the American Statistical Association, 98, 438–455. DOI: 10.1198/016214503000224.
   Web of Science ®Google Scholar
• Kim, Y., Choi, H., and Oh, H.-S. (2008), “Smoothly Clipped Absolute Deviation on High Dimensions,” Journal of the American Statistical Association, 103, 1665–1673. DOI: 10.1198/016214508000001066.
   Web of Science ®Google Scholar
• Leung, G., and Barron, A. R. (2006), “Information Theory and Mixing Least-Squares Regressions,” IEEE Transactions on Information Theory, 52, 3396–3410. DOI: 10.1109/TIT.2006.878172.
   Web of Science ®Google Scholar
• Li, K.-C. (1987), “Asymptotic Optimality for Cp, Cl, Cross-Validation and Generalized Cross-Validation: Discrete Index Set,” The Annals of Statistics, 15, 958–975. DOI: 10.1214/aos/1176350486.
   Web of Science ®Google Scholar
• Liang, H., Zou, G. H., Wan, A. T. K., and Zhang, X. Y. (2011), “Optimal Weight Choice for Frequentist Model Average Estimators,” Journal of the American Statistical Association, 106, 1053–1066. DOI: 10.1198/jasa.2011.tm09478.
   Web of Science ®Google Scholar
• Liu, C.-A. (2015), “Distribution Theory of the Least Squares Averaging Estimator,” Journal of Econometrics, 186, 142–159. DOI: 10.1016/j.jeconom.2014.07.002.
   Web of Science ®Google Scholar
• Liu, Q., and Okui, R. (2013), “Heteroskedasticity-Robust Cp Model Averaging,” Econometrics Journal, 16, 462–473.
   Web of Science ®Google Scholar
• Lu, X., and Su, L. (2015), “Jackknife Model Averaging for Quantile Regressions,” Journal of Econometrics, 188, 40–58. DOI: 10.1016/j.jeconom.2014.11.005.
   Web of Science ®Google Scholar
• Miller, A. J. (2002), Subset Selection in Regression (2nd ed.), London: Chapman and Hall.
   Google Scholar
• Raftery, A. E., and Zheng, Y. (2003), “Discussion: Performance of Bayesian Model Averaging,” Journal of the American Statistical Association, 98, 931–938. DOI: 10.1198/016214503000000891.
   Web of Science ®Google Scholar
• Scheetz, T. E., Kim, K.-Y. A., Swiderski, R. E., Philp, A. R., Braun, T. A., Knudtson, K. L., Dorrance, A. M., DiBona, G. F., Huang, J., Casavant, T. L., Sheffield, V. C., and Stone, E. M. (2006), “Regulation of Gene Expression in the Mammalian Eye and Its Relevance to Eye Disease,” Proceedings of the National Academy of Sciences of the United States of America, 103, 14429–14434. DOI: 10.1073/pnas.0602562103.
   PubMed Web of Science ®Google Scholar
• Shao, J. (1997), “An Asymptotic Theory for Linear Model Selection,” Statistica Sinica, 7, 221–264.
   Web of Science ®Google Scholar
• Wan, A. T. K., Zhang, X., and Zou, G. H. (2010), “Least Squares Model Averaging by Mallows Criterion,” Journal of Econometrics, 156, 277–283. DOI: 10.1016/j.jeconom.2009.10.030.
   Web of Science ®Google Scholar
• Wang, H., and Leng, C. (2007), “Unified Lasso Estimation via Least Squares Approximation,” Journal of the American Statistical Association, 101, 1418–1429.
   Google Scholar
• Wang, H. S., Li, B., and Leng, C. L. (2009), “Shrinkage Tuning Parameter Selection With a Diverging Number of Parameters,” Journal of the Royal Statistical Society, Series B, 71, 671–683. DOI: 10.1111/j.1467-9868.2008.00693.x.
   Google Scholar
• Yang, Y. H. (2005), “Can the Strengths of AIC and BIC Be Shared?—A Conflict Between Model Identification and Regression Estimation,” Biometrika, 92, 937–950. DOI: 10.1093/biomet/92.4.937.
   Web of Science ®Google Scholar
• Yuan, Z., and Yang, Y. (2005), “Combining Linear Regression Models: When and How?” Journal of the American Statistical Association, 100, 1202–1214. DOI: 10.1198/016214505000000088.
   Web of Science ®Google Scholar
• Zhang, C.-H. (2010), “Nearly Unbiased Variable Selection Under Minimax Concave Penalty,” The Annals of Statistics, 38, 894–942. DOI: 10.1214/09-AOS729.
   Web of Science ®Google Scholar
• Zhang, X., and Liang, H. (2011), “Focused Information Criterion and Model Averaging for Generalized Additive Partial Linear Models,” The Annals of Statistics, 39, 174–200. DOI: 10.1214/10-AOS832.
   Web of Science ®Google Scholar
• Zhang, X., Wan, A., and Zhou, Z. (2012), “Focused Information Criteria, Model Selection and Model Averaging in a Tobit Model With a Non-Zero Threshold,” Journal of Business and Economic Statistics, 30, 132–142. DOI: 10.1198/jbes.2011.10075.
   Web of Science ®Google Scholar
• Zhang, X., Zou, G., and Liang, H. (2014), “Model Averaging and Weight Choice in Linear Mixed-Effects Models,” Biometrika, 101, 205–218. DOI: 10.1093/biomet/ast052.
   Web of Science ®Google Scholar
• Zou, H. (2006), “The Adaptive Lasso and Its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429. DOI: 10.1198/016214506000000735.
   Web of Science ®Google Scholar
• Zou, H., and Zhang, H. H. (2009), “On the Adaptive Elastic-Net With a Diverging Number of Parameters,” The Annals of Statistics, 37, 1733–1751. DOI: 10.1214/08-AOS625.
   PubMed Web of Science ®Google Scholar