Model averaging for generalized linear models in diverging model spaces with effective model size

References

• Akaike, H. (1970). Statistical predictor identification. Annals of the Institute of Statistical Mathematics 22(1):203–217. doi:10.1007/BF02506337
   Web of Science ®Google Scholar
• Ando, T., Li, K.-C. (2014). A model-averaging approach for high-dimensional regression. Journal of the American Statistical Association 109(505):254–265. doi:10.1080/01621459.2013.838168
   Web of Science ®Google Scholar
• Ando, T., Li, K. (2017). A weight-relaxed model averaging approach for high-dimensional generalized linear models. The Annals of Statistics 45:2654–2679.
   Web of Science ®Google Scholar
• Buckland, S. T., Burnham, K. P., Augustin, N. H. (1997). Model selection: An integral part of inference. Biometrics 53(2):603. doi:10.2307/2533961
   Web of Science ®Google Scholar
• Charkhi, A., Claeskens, G., Hansen, B. E. (2016). Minimum mean squared error model averaging in likelihood models. Statistica Sinica 26:809–840.
   Web of Science ®Google Scholar
• Chen, J., Li, D., Linton, O., Lu, Z. (2018). Semiparametric ultra-high dimensional model averaging of nonlinear dynamic time series. Journal of the American Statistical Association 113(522):919–932. doi:10.1080/01621459.2017.1302339
   Web of Science ®Google Scholar
• Chen, X., Li, H., Zhang, J. (2023). Complete subset averaging approach for high-dimensional generalized linear models. Economics Letters 226:111084. doi:10.1016/j.econlet.2023.111084
   Web of Science ®Google Scholar
• Claeskens, G., Hjort, N. L. (2008). Model Selection and Model Averaging, Cambridge: Cambridge University Press.
   Google Scholar
• De Luca, G., Magnus, J. R., Peracchi, F. (2018). Weighted-average least squares estimation of generalized linear models. Journal of Econometrics 204(1):1–17. doi:10.1016/j.jeconom.2017.12.007
   Web of Science ®Google Scholar
• Ding, X., Xie, J., Yan, X. (2021). Model averaging for multiple quantile regression with covariates missing at random. Journal of Statistical Computation and Simulation 91(11):2249–2275. doi:10.1080/00949655.2021.1890733
   Web of Science ®Google Scholar
• Dixon, M. F., Ward, T. (2018). Takeuchi’s information criteria as a form of regularization. http://dx.doi.org/10.2139/ssrn.3139945.
   Google Scholar
• Fan, J., Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96(456):1348–1360. doi:10.1198/016214501753382273
   Web of Science ®Google Scholar
• Fan, J., Lv, J. (2008). Sure independence screening for ultrahigh dimensional feature space. Journal of the Royal Statistical Society Series B: Statistical Methodology 70(5):849–911. doi:10.1111/j.1467-9868.2008.00674.x
   PubMed Web of Science ®Google Scholar
• Fan, J., Peng, H. (2004). Nonconcave penalized likelihood with a diverging number of parameters. The Annals of Statistics 32:928–961.
   Web of Science ®Google Scholar
• Fang, F., Lan, W., Tong, J., Shao, J. (2019). Model averaging for prediction with fragmentary data. Journal of Business & Economic Statistics 37(3):517–527. doi:10.1080/07350015.2017.1383263
   Web of Science ®Google Scholar
• Fang, F., Li, J., Wang, J. (2019). Optimal model averaging estimation for correlation structure in generalized estimating equations. Communications in Statistics - Simulation and Computation 48(5):1574–1593. doi:10.1080/03610918.2017.1419260
   Web of Science ®Google Scholar
• Fang, F., Yuan, C., Tian, W. (2023). An asymptotic theory for least squares model averaging with nested models. Econometric Theory 39(2):412–441. doi:10.1017/S0266466622000032
   Web of Science ®Google Scholar
• Feng, Y., Liu, Q., Yao, Q., Zhao, G. (2022). Model averaging for nonlinear regression models. Journal of Business & Economic Statistics 40(2):785–798. doi:10.1080/07350015.2020.1870477
   Web of Science ®Google Scholar
• Flynn, C. J., Hurvich, C. M., Simonoff, J. S. (2013). Efficiency for regularization parameter selection in penalized likelihood estimation of misspecified models. Journal of the American Statistical Association 108(503):1031–1043. doi:10.1080/01621459.2013.801775
   Web of Science ®Google Scholar
• Hansen, B. E. (2007). Least squares model averaging. Econometrica 75(4):1175–1189. doi:10.1111/j.1468-0262.2007.00785.x
   Web of Science ®Google Scholar
• Hansen, B. E., Racine, J. S. (2012). Jackknife model averaging. Journal of Econometrics 167(1):38–46. doi:10.1016/j.jeconom.2011.06.019
   Web of Science ®Google Scholar
• Hoeting, J. A., Madigan, D., Raftery, A. E., Volinsky, C. (1999). Bayesian model averaging: A tutorial. Statistical Science 14:382–417.
   Web of Science ®Google Scholar
• Leung, G., Barron, A. R. Information theory and mixing least-squares regressions. IEEE Transactions on Information Theory 52(8):3396–3410. doi:10.1109/TIT.2006.878172
   Web of Science ®Google Scholar
• Li, C., Li, Q., Racine, J., Zhang, D. (2018). Optimal model averaging of varying coefficient models. Statistica Sinica 28:2795–2809.
   Web of Science ®Google Scholar
• Li, D., Linton, O., Lu, Z. (2015). A flexible semiparametric forecasting model for time series. Journal of Econometrics 187(1):345–357. doi:10.1016/j.jeconom.2015.02.025
   Web of Science ®Google Scholar
• Li, J., Xia, X., Wong, W. K., Nott, D. (2018). Varying-coefficient semiparametric model averaging prediction. Biometrics 74(4):1417–1426. doi:10.1111/biom.1290429775198
   PubMed Web of Science ®Google Scholar
• Liao, J., Zong, X., Zhang, X., Zou, G. (2019). Model averaging based on leave-subject-OUT cross-validation for vector autoregressions. Journal of Econometrics 209(1):35–60. doi:10.1016/j.jeconom.2018.10.007
   Web of Science ®Google Scholar
• Liu, Q., Okui, R. (2013). Heteroscedasticity-robust cp model averaging. The Econometrics Journal 16(3):463–472. doi:10.1111/ectj.12009
   Web of Science ®Google Scholar
• Liu, Q., Okui, R., Yoshimura, A. (2016). Generalized least squares model averaging. Econometric Reviews 35(8-10):1692–1752. doi:10.1080/07474938.2015.1092817
   Web of Science ®Google Scholar
• Lu, X., Su, L. (2015). Jackknife model averaging for quantile regressions. Journal of Econometrics 188(1):40–58. doi:10.1016/j.jeconom.2014.11.005
   Web of Science ®Google Scholar
• Lv, J., Liu, J. S. (2014). Model selection principles in misspecified models. Journal of the Royal Statistical Society Series B: Statistical Methodology 76(1):141–167. doi:10.1111/rssb.12023
   Web of Science ®Google Scholar
• Mallows, C. L. (1973). Some comments on cp. Technometrics 15(4):661–675. doi:10.1080/00401706.1973.10489103
   Web of Science ®Google Scholar
• Mccullagh, P., Nelder, J. A. (2019). Generalized Linear Models, Abingdon, UK: Routledge.
   Google Scholar
• Moro, S., Laureano, R., Cortez. P. (2011). Using data mining for bank direct marketing: An application of the crisp-dm methodology, In Proceedings of the European Simulation and Modelling Conference, 117–121.
   Google Scholar
• Qian, W., Rolling, C. A., Cheng, G., Yang, Y. (2022). Combining forecasts for universally optimal performance. International Journal of Forecasting 38(1):193–208. doi:10.1016/j.ijforecast.2021.05.004
   Web of Science ®Google Scholar
• Racine, J. S., Li, Q., Yu, D., Zheng, L. (2022). Optimal model averaging of mixed-data kernel-weighted spline regressions. Journal of Business & Economic Statistics doi:10.1080/07350015.2022.2118126.
   Web of Science ®Google Scholar
• Rigollet, P., Tsybakov, A. B. (2012). Sparse estimation by exponential weighting. Statistial Science 27:558–575.
   Web of Science ®Google Scholar
• Schwarz, G. E. (1978). Estimating the dimension of a model. The Annals of Statistics 6(2):461–464.
   Web of Science ®Google Scholar
• Stone, M. (1977). An asymptotic equivalence of choice of model by cross-validation and akaike’s criterion. Journal of the Royal Statistical Society: Series B (Methodological) 39(1):44–47. doi:10.1111/j.2517-6161.1977.tb01603.x
   Web of Science ®Google Scholar
• Takeuchi, K. (1976). Distribution of information statistics and validity criteria of models. Mathematical Science 153:12–18 (in Japanese).
   Google Scholar
• Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological) 58(1):267–288. doi:10.1111/j.2517-6161.1996.tb02080.x
   Web of Science ®Google Scholar
• Wang, M., Zhang, X., Wan, A. T. K., You, K., Zou, G. (2023). Jackknife model averaging for high-dimensional quantile regression. Biometrics 79(1):178–189. doi:10.1111/biom.1357434608993
   PubMed Web of Science ®Google Scholar
• Wang, S., Jia, Z. (1994). Inequalities in Matrix Theory, Anhui, China: Anhui Education Press.
   Google Scholar
• White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica 50(1):1. doi:10.2307/1912526
   Web of Science ®Google Scholar
• Yang, Y. (2004). Combining forecasting procedures: Some theoretical results. Econometric Theory 20:176–222.
   Web of Science ®Google Scholar
• Yu, D., Lian, H., Sun, Y., Zhang, X., Hong, Y. (2022). Post-averaging inference for optimal model averaging estimator in generalized linear models, Technical Report, Yunnan University of Finance and Economics.
   Google Scholar
• Yuan, C., Fang, F., Ni, L. (2022). Mallows model averaging with effective model size in fragmentary data prediction. Computational Statistics & Data Analysis 173:107497. doi:10.1016/j.csda.2022.107497
   Web of Science ®Google Scholar
• Yuan, C., Wu, Y., Fang, F. (2022). Model averaging for generalized linear models in fragmentary data prediction. Statistical Theory and Related Fields 6(4):344–352. doi:10.1080/24754269.2022.2105486
   Google Scholar
• Zhang, X., Liu, C.-A. (2019). Inference after model averaging in linear regression models. Econometric Theory 35(4):816–841. doi:10.1017/S0266466618000269
   Web of Science ®Google Scholar
• Zhang, X., Liu, C.-A. (2023). Model averaging prediction by K-fold cross-validation. Journal of Econometrics 235(1):280–301. doi:10.1016/j.jeconom.2022.04.007
   Web of Science ®Google Scholar
• Zhang, X., Yu, D., Zou, G., Liang, H. (2016). Optimal model averaging estimation for generalized linear models and generalized linear mixed-effects models. Journal of the American Statistical Association 111(516):1775–1790. doi:10.1080/01621459.2015.1115762
   Web of Science ®Google Scholar
• Zhang, X., Zou, G., Liang, H., Carroll, R. J. (2020). Parsimonious model averaging with a diverging number of parameters. Journal of the American Statistical Association 115(530):972–984. doi:10.1080/01621459.2019.160436334168389
   PubMed Web of Science ®Google Scholar
• Zheng, H., Tsui, K.-W., Kang, X., Deng, X. (2017). Cholesky-based model averaging for covariance matrix estimation. Statistical Theory and Related Fields 1(1):48–58. doi:10.1080/24754269.2017.1336831
   Google Scholar
• Zhu, R., Wan, A. T. K., Zhang, X., Zou, G. (2019). A mallows-type model averaging estimator for the varying-coefficient partially linear model. Journal of the American Statistical Association 114(526):882–892. doi:10.1080/01621459.2018.1456936
   Web of Science ®Google Scholar
• Zou, H., Zhang, H. (2009). On the adaptive elastic-net with a diverging number of parameters. The Annals of Statistics 37:1733–1751.
   PubMed Web of Science ®Google Scholar
• Zou, J., Wang, W., Zhang, X., Zou, G. (2022). Optimal model averaging for divergent-dimensional poisson regressions. Econometric Reviews 41(7):775–805. doi:10.1080/07474938.2022.2047508
   Web of Science ®Google Scholar