Optimal Model Averaging of Mixed-Data Kernel-Weighted Spline Regressions

References

• Akaike, H. (1974), “A New Look at the Statistical Model Identification,” IEEE Transactions in Automatic Control, 19, 716–723. DOI: 10.1109/TAC.1974.1100705.
   Google Scholar
• Ando, T., and Li, K.-C. (2014), “A Model-Averaging Approach for High-Dimensional Regression,” Journal of the American Statistical Association, 109, 254–265. DOI: 10.1080/01621459.2013.838168.
   Web of Science ®Google Scholar
• Andrews, D. W. (1991), “Asymptotic Optimality of Generalized CL, Cross-Validation, and Generalized Cross-Validation in Regression with Heteroskedastic Errors,” Journal of Econometrics, 47, 359–377. DOI: 10.1016/0304-4076(91)90107-O.
   Web of Science ®Google Scholar
• Bates, J. M., and Granger, C. W. (1969), “The Combination of Forecasts,” Journal of the Operational Research Society, 20, 451–468. DOI: 10.1057/jors.1969.103.
   Google Scholar
• Buckland, S. T., Burnhamn, K. P., and Augustin, N. H. (1997), “Model Selection: An Integral Part of Inference,” Biometrics, 53, 603–618. DOI: 10.2307/2533961.
   Web of Science ®Google Scholar
• Burman, P., and Chen, K.-W. (1989), “Nonparametric Estimation of A Regression Function,” The Annals of Statistics, 17, 1567–1596. DOI: 10.1214/aos/1176347382.
   Web of Science ®Google Scholar
• Cheng, X., and Hansen, B. E. (2015), “Forecasting with Factor-Augmented Regression: A Frequentist Model Averaging Approach,” Journal of Econometrics, 186, 280–293. DOI: 10.1016/j.jeconom.2015.02.010.
   Web of Science ®Google Scholar
• Claeskens, G., and Hjort, N. L. (2008), Model Selection and Model Averaging, Cambridge: Cambridge University Press.
   Google Scholar
• Croissant, Y., and Graves, S. (2020), Ecdat: Data Sets for Econometrics, r package version 0.3-9.
   Google Scholar
• Fang, F., Li, J., and Xia, X. (2022), “Semiparametric Model Averaging Prediction for Dichotomous Response,” Journal of Econometrics, 229, 219–245. DOI: 10.1016/j.jeconom.2020.09.008.
   Web of Science ®Google Scholar
• Greene, W. H. (2003), Econometric Analysis (5th ed), Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Hall, P., and Heyde, C. (1980), Martingale Limit Theory and Its Application, New York: Academic Press.
   Google Scholar
• Hansen, B. E. (2007), “Least Squares Model Averaging,” Econometrica, 75, 1175–1189. DOI: 10.1111/j.1468-0262.2007.00785.x.
   Web of Science ®Google Scholar
• Hansen, B. E. (2008), “Least-Squares Forecast Averaging,” Journal of Econometrics, 146, 342–350.
   Web of Science ®Google Scholar
• Hansen, B. E. (2014), “Nonparametric Sieve Regression: Least Squares, Averaging Least Squares, and Cross-Validation,” in The Oxford Handbook of Applied Nonparametric and Semiparametric Econometrics and Statistics, eds. J. Racine, L. Su and A. Ullah, pp. 215–248, Oxford: Oxford University Press.
   Google Scholar
• Hansen, B. E. (2015), “The Integrated Mean Squared Error of Series Regression and A Rosenthal Hilbert-Space Inequality,” Econometric Theory, 31, 337–361.
   Web of Science ®Google Scholar
• Hansen, B. E., and Racine, J. S. (2012), “Jackknife Model Averaging,” Journal of Econometrics, 167, 38–46. DOI: 10.1016/j.jeconom.2011.06.019.
   Web of Science ®Google Scholar
• Hoeting, J. A., Madigan, D., Raftery, A. E., and Volinsky, C. T. (1999), “Bayesian Model Averaging: A Tutorial,” Statistical Science, 14, 382–417.
   Web of Science ®Google Scholar
• Hogben, L. (2006), Handbook of Linear Algebra, Boca Raton, FL: CRC Press.
   Google Scholar
• Jiang, J. (1996), “REML Estimation: Asymptotic Behavior and Related Topics,” The Annals of Statistics, 24, 255–286. DOI: 10.1214/aos/1033066209.
   Web of Science ®Google Scholar
• Kelejian, H., and Prucha, I. R. (2001), “On the Asymptotic Distribution of the Moran I Test Statistic with Applications,” Journal of Econometrics, 104, 219–257. DOI: 10.1016/S0304-4076(01)00064-1.
   Web of Science ®Google Scholar
• Kitagawa, T., and Muris, C. (2016), “Model Averaging in Semiparametric Estimation of Treatment Effects,” Journal of Econometrics, 193, 271–289. DOI: 10.1016/j.jeconom.2016.03.002.
   Web of Science ®Google Scholar
• Kuersteiner, G., and Okui, R. (2010), “Constructing Optimal Instruments by First-Stage Prediction Averaging,” Econometrica, 78, 697–718.
   Web of Science ®Google Scholar
• Leamer, E. E. (1983), “Let’s Take the Con Out of Econometrics,” American Economic Review, 73, 31–43.
   Web of Science ®Google Scholar
• Li, C., Li, Q., Racine, J. S., and Zhang, D. (2018), “Optimal Model Averaging of Varying Coefficient Models,” Statistica Sinica, 28, 2795–2809.
   Web of Science ®Google Scholar
• Li, D., Linton, O., and Lu, Z. (2015), “A Flexible Semiparametric Forecasting Model for Time Series,” Journal of Econometrics, 187, 345–357. DOI: 10.1016/j.jeconom.2015.02.025.
   Web of Science ®Google Scholar
• Li, J., Lv, J., Wan, A. T., and Liao, J. (2020), “AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories,” Journal of the American Statistical Association, 117, 495–509. DOI: 10.1080/01621459.2020.1790375.
   Web of Science ®Google Scholar
• Liang, H., Zou, G., Wan, A. T., and Zhang, X. (2011), “Optimal Weight Choice for Frequentist Model Average Estimators,” Journal of the American Statistical Association, 106, 1053–1066. DOI: 10.1198/jasa.2011.tm09478.
   Web of Science ®Google Scholar
• Liu, C.-A. (2015), “Distribution Theory of the Least Squares Averaging Estimator,” Journal of Econometrics, 186, 142–159. DOI: 10.1016/j.jeconom.2014.07.002.
   Web of Science ®Google Scholar
• Liu, C.-A. (2018), “Averaging Estimators for Kernel Regressions,” Economics Letters, 171, 102–105.
   Web of Science ®Google Scholar
• Liu, C.-A., and Tao, J. (2016), “Model Selection and Model Averaging in Nonparametric Instrumental Variables Models”, MPRA Paper No. 69492. Available at https://mpra.ub.uni-muenchen.de/69492/.
   Google Scholar
• Liu, Q., and Okui, R. (2013), “Heteroscedasticity-Robust Cp Model Averaging,” The Econometrics Journal, 16, 463–472. DOI: 10.1111/ectj.12009.
   Web of Science ®Google Scholar
• Liu, Q., Okui, R., and Yoshimura, A. (2016), “Generalized Least Squares Model Averaging,” Econometric Reviews, 35, 1692–1752. DOI: 10.1080/07474938.2015.1092817.
   Web of Science ®Google Scholar
• Lu, X., and Su, L. (2015), “Jackknife Model Averaging for Quantile Regressions,” Journal of Econometrics, 188, 40–58. DOI: 10.1016/j.jeconom.2014.11.005.
   Web of Science ®Google Scholar
• Ma, S., and Racine, J. S. (2013), “Additive Regression Splines with Irrelevant Categorical and Continuous Regressors,” Statistica Sinica, 23, 515–541.
   Web of Science ®Google Scholar
• Ma, S., Racine, J. S., and Yang, L. (2015), “Spline Regression in the Presence of Categorical Predictors,” Journal of Applied Econometrics, 30, 703–717. DOI: 10.1002/jae.2410.
   Web of Science ®Google Scholar
• Mallows, C. L. (1973), “Some Comments on Cp,” Technometrics, 15, 661–675.
   Web of Science ®Google Scholar
• Newey, W. K. (1997), “Convergence Rates and Asymptotic Normality for Series Estimators,” Journal of Econometrics, 79, 147–168. DOI: 10.1016/S0304-4076(97)00011-0.
   Web of Science ®Google Scholar
• Ouyang, D., Li, Q., and Racine, J. S. (2013), “Categorical Semiparametric Varying Coefficient Models,” Journal of Applied Econometrics, 28, 551–579. DOI: 10.1002/jae.1261.
   Web of Science ®Google Scholar
• Peng, J., and Yang, Y. (2022), “On Improvability of Model Selection by Model Averaging,” Journal of Econometrics, 229, 246–262. DOI: 10.1016/j.jeconom.2020.12.003.
   Web of Science ®Google Scholar
• Racine, J. S. (2017), ma: Model Averaging, r package version 1.0-8.
   Google Scholar
• Schwarz, G. (1978), “Estimating the Dimension of A Model,” The Annals of Statistics, 6, 461–464. DOI: 10.1214/aos/1176344136.
   Web of Science ®Google Scholar
• Sun, Y., Hong, Y., Lee, T.-H., Wang, S., and Zhang, X. (2022), “Time-Varying Model Averaging,” Journal of Econometrics, 222, 974–992. DOI: 10.1016/j.jeconom.2020.02.006.
   Web of Science ®Google Scholar
• van der Vaart, A. W. (2000), Asymptotic Statistics, Cambridge Series in Statistical and Probabilistic Mathematics, New York: Cambridge Univeristy Press.
   Google Scholar
• Wan, A. T., Zhang, X., and Zou, G. (2010), “Least Squares Model Averaging by Mallows Criterion,” Journal of Econometrics, 156, 277–283. DOI: 10.1016/j.jeconom.2009.10.030.
   Web of Science ®Google Scholar
• Whittle, P. (1960), “Bounds for the Moments of Linear and Quadratic Forms in Independent Variables,” Theory of Probability and Its Applications, 5, 302–305. DOI: 10.1137/1105028.
   Google Scholar
• Xie, T. (2015), “Prediction Model Averaging Estimator,” Economics Letters, 131, 5–8. DOI: 10.1016/j.econlet.2015.03.027.
   Web of Science ®Google Scholar
• Yu, D., Lian, H., Sun, Y., Zhang, X., and Hong, Y. (2021), “Post-Averaging Inference for Optimal Model Averaging Estimator in Generalized Linear Models,” Technical report, Yunnan University of Finance and Economics.
   Google Scholar
• Zhang, X., and Liu, C.-A. (2019), “Inference After Model Averaging in Linear Regression Models,” Econometric Theory, 35, 816–841. DOI: 10.1017/S0266466618000269.
   Web of Science ®Google Scholar
• Zhang, X., and Wang, W. (2019), “Optimal Model Averaging Estimation for Partially Linear Models,” Statistica Sinica, 29, 693–718. DOI: 10.5705/ss.202015.0392.
   Web of Science ®Google Scholar
• Zhang, X., Zou, G., Liang, H., and Carroll, R. J. (2020), “Parsimonious Model Averaging with A Diverging Number of Parameters,” Journal of the American Statistical Association, 115, 972–984. DOI: 10.1080/01621459.2019.1604363.
   PubMed Web of Science ®Google Scholar
• Zhao, S., Zhang, X., and Gao, Y. (2016), “Model Averaging with Averaging Covariance Matrix,” Economics Letters, 145, 214–217. DOI: 10.1016/j.econlet.2016.06.011.
   Web of Science ®Google Scholar
• Zhu, R., Wan, A. T., Zhang, X., and Zou, G. (2019), “A Mallows-Type Model Averaging Estimator for the Varying-Coefficient Partially Linear Model,” Journal of the American Statistical Association, 114, 882–892. DOI: 10.1080/01621459.2018.1456936.
   Web of Science ®Google Scholar