A multi-step kernel–based regression estimator that adapts to error distributions of unknown form

References

• Andrabi, T., J. Das, and A. I. Khwaja. 2017. Report cards: The impact of providing school and child test scores on educational markets. American Economic Review 107 (6):1535–63. doi:https://doi.org/10.1257/aer.20140774.
   Web of Science ®Google Scholar
• Bassett, G. W., and R. W. Koenker. 1982. An empirical quantile function for linear models with iid errors. Journal of the American Statistical Association 77:407–15. doi:https://doi.org/10.2307/2287261.
   Web of Science ®Google Scholar
• Bickel, P. J. 1982. On adaptive estimation. The Annals of Statistics 10 (3):647–71. doi:https://doi.org/10.1214/aos/1176345863.
   Web of Science ®Google Scholar
• Bloomfield, P. 1974. On the distribution of the residuals from a fitted linear model. Technical report, Department of Statistics, Princeton University, Princeton, NJ, Series 2; 56.
   Google Scholar
• Chai, G., Z. Li, and H. Tian. 1991. Consistent nonparametric estimation of error distributions in linear model. Acta Mathematicae Applicatae Sinica 7 (3):245–56. doi:https://doi.org/10.1007/BF02005973.
   Google Scholar
• Chen, Y., Q. Wang, and W. Yao. 2015. Adaptive estimation for varying coefficient models. Journal of Multivariate Analysis 137:17–31. doi:https://doi.org/10.1016/j.jmva.2015.01.017.
   Web of Science ®Google Scholar
• Crowder, M. 1984. On constrained maximum likelihood estimation with non-i.i.d. observations. Annals of the Institute of Statistical Mathematics 36 (2):239–49. doi:https://doi.org/10.1007/BF02481968.
   Web of Science ®Google Scholar
• De Gooijer, J. G. 2017. Elements of nonlinear time series analysis and forecasting. New York: Springer-Verlag.
   Google Scholar
• Friedman, J. H. 1991. Multivariate adaptive regression splines. The Annals of Statistics 19 (1):1–141. with discussion).
   Web of Science ®Google Scholar
• Hshieh, D. A., and C. F. Manski. 1987. Monte Carlo evidence on adaptive maximum likelihood estimation of a regression. The Annals of Statistics 15:541–51. doi:https://doi.org/10.1214/aos/1176350359.
   Web of Science ®Google Scholar
• Kitamura, Y. 1997. Empirical likelihood methods with weakly dependent processes. The Annals of Statistics 25 (5):2084–102. doi:https://doi.org/10.1214/aos/1069362388.
   Web of Science ®Google Scholar
• Kitamura, Y. 2007. Empirical likelihood methods in econometrics: Theory and practice. In Advances in economics and econometrics: Theory and applications, Ninth World Congress, Econometric Society Monographs, ed. R. Blundell, W. Newey, and T. Persson, pp. 174–237. Cambridge: Cambridge University Press. doi:https://doi.org/10.1017/CBO9780511607547.008.
   Google Scholar
• Kooperberg, C., S. Bose, and C. J. Stone. 1997. Polychotomous regression. Journal of the American Statistical Association 92 (437):117–27. doi:https://doi.org/10.1080/01621459.1997.10473608.
   Web of Science ®Google Scholar
• Linton, O., and Z. Xiao. 2007. A nonparametric regression estimator that adapts to error distribution of unknown form. Econometric Theory 23 (3):371–413. doi:https://doi.org/10.1017/S026646660707017X.
   Web of Science ®Google Scholar
• Manski, C. F. 1984. Adaptive estimation of non-linear regression models. Econometric Reviews 3 (2):145–94. doi:https://doi.org/10.1080/07474938408800060.
   Google Scholar
• Moore, T. J., B. M. Sadler, and R. J. Kozick. 2008. Maximum-likelihood estimation, the Cramér-Rao bound, and the method of scoring with parameter constraints. IEEE Transactions on Signal Processing 56 (3):895–908. doi:https://doi.org/10.1109/TSP.2007.907814.
   Web of Science ®Google Scholar
• Newey, W. K. 1988. Adaptive estimation of regression models via moment restrictions. Journal of Econometrics 38 (3):301–39. doi:https://doi.org/10.1016/0304-4076(88)90048-6.
   Web of Science ®Google Scholar
• Newey, W. K., and D. McFadden. 1994. Large sample estimation and hypothesis testing. In Handbook of econometrics, ed. K. J. Arrow and D. Intriligator, Vol. 4, 2111–245. New York: Elsevier.
   Google Scholar
• Osborne, M. R. 2000. Scoring with constraints. The Anziam Journal 42 (1):9–25. doi:https://doi.org/10.1017/S1446181100011561.
   Google Scholar
• Owen, A. B. 1988. Empirical likelihood ratio confidence intervals for a single functional. Biometrika 75 (2):237–49. doi:https://doi.org/10.1093/biomet/75.2.237.
   Web of Science ®Google Scholar
• Owen, A. B. 1990. Empirical likelihood confidence regions. The Annals of Statistics 18 (1):90–120. doi:https://doi.org/10.1214/aos/1176347494.
   Web of Science ®Google Scholar
• Owen, A. B. 1991. Empirical likelihood for linear models. The Annals of Statistics 19 (4):1725–47. doi:https://doi.org/10.1214/aos/1176348368.
   Web of Science ®Google Scholar
• Owen, A. B. 2001. Empirical likelihood. Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Qin, J., and J. Lawless. 1994. Empirical likelihood and general estimating equations. The Annals of Statistics 22 (1):300–25. doi:https://doi.org/10.1214/aos/1176325370.
   Web of Science ®Google Scholar
• Reichardt, H. 2017. Adaptive estimation in linear regression using repeated kernel error density estimation. MSc. thesis. Econometrics, Erasmus University Rotterdam. https://thesis.eur.nl/pub/38903/.
   Google Scholar
• Ren, C., J. Le Kernec, J. Galy, E. Chaumette, P. Larzabal, and A. Renaux. 2015. A constrained hybrid Cramér-Rao bound for parameter estimation. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brisbane, Australia, 3472–6.
   Google Scholar
• Robinson, P. M. 1988. Root-n-consistent semiparametric regression. Econometrica 56 (4):931–54. doi:https://doi.org/10.2307/1912705.
   Web of Science ®Google Scholar
• Schick, A. 1993. On efficient estimation in regression models. The Annals of Statistics 21 (3):1486–521. doi:https://doi.org/10.1214/aos/1176349269.
   Web of Science ®Google Scholar
• Stoica, P., and B. C. Ng. 1998. On the Cramér-Rao bound under parametric constraints. IEEE Signal Processing Letters 5:177–9. doi:https://doi.org/10.1109/97.700921.
   Web of Science ®Google Scholar
• Stone, C. J. 1975. Adaptive maximum likelihood estimators of a location parameter. The Annals of Statistics 3 (2):267–84. doi:https://doi.org/10.1214/aos/1176343056.
   Web of Science ®Google Scholar
• Wade, W. 1974. The bounded convergence theorem. The American Mathematical Monthly 81 (4):387–9. doi:https://doi.org/10.2307/2319009.
   Web of Science ®Google Scholar
• Wang, Q., and W. Yao. 2012. An adaptive estimation of MAVE. Journal of Multivariate Analysis 104 (1):88–100. doi:https://doi.org/10.1016/j.jmva.2011.07.001.
   Web of Science ®Google Scholar
• White, H., and G. M. MacDonald. 1980. Some large-sample tests for nonnormality in the linear regression model. Journal of the American Statistical Association 75 (369):16–28. doi:https://doi.org/10.1080/01621459.1980.10477415.
   Web of Science ®Google Scholar
• Yao, W., and Z. Zhao. 2013. Kernel density-based linear regression estimate. Communications in Statistics - Theory and Methods 42 (24):4499–512. doi:https://doi.org/10.1080/03610926.2011.650269.
   Web of Science ®Google Scholar
• Yuan, A., and J. G. De Gooijer. 2007. Semiparametric regression with kernel error model. Scandinavian Journal of Statistics 34:841–69. doi:https://doi.org/10.1111/j.1467-9469.2006.00531.x.
   Web of Science ®Google Scholar
• Zhang, W. Y. 1990. On the congruent kernel estimate of error distributions in linear model (in Chinese). Journal of Sichuan University (Natural Science Edition) 27:132–44.
   Google Scholar