The Temporal Overfitting Problem with Applications in Wind Power Curve Modeling

References

• Altman, N. S. (1990), “Kernel Smoothing of Data with Correlated Errors,” Journal of the American Statistical Association, 85, 749–759. DOI: 10.1080/01621459.1990.10474936.
   Web of Science ®Google Scholar
• Ba, S., and Joseph, V. R. (2012), “Composite Gaussian Process Models for Emulating Expensive Functions,” The Annals of Applied Statistics, 6, 1838–1860. DOI: 10.1214/12-AOAS570.
   Web of Science ®Google Scholar
• Bessa, R. J., Miranda, V., Botterud, A., Wang, J., and Constantinescu, E. M. (2012), “Time Adaptive Conditional Kernel Density Estimation for Wind Power Forecasting,” IEEE Transactions on Sustainable Energy, 3, 660–669. DOI: 10.1109/TSTE.2012.2200302.
   Web of Science ®Google Scholar
• Burman, P., Chow, E., and Nolan, D. (1994), “A Cross-Validatory Method for Dependent Data,” Biometrika, 81, 351–358. DOI: 10.1093/biomet/81.2.351.
   Web of Science ®Google Scholar
• Chipman, H. A., George, E. I., and McCulloch, R. E. (2010), “BART: Bayesian Additive Regression Trees,” The Annals of Applied Statistics, 4, 266–298. DOI: 10.1214/09-AOAS285.
   Web of Science ®Google Scholar
• Chu, C.-K., and Marron, J. S. (1991), “Comparison of Two Bandwidth Selectors with Dependent Errors,” The Annals of Statistics, 19, 1906–1918. DOI: 10.1214/aos/1176348377.
   Web of Science ®Google Scholar
• De Brabanter, K., Cao, F., Gijbels, I., and Opsomer, J. (2018), “Local Polynomial Regression with Correlated Errors in Random Design and Unknown Correlation Structure,” Biometrika, 105, 681–690. DOI: 10.1093/biomet/asy025.
   Web of Science ®Google Scholar
• De Brabanter, K., De Brabanter, J., Suykens, J. A., and De Moor, B. (2011), “Kernel Regression in the Presence of Correlated Errors,” Journal of Machine Learning Research, 12, 1955–1976.
   Web of Science ®Google Scholar
• Ding, Y. (2019), Data Science for Wind Energy, Boca Raton, FL: Chapman & Hall.
   Google Scholar
• EIA (2021), US Energy Information Administration, available at https://www.eia.gov/energyexplained/wind/electricity-generation-from-wind.php.
   Google Scholar
• Geller, J., and Neumann, M. H. (2018), “Improved Local Polynomial Estimation in Time Series Regression,” Journal of Nonparametric Statistics, 30, 1–27. DOI: 10.1080/10485252.2017.1402118.
   Web of Science ®Google Scholar
• Gu, C. (2013), Smoothing Spline ANOVA Models (2nd ed.), New York: Springer-Verlag.
   Google Scholar
• ——- (2014), “Smoothing Spline ANOVA Models: R Package gss,” Journal of Statistical Software, 58, 1–25.
   Web of Science ®Google Scholar
• Hastie, T., Tibshirani, R., and Friedman, J. (2009), The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd ed.), Springer: New York.
   Google Scholar
• IEC (2005), IEC TS 61400-12-1 Ed. 1, Power Performance Measurements of Electricity Producing Wind Turbines, Geneva, Switzerland.
   Google Scholar
• Kumar, N., Prakash, A., and Ding, Y. (2021), DSWE: Data Science for Wind Energy, R package version 1.5.1, available at https://CRAN.R-project.org/package=DSWE.
   Google Scholar
• Lee, G., Ding, Y., Genton, M. G., and Xie, L. (2015), “Power Curve Estimation with Multivariate Environmental Factors for Inland and Offshore Wind Farms,” Journal of the American Statistical Association, 110, 56–67. DOI: 10.1080/01621459.2014.977385.
   Web of Science ®Google Scholar
• Meyer, H., Reudenbach, C., Hengl, T., Katurji, M., and Nauss, T. (2018), “Improving Performance of Spatio-Temporal Machine Learning Models Using Forward Feature Selection and Target-Oriented Validation,” Environmental Modelling & Software, 101, 1–9.
   Web of Science ®Google Scholar
• Opsomer, J., Wang, Y., and Yang, Y. (2001), “Nonparametric Regression with Correlated Errors,” Statistical Science, 16, 134–153. DOI: 10.1214/ss/1009213287.
   Web of Science ®Google Scholar
• Rabinowicz, A., and Rosset, S. (in press), “Cross-Validation for Correlated Data,” Journal of the American Statistical Association. DOI: 10.1080/01621459.2020.1801451.
   Web of Science ®Google Scholar
• Racine, J. (2000), “Consistent Cross-Validatory Model-Selection for Dependent Data: HV-Block Cross-Validation,” Journal of Econometrics, 99, 39–61. DOI: 10.1016/S0304-4076(00)00030-0.
   Web of Science ®Google Scholar
• Rasmussen, C. E., and Williams, C. K. I. (2006), Gaussian Processes for Machine Learning, Cambridge, MA: The MIT Press.
   Google Scholar
• Roberts, D. R., Bahn, V., Ciuti, S., Boyce, M. S., Elith, J., Guillera-Arroita, G., Hauenstein, S., Lahoz-Monfort, J. J., Schröder, B., Thuiller, W., Warton, D. I., Wintle, B. A., Hartig, F., and Dormann, C. F. (2017), “Cross-Validation Strategies for Data with Temporal, Spatial, Hierarchical, or Phylogenetic Structure,” Ecography, 40, 913–929. DOI: 10.1111/ecog.02881.
   Web of Science ®Google Scholar
• Ruppert, D., Sheather, S. J., and Wand, M. P. (1995), “An Effective Bandwidth Selector for Local Least Squares Regression,” Journal of the American Statistical Association, 90, 1257–1270. DOI: 10.1080/01621459.1995.10476630.
   Web of Science ®Google Scholar
• Sheridan, R. P. (2013), “Time-Split Cross-Validation as a Method for Estimating the Goodness of Prospective Prediction,” Journal of Chemical Information and Modeling, 53, 783–790. DOI: 10.1021/ci400084k.
   PubMed Web of Science ®Google Scholar
• Tuo, R., and Wu, C. J. (2016), “A Theoretical Framework for Calibration in Computer Models: Parametrization, Estimation and Convergence Properties,” SIAM/ASA Journal on Uncertainty Quantification, 4, 767–795. DOI: 10.1137/151005841.
   Web of Science ®Google Scholar
• ——- (2018), “Prediction Based on the Kennedy-O’Hagan Calibration Model: Asymptotic Consistency and Other Properties,” Statistica Sinica, 8, 743–759.
   Google Scholar
• Vapnik, V. (2000), The Nature of Statistical Learning Theory (2nd ed.), New York: Springer-Verlag.
   Google Scholar
• Wang, W., Tuo, R., and Wu, C. J. (2020), “On Prediction Properties of Kriging: Uniform Error Bounds and Robustness,” Journal of the American Statistical Association, 115, 920–930. DOI: 10.1080/01621459.2019.1598868.
   Web of Science ®Google Scholar
• Xiao, Z., Linton, O. B., Carroll, R. J., and Mammen, E. (2003), “More Efficient Local Polynomial Estimation in Nonparametric Regression with Autocorrelated Errors,” Journal of the American Statistical Association, 98, 980–992. DOI: 10.1198/016214503000000936.
   Web of Science ®Google Scholar