Pointwise Bayesian Credible Intervals for Regularized Linear Wavelet Estimators

ABSTRACT

The regularized linear wavelet estimator has been recently proposed as an alternative to the spline smoothing estimator, one of the most used linear estimator for the standard nonparametric regression problem. It has been demonstrated that the regularized linear wavelet estimator attains the optimal rate of convergence in the mean integrated squared error sense and compares favorably with the smoothing spline estimator in finite-sample situations, especially for less smooth response functions. We investigate further this estimator, extending Bayesian aspects of smoothing splines considered earlier in the literature. We first consider a Bayesian formalism in the wavelet domain that gives rise to the regularized linear wavelet estimator obtained in the standard nonparametric regression setting. We then use the posterior distribution to construct pointwise Bayesian credible intervals for the resulting regularized linear wavelet function estimate. Simulation results show that the wavelet-based pointwise Bayesian credible intervals have good empirical coverage rates for standard nominal coverage probabilities and compare favorably with the corresponding intervals obtained by smoothing splines, especially for less smooth response functions. Moreover, their construction algorithm is of order 𝒪(n) and it is easily implemented.

Keywords:

• Bayesian credible intervals
• Linear wavelet methods
• Nonparametric regression
• Regularization
• Smoothing splines
• Sobolev spaces

Mathematics Subject Classification:

• 62F15
• 62F25

Acknowledgments

The author is grateful to Brani Vidakovic (Georgia Institute of Technology, USA) and Theofanis Sapatinas (University of Cyprus, Cyprus).