References
- Berndt, E. (1991), The Practice of Econometrics: Classic and Contemporary. Reading, MA: Addison-Wesley Publishing Company. DOI: https://doi.org/10.1086/ahr/80.1.64.
- Blei, D. M., Kucukelbir, A., and McAuliffe, J. D. (2017), “Variational Inference: A Review for Statisticians,” Journal of the American Statistical Association, 112, 859–877. DOI: https://doi.org/10.1080/01621459.2017.1285773.
- Blei, D. M., and Lafferty, J. D. (2007), “A Correlated Topic Model of Science,” The Annals of Applied Statistics, 1, 17–35. DOI: https://doi.org/10.1214/07-AOAS114.
- Breslow, N. E., and Clayton, D. G. (1993), “Approximate Inference in Generalized Linear Mixed Models,” Journal of the American Statistical Association, 88, 9–25. DOI: https://doi.org/10.1080/01621459.1993.10594284.
- Chen, Y. C., Wang, Y. S., and Erosheva, E. A. (2018), “On the Use of Bootstrap with Variational Inference: Theory, Interpretation, and a Two-sample Test Example,” The Annals of Applied Statistics, 12, 846–876. DOI: https://doi.org/10.1214/18-AOAS1169.
- Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977), “Maximum Likelihood from Incomplete Data Via the EM Algorithm,” Journal of the Royal Statistical Society, Series B, 39, 1–38. DOI: https://doi.org/10.1111/j.2517-6161.1977.tb01600.x.
- Eilers, P. H. C., and Marx, B. D. (1996), “Flexible Smoothing with B-splines and Penalties,” Statistical Science, 11, 89–121. DOI: https://doi.org/10.1214/ss/1038425655.
- Fan, J., and Peng, H. (2004), “Nonconcave Penalized Likelihood with a Diverging Number of Parameters,” The Annals of Statistics, 32, 928–961. DOI: https://doi.org/10.1214/009053604000000256.
- Gneiting, T., and Raftery, A. E. (2007), “Strictly Proper Scoring Rules, Prediction, and Estimation,” Journal of the American Statistical Association, 102, 359–378. DOI: https://doi.org/10.1198/016214506000001437.
- Hall, P., Pham, T., Wand, M. P., and Wang, S. S. (2011), “Asymptotic Normality and Valid Inference for Gaussian Variational Approximation,” The Annals of Statistics, 39, 2502–2532. DOI: https://doi.org/10.1214/11-AOS908.
- Hastie, T., and Tibshirani, R. (1986), “Generalized Additive Models,” Statistical Science, 1, 297–310. DOI: https://doi.org/10.1214/ss/1177013604.
- Hui, F. K. C., Mueller, S., and Welsh, A. H. (2017a), “Hierarchical Selection of Fixed and Random Effects in Generalized Linear Mixed Models,” Statistica Sinica, 27, 501–518.
- Hui, F. K. C., Warton, D. I., Ormerod, J. T., Haapaniemi, V., and Taskinen, S. (2017b), “Variational Approximations for Generalized Linear Latent Variable Models,” Journal of Computational and Graphical Statistics, 26, 35–43. DOI: https://doi.org/10.1080/10618600.2016.1164708.
- Kauermann, G. (2005), “A Note on Smoothing Parameter Selection for Penalized Spline Smoothing,” Journal of Statistical Planning and Inference, 127, 53–69. DOI: https://doi.org/10.1016/j.jspi.2003.09.023.
- Kauermann, G., Krivobokova, T., and Fahrmeir, L. (2009), “Some Asymptotic Results on Generalized Penalized Spline Smoothing,” Journal of the Royal Statistical Society, Series B, 71, 487–503. DOI: https://doi.org/10.1111/j.1467-9868.2008.00691.x.
- Knowles, D. A., and Minka, T. (2011), “Non-conjugate Variational Message Passing for Multinomial and Binary Regression,” in Advances in Neural Information Processing Systems (Vol. 24), eds. J. Shawe-Taylor, R. S. Zemel, P. L. Bartlett, F. Pereira, and K. Q. Weinberger, New York: Curran Associates, Inc, pp. 1701–1709.
- Krivobokova, T., Kneib, T., and Claeskens, G. (2010), “Simultaneous Confidence Bands for Penalized Spline Estimators,” Journal of the American Statistical Association, 105, 852–863. DOI: https://doi.org/10.1198/jasa.2010.tm09165.
- Lin, X., and Zhang, D. (1999), “Inference in Generalized Additive Mixed Models by Using Smoothing Splines,” Journal of the Royal Statistical Society, Series B, 61, 381–400. DOI: https://doi.org/10.1111/1467-9868.00183.
- Louis, T. A. (1982), “Finding the Observed Information Matrix When Using the EM Algorithm,” Journal of the Royal Statistical Society, Series B, 44, 226–233. DOI: https://doi.org/10.1111/j.2517-6161.1982.tb01203.x.
- Lu, Y., Zhang, R., and Zhu, L. (2008), “Penalized Spline Estimation for Varying-Coefficient Models,” Communications in Statistics–Theory and Methods, 37, 2249–2261. DOI: https://doi.org/10.1080/03610920801931887.
- Luts, J., Broderick, T., and Wand, M. P. (2014), “Real-time Semiparametric Regression,” Journal of Computational and Graphical Statistics, 23, 589–615. DOI: https://doi.org/10.1080/10618600.2013.810150.
- Luts, J., and Wand, M. P. (2015), “Variational Inference for Count Response Semiparametric Regression,” Bayesian Analysis, 10, 991–1023. DOI: https://doi.org/10.1214/14-BA932.
- Ormerod, J., and Wand, M. (2010), “Explaining Variational Approximations,” The American Statistician, 64(2), 140–153. DOI: https://doi.org/10.1198/tast.2010.09058.
- Ormerod, J., and Wand, M. (2012), “Gaussian Variational Approximate Inference for Generalized Linear Mixed Models,” Journal of Computational and Graphical Statistics, 21, 2–17.
- Ormerod, J. T., You, C., and Mueller, S. (2016), “A Variational Bayes Approach to Variable Selection,” Electronic Journal of Statistics, 11, 3549–3594. DOI: https://doi.org/10.1214/17-EJS1332.
- Reiss, P. T., and Ogden, R. T. (2009), “Smoothing Parameter Selection for a Class of Semiparametric Linear Models,” Journal of the Royal Statistical Society, Series B, 71, 505–523. DOI: https://doi.org/10.1111/j.1467-9868.2008.00695.x.
- Rigby, R. A., and Stasinopoulos, D. M. (2005), “Generalized Additive Models for Location, Scale and Shape” (with discussion), Journal of the Royal Statistical Society, Series C, 54, 507–554. DOI: https://doi.org/10.1111/j.1467-9876.2005.00510.x.
- Ruppert, D. (2002). “Selecting the Number of Knots for Penalized Splines,” Journal of Computational and Graphical Statistics, 11, 735–757. DOI: https://doi.org/10.1198/106186002853.
- Ruppert, D., Wand, M., and Carroll, R. (2003), Semiparametric Regression,” New York: Cambridge University Press.
- Wang, X., Shen, J., and Ruppert, D. (2011), “On the Asymptotics of Penalized Spline Smoothing,” Electronic Journal of Statistics, 5, 1–17. DOI: https://doi.org/10.1214/10-EJS593.
- Westling, T., and McCormick, T. H. (2017), “Consistency, Calibration, and Efficiency of Variational Inference,” arXiv preprint, 1510.08151v3.
- Wood, S. (2006), Generalized Additive Models: An Introduction with R, Boca Raton, FL: CRC Press.
- Wood, S. (2011). “Fast Stable Restricted Maximum Likelihood and Marginal Likelihood Estimation of Semiparametric Generalized Linear Models,” Journal of the Royal Statistical Society, Series B, 73, 3–36.
- Wood, S. N., Pya, N., and Säfken, B. (2016), “Smoothing Parameter and Model Selection for General smooth Models,” Journal of the American Statistical Association, 111, 1548–1563. DOI: https://doi.org/10.1080/01621459.2016.1180986.
- Wood, S., and Scheipl, F. (2016), gamm4: Generalized Additive Mixed Models using ‘mgcv’ and ‘lme4’. R package version 0.2-4, available at https://CRAN.R-project.org/package=gamm4.
- Xue, L. (2009), “Consistent Variable Selection in Additive Models,” Statistica Sinica, 19, 1281–1296.
- Yu, Y., and Ruppert, D. (2002). Penalized Spline Estimation for Partially Linear Single-index Models,” Journal of the American Statistical Association, 97, 1042–1054. DOI: https://doi.org/10.1198/016214502388618861.