Fast, Scalable Approximations to Posterior Distributions in Extended Latent Gaussian Models

References

• Baghishania, H., and Mohammadzadeh, M. (2012), “Asymptotic Normality of Posterior Distributions for Generalized Linear Mixed Models,” Journal of Multivariate Analysis, 111, 66–77. DOI: 10.1016/j.jmva.2012.05.003.
   Web of Science ®Google Scholar
• Bates, D., and Maechler, M. (2019), Matrix: Sparse and Dense Matrix Classes and Methods. R package version 1.2-18.
   Google Scholar
• Bilodeau, B., Stringer, A., and Tang, Y. (2021), “Stochastic Convergence Rates and Applications of Adaptive Quadrature in Bayesian Inference.” arXiv:2102.06801.
   Google Scholar
• Blei, D. M., Kucukelbirb, A., and McAuliffe, J. D. (2017), “Variational Inference: A Review for Statisticians,” Journal of the American Statistical Association, 112, 859–877. DOI: 10.1080/01621459.2017.1285773.
   Web of Science ®Google Scholar
• Braun, M. (2014), “trustOptim: An R Package for Trust Region Optimization with Sparse Hessians,” Journal of Statistical Software, 60, 1–16. DOI: 10.18637/jss.v060.i04.
   Web of Science ®Google Scholar
• Breslow, N. E., and Clayton, D. G. (1993), “Approximate Inference in Generalized Linear Mixed Models,” Journal of the American Statistical Association, 88, 9–25.
   Web of Science ®Google Scholar
• Brown, P. (2015), “Model-based Geostatistics the Easy Way,” Journal of Statistical Software, 63, 1–24. DOI: 10.18637/jss.v063.i12.
   Web of Science ®Google Scholar
• Brown, P., and Stafford, J. (2021), “A Root Gaussian Cox Process for Spatially-Aggregated Disease Incidence Data,” (in prepartion).
   Google Scholar
• Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., and Riddell, A. (2017), “Stan: A Probabilistic Programming Language,” Journal of Statistical Software, 76, 1–32. DOI: 10.18637/jss.v076.i01.
   PubMed Web of Science ®Google Scholar
• Diggle, P., Moraga, P., Rowlingson, B., and Taylor, B. (2013), “Spatial and Spatio-Temporal Log-Gaussian Cox Processes: Extending the Geostatistical Paradigm,” Statistical Science, 28, 542–563. DOI: 10.1214/13-STS441.
   Web of Science ®Google Scholar
• Diggle, P. J., and Giorgi, E. (2016), “Model-Based Geostatistics for Prevalence Mapping in Low-Resource Settings,” Journal of the American Statistical Association, 111, 1096–1120. DOI: 10.1080/01621459.2015.1123158.
   Web of Science ®Google Scholar
• Diggle, P. J., Kaimi, I., and Abellana, R. (2010), “Partial-Likelihood Analysis of Spatio-Temporal Point-Process Data,” Biometrics, 66, 347–354. DOI: 10.1111/j.1541-0420.2009.01304.x.
   PubMed Web of Science ®Google Scholar
• Ding, H., Lee, Y., Sato, I., and Sugiyama, M. (2018), “Variational Inference for Gaussian Process with Panel Count Data,” arXiv:1803.04232 [stat.ML].
   Google Scholar
• Eadie, G. M., and Harris, W. E. (2016), “Bayesian Mass Estimates of the Milky Way: The Dark and Light Sides of Parameter Assumptions,” The Astrophysical Journal, 829, 108. DOI: 10.3847/0004-637X/829/2/108.
   Web of Science ®Google Scholar
• Eadie, G. M., and Juric, M. (2019), “The Cumulative Mass Profile of the Milky Way as Determined by Globular Cluster Kinematics from Gaia DR2,” The Astrophysical Journal, 875, 159. DOI: 10.3847/1538-4357/ab0f97.
   Web of Science ®Google Scholar
• Eadie, G. M., Keller, B., and Harris, W. E. (2018), “Estimating the Milky Way’s Mass via Hierarchical Bayes: A Blind Test on MUGS2 Simulated Galaxies,” The Astrophysical Journal, 865, 72. DOI: 10.3847/1538-4357/aadb95.
   Web of Science ®Google Scholar
• Eadie, G. M., Springford, A., and Harris, W. E. (2017),“Bayesian Mass Estimates of the Milky Way: Including Measurement Uncertainties with Hierarchical Bayes,” The Astrophysical Journal, 835, 167. DOI: 10.3847/1538-4357/835/2/167.
   Web of Science ®Google Scholar
• Fing, Y., Rue, H., and Wakefield, J. (2010), “Bayesian Inference for Generalized Linear Mixed Models,” Biostatistics, 11, 397–412. DOI: 10.1093/biostatistics/kxp053.
   PubMed Web of Science ®Google Scholar
• Fuglstad, G.-A., Simpson, D., Lindgren, F., and Rue, H. (2019), “Constructing Priors that Penalize the Complexity of Gaussian Random Fields,” Journal of the American Statistical Association, 114, 445–452. DOI: 10.1080/01621459.2017.1415907.
   Web of Science ®Google Scholar
• Geyer, C. J. (2020), trust: Trust Region Optimization, R package version 0.1-8.
   Google Scholar
• Hall, D. B. (2000), “Zero-Inflated Poisson and Binomial Regression with Random Effects: A Case Study,” Biometrics, 54, 1030–1039. DOI: 10.1111/j.0006-341X.2000.01030.x.
   Google Scholar
• Heiss, F., and Winschel, V. (2008), “Likelihood Approximation by Numerical Integration on Sparse Grids,” Journal of Econometrics, 144, 62–80. DOI: 10.1016/j.jeconom.2007.12.004.
   Web of Science ®Google Scholar
• Henderson, R., Shimakura, S., and Gorst, D. (2002), “Modelling Spatial Variation in Leukaemia Survival,” Journal of the American Statistical Association, 97, 965–972. DOI: 10.1198/016214502388618753.
   Web of Science ®Google Scholar
• Hoffman, M. D., and Gelman, A. (2014), “The no-u-turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo,” Journal of Machine Learning Research, 15, 1351–1381.
   Web of Science ®Google Scholar
• ICPSR. (2015), “Treatment Episode Data Set – Discharges (teds-d) – Concatenated, 2006 to 2011.”
   Google Scholar
• Jin, S., and Andersson, B. (2020), “A Note on the Accuracy of Adaptive Gauss-Hermite Quadrature,” Biometrika, 107, 737–744. DOI: 10.1093/biomet/asz080.
   Web of Science ®Google Scholar
• Kass, R. E., Tierney, L., and Kadane, J. B. (1990), “The Validity of Posterior Expansions based on Laplace’s Method,” in Bayesian and Likelihood Methods in Statistics and Econometrics, eds. S. Geisser, J. S. Hodges, S. J. Press, and A. Zellner, 473–488, Amsterdam: North Holland.
   Google Scholar
• Kleijn, B., and van der Vaart, A. (2012), “The Bernstein von-Mises Theorem under Misspecification,” Electronic Journal of Statistics, 6, 354–381. DOI: 10.1214/12-EJS675.
   Web of Science ®Google Scholar
• Knorr-Held, L., and Rue, H. (2002), “On Block Updating in Markov Random Field Models for Disease Mapping,” Scandinavian Journal of Statistics, 29, 597–614.
   Web of Science ®Google Scholar
• Kristensen, K., Nielson, A., Berg, C. W., Skaug, H., and Bell, B. M. (2016), “TMB: Automatic Differentiation and Laplace Approximation,” Journal of Statistical Software, 70, 1–21. DOI: 10.18637/jss.v070.i05.
   Web of Science ®Google Scholar
• Law, H. C. L., Sejdinovic, D., Cameron, E., Lucas, T. C., Flaxman, S., Battle, K., and Fukumizu, K. (2018), “Variational Learning on Aggregate Outputs with Gaussian Processes,” arXiv:1805.08463 [stat.ML].
   Google Scholar
• Lee, J. S., Nguyen, P., Brown, P. E., Stafford, J., and Saint-Jacques, N. (2017), “A Local-EM Algorithm for Spatio-Temporal Disease Mapping with Aggregated Data,” Spatial Statistics, 21, 75–95. DOI: 10.1016/j.spasta.2017.05.001.
   Web of Science ®Google Scholar
• Li, Y., Brown, P., Gesink, D. C., and Rue, H. (2012), “Log Gaussian Cox Processes and Spatially Aggregated Disease Incidence Data,” Statistical Methods in Medical Research, 21, 479–507. DOI: 10.1177/0962280212446326.
   PubMed Web of Science ®Google Scholar
• Lindgren, F., and Rue, H. (2015), “Bayesian Spatial Modelling with R-INLA,” Journal of Statistical Software, 63, 1–25. DOI: 10.18637/jss.v063.i19.
   Web of Science ®Google Scholar
• Lindgren, F., Rue, H., and Lindstroom, J. (2011), “An Explicit Link Between Gaussian Fields and Gaussian Markov Random Fields: The Stochastic Partial Differential Equation Approach,” Journal of the Royal Statistical Society, Series B, 73, 423–498. DOI: 10.1111/j.1467-9868.2011.00777.x.
   Google Scholar
• Margossian, C. C., Vehtari, A., Simpson, D., and Agrawal, R. (2020), “Hamiltonian Monte Carlo using an adjoint-differentiated Laplace Approximation,” arXiv:2004.12550v3 [stat.CO].
   Google Scholar
• Martino, S., Akerkar, R., and Rue, H. (2011), “Approximate Bayesian Inference for Survival Models,” Scandinavian Journal of Statistics, 38, 514–528.
   Web of Science ®Google Scholar
• Martins, T. G., Simpson, D., Lindgren, F., and Rue, H. (2013), “Bayesian Computing with INLA: New Features,” Computational Statistics and Data Analysis, 67, 68–83. DOI: 10.1016/j.csda.2013.04.014.
   Web of Science ®Google Scholar
• Monnahan, C., and Kristensen, K. (2018), “No-U-turn Sampling for Fast Bayesian Inference in ADMB and TMB: Introducing the adnuts and tmbstan R Packages,” PloS One, 13, e0197954. DOI: 10.1371/journal.pone.0197954.
   PubMed Web of Science ®Google Scholar
• Murray, I., Adams, R. P., and MacKay, D. J. C. (2010), “Elliptical Slice Sampling,” in Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 541–548.
   Google Scholar
• Nandi, A. K., Lucas, T. C. D., Arambepola, R., Gething, P., and Weiss, D. (2020), “Disaggregation: An R package for Bayesian Spatial Disaggregation Modelling,” arxiv.
   Google Scholar
• Ogden, H. (2017), “On Asymptotic Validity of Naive Inference with an Approximate Likelihood,” Biometrika, 104, 153–164. DOI: 10.1093/biomet/asx002.
   Web of Science ®Google Scholar
• Ogden, H. (2021), “On the Error in Laplace Approximations of High-Dimensional Integrals,” Stat, 10, e380.
   Web of Science ®Google Scholar
• Petras, K. (2003), “Smolyak Cubature of Given Polynomial Degree with few Nodes for Increasing Dimension,” Numerische Mathematik, 93, 729–753. DOI: 10.1007/s002110200401.
   Web of Science ®Google Scholar
• Pinheiro, J. C., and Bates, D. M. (1995), “Approximations to the Log-likelihood Function in the Nonlinear Mixed Effects Models,” Journal of Computational and Graphical Statistics, 4, 12–35.
   Google Scholar
• Rue, H. (2001), “Fast Sampling of Gaussian Markov Random Fields,” Journal of the Royal Statistical Society, Series B, 63, 325–338. DOI: 10.1111/1467-9868.00288.
   Google Scholar
• Rue, H., and Martino, S. (2007), “Approximate Bayesian Inference for Hierarchical Gaussian Markov Random Field Models,” Journal of Statistical Planning and Inference, 137, 3177–3192. DOI: 10.1016/j.jspi.2006.07.016.
   Web of Science ®Google Scholar
• Rue, H., Martino, S., and Chopin, N. (2009), “Approximate Bayesian Inference for Latent Gaussian Models by using Integrated Nested Laplace Approximations,” Journal of the Royal Statistical Society, Series B, 71, 319–392. DOI: 10.1111/j.1467-9868.2008.00700.x.
   Web of Science ®Google Scholar
• Rue, H., Riebler, A., Sørbye, S. H., Illian, J. B., Simpson, D. P., and Lindgren, F. K. (2017), “Bayesian Computing with INLA: A Review,” Annual Review of Statistics and Its Application, 4, 395–421. DOI: 10.1146/annurev-statistics-060116-054045.
   Web of Science ®Google Scholar
• Schlather, M., Malinowski, A., Menck, P. J., Oesting, M., and Strokorb, K. (2015), “Analysis, Simulation and Prediction of Multivariate Random Fields with Package RandomFields,” Journal of Statistical Software, 63, 1–25. DOI: 10.18637/jss.v063.i08.
   Web of Science ®Google Scholar
• Shun, Z., and McCullagh, P. (1995), “Laplace Approximation of High Dimensional Integrals,” Journal of the Royal Statistical Society, Series B, 57, 749–760. DOI: 10.1111/j.2517-6161.1995.tb02060.x.
   Google Scholar
• Simpson, D., Illian, J. B., Lindgren, F., Sorbye, S. H., and Rue, H. (2016), “Going Off Grid: Computatioanlly Efficient Inference for Log-Gaussian Cox Processes,” Biometrika, 103, 49–70. DOI: 10.1093/biomet/asv064.
   Web of Science ®Google Scholar
• Simpson, D., Rue, H., Martins, T. G., Riebler, A., and Sørbye, S. H. (2017), “Penalising Model Component Complexity: A Principled, Practical Approach to Constructing Priors,” Statistical Science, 32, 1–28. DOI: 10.1214/16-STS576.
   Web of Science ®Google Scholar
• Stringer, A., Brown, P., and Stafford, J. (2021), “Approximate Bayesian Inference for Case Crossover Models,” Biometrics, 77, 785–795. DOI: 10.1111/biom.13329.
   PubMed Web of Science ®Google Scholar
• Tierney, L., and Kadane, J. B. (1986), “Accurate Approximations to Posterior Moments and Marginal Densities,” Journal of the American Statistical Association, 81, 82–86. DOI: 10.1080/01621459.1986.10478240.
   Web of Science ®Google Scholar
• van der Vaart, A. (1998), Asymptotic Statistics, Cambridge: Cambridge University Press.
   Google Scholar
• van Niekerk, J., Bakka, H., and Rue, H. (2021), “Competing Risks Joint Models using r-inla,” Statistical Modelling, 21, 56–71. DOI: 10.1177/1471082X20913654.
   Web of Science ®Google Scholar
• Vehtari, A., Gelman, A., and Gabry, J. (2017), “Practical Bayesian Model Evaluation using Leave-One-Out Cross-Validation and WAIC,” Statistics and Computing, 27, 1413–1432. DOI: 10.1007/s11222-016-9696-4.
   Web of Science ®Google Scholar
• Vehtari, A., Simpson, D., Gelman, A., Yao, Y., and Gabry, J. (2021), “Pareto Smoothed Importance Sampling,” arXiv:1507.02646v7 [stat.CO].
   Google Scholar
• Wachter, A., and Biegler, L. T. (2006), “On the Implementation of a Primal-Dual Interior Point Filter Line Search Algorithm for Large-Scale Nonlinear Programming,” Mathematical Programming, 106, 25–57. DOI: 10.1007/s10107-004-0559-y.
   Web of Science ®Google Scholar
• Walker, A. M. (1969), “On the Asymptotic Behaviour of Posterior Distributions,” Journal of the Royal Statistical Society, Series B, 31, 80–88. DOI: 10.1111/j.2517-6161.1969.tb00767.x.
   Google Scholar
• Weiser, C. (2016), mvQuad: Methods for Multivariate Quadrature (R package version 1.0-6).
   Google Scholar
• Wood, S. (2011), “Fast Stable Restricted Maximum Likelihood and Marginal Likelihood Estimation of Semiparametric Generalized Linear Models,” Journal of the Royal Statistical Society, Series B, 73, 3–36. DOI: 10.1111/j.1467-9868.2010.00749.x.
   Google Scholar
• Wood, S. (2016), “Smoothing Parameter and Model Selection for General Smooth Models,” Journal of the American Statistical Association, 111, 1548–1575.
   Web of Science ®Google Scholar
• Wood, S. (2020), “Simplified Integrated Nested Laplace Approximation,” Biometrika, 107, 223–230.
   Web of Science ®Google Scholar
• Yao, Y., Vehtari, A., Simpson, D., and Gelman, A. (2018), “Yes, but did it Work?: Evaluating Variational Inference,” in Proceedings of the 35th International Conference on Machine Learning.
   Google Scholar
• Zhang, H. (2004), “Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics,” Journal of the American Statistical Association, 99, 250–261. DOI: 10.1198/016214504000000241.
   Web of Science ®Google Scholar