Sampling Strategies for Fast Updating of Gaussian Markov Random Fields

References

• Agapiou, S., Bardsley, J. M., Papaspiliopoulos, O., and Stuart, A. M. (2014), “Analysis of the Gibbs Sampler for Hierarchical Inverse Problems,” SIAM/ASA Journal on Uncertainty Quantification, 2, 511–544. DOI: 10.1137/130944229.
   Web of Science ®Google Scholar
• Banerjee, S., Carlin, B. P., and Gelfand, A. E. (2015), Hierarchical Modeling and Analysis for Spatial Data (2nd ed.), Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Bardsley, J. M. (2012), “MCMC-Based Image Reconstruction With Uncertainty Quantification,” SIAM Journal on Scientific Computing, 34, 1316–1332.
   Web of Science ®Google Scholar
• Bates, D., and Maechler, M. (2016), Matrix: Sparse and Dense Matrix Classes and Methods, R Package Version 1.2-6.
   Google Scholar
• Bayarri, M. J., Berger, J. O., Paulo, R., Sacks, J., Cafeo, J. A., Cavendish, J., Lin, C.-H., and Tu, J. (2007), “A Framework for Validation of Computer Models,” Technometrics, 49, 138–154. DOI: 10.1198/004017007000000092.
   Web of Science ®Google Scholar
• Besag, J. (1974), “Spatial Interaction and the Statistical Analysis of Lattice Systems,” Journal of the Royal Statistical Society, Series B, 36, 192–236. DOI: 10.1111/j.2517-6161.1974.tb00999.x.
   Google Scholar
• Besag, J. (1986), “On the Statistical Analysis of Dirty Pictures,” Journal of the Royal Statistical Society, Series B, 48, 259–302.
   Google Scholar
• Besag, J., and Kooperberg, C. (1995), “On Conditional and Intrinsic Autoregressions,” Biometrika, 82, 733–46. DOI: 10.1093/biomet/82.4.733.
   Web of Science ®Google Scholar
• Besag, J., York, J. C., and Mollié, A. (1991), “Bayesian Image Restoration, With Two Applications in Spatial Statistics,” Annals of the Institute of Statistical Mathematics, 43, 1–59. DOI: 10.1007/BF00116466.
   Web of Science ®Google Scholar
• Brélaz, D. (1979), “New Methods to Color the Vertices of a Graph,” Communications of the ACM, 22, 251–256. DOI: 10.1145/359094.359101.
   Web of Science ®Google Scholar
• Brooks, S. P., and Gelman, A. (1998), “General Methods for Monitoring Convergence of Iterative Simulations,” Journal of Computational and Graphical Statistics, 7, 434–455. DOI: 10.2307/1390675.
   Web of Science ®Google Scholar
• Brown, D. A., Datta, G. S., and Lazar, N. A. (2017), “A Bayesian Generalized CAR Model for Correlated Signal Detection,” Statistica Sinica, 27, 1125–1153.
   Web of Science ®Google Scholar
• Brown, D. A., Lazar, N. A., Datta, G. S., Jang, W., and McDowell, J. E. (2014), “Incorporating Spatial Dependence Into Bayesian Multiple Testing of Statistical Parametric Maps in Functional Neuroimaging,” NeuroImage, 84, 97–112. DOI: 10.1016/j.neuroimage.2013.08.024.
   PubMed Web of Science ®Google Scholar
• Brown, D. A., McMahan, C. S., Shinohara, R. T., and Linn, K. L. (2017), “Bayesian Spatial Binary Regression for Label Fusion in Structural Neuroimaging,” arXiv no. 1710.10351.
   Google Scholar
• Cai, Z. (2014), “Very Large Scale Bayesian Machine Learning,” unpublished doctoral dissertation, Rice University, Department of Computer Science.
   Google Scholar
• Cai, Z., Jermaine, C., Vagena, Z., Logothetis, D., and Perez, L. (2013), “The Pairwise Gaussian Random Field for High-Dimensional Data Imputation,” in IEEE 13th International Conference on Data Mining (ICDM), pp. 61–70.
   Google Scholar
• Carlin, B. P., and Louis, T. A. (2009), Bayesian Methods for Data Analysis (3rd ed.), Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Cheng, D., Cheng, Y., Liu, Y., Peng, R., and Teng, S.-H. (2015), “Efficient Sampling for Gaussian Graphical Models via Spectral Sparsification,” in Journal of Machine Learning Research: Proceedings of the 28th International Conference on Learning Theory, pp. 364–390.
   Google Scholar
• Culberson, J. C. (1992), “Iterated Greedy Graph Coloring and the Difficulty Landscape,” Technical Report, University of Alberta.
   Google Scholar
• Dempster, A. P. (1972), “Covariance Selection,” Biometrics, 28, 157–175. DOI: 10.2307/2528966.
   Web of Science ®Google Scholar
• Eddelbuettel, D., and François, R. (2011), “Rcpp: Seamless R and C++ Integration,” Journal of Statistical Software, 40, 1–18.
   Web of Science ®Google Scholar
• Fox, C., and Norton, R. A. (2016), “Fast Sampling in a Linear-Gaussian Inverse Problem,” SIAM/ASA Journal on Uncertainty Quantification, 4, 1191–1218. DOI: 10.1137/15M1029527.
   Web of Science ®Google Scholar
• Furrer, R., and Sain, S. R. (2010), “spam: A Sparse Matrix R Package With Emphasis on MCMC Methods for Gaussian Markov Random Fields,” Journal of Statistical Software, 36, 1–25.
   Web of Science ®Google Scholar
• Gelfand, A. E., and Sahu, S. K. (1999), “Identifiability, Improper Priors, and Gibbs Sampling for Generalized Linear Models,” Journal of the American Statistical Association, 94, 247–253. DOI: 10.1080/01621459.1999.10473840.
   Web of Science ®Google Scholar
• Gelfand, A. E., and Smith, A. F. M. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398–409. DOI: 10.1080/01621459.1990.10476213.
   Web of Science ®Google Scholar
• Gelman, A. (2006), “Prior Distributions for Variance Parameters in Hierarchical Models,” Bayesian Analysis, 1, 515–533. DOI: 10.1214/06-BA117A.
   Web of Science ®Google Scholar
• Geman, S., and Geman, D. (1984), “Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721–741. DOI: 10.1109/TPAMI.1984.4767596.
   PubMed Web of Science ®Google Scholar
• Gerber, F., and Furrer, R. (2015), “Pitfalls in the Implementation of Bayesian Hierarchical Modeling of Areal Count Data: An Illustration Using BYM and Leroux Models,” Journal of Statistical Software, 63, 1–32.
   Web of Science ®Google Scholar
• Golub, G. H., and Van Loan, C. F. (1996), Matrix Computations (3rd ed.), Baltimore, MD: The Johns Hopkins University Press.
   Google Scholar
• Gonzalez, J. E., Low, Y., Gretton, A., and Guestrin, C. (2011), “Parallel Gibbs Sampling: From Colored Fields to Thin Junction Trees,” in Journal of Machine Learning Research: Proceedings of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 324–332.
   Google Scholar
• Grimmett, G. R., and McDiarmid, C. J. H. (1975), “On Colouring Random Graphs,” Mathematical Proceedings of the Cambridge Philosophical Society, 33, 313–324. DOI: 10.1017/S0305004100051124.
   Google Scholar
• Hastings, W. (1970), “Monte Carlo Sampling Methods Using Markov Chains and Their Application,” Biometrika, 57, 97–109. DOI: 10.1093/biomet/57.1.97.
   Web of Science ®Google Scholar
• Higdon, D. M. (1998), “Auxiliary Variable Methods for Markov Chain Monte Carlo With Applications,” Journal of the American Statistical Association, 93, 585–595. DOI: 10.1080/01621459.1998.10473712.
   Web of Science ®Google Scholar
• Hodges, J. S., Carlin, B. P., and Fan, Q. (2003), “On the Precision of the Conditionally Autoregressive Prior in Spatial Models,” Biometrics, 59, 317–322. DOI: 10.1111/1541-0420.00038.
   PubMed Web of Science ®Google Scholar
• Hunziker, P. (2017), MapColoring: Optimal Contrast Map Coloring, R Package Version 1.0.
   Google Scholar
• Johnson, M., Saunderson, J., and Willsky, A. (2013), “Analyzing Hogwild Parallel Gaussian Gibbs Sampling,” in Advances in Neural Information Processing Systems 26, eds. C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger, Curran Associates, Inc., pp. 2715–2723.
   Google Scholar
• Kass, R. E., Carlin, B. P., Gelman, A., and Neal, R. (1998), “Markov Chain Monte Carlo in Practice: A Roundtable Discussion,” The American Statistician, 52, 93–100. DOI: 10.2307/2685466.
   Web of Science ®Google Scholar
• Knorr-Held, L., and Rue, H. (2002), “On Block Updating in Markov Random Field Models for Disease Mapping,” Scandinavian Journal of Statistics, 29, 597–614. DOI: 10.1111/1467-9469.00308.
   Web of Science ®Google Scholar
• Koenker, R., and Ng, P. (2016), SparseM: Sparse Linear Algebra, R Package Version 1.74.
   Google Scholar
• Krager, D., Motwani, R., and Sudan, M. (1998), “Approximate Graph Coloring by Semidefinite Programming,” Journal of the ACM, 45, 246–265. DOI: 10.1145/274787.274791.
   Web of Science ®Google Scholar
• Lazar, N. A. (2008), The Statistical Analysis of Functional MRI Data, New York: Springer Science + Business Media, LLC.
   Google Scholar
• Lee, D. (2013), “CARBayes: An R Package for Bayesian Spatial Modeling With Conditional Autoregressive Priors,” Journal of Statistical Software, 55, 1–24.
   Web of Science ®Google Scholar
• Lindgren, F., and Rue, H. (2015), “Bayesian Spatial Modelling With R-INLA,” Journal of Statistical Software, 63, 1–25.
   Web of Science ®Google Scholar
• Lindgren, F., Rue, H., and Lindström, J. (2011), “An Explicit Link Between Gaussian Fields and Gaussian Markov Random Fields: The Stochastic Partial Differential Equation Approach,” Journal of the Royal Statistical Society, Series B, 73, 423–498. DOI: 10.1111/j.1467-9868.2011.00777.x.
   Google Scholar
• Liu, J. S., Wong, W. H., and Kong, A. (1994), “Covariance Structure of the Gibbs Sampler With Applications to the Comparisons of Estimators and Augmentation Schemes,” Biometrika, 81, 27–40. DOI: 10.1093/biomet/81.1.27.
   Web of Science ®Google Scholar
• Liu, Y., Kosut, O., and Willsky, A. S. (2015), “Sampling From Gaussian Markov Random Fields Using Stationary and Non-stationary Subgraph Pertubations,” IEEE Transactions on Signal Processing, 63, 576–589. DOI: 10.1109/TSP.2014.2375134.
   Web of Science ®Google Scholar
• Lunn, D. J., Thomas, A., Best, N., and Spiegelhalter, D. (2000), “WinBUGS—A Bayesian Modelling Framework: Concepts, Structure, and Extensibility,” Statistics and Computing, 10, 325–337. DOI: 10.1023/A:1008929526011.
   Web of Science ®Google Scholar
• Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953), “Equation of State Calculations by Fast Computing Machines,” Journal of Chemical Physics, 21, 1087–1091. DOI: 10.1063/1.1699114.
   Web of Science ®Google Scholar
• Ng, E. G., and Peyton, B. W. (1993), “Block Sparse Cholesky Algorithms on Advanced Uniprocessor Computers,” SIAM Journal on Scientific Computing, 14, 1034–1056. DOI: 10.1137/0914063.
   Web of Science ®Google Scholar
• Niu, F., Recht, B., Ré, C., and Wright, S. J. (2011), “Hogwild! A Lock-Free Approach to Parallelizing Stochastic Gradient Descent,” in Advances in Neural Information Processing Systems 24, eds. J. Shawe-Taylor, R. S. Zemel, P. L. Bartlett, F. Pereira, and K. Q. Weinberger, Curran Associates, Inc., pp. 693–701.
   Google Scholar
• Polson, N. G., Scott, J. G., and Windle, J. (2013), “Bayesian Inference for Logistic Models Using Pólya Gamma Latent Variables,” Journal of the American Statistical Association, 108, 1339–1349. DOI: 10.1080/01621459.2013.829001.
   Web of Science ®Google Scholar
• R Core Team (2018), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing.
   Google Scholar
• Robert, C., and Casella, G. (2004), Monte Carlo Statistical Methods (2nd ed.), New York: Springer.
   Google Scholar
• Rue, H. (2001), “Fast Sampling of Gaussian Markov Random Fields,” Journal of the Royal Statistical Society, Series B, 63, 325–338. DOI: 10.1111/1467-9868.00288.
   Google Scholar
• Rue, H., and Held, L. (2005), Gaussian Markov Random Fields, Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Rue, H., Martino, S., and Chopin, N. (2009), “Approximate Bayesian Inference for Latent Gaussian Models by Using Integrated Nested Laplace Approximations,” Journal of the Royal Statistical Society, Series B, 71, 319–392. DOI: 10.1111/j.1467-9868.2008.00700.x.
   Web of Science ®Google Scholar
• Rue, H., and Tjelmeland, H. (2002), “Fitting Gaussian Markov Random Fields to Gaussian Fields,” Scandinavian Journal of Statistics, 29, 31–49. DOI: 10.1111/1467-9469.00058.
   Web of Science ®Google Scholar
• Schabenberger, O., and Gotway, C. A. (2005), Statistical Methods for Spatial Data Analysis, Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Self, S. C. W., McMahan, C. S., Brown, D. A., Lund, R. B., Gettings, J. R., and Yabsley, M. J. (2018), “A Large-Scale Spatio-Temporal Binomial Regression Model for Estimating Seroprevalence Trends,” Environmetrics, 29, e2538. DOI: 10.1002/env.2538.
   Web of Science ®Google Scholar
• Sherman, A. H. (1975), “On the Efficient Solution of Sparse Systems of Linear and Nonlinear Equations,” unpublished doctoral dissertation, Yale University.
   Google Scholar
• Song, H.-R., Fuentes, M., and Ghosh, S. (2008), “A Comparative Study of Gaussian Geostatistical Models and Gaussian Markov Random Fields,” Journal of Multivariate Analysis, 99, 1681–1697. DOI: 10.1016/j.jmva.2008.01.012.
   PubMed Web of Science ®Google Scholar
• Waller, L. A., Carlin, B. P., Xia, H., and Gelfand, A. E. (1997), “Hierarchical Spatio-Temporal Mapping of Disease Rates,” Journal of the American Statistical Association, 92, 607–617. DOI: 10.1080/01621459.1997.10474012.
   Web of Science ®Google Scholar
• Xiao, G., Reilly, C., and Khodursky, A. B. (2009), “Improved Detection of Differentially Expressed Genes Through Incorporation of Gene Location,” Biometrics, 65, 805–814. DOI: 10.1111/j.1541-0420.2008.01161.x.
   PubMed Web of Science ®Google Scholar