Noisy Hamiltonian Monte Carlo for Doubly Intractable Distributions

References

• Alquier, P., Friel, N., Everitt, R., and Boland, A. (2016), “Noisy Monte Carlo: Convergence of Markov Chains with Approximate Transition Kernels,” Statistics and Computing, 26, 29–47.
   Web of Science ®Google Scholar
• Andrieu, C., and Roberts, G. O. (2009), “The Pseudo-Marginal Approach for Efficient Monte Carlo Computations,” The Annals of Statistics, 37, 697–725.
   Web of Science ®Google Scholar
• Augustin, N. H., Mugglestone, M. A., and Buckland, S. T. (1998), “The Role of Simulation in Modelling Spatially Correlated Data,” Environmetrics, 9, 175–196.
   Web of Science ®Google Scholar
• Beaumont, M. A. (2003), “Estimation of Population Growth or Decline in Genetically Monitored Populations,” Genetics, 164, 1139–1160.
   PubMed Web of Science ®Google Scholar
• Besag, J. E. (1974), “Spatial Interaction and the Statistical Analysis of Lattice Systems” (with discussion) Journal of the Royal Statistical Society, Series B, 36, 192–236.
   Google Scholar
• Beskos, A., Pillai, N., Roberts, G., Sanz-Serna, J.-M., and Stuart, A. (2013), “Optimal Tuning of the Hybrid Monte Carlo Algorithm,” Bernoulli, 19, 1501–1534.
   Web of Science ®Google Scholar
• Caimo, A., and Friel, N. (2014), “Bergm: Bayesian Exponential Random Graphs in R,” Journal of Statistical Software, 61, 1–25.
   Web of Science ®Google Scholar
• Carpenter, B., Gelman, A., Hoffman, M., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., and Riddell, A. (2017), “Stan: A Probabilistic Programming Language,” Journal of Statistical Software, 76, 1–32.
   PubMed Web of Science ®Google Scholar
• Chen, T., Fox, E., and Guestrin, C. (2014), “Stochastic Gradient Hamiltonian Monte Carlo,” in Proceedings of the 31st International Conference on Machine Learning (Vol. 32), JMLR.org, pp. 1683–1691.
   Google Scholar
• Clifford, P. (1990), “Markov Random Fields in Statistics,” in Disorder in Physical Systems: A Volume in Honour of John M. Hammersley, Clarendon Press, pp. 19–32.
   Google Scholar
• Duane, S., Kennedy, A., Pendleton, B. J., and Roweth, D. (1987), “Hybrid Monte Carlo,” Physics Letters B, 195, 216–222.
   Web of Science ®Google Scholar
• François, O., Ancelet, S., and Guillot, G. (2006), “Bayesian Clustering Using Hidden Markov Random Fields in Spatial Population Genetics,” Genetics, 174, 805–816.
   PubMed Web of Science ®Google Scholar
• Friel, N. (2012), “Bayesian Inference for Gibbs Random Fields Using Composite Likelihoods,” in Proceedings of the Winter Simulation Conference, no. 28 in WSC ’12, pp. 1–8.
   Google Scholar
• Friel, N., Mira, A., and Oates, C. J. (2016), “Exploiting Multi-Core Architectures for Reduced-Variance Estimation with Intractable Likelihoods,” Bayesian Analysis, 11, 215–245.
   Web of Science ®Google Scholar
• Friel, N., and Rue, H. (2007), “Recursive Computing and Simulation-Free Inference for General Factorizable Models,” Biometrika, 94, 661–672.
   Web of Science ®Google Scholar
• Girolami, M., and Calderhead, B. (2011), “Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods,” Journal of the Royal Statistical Society, Series B, 73, 123–214.
   Google Scholar
• Green, P. J., and Richardson, S. (2002), “Hidden Markov Models and Disease Mapping,” Journal of the American Statistical Association, 97, 1055–1070.
   Web of Science ®Google Scholar
• Grimmett, G. R. (1973), “A Theorem about Random Fields,” Bulletin of the London Mathematical Society, 5, 81–84.
   Google Scholar
• Hastings, W. K. (1970), “Monte Carlo Sampling Methods using Markov Chains and their Applications,” Biometrika, 57, 97–109.
   Web of Science ®Google Scholar
• Hoffman, M. D., and Gelman, A. (2014), “The No-U-turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo,” Journal of Machine Learning Research, 15, 1593–1623.
   Web of Science ®Google Scholar
• Hurn, M. A., Husby, O. K., and Rue, H. (2003), “A Tutorial on Image Analysis,” in Spatial Statistics and Computational Methods (Lecture Notes in Statistics, Vol. 173), ed. J. Møller, New York: Springer, pp. 87–141.
   Google Scholar
• Jaakkola, T. S., and Jordan, M. I. (2000), “Bayesian Parameter Estimation via Variational Methods,” Statistics and Computing, 10, 25–37.
   Web of Science ®Google Scholar
• Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K. (1999), “An Introduction to Variational Methods for Graphical Models,” Machine Learning, 37, 183–233.
   Web of Science ®Google Scholar
• Lindsay, B. G. (1988), “Composite Likelihood Methods,” Contemporary Mathematics, 80, 221–239.
   Google Scholar
• Lyne, A.-M., Girolami, M., Atchadé, Y., Strathmann, H., and Simpson, D. (2015), “On Russian Roulette Estimates for Bayesian Inference with Doubly-Intractable Likelihoods,” Statistical Science, 30, 443–467.
   Web of Science ®Google Scholar
• Marin, J.-M., Pudlo, P., Robert, C. P., and Ryder, R. J. (2012), “Approximate Bayesian Computational Methods,” Statistics and Computing, 22, 1167–1180.
   Web of Science ®Google Scholar
• Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953), “Equation of State Calculations by Fast Computing Machines,” The Journal of Chemical Physics, 21, 1087–1092.
   Web of Science ®Google Scholar
• Møller, J., Pettitt, A. N., Reeves, R., and Berthelsen, K. K. (2006), “An Efficient Markov Chain Monte Carlo Method for Distributions With Intractable Normalising Constants,” Biometrika, 93, 451–458.
   Web of Science ®Google Scholar
• Murray, I., Ghahramani, Z., and MacKay, D. J. C. (2006), “MCMC for Doubly-Intractable Distributions,” in Proceedings of the 22nd Annual Conference on Uncertainty in Artificial Intelligence (UAI-06), AUAI Press, pp. 359–366.
   Google Scholar
• Narasimhan, B., and Johnson, S. G. (2017), “cubature: Adaptive Multivariate Integration over Hypercubes,” R Package Version 1.3-8.
   Google Scholar
• Neal, R. M. (2001), “Annealed Importance Sampling,” Statistics and Computing, 11, 125–139.
   Web of Science ®Google Scholar
• ——— (2011), Handbook of Markov Chain Monte Carlo, Boca Raton, FL: CRC Press, pp. 113–162.
   Google Scholar
• Polyak, B. T., and Juditsky, A. B. (1992), “Acceleration of Stochastic Approximation by Averaging,” SIAM Journal on Control and Optimization, 30, 838–855.
   Web of Science ®Google Scholar
• Potts, R. B. (1952), “Some Generalized Order-Disorder Transformations,” in Mathematical Proceedings of the Cambridge Philosophical Society (Vol. 48), Cambridge Univ. Press, pp. 106–109.
   Web of Science ®Google Scholar
• Robbins, H., and Monro, S. (1951), “A Stochastic Approximation Method,” The Annals of Mathematical Statistics, 22, 400–407.
   Google Scholar
• Robert, C. P., and Casella, G. (2004), Monte Carlo Statistical Methods (Springer Texts in Statistics, 2nd ed.), New York: Springer.
   Google Scholar
• Roberts, G. O., and Rosenthal, J. S. (2001), “Optimal Scaling for Various Metropolis-Hastings Algorithms,” Statistical Science, 16, 351–367.
   Web of Science ®Google Scholar
• Roberts, G. O., and Tweedie, R. L. (1996), “Exponential Convergence of Langevin Distributions and their Discrete Approximations,” Bernoulli, 2, 341–363.
   Google Scholar
• Robins, G., Pattison, P., Kalish, Y., and Lusher, D. (2007), “An Introduction to Exponential Random Graph (p*) Models for Social Networks,” Social Networks, 29, 173–191.
   Web of Science ®Google Scholar
• Ruppert, D. (1988), “Efficient Estimations from a Slowly Convergent Robbins-Monro Process,” Technical Report, Cornell University Operations Research and Industrial Engineering, Technical Report No. 781.
   Google Scholar
• Stoehr, J., and Friel, N. (2015), “Calibration of Conditional Composite Likelihood for Bayesian Inference on Gibbs Random Fields,” in JMLR W&CP: Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics (Vol. 38), pp. 921–929.
   Google Scholar
• Stoehr, J., Pudlo, P., and Friel, N. (2016), “GiRaF: A Toolbox for Gibbs Random Fields Analysis,” R Package Version 1.0.
   Google Scholar
• Tierney, L. (1998), “A Note on Metropolis-Hastings Kernels for General State Spaces,” The Annals of Applied Probability, 8, 1–9.
   Web of Science ®Google Scholar
• Zachary, W. W. (1977), “An Information Flow Model for Conflict and Fission in Small Groups,” Journal of Anthropological Research, 33, 452–473.
   Web of Science ®Google Scholar