An Adaptive Exchange Algorithm for Sampling From Distributions With Intractable Normalizing Constants

REFERENCES

• Andrews, D., and Herzberg, A. (1985), Data, New York: Springer.
   Google Scholar
• Andrieu, C., Doucet, A., and Holenstein, R. (2010), Particle Markov Chain Monte Carlo Methods, Journal of the Royal Statistical Society, Series B, 72, 269–342.
   Google Scholar
• Andrieu, C., and Moulines, E. (2006), On the Ergodicity Properties of Some Adaptive MCMC Algorithms, Annals of Applied Probability, 16, 1462–1505.
   Web of Science ®Google Scholar
• Andrieu, C., Moulines, E., and Priouret, P. (2005), Stability of Stochastic Approximation Under Verifiable Conditions, SIAM Journal of Control and Optimization, 44, 283–312.
   Web of Science ®Google Scholar
• Andrieu, C., and Roberts, G. (2009), The Pseudo-Marginal Approach for Efficient Monte Carlo Computations, Annals of Statistics, 37, 697–725.
   Web of Science ®Google Scholar
• Atchade, Y.F., Lartillot, N., and Robert, C.P. (2013), Bayesian Computation for Intractable Normalizing Constants, Brazilian Journal of Statistics, 27, 416–436.
   Web of Science ®Google Scholar
• Atchade, Y.F., and Liu, J.S. (2010), The Wang-Landau Algorithm in General State Spaces: Applications and Convergence Analysis, Statistica Sinica, 20, 209–233.
   Web of Science ®Google Scholar
• Balram, N., and Moura, J. (1993), Noncausal Gauss Markov Random Fields: Parameter Structure and Estimation, IEEE Transactions on Information Theory, 39, 1333–1355.
   Web of Science ®Google Scholar
• Beaumont, M.A., Zhang, W., and Balding, D.J. (2002), Approximate Bayesian Computation in Population Genetics, Genetics, 162, 2025–2035.
   PubMed Web of Science ®Google Scholar
• Besag, J.E. (1974), Spatial Interaction and the Statistical Analysis of Lattice Systems” (), Journal of the Royal Statistical Society, Series B, 36, 192–236.
   Google Scholar
• Besag, J.E., and Moran, P. (1975), On the Estimation and Testing of Spatial Interaction in Gaussian Lattice Processes, Biometrika, 62, 555–562.
   Web of Science ®Google Scholar
• Caimo, A., and Friel, N. (2011), Bayesian Inference for Exponential Random Graph Models, Social Networks, 33, 41–55.
   Web of Science ®Google Scholar
• Chang, M. (2011), Modern Issues and Methods in Biostatistics, New York: Springer.
   Google Scholar
• Childs, A.M., Patterson, R.B., and MacKay, D.J. (2001), Exact Sampling From Non-Attractive Distributions Using Summary States, Physics Review E, 63, 036113.
   Web of Science ®Google Scholar
• Everitt, R.G. (2012), Bayesian Parameter Estimation for Latent Markov Random Fields and Social Networks, Journal of Computational and Graphical Statistics, 21, 940–960.
   Web of Science ®Google Scholar
• Ferguson, T.S. (1996), A Course in Large Sample Theory, New York: Chapman & Hall.
   Google Scholar
• Fort, G., Moulines, E., and Priouret, P. (2011), Convergence of Adaptive and Interacting Markov Chain Monte Carlo Algorithms, Annals of Statistics, 39, 3262–3289.
   Web of Science ®Google Scholar
• Gelman, A., and Rubin, D. (1992), Inference From Iterative Simulation Using Multiple Sequences (, Statistical Science, 7, 457–511.
   Google Scholar
• Geyer, C. J. (1991), “Markov Chain Monte Carlo Maximum Likelihood,” in Computer Science and Statistics: Proceedings of the 23rd Symposium on the Interface, eds. E. Keramidas and S. M. Kauffman, Fairfax Station, VA: Interface Foundation, pp. 156–163.
   Google Scholar
• Geyer, C.J., and Thompson, E.A. (1992), Constrained Monte Carlo Maximum Likelihood for Dependent Data, Journal of the Royal Statistical Society, Series B, 54, 657–699.
   Google Scholar
• Green, P.J. (1995), Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination, Biometrika, 82, 711–732.
   Web of Science ®Google Scholar
• Gu, M., and Zhu, H. (2001), Maximum Likelihood Estimation for Spatial Models by Markov Chain Monte Carlo Stochastic Approximation, Journal of the Royal Statistical Society, Series B, 63, 339–355.
   Google Scholar
• Haario, H., Saksman, E., and Tamminen, J. (2001), An Adaptive Metropolis Algorithm, Bernoulli, 7, 223–242.
   Web of Science ®Google Scholar
• Huang, F., and Ogata, Y. (1999), Improvements of the Maximum Pesudo-Likelihood Estimators in Various Spatial Statistical Models, Journal of Computational and Graphical Statistics, 8, 510–530.
   Web of Science ®Google Scholar
• Hukushima, K., and Nemoto, K. (1996), Exchange Monte Carlo Method and Application to Spin Glass Simulations, Journal of the Physical Society of Japan, 65, 1604–1608.
   Web of Science ®Google Scholar
• Hurn, M. A., Husby, O. K., and Rue, H. (2003), “A Tutorial on Image Analysis,” in Spatial Statistics and Computational Methods: Lecture Notes in Statistics (Vol. 173), New York: Springer, pp. 87–141.
   Google Scholar
• Jin, I.H., and Liang, F. (2014), Use of SAMC for Bayesian Analysis of Statistical Models With Intractable Normalizing Constants, Computational Statistics and Data Analysis, 71, 402–416.
   Web of Science ®Google Scholar
• Liang, F. (2007), Continuous Contour Monte Carlo for Marginal Density Estimation With an Application to a Spatial Statistical Models, Journal of Computational and Graphical Statistics, 16, 608–632.
   Web of Science ®Google Scholar
• ——— (2009), Improving SAMC Using Smoothing Methods: Theory and Applications to Bayesian Model Selection Problems, Annals of Statistics, 37, 2626–2654.
   Web of Science ®Google Scholar
• ——— (2010), A Double Metropolis-Hastings Sampler for Spatial Models With Intractable Normalizing Constants, Journal of Statistical Computing and Simulation, 80, 1007–1022.
   Web of Science ®Google Scholar
• Liang, F., and Jin, I.H. (2013), A Monte Carlo Metropolis-Hastings Algorithm for Sampling From Distributions With Intractable Normalizing Constants, Neural Computation, 25, 2199–2234.
   PubMed Web of Science ®Google Scholar
• Liang, F., Liu, C., and Carroll, R.J. (2007), Stochastic Approximation in Monte Carlo Computation, Journal of American Statistical Association, 102, 305–320.
   Web of Science ®Google Scholar
• ——— (2010), Advanced Markov Chain Monte Carlo Methods: Learning from Past Samples, Chichester: Wiley.
   Google Scholar
• Liang, F., and Wong, W.H. (2001), Real-Parameter Evolutionary Sampling With Applications in Bayesian Mixture Models, Journal of the American Statistical Association, 96, 653–666.
   Web of Science ®Google Scholar
• Lin, F. (2014), Split-and-Merge Strategies for Big Data Analysis, Ph.D dissertation, Department of Statistics, Texas A&M University.
   Google Scholar
• Lyne, A., Girolami, M., Atchade, Y., Strathmann, H., and Simpson, D. (2014), Playing Russian Roulette With Intractable Likelihoods, arXv:1306.4032v2.
   Google Scholar
• Martin, R., Zhang, J. and Liu, C.2010
   Google Scholar
• Møller, J., Pettitt, A.N., Reeves, R.W., and Berthelsen, K.K. (2006), An Efficient Markov Chain Monte Carlo Method for Distributions With Intractable Normalising Constants, Biometrika, 93, 451–459.
   Web of Science ®Google Scholar
• Murray, I., Ghahramani, Z., and MacKay, D. J. (2006), “MCMC for Doubly-Intractable Distributions,” in Proceedings of 22nd Annual Conference on Uncertainty in Artificial Intelligence (UAI), eds. R. Dechter and T. S. Richardson, Cambridge, MA: AUAI Press, pp. 359–366.
   Google Scholar
• Neal, R. (1998), Annealed Importance Sampling, Statistics and Computing, 11, 125–139.
   Web of Science ®Google Scholar
• Plummer, M., Best, N., Cowles, K., Vines, K., Sarkar, D., Almond, R. (2012), Coda: Output Analysis and Diagnostics for Markov Chain Monte Carlo Simulations, R Package. Available at http://cran.r–project.org
   Google Scholar
• Preisler, H.K. (1993), Modeling Spatial Patterns of Trees Attacked by Bark-Beetles, Applied Statistics, 42, 501–514.
   Web of Science ®Google Scholar
• Propp, J.G., and Wilson, D.B. (1996), Exact Sampling With Coupled Markov Chains and Applications to Statistical Mechanics, Random Structures and Algorithms, 9, 223–252.
   Web of Science ®Google Scholar
• Riggan, W. B., Creason, J. P., Nelson, W. C., Manton, K. G., Woodbury, M. A., Stallard, E., Pellom, A. C., and Beaubier, J. (1987), U.S. Cancer Mortality Rates and Trends, 1950–1979 (Vol. IV: Maps), Washington, D.C.: U.S. Government Printing Office.
   Google Scholar
• Roberts, G.O., and Rosenthal, J.S. (2007), Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms, Journal of Applied Probability, 44, 458–475.
   Web of Science ®Google Scholar
• Roberts, G.O., and Tweedie, R.L. (1996), Geometric Convergence and Central Limit Theorems for Multidimensional Hastings and Metropolis Algorithms, Biometrika, 83, 95–110.
   Web of Science ®Google Scholar
• Rosenthal, J.S. (1995), Minorization Conditions and Convergence Rate for Markov Chain Monte Carlo, Journal of American Statistical Association, 90, 558–566.
   Web of Science ®Google Scholar
• Sherman, M., Apanasovich, T.V., and Carroll, R.J. (2006), On Estimation in Binary Autologistic Spatial Models, Journal of Statistical Computation and Simulation, 76, 167–179.
   Web of Science ®Google Scholar
• Snijders, T.A., Pattison, P.E., Robins, G.L., and Handcock, M.S. (2006), New Specification for Exponential Random Graph Models, Sociological Methodology, 36, 99–153.
   Web of Science ®Google Scholar