Variational Bayes With Intractable Likelihood

References

• Amari, S. (1998), “Natural Gradient Works Efficiently in Learning,” Neural Computation, 10, 251–276.
   Web of Science ®Google Scholar
• Andrieu, C., and Roberts, G. (2009), “The Pseudo-Marginal Approach for Efficient Monte Carlo Computations,” The Annals of Statistics, 37, 697–725.
   Web of Science ®Google Scholar
• Beaumont, M. A. (2003), “Estimation of Population Growth or Decline in Genetically Monitored Populations,” Genetics, 164, 1139–1160.
   PubMed Web of Science ®Google Scholar
• Bishop, C. M. (2006), Pattern Recognition and Machine Learning, New York: Springer.
   Google Scholar
• Deligiannidis, G., Doucet, A., and Pitt, M. (2016), “The Correlated Pseudo-Marginal Method,” Technical Report. arXiv:1511.04992v3.
   Google Scholar
• Dick, J., and Pillichshammer, F. (2010), Digital Nets and Sequences. Discrepancy Theory and Quasi-Monte Carlo Integration, Cambridge: Cambridge University Press.
   Google Scholar
• Doucet, A., Pitt, M. K., Deligiannidis, G., and Kohn, R. (2015), “Efficient Implementation of Markov Chain Monte Carlo When Using an Unbiased Likelihood Estimator,” Biometrika, 102, 295–313.
   Web of Science ®Google Scholar
• Durbin, J., and Koopman, S. J. (1997), “Monte Carlo Maximum Likelihood Estimation for Non-Gaussian State Space Models,” Biometrika, 84, 669–684.
   Web of Science ®Google Scholar
• ——— (2001), Time Series Analysis by State Space Methods, Oxford: Oxford University Press.
   Google Scholar
• Fitzmaurice, G. M., and Laird, N. M. (1993), “A Likelihood-Based Method for Analysing Longitudinal Binary Responses,” Biometrika, 80, 141–151.
   Web of Science ®Google Scholar
• Fitzmaurice, G. M., Laird, N. M., and Ware, J. H. (2011), Applied Longitudinal Analysis (2nd ed.), Hoboken, NJ: Wiley.
   Google Scholar
• Flury, T., and Shephard, N. (2011), “Bayesian Inference Based Only on Simulated Likelihood: Particle Filter Analysis of Dynamic Economic Models,” Econometric Theory, 1, 1–24.
   Google Scholar
• Ghahramani, Z., and Hinton, G. E. (2000), “Variational Learning for Switching State-Space Models,” Neural Computation, 12, 831–864.
   PubMed Web of Science ®Google Scholar
• Haario, H., Saksman, E., and Tamminen, J. (2001), “An Adaptive Metropolis Algorithm,” Bernoulli, 7, 223–242.
   Web of Science ®Google Scholar
• Hoffman, M. D., Blei, D. M., Wang, C., and Paisley, J. (2013), “Stochastic Variational Inference,” Journal of Machine Learning Research, 14, 1303–1347.
   Web of Science ®Google Scholar
• Honkela, A., Raiko, T., Kuusela, M., Tornio, M., and Karhunen, J. (2010), “Approximate Riemannian Conjugate Gradient Learning for Fixed-Form Variational Bayes,” Journal of Machine Learning Research, 11, 3235–3268.
   Web of Science ®Google Scholar
• Kim, S., Shephard, N., and Chib, S. (1998), “Stochastic Volatility: Likelihood Inference and Comparison With Arch Models,” The Review of Economic Studies, 65, 361–393.
   Web of Science ®Google Scholar
• Neville, S. E., Ormerod, J. T., and Wand, M. P. (2014), “Mean Field Variational Bayes for Continuous Sparse Signal Shrinkage: Pitfalls and Remedies,” Electronic Journal of Statistics, 8, 1113–1151.
   Web of Science ®Google Scholar
• Nolan, J. (2007), Stable Distributions: Models for Heavy-Tailed Data, Boston: Birkhauser.
   Google Scholar
• Nott, D. J., Tan, S., Villani, M., and Kohn, R. (2012), “Regression Density Estimation With Variational Methods and Stochastic Approximation,” Journal of Computational and Graphical Statistics, 21, 797–820.
   Web of Science ®Google Scholar
• Ormerod, J. T., and Wand, M. P. (2012), “Gaussian Variational Approximate Inference for Generalized Linear Mixed Models,” Journal of Computational and Graphical Statistics, 21, 2–17.
   Web of Science ®Google Scholar
• Owen, A. (1997), “Monte Carlo Variance of Scrambled Net Quadrature,” SIAM Journal on Numerical Analysis, 34, 1884–1910.
   Web of Science ®Google Scholar
• Paisley, J., Blei, D., and Jordan, M. (2012), “Variational Bayesian Inference With Stochastic Search,” in International Conferenceon Machine Learning, Edinburgh, Scotland, UK, pp. 1367–1374.
   Google Scholar
• Peters, G., Sisson, S., and Fan, Y. (2012), “Likelihood-Free Bayesian Inference for α-Stable Models,” Computational Statistics & Data Analysis, 56, 3743–3756.
   Web of Science ®Google Scholar
• Pitt, M. K., Silva, R. S., Giordani, P., and Kohn, R. (2012), “On Some Properties of Markov Chain Monte Carlo Simulation Methods Based on the Particle Filter,” Journal of Econometrics, 171, 134–151.
   Web of Science ®Google Scholar
• Ranganath, R., Gerrish, S., and Blei, D. M. (2014), “Black Box Variational Inference,” in International Conference on Artificial Intelligence and Statistics (Vol. 33), Iceland: Reykjavik, pp. 814–822.
   Google Scholar
• Sacks, J. (1958), “Asymptotic Distribution of Stochastic Approximation Procedures,” The Annals of Mathematical Statistics, 29, 373–405.
   Google Scholar
• Salimans, T., and Knowles, D. A. (2013), “Fixed-Form Variational Posterior Approximation Through Stochastic Linear Regression,” Bayesian Analysis, 8, 741–908.
   PubMed Web of Science ®Google Scholar
• Shephard, N., and Pitt, M. K. (1997), “Likelihood Analysis of Non-Gaussian Measurement Time Series,” Biometrika, 84, 653–667.
   Web of Science ®Google Scholar
• Stan Development Team (2016), “The Stan C++ Library,” Version 2.14.0.
   Google Scholar
• Tan, L. S. L., and Nott, D. J. (2013), “Variational Inference for Generalized Linear Mixed Models Using Partially Noncentered Parametrizations,” Statistical Science, 28, 168–188.
   Web of Science ®Google Scholar
• Tavare, S., Balding, D. J., Griffiths, R. C., and Donnelly, P. (1997), “Inferring Coalescence Times From DNA Sequence Data,” Genetics, 145, 505–518.
   PubMed Web of Science ®Google Scholar
• Tran, M.-N., Kohn, R., Quiroz, M., and Villani, M. (2016), “Block-Wise Pseudo-Marginal Metropolis-Hastings,” Technical Report. arXiv:1603.02485.
   Google Scholar
• Tran, M.-N., Scharth, M., Pitt, M. K., and Kohn, R. (2013), “Importance Sampling Squared for Bayesian Inference in Latent Variable Models,” available at http://arxiv.org/abs/1309.3339.
   Google Scholar
• Turner, R. E., and Sahani, M. (2011), “Two Problems With Variational Expectation Maximisation for Time-Series Models,” in Bayesian Time Series Models, eds. D. Barber, A. T. Cemgil, and S. Chiappa, Cambridge: Cambridge University Press, pp. 109–130.
   Google Scholar