Expectation Propagation for Likelihood-Free Inference

REFERENCES

• Andrieu, C., Doucet, A., and Holenstein, R. (2010), “Particle Markov Chain Monte Carlo Methods,” Journal of the Royal Statistical Society, Series B, 72, 269–342.
   Google Scholar
• Andrieu, C., Doucet, A., and Tadic, V. (2005), “On-Line Parameter Estimation in General State-Space Models,” 44th IEEE Conference on Decision and Control, 2005 and 2005 European Control Conference. CDC-ECC’05, pp. 332–337.
   Google Scholar
• Bazin, E., Dawson, K., and Beaumont, M. (2010), “Likelihood-Free Inference of Population Structure and Local Adaptation in a Bayesian Hierarchical Model,” Genetics, 185, 587–602.
   PubMedGoogle Scholar
• Beaumont, M.A. (2010), “Approximate Bayesian Computation in Evolution and Ecology,” Annual Review of Ecology, Evolution, and Systematics, 41, 379–406.
   Web of Science ®Google Scholar
• Beaumont, M.A., Zhang, W., and Balding, D. (2002), “Approximate Bayesian Computation in Population Genetics,” Genetics, 162, 2025–2035.
   PubMed Web of Science ®Google Scholar
• Bishop, C. (2006), Pattern Recognition and Machine Learning, New York: Springer.
   Google Scholar
• Blum, M. G.B. (2010), “Approximate Bayesian Computation: A Nonparametric Perspective,” Journal of the American Statistical Association, 105, 1178–1187.
   Web of Science ®Google Scholar
• Bogacz, R., Usher, M., Zhang, J., and McClelland, J.L. (2007), “Extending a Biologically Inspired Model of Choice: Multi-Alternatives, Nonlinearity and Value-Based Multidimensional Choice,” Philosophical Transactions of the Royal Society B: Biological Sciences, 362, 1655–1670.
   PubMedGoogle Scholar
• Bollerslev, T. (1986), “Generalized Autoregressive Conditional Heteroskedasticity,” Journal of Econometrics, 31, 307–327.
   Web of Science ®Google Scholar
• Boyen, X., and Koller, D. (1998), “Tractable Inference for Complex Stochastic Processes,” in Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, Burlington, MA: Morgan Kaufmann Publishers Inc., pp. 33–42.
   Google Scholar
• Boys, R., Wilkinson, D., and Kirkwood, T. (2008), “Bayesian Inference for a Discretely Observed Stochastic Kinetic Model,” Statistics and Computing, 18, 125–135.
   Web of Science ®Google Scholar
• Brascamp, J.W., van Ee, R., Noest, A.J., Jacobs, R.H., and Berg, A.V. (2006), “The Time Course of Binocular Rivalry Reveals a Fundamental Role of Noise,” Journal of Vision, 6, 1244–1256.
   PubMed Web of Science ®Google Scholar
• Calvet, L., and Czellar, V. (2011), “State-Observation Sampling and the Econometrics of Learning Models,” Cahier de Recherche du Groupe HEC, 947.
   Google Scholar
• Chambers, J., Mallows, C., and Stuck, B. (1976), “A Method for Simulating Stable Random Variables,” Journal of the American Statistical Association, 71, 340–344.
   Web of Science ®Google Scholar
• Davison, A., Padoan, S.A., and Ribatet, M. (2012), “Statistical Modeling of Spatial Extremes,” Statistical Science, 27, 161–186.
   Web of Science ®Google Scholar
• Dean, T., Singh, S., Jasra, A., and Peters, G. (2011), “Parameter Estimation for Hidden Markov Models With Intractable Likelihoods,” Technical Report No. 660, Engineering Department, Cambridge University.
   Google Scholar
• Diggle, P., and Gratton, R. (1984), “Monte Carlo Methods of Inference for Implicit Statistical Models,” Journal of the Royal Statistical Society, Series B, 46, 193–227.
   Google Scholar
• Fearnhead, P., and Prangle, D. (2012), “Constructing Summary Statistics for Approximate Bayesian Computation: Semi-Automatic Approximate Bayesian Computation,” Journal of the Royal Statistical Society, Series B, 74, 1–28.
   Google Scholar
• Gelfand, A., and Dey, D. (1994), “Bayesian Model Choice: Asymptotics and Exact Calculations,” Journal of the Royal Statistical Society, Series B, 56, 501–514.
   Google Scholar
• Gentle, J. (2003), Random Number Generation and Monte Carlo Methods, New York: Springer-Verlag.
   Google Scholar
• Gerstner, W., and Kistler, W.M. (2002), Spiking Neuron Models: Single Neurons, Populations, Plasticity (1st ed.), Cambridge: Cambridge University Press.
   Google Scholar
• Gillespie, D.T. (1977), “Exact Stochastic Simulation of Coupled Chemical Reactions,” The Journal of Physical Chemistry, 81, 2340–2361.
   Web of Science ®Google Scholar
• Golightly, A., and Wilkinson, D. J. (2011), “Bayesian Parameter Inference for Stochastic Biochemical Network Models Using Particle Markov Chain Monte Carlo,” Interface Focus, 1, 807–820.
   PubMed Web of Science ®Google Scholar
• Holenstein, R. (2009), “Particle Markov Chain Monte Carlo,” . Ph.D. dissertation, University of British Columbia.
   Google Scholar
• Jasra, A., Singh, S., Martin, J., and McCoy, E. (2012), “Filtering Via Approximate Bayesian Computation,” Statistics and Computing, 22, 1223–1237.
   Web of Science ®Google Scholar
• Kim, S., Shephard, N., and Chib, S. (1998), “Stochastic Volatility: Likelihood Inference and Comparison With ARCH Models,” The Review of Economic Studies, 65, 361–393.
   Web of Science ®Google Scholar
• Kong, A., Liu, J.S., and Wong, W.H. (1994), “Sequential Imputations and Bayesian Missing Data Problems,” Journal of the American Statistical Association, 89, 278–288.
   Web of Science ®Google Scholar
• Lauritzen, S.L. (1992), “Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models,” Journal of the American Statistical Association, 87, 1098–1108.
   Web of Science ®Google Scholar
• Liu, S., and Brorsen, B. (1995), “Maximum Likelihood Estimation of a GARCH-Stable Model,” Journal of Econometrics, 10, 273–285.
   Google Scholar
• Luce, D.R. (1991), Response Times: Their Role in Inferring Elementary Mental Organization (Oxford Psychology Series), USA: Oxford University Press.
   Google Scholar
• Marjoram, P., Molitor, J., Plagnol, V., and Tavaré, S. (2003), “Markov Chain Monte Carlo Without Likelihoods,” Proceedings of the National Academy of Sciences of the United States, 100, 15324–15328.
   PubMed Web of Science ®Google Scholar
• Maybeck, P. S. (1982), Stochastic Models, Estimation, and Control, Waltham, MA: Academic Press.
   Google Scholar
• Mengersen, K.L., Pudlo, P., and Robert, C.P. (2013), “Bayesian Computation Via Empirical Likelihood,” Proceedings of the National Academy of Sciences, 110, 1321–1326.
   PubMed Web of Science ®Google Scholar
• Menn, C., and Rachev, S. (2005), “A GARCH Option Pricing Model With Alpha-Stable Innovations,” European Journal of Operational Research, 163, 201–209.
   Google Scholar
• Meyer, D.E., Osman, A.M., Irwin, D.E., and Yantis, S. (1988), “Modern Mental Chronometry,” Biological Psychology, 26, 3–67.
   PubMed Web of Science ®Google Scholar
• Minka, T. (2001a), “Expectation Propagation for Approximate Bayesian Inference,” Proceedings of Uncertainty in Artificial Intelligence, 17, 362–369.
   Google Scholar
• Minka, T. (2001b), “A Family of Algorithms for Approximate Bayesian Inference,” . Ph.D. dissertation, MIT Media Lab.
   Google Scholar
• Minka, T. (2004), “Power EP,” . Technical Report No. MSR-TR-2004-149, Department of Statistics, Carnegie Mellon University, Pittsburgh, PA.
   Google Scholar
• Minka, T. (2005), “Divergence Measures and Message Passing,” . Technical Report No. MSR-TR-2005-173, Microsoft Research Ltd., Cambridge, UK.
   Google Scholar
• Mittnik, S., Paolella, M., and Rachev, S. (2000), “Diagnosing and Treating the Fat Tails in Financial Returns Data,” Journal of Empirical Finance, 7, 389–416.
   Google Scholar
• Nolan, J. P. (2013), Stable Distributions—Models for Heavy Tailed Data, Boston, MA: Birkhauser. Available at academic2.american.edu/∼jpnolan.
   Google Scholar
• Nuthmann, A., Smith, T.J., Engbert, R., and Henderson, J.M. (2010), “CRISP: A Computational Model of Fixation Durations in Scene Viewing,” Psychological Review, 117, 382–405.
   PubMed Web of Science ®Google Scholar
• Opper, M., and Winther, O. (1999), “A Bayesian Approach to On-line Learning,” in On-line Learning in Neural Networks, ed. D. Saad, Cambridge: Cambridge University Press, pp. 363–378.
   Google Scholar
• Paquet, U., Winther, O., and Opper, M. (2009), “Perturbation Corrections in Approximate Inference: Mixture Modelling Applications,” Journal of Machine Learning Research, 10, 1263–1304.
   Google Scholar
• Peters, G., Sisson, S., and Fan, Y. (2012), “Likelihood-Free Bayesian Inference for α-Stable Models,” Computational Statistics and Data Analysis, 56, 3743–3756.
   Web of Science ®Google Scholar
• Pritchard, J., Seielstad, M., Perez-Lezaun, A., and Feldman, M. (1999), “Population Growth of Human Y Chromosomes: A Study of Y Chromosome Microsatellites,” Molecular Biology and Evolution, 16, 1791–1798.
   PubMed Web of Science ®Google Scholar
• Ratcliff, R. (1978), “A Theory of Memory Retrieval,” Psychological Review, 85, 59–108.
   Web of Science ®Google Scholar
• Ratcliff, R., and McKoon, G. (2008), “The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks,” Neural Computation, 20, 873–922.
   PubMed Web of Science ®Google Scholar
• Rubin, D. (1984), “Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician,” Journal of the American Statistical Association, 12, 1151–1172.
   Google Scholar
• Rue, H., Martino, S., and Chopin, N. (2009), “Approximate Bayesian Inference for Latent Gaussian Models by Using Integrated Nested Laplace Approximations,” Journal of the Royal Statistical Society, Series B, 71, 319–392.
   Web of Science ®Google Scholar
• Schervish, M.J. (1995), Theory of Statistics, New York: Springer-Verlag.
   Google Scholar
• Seeger, M. (2005), “Expectation Propagation for Exponential Families,” . Technical Report, Univ. California Berkeley. Available at http://ipg.epfl.ch/∼seeger/lapmalmainweb/papers/epexpfam.pdf.
   Google Scholar
• Tavaré, S., Balding, D., Griffiths, R., and Donnelly, P. (1997), “Inferring Coalescence Times From DNA Sequence Data,” Genetics, 145, 505–518.
   PubMed Web of Science ®Google Scholar
• Titterington, M. (2011), “The EM Algorithm, Variational Approximations, and Expectation Propagation for Mixtures,” in Mixtures: Estimation and Applications (Vol. 896, Chap. 1), eds. K. Mengersen, C. Robert, and M. Titterington, New York: Wiley.
   Google Scholar
• Toni, T., Welch, D., Strelkowa, N., Ipsen, A., and Stumpf, M. P.H. (2009), “Approximate Bayesian Computation Scheme for Parameter Inference and Model Selection in Dynamical Systems,” Journal of The Royal Society Interface, 6, 187–202.
   PubMed Web of Science ®Google Scholar
• Train, K.E. (2003), Discrete Choice Methods With Simulation, Cambridge: Cambridge University Press.
   Google Scholar
• Varin, C., Reid, N., and Firth, D. (2011), “An Overview of Composite Likelihood Methods,” Statistica Sinica, 21, 5–42.
   Web of Science ®Google Scholar
• Wang, B., and Titterington, D. (2005), “Inadequacy of Interval Estimates Corresponding to Variational Bayesian Approximations,” Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, pp. 373–380.
   Google Scholar
• Wichmann, F.A., and Hill, N.J. (2001), “The Psychometric Function: I. Fitting, Sampling, and Goodness of Fit,” Perception and Psychophysics, 63, 1293–1313.
   PubMed Web of Science ®Google Scholar
• Wilkinson, R. (2008), “Approximate Bayesian Computation (ABC) Gives Exact Results Under the Assumption of Model Error,” . arXiv:0811.3355.
   Google Scholar