Bayesian Inference in Common Microeconometric Models With Massive Datasets by Double Marginalized Subsampling

References

• Albert, J. H., and Chib, S. (1993), “Bayesian Analysis of Binary and Polychotomous Response Data,” Journal of the American Statistical Association, 88, 669–679. DOI: 10.1080/01621459.1993.10476321.
   Web of Science ®Google Scholar
• Andrieu, C., and Roberts, G. O. (2009), “The Pseudo-Marginal Approach for Efficient Monte Carlo Computations,” The Annals of Statistics, 37, 697–725. DOI: 10.1214/07-AOS574.
   Web of Science ®Google Scholar
• Azzalini, A., and Dalla Valle, A. (1996), “The Multivariate Skew-Normal Distribution,” Biometrika, 4, 715–726. DOI: 10.1093/biomet/83.4.715.
   Google Scholar
• Balakrishnan, S., and Madigan, D. (2006), “A One-Pass Sequential Monte Carlo Method for Bayesian Analysis of Massive Datasets,” Bayesian Analysis, 1, 345–362. DOI: 10.1214/06-BA112.
   Web of Science ®Google Scholar
• Banterle, M., Crazian, C., Lee, A., and Robert, C. (2019), “Accelerating Metropolis-Hastings Algorithms by Delayed Acceptance,” Foundations of Data Science, 1, 103–128. DOI: 10.3934/fods.2019005.
   Google Scholar
• Bardenet, R., Doucet, A., and Holmes, C. (2017), “On Markov Chain Monte Carlo Methods for Tall Data,” Journal of Machine Learning Research, 18, 1–43.
   Web of Science ®Google Scholar
• Bierkens, J., Fearnhead, P., and Roberts, G. (2019), “The Zig-Zag Process and Super-Efficient Sampling for Bayesian Analysis of Big Data,” The Annals of Statistics, 47, 1288–1320. DOI: 10.1214/18-AOS1715.
   Web of Science ®Google Scholar
• Blei, D. M., Kucukelbir, A., and McAuliffe, J. D. (2017), “Variational Inference: A Review for Statisticians,” Journal of the American Statistical Association, 112, 859–877. DOI: 10.1080/01621459.2017.1285773.
   Web of Science ®Google Scholar
• Carter, C. K., and Kohn, R. (1994), “On Gibbs Sampling for State Space Models,” Biometrika, 81, 541–553. DOI: 10.1093/biomet/81.3.541.
   Web of Science ®Google Scholar
• Celeux, G., Hurn, M., and Robert, C. P. (2000), “Computational and Inferential Difficulties With Mixture Posterior Distributions,” Journal of the American Statistical Association, 95, 957–970. DOI: 10.1080/01621459.2000.10474285.
   Web of Science ®Google Scholar
• Celeux, G., Kamary, K., Malsiner-Walli, G., Marin, J.-M., and Robert, C. P. (2019), “Computational Solutions for Bayesian Inference in Mixture models,” in Handbook of Mixture Analysis, (Eds.), S. Fruhwirth-Schnatter, G. Celeux, and C. P. Robert, New York: Chapman and Hall.
   Google Scholar
• Chib, S. (1992), “Bayesian Inference in the Tobit Censored Regression Mode,” Journal of Econometrics, 51, 79–99. DOI: 10.1016/0304-4076(92)90030-U.
   Web of Science ®Google Scholar
• Chib, S., and Carlin, B. P. (1999), “On MCMC Sampling in Hierarchical Longitudinal Models,” Statistics and Computing, 9, 17–26. DOI: 10.1023/A:1008853808677.
   Web of Science ®Google Scholar
• Cogley, T., and Sargent, T. J. (2005), “Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S,” Review of Economic Dynamics, 8, 262–302. DOI: 10.1016/j.red.2004.10.009.
   Web of Science ®Google Scholar
• Creal, D. (2012), “A Survey of Sequential Monte Carlo Methods for Economics and Finance,” Econometric Reviews, 31, 245–296. DOI: 10.1080/07474938.2011.607333.
   Web of Science ®Google Scholar
• Deligiannidis, G., Doucet, A., and Pitt, M. (2018), “The Correlated Pseudo-Marginal Method,” Journal of the Royal Statistical Society, Series B, 80, 839–870. DOI: 10.1111/rssb.12280.
   Google Scholar
• Durbin, J., and Koopman, S. J. (2002), “A Simple and Efficient Simulation Smoother for State Space Time Series Analysis,” Biometrika, 89, 603–615. DOI: 10.1093/biomet/89.3.603.
   Web of Science ®Google Scholar
• Gelfand, A. E., and Smith, A. F. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398–409. DOI: 10.1080/01621459.1990.10476213.
   Web of Science ®Google Scholar
• Geweke, J. (2007), “Interpretation and Inference in Mixture Models: Simple MCMC Works,” Computational Statistics & Data Analysis, 51, 3529–3550.
   Web of Science ®Google Scholar
• Geweke, J., and Durham, G. (2019), “Sequentially Adaptive Bayesian Learning Algorithms for Inference and Optimization,” Journal of Econometrics, 210, 4–25. DOI: 10.1016/j.jeconom.2018.11.002.
   Web of Science ®Google Scholar
• Hastings, W. K. (1970), “Monte Carlo Sampling Methods Using Markov Chains and their Applications,” Biometrika, 57, 97–109. DOI: 10.1093/biomet/57.1.97.
   Web of Science ®Google Scholar
• Heckman, J. J. (1979), “Sample Selection Bias as a Specification Error,” Econometrica, 47, 153–161. DOI: 10.2307/1912352.
   Web of Science ®Google Scholar
• Holmes, C. C., and Held, L. (2006), “Bayesian Auxiliary Variable Models for Binary and Multinomial Regression,” Bayesian Analysis, 1, 146–168. DOI: 10.1214/06-BA105.
   Web of Science ®Google Scholar
• Jacquier, E., Polson, N. G., and Rossi, P. E. (1994), “Bayesian Analysis of Stochastic Volatility Models,” Journal of Business and Economic Statistics, 20, 69–87. DOI: 10.1198/073500102753410408.
   Google Scholar
• Jasra, A., Holmes, C. C., and Stephens, D. A. (2005), “Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling,” Statistical Science, 20, 50–67. DOI: 10.1214/088342305000000016.
   Web of Science ®Google Scholar
• Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., and Saul, L. K. (1999), “An Introduction to Variational Methods for Graphical Models,” Machine Learning, 37, 183–233. DOI: 10.1023/A:1007665907178.
   Web of Science ®Google Scholar
• Koop, G., Poirier, D. J., and Tobias, J. L. (2007), Bayesian Econometric Methods. Cambridge: Cambridge University Press.
   Google Scholar
• Koopman, S. J., and Uspensky, E. H. (2002), “The Stochastic Volatility in Mean Model: Empirical Evidence From International Stock Market,” Journal of Applied Econometrics, 17, 667–689. DOI: 10.1002/jae.652.
   Web of Science ®Google Scholar
• Korattikara, A., Chen, Y., and Welling, M. (2014), “Austerity in MCMC Land: Cutting the Metropolis-Hastings Budget,” Proceedings of the 31st International Conference on Machine Learning, 1, 181–189.
   Google Scholar
• Li, M., and Tobias, J. L. (2009), “Bayesian Methods in Microeconometrics,” in The Oxford Handbook of Bayesian Econometrics, eds. J. Geweke, G. Koop, and H. Van Dijk, Oxford: Oxford University Press.
   Google Scholar
• Maclaurin, D., and Adams, R. (2014), “Firefly Monte Carlo: Exact MCMC With Subsets of Data,” Uncertainty in Artificial Intelligence—Proceedings of the 30th Conference, UAI 2014, 4289–4295.
   Google Scholar
• Marin, J.-M., Mengersen, K., and Robert, C. P. (2005), “Bayesian Modelling and Inference on Mixtures of Distributions,” in Bayesian Thinking, Vol. 25 of Handbook of Statistics, eds. D. Dey and C. Rao, New York: Elsevier Science Publishers, pp. 459–507.
   Google Scholar
• McCulloch, R. E. and Rossi, P. (1994), “An Exact Likelihood Analysis of the Multinomial Probit Model,” Journal of Econometrics, 64, 207–240. DOI: 10.1016/0304-4076(94)90064-7.
   Web of Science ®Google Scholar
• Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953), “Equation of State Calculations by Fast Computing Machines,” The Journal of Chemical Physics, 21, 1087–1092. DOI: 10.1063/1.1699114.
   Web of Science ®Google Scholar
• Neiswanger, W., Wang, C., and Xing, E. P. (2014), “Asymptotically Exact, Embarrassingly Parallel MCMC,” in Proceedings of the Thirtieth Conference on Uncertainty in Artificial Intelligence, eds. N. Zhang and J. Tian, Arlington: AUAI Press, pp. 623–632.
   Google Scholar
• Nemeth, C., and Sherlock, C. (2018), “Merging MCMC Subposteriors Through Gaussian-Process Approximations,” Bayesian Analysis, 13, 507–530. DOI: 10.1214/17-BA1063.
   Web of Science ®Google Scholar
• Qian, H. (2018), “Big Data Bayesian Linear Regression and Variable Selection by Normal-Inverse-Gamma Summation,” Bayesian Analysis, 13, 1011–1035. DOI: 10.1214/17-BA1083.
   Web of Science ®Google Scholar
• Quiroz, M., Kohn, R., Villani, M., and Tran, M. (2019), “Speeding up MCMC by Efficient Data Subsampling,” Journal of the American Statistical Association, 114, 831–843. DOI: 10.1080/01621459.2018.1448827.
   Web of Science ®Google Scholar
• Robbins, H., and Monro, S. (1951), “A Stochastic Approximation Method,” The Annals of Mathematical Statistics, 22, 400–407. DOI: 10.1214/aoms/1177729586.
   Google Scholar
• Robert, C., and Casella, G. (2004), Monte Carlo Statistical Methods, New York: Springer Science Business Media.
   Google Scholar
• Scott, S. L., Blocker, A. W., Bonassi, F. V., Chipman, H. A., George, E. I., and McCulloch, R. E. (2016), “Bayes and Big Data: The Consensus Monte Carlo Algorithm,” International Journal of Management Science and Engineering Management, 11, 78–88. DOI: 10.1080/17509653.2016.1142191.
   Web of Science ®Google Scholar
• Stephens, M. (2000), “Dealing With Label Switching in Mixture Models,” Journal of the Royal Statistical Society, Series B, 62, 795–809. DOI: 10.1111/1467-9868.00265.
   Google Scholar
• Tanner, M. A., and Wong, W. H. (1987), “The Calculation of Posterior Distributions by Data Augmentation,” Journal of the American Statistical Association, 82, 528–550. DOI: 10.1080/01621459.1987.10478458.
   Web of Science ®Google Scholar
• Teh, Y. W., Thiery, H. A., and Vollmer, S. J. (2016), “Consistency and Fluctuations for Stochastic Gradient Langevin Dynamics,” Journal of Machine Learning Research, 17, 1–33.
   Web of Science ®Google Scholar
• Tierney, L. (1994), “Markov Chains for Exploring Posterior Distributions,” Annals of Statistics, 22, 1701–1728.
   Web of Science ®Google Scholar
• Tobin, J. (1958), “Estimation of Relationships for Limited Dependent Variables,” Econometrica, 26, 24–36. DOI: 10.2307/1907382.
   Web of Science ®Google Scholar
• Yao, W., and Lindsay, B. G. (2009), “Bayesian Mixture Labeling by Highest Posterior Density,” Journal of the American Statistical Association, 104, 758–767. DOI: 10.1198/jasa.2009.0237.
   Web of Science ®Google Scholar
• Yu, J. (2005), “On Leverage in a Stochastic Volatility Model,” Journal of Econometrics, 127, 165–178. DOI: 10.1016/j.jeconom.2004.08.002.
   Web of Science ®Google Scholar