Advanced search
Publication Cover
Journal of the American Statistical Association Volume 114, 2019 - Issue 527
Submit an article Journal homepage
4,577
Views
73
CrossRef citations to date
0
Altmetric
Theory and Methods

Frequentist Consistency of Variational Bayes

Yixin WangDepartment of Statistics, Columbia University, New York, NYORCID Iconhttps://orcid.org/0000-0002-6617-4842View further author information
ORCID Icon &
David M. BleiDepartment of Statistics and Department of Computer Science, Columbia University, New York, NYView further author information
Pages 1147-1161 | Received 01 May 2017, Published online: 06 Aug 2018

Citations (73)

Keep up to date with the latest research on this topic with citation updates for this article.

Subscribe to citation updates

Read on this site (13)

Rafael Cabral, David Bolin & Håvard Rue. (2023) Fitting Latent Non-Gaussian Models Using Variational Bayes and Laplace Approximations. Journal of the American Statistical Association 0:0, pages 1-13.
Read now
Yanyan Zeng, Daolin Pang, Hongyu Zhao & Tao Wang. (2023) A Zero-Inflated Logistic Normal Multinomial Model for Extracting Microbial Compositions. Journal of the American Statistical Association 118:544, pages 2356-2369.
Read now
Daolin Pang, Hongyu Zhao & Tao Wang. (2023) Factor Augmented Inverse Regression and its Application to Microbiome Data Analysis. Journal of the American Statistical Association 0:0, pages 1-11.
Read now
Chong You, John T. Ormerod, Xiangyang Li, Cheng Heng Pang & Xiao-Hua Zhou. (2023) An Approximated Collapsed Variational Bayes Approach to Variable Selection in Linear Regression. Journal of Computational and Graphical Statistics 32:3, pages 782-792.
Read now
David T. Frazier, Rubén Loaiza-Maya & Gael M. Martin. (2023) Variational Bayes in State Space Models: Inferential and Predictive Accuracy. Journal of Computational and Graphical Statistics 32:3, pages 793-804.
Read now
Jie Guo, Hao Yan & Chen Zhang. (2023) A Bayesian Partially Observable Online Change Detection Approach with Thompson Sampling. Technometrics 65:2, pages 179-191.
Read now
Weichang Yu & Howard D. Bondell. (2023) Variational Bayes for Fast and Accurate Empirical Likelihood Inference. Journal of the American Statistical Association 0:0, pages 1-13.
Read now
Vojtech Kejzlar, Shrijita Bhattacharya, Mookyong Son & Tapabrata Maiti. (2023) Black Box Variational Bayesian Model Averaging. The American Statistician 77:1, pages 85-96.
Read now
Andrew Zammit-Mangion, Tin Lok James Ng, Quan Vu & Maurizio Filippone. (2022) Deep Compositional Spatial Models. Journal of the American Statistical Association 117:540, pages 1787-1808.
Read now
Kolyan Ray & Botond Szabó. (2022) Variational Bayes for High-Dimensional Linear Regression With Sparse Priors. Journal of the American Statistical Association 117:539, pages 1270-1281.
Read now
Se Yoon Lee. (2022) Gibbs sampler and coordinate ascent variational inference: A set-theoretical review. Communications in Statistics - Theory and Methods 51:6, pages 1549-1568.
Read now
Junhui Park & Seung-Ho Kang. (2022) The determination of biosimilarity margin and the assessment of biosimilarity for an -arm parallel design. Communications in Statistics - Theory and Methods 51:2, pages 387-403.
Read now
T. Westling & T. H. McCormick. (2019) Beyond Prediction: A Framework for Inference With Variational Approximations in Mixture Models. Journal of Computational and Graphical Statistics 28:4, pages 778-789.
Read now

Articles from other publishers (60)

Jiaming Sui & Junxiong Jia. (2023) Non-centered parametric variational Bayes’ approach for hierarchical inverse problems of partial differential equations. Mathematics of Computation 93:348, pages 1715-1760.
Crossref
Yangfan Zhang & Yun Yang. (2024) Bayesian model selection via mean-field variational approximation. Journal of the Royal Statistical Society Series B: Statistical Methodology.
Crossref
Jens Lichter, Paul F V Wiemann & Thomas Kneib. (2024) Variational inference: uncertainty quantification in additive models. AStA Advances in Statistical Analysis.
Crossref
José L. Muñoz-Cobo, César Berna-Escriche & David Blanco. (2024) Bayesian calibration and fitting of nuclear thermal–hydraulic models by Markov chain Monte Carlo methods using the Gibbs sampler. Annals of Nuclear Energy 198, pages 110318.
Crossref
Chengqian Xian, Camila P. E. de Souza, Wenqing He, Felipe F. Rodrigues & Renfang Tian. (2024) Variational Bayesian analysis of survival data using a log-logistic accelerated failure time model. Statistics and Computing 34:2.
Crossref
Yao Zhai, Wei Liu, Yunzhi Jin & Yanqing Zhang. (2024) Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models. Mathematics 12:7, pages 995.
Crossref
Zhengpin Li, Yanxi Hou & Tiandong Wang. (2024) Recent advances on mechanisms of network generation: Community, exchangeability, and scale‐free properties . WIREs Computational Statistics 16:2.
Crossref
Steven Winter, Trevor Campbell, Lizhen Lin, Sanvesh Srivastava & David B. Dunson. (2024) Emerging Directions in Bayesian Computation. Statistical Science 39:1.
Crossref
Gael M. Martin, David T. Frazier & Christian P. Robert. (2024) Approximating Bayes in the 21st Century. Statistical Science 39:1.
Crossref
Shrijita Bhattacharya, Zihuan Liu & Tapabrata Maiti. (2023) Comprehensive study of variational Bayes classification for dense deep neural networks. Statistics and Computing 34:1.
Crossref
Jie Guo, Hao Yan & Chen Zhang. (2024) Thompson Sampling-Based Partially Observable Online Change Detection for Exponential Families. INFORMS Journal on Data Science.
Crossref
Zihuan Liu, Shrijita Bhattacharya & Tapabrata Maiti. (2024) Variational Bayes Ensemble Learning Neural Networks With Compressed Feature Space. IEEE Transactions on Neural Networks and Learning Systems 35:1, pages 1379-1385.
Crossref
Efe Sertkaya & Ilya O. Ryzhov. (2023) Approximate Gaussian Process Regression with Pairwise Comparison Data. Approximate Gaussian Process Regression with Pairwise Comparison Data.
Yemao Xia, Jinye Chen & Depeng Jiang. (2023) Variational Bayesian analysis for two-part latent variable model. Computational Statistics.
Crossref
Prateek JaiswalHarsha Honnappa & Vinayak A. Rao. (2023) Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency. SIAM Journal on Optimization 33:3, pages 1968-1995.
Crossref
Matias Quiroz, David J. Nott & Robert Kohn. (2023) Gaussian Variational Approximations for High-dimensional State Space Models. Bayesian Analysis 18:3.
Crossref
Debamita Kundu, Ritendranath Mitra, Paul S. Albert & Jeremy T. Gaskins. (2023) A Bayesian hierarchical sparse factor model for estimating simultaneous covariance matrices for gestational outcomes in consecutive pregnancies. Statistics in Medicine 42:19, pages 3353-3370.
Crossref
Gary Koop & Dimitris Korobilis. (2023) BAYESIAN DYNAMIC VARIABLE SELECTION IN HIGH DIMENSIONS. International Economic Review 64:3, pages 1047-1074.
Crossref
Louisa Kontoghiorghes & Ana Colubi. (2023) New metrics and tests for subject prevalence in documents based on topic modeling. International Journal of Approximate Reasoning 157, pages 49-69.
Crossref
Michael Celentano, Zhou Fan & Song Mei. (2023) Local convexity of the TAP free energy and AMP convergence for Z2-synchronization. The Annals of Statistics 51:2.
Crossref
Vojtech Kejzlar & Tapabrata Maiti. (2022) Variational inference with vine copulas: an efficient approach for Bayesian computer model calibration. Statistics and Computing 33:1.
Crossref
Pekka Korhonen, Francis K. C. Hui, Jenni Niku & Sara Taskinen. (2022) Fast and universal estimation of latent variable models using extended variational approximations. Statistics and Computing 33:1.
Crossref
Dennis Nieman, Botond Szabo & Harry van Zanten. (2023) Uncertainty quantification for sparse spectral variational approximations in Gaussian process regression. Electronic Journal of Statistics 17:2.
Crossref
Ameera Jaber Mohaisen & Saja Yaseen Abdulsamad. Asymptotic properties of bayes factor in panel data model. Asymptotic properties of bayes factor in panel data model.
. 2023. Hamiltonian Monte Carlo Methods in Machine Learning. Hamiltonian Monte Carlo Methods in Machine Learning 175 184 .
Tshilidzi Marwala, Wilson Tsakane Mongwe & Rendani Mbuvha. 2023. Hamiltonian Monte Carlo Methods in Machine Learning. Hamiltonian Monte Carlo Methods in Machine Learning 1 29 .
Hao Lei, Kailiang Liu & Ying Chen. 2023. Research Papers in Statistical Inference for Time Series and Related Models. Research Papers in Statistical Inference for Time Series and Related Models 83 109 .
Xiaoping Shi, Xiang-Sheng Wang & Augustine Wong. (2022) Explicit Gaussian Variational Approximation for the Poisson Lognormal Mixed Model. Mathematics 10:23, pages 4542.
Crossref
Augusto Fasano, Daniele Durante & Giacomo Zanella. (2022) Scalable and accurate variational Bayes for high-dimensional binary regression models. Biometrika 109:4, pages 901-919.
Crossref
Zuheng Xu & Trevor Campbell. (2022) The computational asymptotics of Gaussian variational inference and the Laplace approximation. Statistics and Computing 32:4.
Crossref
Jan Povala, Ieva Kazlauskaite, Eky Febrianto, Fehmi Cirak & Mark Girolami. (2022) Variational Bayesian approximation of inverse problems using sparse precision matrices. Computer Methods in Applied Mechanics and Engineering 393, pages 114712.
Crossref
Se Yoon Lee. (2022) Bayesian Nonlinear Models for Repeated Measurement Data: An Overview, Implementation, and Applications. Mathematics 10:6, pages 898.
Crossref
Daniel Ries, Jason Adams & Joshua Zollweg. (2022) Target Detection on Hyperspectral Images Using MCMC and VI Trained Bayesian Neural Networks. Target Detection on Hyperspectral Images Using MCMC and VI Trained Bayesian Neural Networks.
Tiantian Liu, Peirong Xu, Yueyao Du, Hui Lu, Hongyu Zhao & Tao Wang. (2022) MZINBVA: variational approximation for multilevel zero-inflated negative-binomial models for association analysis in microbiome surveys. Briefings in Bioinformatics 23:1.
Crossref
Riccardo Barbano, Simon Arridge, Bangti Jin & Ryutaro Tanno. 2022. Biomedical Image Synthesis and Simulation. Biomedical Image Synthesis and Simulation 601 641 .
Kaito Shimamura & Shuichi Kawano. (2021) Bayesian sparse convex clustering via global-local shrinkage priors. Computational Statistics 36:4, pages 2671-2699.
Crossref
Narges Manouchehri, Nizar Bouguila & Wentao Fan. (2021) Batch and online variational learning of hierarchical Dirichlet process mixtures of multivariate Beta distributions in medical applications. Pattern Analysis and Applications 24:4, pages 1731-1744.
Crossref
Luka Žnidarič, Gjorgji Nusev, Bertrand Morel, Julie Mougin, Đani Juričić & Pavle Boškoski. (2021) Evaluating uncertainties in electrochemical impedance spectra of solid oxide fuel cells. Applied Energy 298, pages 117101.
Crossref
Jenni Niku, Francis K. C. Hui, Sara Taskinen & David I. Warton. (2021) Analyzing environmental‐trait interactions in ecological communities with fourth‐corner latent variable models. Environmetrics 32:6.
Crossref
Lin Lin & Boris P Hejblum. (2020) Bayesian mixture models for cytometry data analysis. WIREs Computational Statistics 13:4.
Crossref
Shiyuan He, Zhenfeng Lin, Wenlong Yuan, Lucas M. Macri & Jianhua Z. Huang. (2021) Simultaneous inference of periods and period-luminosity relations for Mira variable stars. The Annals of Applied Statistics 15:2.
Crossref
Shrijita Bhattacharya & Tapabrata Maiti. (2021) Statistical foundation of Variational Bayes neural networks. Neural Networks 137, pages 151-173.
Crossref
Imon Banerjee, Vinayak A. Rao & Harsha Honnappa. (2021) PAC-Bayes Bounds on Variational Tempered Posteriors for Markov Models. Entropy 23:3, pages 313.
Crossref
Muhammad Emzir, Sari Lasanen, Zenith Purisha, Lassi Roininen & Simo Särkkä. (2020) Non-stationary multi-layered Gaussian priors for Bayesian inversion. Inverse Problems 37:1, pages 015002.
Crossref
Prateek Jaiswal & Harsha Honnappa. (2020) Statistical Inference for Approximate Bayesian Optimal Design. Statistical Inference for Approximate Bayesian Optimal Design.
Changro Lee & Keith Key-Ho Park. (2020) Representing Uncertainty in Property Valuation Through a Bayesian Deep Learning Approach. Real Estate Management and Valuation 28:4, pages 15-23.
Crossref
Pierre Alquier. (2020) Approximate Bayesian Inference. Entropy 22:11, pages 1272.
Crossref
Sean Plummer, Debdeep Pati & Anirban Bhattacharya. (2020) Dynamics of Coordinate Ascent Variational Inference: A Case Study in 2D Ising Models. Entropy 22:11, pages 1263.
Crossref
Anderson Y. Zhang & Harrison H. Zhou. (2020) Theoretical and computational guarantees of mean field variational inference for community detection. The Annals of Statistics 48:5.
Crossref
Milan Papež & Anthony Quinn. (2020) Bayesian transfer learning between Student-t filters. Signal Processing 175, pages 107624.
Crossref
Fengshuo Zhang & Chao Gao. (2020) Convergence rates of variational posterior distributions. The Annals of Statistics 48:4.
Crossref
Weichang Yu, John T. Ormerod & Michael Stewart. (2020) Variational discriminant analysis with variable selection. Statistics and Computing 30:4, pages 933-951.
Crossref
Pierre Alquier & James Ridgway. (2020) Concentration of tempered posteriors and of their variational approximations. The Annals of Statistics 48:3.
Crossref
Bradley Worley. (2019) Scalable Mean-Field Sparse Bayesian Learning. IEEE Transactions on Signal Processing 67:24, pages 6314-6326.
Crossref
Andrew Olenski & Szymon Sacher. (2022) Estimating Nursing Home Quality with Selection. SSRN Electronic Journal.
Crossref
Dimitris Korobilis & Kenichi Shimizu. (2021) Bayesian Approaches to Shrinkage and Sparse Estimation. SSRN Electronic Journal.
Crossref
yuanxiang Guo. (2021) Discussions About Selected Applied Time-Series Topics Using the Vector Autoregressions. SSRN Electronic Journal.
Crossref
Rohit Allena. (2021) Confident Risk Premiums and Investments using Machine Learning Uncertainties. SSRN Electronic Journal.
Crossref
Dimitris Korobilis. (2018) Machine Learning Macroeconometrics: A Primer. SSRN Electronic Journal.
Crossref
Gary Koop & Dimitris Korobilis. (2018) Variational Bayes Inference in High-Dimensional Time-Varying Parameter Models. SSRN Electronic Journal.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.