Empirical study on variational inference methods for topic models

References

• Asuncion, A. (2010). Approximate mean field for dirichlet-based models. In ICML Workshop on Topic Models, Citeseer.
   Google Scholar
• Asuncion, A., Welling, M., Smyth, P., & Teh, Y. W. (2009). On smoothing and inference for topic models. In International Conference on Uncertainty in Artificial Intelligence (pp. 27–34). Montreal, QC, Canada: AUAI Press.
   Google Scholar
• Beal, M. J. (2003). Variational algorithms for approximate Bayesian inference. London: University of London.
   Google Scholar
• Beirami, A., Cevher, V., Bower, B., & Tsianos, K. (2008). Proofs of alpha divergence properties. Technical Representative STAT 631.
   Google Scholar
• Bishop, C. M. (2006). Pattern recognition and machine learning. New York, NY: Springer-Verlag.
   Google Scholar
• Blei, D. M. (2012). Probabilistic topic models. Communications of the ACM, 55, 77–84.
   Web of Science ®Google Scholar
• Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017). Variational inference: A review for statisticians. Journal of the American Statistical Association, 112, 859–877.
   Web of Science ®Google Scholar
• Blei, D. M., & Lafferty, J. D. (2009). Topic models. In A. Srivastava & M. Sahami (Eds.), Text Mining: Classification, Clustering, and Applications (pp. 75--99). Boca Raton, FL: CRC Press.
   Google Scholar
• Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3, 993–1022.
   Web of Science ®Google Scholar
• Buntine, W. (2009). Estimating likelihoods for topic models. In Asian Conference on Machine Learning, Berlin, Heidelberg, Springer.
   Google Scholar
• Buntine, W., & Jakulin, A. (2004). Applying discrete PCA in data analysis. In Proceedings of the 20th conference on Uncertainty in artificial intelligence (pp. 59–66). Banff, Canada: AUAI Press.
   Google Scholar
• Chang, J., Gerrish, S., Wang, C., Boyd-Graber, J. L., & Blei, D. M. (2009). Reading tea leaves: How humans interpret topic models. In Advances in neural information processing systems (pp. 288–296). Vancouver, British Columbia.
   Google Scholar
• Giordano, R. J., Broderick, T., & Jordan, M. I. (2015). Linear response methods for accurate covariance estimates from mean field variational bayes. In Advances in Neural Information Processing Systems (pp. 1441–1449). Montreal, Quebec, Canada.
   Google Scholar
• Griffiths, T. L., & Steyvers, M. (2004). Finding scientific topics. Proceedings of the National Academy of Sciences,101, 5228–5235.
   Google Scholar
• Mimno, D., Hoffman, M., & Blei, D. (2012). Sparse stochastic inference for latent dirichlet allocation. In International Conference on Machine Learning (3, pp. 362–365). Edinburgh, Scotland, UK.
   Google Scholar
• Minka, T. P. (2001). Expectation propagation for approximate bayesian inference. In Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence (pp. 362–369). Seattle, Washington, USA: Morgan Kaufmann Publishers.
   Google Scholar
• Minka, T. P. (2003). Estimating a dirichlet distribution. In In UAI-2002, 39, 115.
   Google Scholar
• Minka, T. P. (2005). Divergence measures and message passing. Technical Representative Microsoft Research.Cambridge.
   Google Scholar
• Minka, T. P. & Lafferty, J. (2002). Expectation-propagation for the generative aspect model. In Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence (pp. 352–359). Edmonton, Canada: Morgan Kaufmann Publishers.
   Google Scholar
• Newman, D., Karimi, S., & Cavedon, L. (2009). External evaluation of topic models. In Australasian Document Computing Symposium (pp. 1–8). Sydney, Australia.
   Google Scholar
• Newman, D., Lau, J. H., Grieser, K., & Baldwin, T. (2010). Automatic evaluation of topic coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (pp. 100–108). Los Angeles, California, USA: Association for Computational Linguistics.
   Google Scholar
• Sato, I., & Nakagawa, H. (2012). Rethinking collapsed variational bayes inference for lda. In Proceedings of the International Conference on Machine Learning (pp. 999–1006). Edinburgh, Scotland, UK.
   Google Scholar
• Steyvers, M., & Griffiths, T. (2007). Probabilistic topic models. Handbook of Latent Semantic Analysis, 427, 424–440.
   Google Scholar
• Teh, Y. W., Kurihara, K., & Welling, M. (2007). Collapsed variational inference for hdp. In Advances in neural information processing systems (pp. 1481–1488). Vancouver, British Columbia, Canada.
   Google Scholar
• Teh, Y. W., Newman, D., & Welling, M. (2006). A collapsed variational bayesian inference algorithm for latent dirichlet allocation. In Advances in neural information processing systems (pp. 1353–1360). Vancouver, British Columbia, Canada.
   Google Scholar
• Wallach, H. M. (2008). Structured topic models for language (PhD thesis). Cambridge, England: University of Cambridge.
   Google Scholar
• Wallach, H. M., Mimno, D. M., & McCallum, A. (2009). Rethinking lda: Why priors matter. In Advances in neural information processing systems (pp. 1973–1981). Vancouver, British Columbia, Canada.
   Google Scholar
• Wallach, H. M., Murray, I., Salakhutdinov, R., & Mimno, D. (2009). Evaluation methods for topic models. In Proceedings of the 26th Annual International Conference on Machine Learning, ACM (pp. 1105–1112). Montreal, Quebec, Canada.
   Google Scholar