321
Views
1
CrossRef citations to date
0
Altmetric
Research Article

Fast copula variational inference

, , , &

References

  • Barber, D., & Bishop, C. M. (1998). Ensemble learning in Bayesian neural networks. Nato Asi Series F: Computer and Systems Sciences, 168, 215–238. http://research.microsoft.com/□cmbishop
  • Bedford, T., & Cooke, R. M. (2002). Vines: A new graphical model for dependent random variables. Annals of Statistics, 1031–1068. http://dx.doi.org/10.1214/aos/1031689016
  • Bishop, C. M. (2006). Pattern recognition and machine learning. Springer-Verlag.
  • Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017). Variational inference: A review for statisticians. Journal of the American Statistical Association, 112 (518), 859–877. https://doi.org/10.1080/01621459.2017.1285773
  • Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3 (Jan), 993–1022. https://dl.acm.org/doi/10.5555/944919.944937
  • Chi, J., Ouyang, J., Li, X., & Li, C. (2018). Empirical study on variational inference methods for topic models. Journal of Experimental and Theoretical Artificial Intelligence, 30 (1), 129–142. https://doi.org/10.1080/0952813X.2017.1409277
  • Genest, C., Gerber, H., Goovaerts, M., & J.A. Laeven, R. (2009). Editorial to the special issue on modeling and measurement of multivariate risk in insurance and finance, 44(2), 143–145. https://doi.org/10.1016/j.insmatheco.2008.10.005
  • Han, S., Liao, X., Dunson, D., & Carin, L. (2016). Variational gaussian copula inference. In Artificial Intelligence and Statistics (pp. 829–838).
  • Hensman, J., Rattray, M., & Lawrence, N. D. (2012). Fast variational inference in the conjugate exponential family. In Neural Information Processing Systems (pp. 2897–2905).
  • Hoffman, M. D., & Blei, D. M. (2015). Structured stochastic variational inference. In Artificial Intelligence and Statistics (pp. 361–369).
  • Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. (2013). Stochastic variational inference. The Journal of Machine Learning Research, 14 (1), 1303–1347. https://dl.acm.org/doi/10.5555/2567709.2502622
  • Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999). An introduction to variational methods for graphical models. Machine Learning, 37 (2), 183–233. https://doi.org/10.1023/A:1007665907178
  • Khan, M. E., Babanezhad, R., Lin, W., Schmidt, M. W., & Sugiyama, M. (2016). Faster stochastic variational inference using proximal-gradient methods with general divergence functions. In Proceedings of the Thirty-second Conference on Uncertainty in Artificial Intelligence (pp. 319–328).
  • Kingma, D. P., & Ba, J. (2015). Adam: A method for stochastic optimization. In International Conference on Learning Representations (pp. 115)
  • Krackhardt, D. (1987). Cognitive social structures. Social Networks, 9 (2), 109–134. https://doi.org/10.1016/0378-8733(87)90009-8
  • Li, X., Li, C., Chi, J., & Ouyang, J. (2018). Variance reduction in black-box variational inference by adaptive importance sampling. In International Joint Conference on Artificial Intelligence (pp. 2404–2410).
  • Li, X., Li, C., Chi, J., Ouyang, J., & Wang, W. (2018). Black-box expectation propagation for bayesian models. In Proceedings of the 2018 Siam International Conference on Data Mining (pp. 603–611).
  • Nelsen, R. B. (2007). An introduction to copulas. Springer Science & Business Media.
  • Opper, M., & Archambeau, C. (2009). The variational gaussian approximation revisited. Neural Computation, 21 (3), 786–792.
  • Paisley, J. W., Blei, D. M., & Jordan, M. I. (2012). Variational bayesian inference with stochastic search. In Proceedings of the 29th International Conference on Machine Learning (pp. 1363–1370)
  • Ranganath, R., Gerrish, S., & Blei, D. M. (2014). Black box variational inference. In Artificial Intelligence and Statistics (pp. 814–822).
  • Ranganath, R., Tran, D., & Blei, D. M. (2016). Hierarchical variational models. In International Conference on Machine Learning (pp. 324–333).
  • Ranganath, R., Wang, C., Blei, D. M., & Xing, E. (2013). An adaptive learning rate for stochastic variational inference. In International Conference on Machine Learning (pp. 298–306).
  • Robbins, H., & Monro, S. (1985). A stochastic approximation method. In Herbert Robbins Selected Papers (pp. 102–109).
  • Saul, L. K., & Jordan, M. I. (1996). Exploiting tractable substructures in intractable networks. In Neural Information Processing Systems (pp. 486–492).
  • Seeger, M., & Nickisch, H. (2011). Fast convergent algorithms for expectation propagation approximate bayesian inference. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (pp. 652–660).
  • Sklar, A. (1973). Random variables, joint distribution functions, and copulas. Kybernetika, 9 (6), 449–460.
  • Sontag, D., & Roy, D. M. (2011). Complexity of inference in latent dirichlet allocation. In Neural Information Processing Systems (pp. 1008–1016).
  • Tran, D., Blei, D. M., & Airoldi, E. M. (2015). Copula variational inference. In Neural Information Processing Systems (pp. 3564–3572).
  • Tran, V. H. (2018). Copula variational Bayes inference via information geometry. IEEE Transactions on Information Theory.
  • Wainwright, M. J., & Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1 (1–2), 1–305. https://doi.org/10.1561/2200000001
  • Yin, M., & Zhou, M. (2018). Semi-implicit variational inference. In Proceedings of the 35th International Conference on Machine Learning (pp. 5646–5655).

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.