Implicit Copula Variational Inference

References

• Azzalini, A., and Dalla Valle, A. (1996), “The Multivariate Skew-Normal Distribution,” Biometrika, 83, 715–726. DOI: 10.1093/biomet/83.4.715.
   Web of Science ®Google Scholar
• Betancourt, M., and Girolami, M. (2015), “Hamiltonian Monte Carlo for Hierarchical Models,” Current Trends in Bayesian Methodology with Applications, 79, 2–4.
   Google Scholar
• Carvalho, C. M., Polson, N. G., and Scott, J. G. (2010), “The Horseshoe Estimator for Sparse Signals,” Biometrika, 97, 465–480. DOI: 10.1093/biomet/asq017.
   Web of Science ®Google Scholar
• Chi, J., Ouyang, J., Zhang, A., Wang, X., and Li, X. (2021), “Fast Copula Variational Inference,” Journal of Experimental & Theoretical Artificial Intelligence, 34, 295–310.
   Web of Science ®Google Scholar
• Czado, C. (2019), Analyzing Dependent Data with Vine Copulas, Lecture Notes in Statistics, Cham: Springer.
   Google Scholar
• Danaher, P. J., Danaher, T. S., Smith, M. S., and Loaiza-Maya, R. (2020), “Advertising Effectiveness for Multiple Retailer-Brands in a Multimedia and Multichannel Environment,” Journal of Marketing Research, 57, 445–467. DOI: 10.1177/0022243720910104.
   Web of Science ®Google Scholar
• Fang, H.-B., Fang, K.-T., and Kotz, S. (2002), “The Meta-Elliptical Distributions with Given Marginals,” Journal of Multivariate Analysis, 82, 1–16. DOI: 10.1006/jmva.2001.2017.
   Web of Science ®Google Scholar
• Frank, M. W. (2009), “Inequality and Growth in the United States: Evidence from a New State-Level Panel of Income Inequality Measures,” Economic Inquiry, 47, 55–68. DOI: 10.1111/j.1465-7295.2008.00122.x.
   Web of Science ®Google Scholar
• Ghosh, S., Yao, J., and Doshi-Velez, F. (2019), “Model Selection in Bayesian Neural Networks via Horseshoe Priors,” Journal of Machine Learning Research, 20, 1–46.
   Web of Science ®Google Scholar
• Gómez-Sánchez-Manzano, E., Gómez-Villegas, M., and Marín, J. (2008), “Multivariate Exponential Power Distributions as Mixtures of Normal Distributions with Bayesian Applications,” Communications in Statistics–Theory and Methods, 37, 972–985. DOI: 10.1080/03610920701762754.
   Google Scholar
• Gunawan, D., Kohn, R., and Nott, D. (2021), “Flexible Variational Bayes based on a Copula of a Mixture of Normals,” arXiv preprint arXiv:2106.14392.
   Google Scholar
• Han, S., Liao, X., Dunson, D. B., and Carin, L. C. (2016), “Variational Gaussian Copula Inference,” in Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, eds. A. Gretton and C. C. Robert (Vol. 51), pp. 829–838, Cadiz, Spain. JMLR Workshop and Conference Proceedings.
   Google Scholar
• Hirt, M., Dellaportas, P., and Durmus, A. (2019), “Copula-Like Variational Inference,” in Advances in Neural Information Processing Systems, eds. H. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché-Buc, E. Fox, and R. Garnett (Vol. 32).
   Google Scholar
• Ingraham, J., and Marks, D. (2017), “Variational Inference for Sparse and Undirected Models,” in International Conference on Machine Learning, pp. 1607–1616. PMLR.
   Google Scholar
• Kano, Y. (1994), “Consistency Property of Elliptic Probability Density Functions,” Journal of Multivariate Analysis, 51, 139–147. DOI: 10.1006/jmva.1994.1054.
   Web of Science ®Google Scholar
• Kotz, S., Kozubowski, T. J., and Podgórski, K. (2001), The Laplace Distribution and Generalizations, Boston: Springer.
   Google Scholar
• Miller, A. C., Foti, N. J., and Adams, R. P. (2017), “Variational Boosting: Iteratively Refining Posterior Approximations,” in International Conference on Machine Learning, pp. 2420–2429. PMLR.
   Google Scholar
• Mishkin, A., Kunstner, F., Nielsen, D., Schmidt, M., and Khan, M. E. (2018), “Slang: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient,” arXiv preprint arXiv:1811.04504.
   Google Scholar
• Nelsen, R. B. (2006), An Introduction to Copulas, New York; Secaucus, NJ: Springer-Verlag.
   Google Scholar
• Oh, D. H., and Patton, A. J. (2017), “Modeling Dependence in High Dimensions with Factor Copulas,” Journal of Business & Economic Statistics, 35, 139–154.
   Web of Science ®Google Scholar
• Ong, V. M.-H., Nott, D. J., and Smith, M. S. (2018), “Gaussian Variational Approximation with Factor Covariance Structure,” Journal of Computational and Graphical Statistics, 27, 465–478. DOI: 10.1080/10618600.2017.1390472.
   Web of Science ®Google Scholar
• Pinheiro, J. C., and Bates, D. M. (1996), “Unconstrained Parametrizations for Variance-Covariance Matrices,” Statistics and Computing, 6, 289–296. DOI: 10.1007/BF00140873.
   Web of Science ®Google Scholar
• Ranganath, R., Gerrish, S., and Blei, D. (2014), “Black Box Variational Inference,” in Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, volume 33 of Proceedings of Machine Learning Research, eds. S. Kaski and J. Corander, pp. 814–822, Reykjavik, Iceland. PMLR.
   Google Scholar
• Rebonato, R., and Jäckel, P. (1999), “The Most General Methodology to Create a Valid Correlation Matrix for Risk Management and Option Pricing Purposes,” Journal of Risk, 2, 17–27. DOI: 10.21314/JOR.2000.023.
   Google Scholar
• Rothman, A. J., Bickel, P. J., Levina, E., and Zhu, J. (2008), Sparse Permutation Invariant Covariance Estimation,” Electronic Journal of Statistics, 2, 494–515. DOI: 10.1214/08-EJS176.
   Web of Science ®Google Scholar
• Smith, M. S. (2021), “Implicit Copulas: An Overview,” Econometrics and Statistics (forthcoming). DOI: 10.1016/j.ecosta.2021.12.002.
   PubMed Web of Science ®Google Scholar
• Smith, M. S., Loaiza-Maya, R., and Nott, D. J. (2020), “High-Dimensional Copula Variational Approximation through Transformation,” Journal of Computational and Graphical Statistics, 29, 729–743. DOI: 10.1080/10618600.2020.1740097.
   Web of Science ®Google Scholar
• Tran, D., Blei, D., and Airoldi, E. M. (2015), “Copula Variational Inference,” in Advances in Neural Information Processing Systems, pp. 3564–3572.
   Google Scholar
• Wilson, A. G., and Ghahramani, Z. (2010), “Copula Processes,” in Advances in Neural Information Processing Systems, pp. 2460–2468.
   Google Scholar
• Yoshiba, T. (2018), “Maximum Likelihood Estimation of Skew-t Copulas with its Applications to Stock Returns,” Journal of Statistical Computation and Simulation, 88, 2489–2506. DOI: 10.1080/00949655.2018.1469631.
   Web of Science ®Google Scholar
• Yu, X., Nott, D. J., Tran, M.-N., and Klein, N. (2021), “Assessment and Adjustment of Approximate Inference Algorithms using the Law of Total Variance,” Journal of Computational and Graphical Statistics, 30, 977–990. DOI: 10.1080/10618600.2021.1880921.
   Web of Science ®Google Scholar
• Zhang, Z., Nishimura, A., Bastide, P., Ji, X., Payne, R. P., Goulder, P., Lemey, P., and Suchard, M. A. (2021), “Large-Scale Inference of Correlation among Mixed-Type Biological Traits with Phylogenetic Multivariate Probit Models,” The Annals of Applied Statistics, 15, 230–251. DOI: 10.1214/20-AOAS1394.
   Web of Science ®Google Scholar
• Zhou, B., Gao, J., Tran, M.-N., and Gerlach, R. (2021), “Manifold Optimization-Assisted Gaussian Variational Approximation,” Journal of Computational and Graphical Statistics, 30, 946–957. DOI: 10.1080/10618600.2021.1923516.
   Web of Science ®Google Scholar