Fast Bayesian Factor Analysis via Automatic Rotations to Sparsity

References

• Albert, J. H., and Chib, S. (1993), “Bayesian Analysis of Binary and Polychotomous Response Data,” Journal of the American Statistical Association, 88, 669–679.
   Web of Science ®Google Scholar
• Bhattacharya, A., and Dunson, D. (2011), “Sparse Bayesian Infinite Factor Models,” Biometrika, 98, 291–306.
   PubMed Web of Science ®Google Scholar
• Carvalho, C. M., Chang, J., Lucas, J. E., Nevins, J. R., Wang, Q., and West, M. (2008), “High-Dimensional Sparse Factor Modelling: Applications in Gene Expression Genomics,” Journal of the American Statistical Association, 103, 1438–1456.
   PubMed Web of Science ®Google Scholar
• Dempster, A., Laird, N., and Rubin, D. (1977), “Maximum Likelihood From Incomplete Data via the EM Algorithm,” Journal of the Royal Statistical Society, Series B, 39, 1–38.
   Google Scholar
• Frühwirth-Schnatter, S., and Lopes, H. (2009), “Parsimonious Bayesian Factor Analysis When the Number of Factors is Unknown,” Technical report, University of Chicago Booth School of Business.
   Google Scholar
• George, E. I., and McCulloch, R. E. (1993), “Variable Selection Via Gibbs Sampling,” Journal of the American Statistical Association, 88, 881–889.
   Web of Science ®Google Scholar
• Geweke, J., and Zhou, G. (1996), “Measuring the Pricing Error of the Arbitrage Pricing Theory,” The Review of Financial Studies, 9, 557–587.
   Web of Science ®Google Scholar
• Ghosh, J., and Dunson, D. (2009), “Default Prior Distributions and Efficient Posterior Computation in Bayesian Factor Analysis,” Journal of Computational and Graphical Statistics, 18, 306–320.
   PubMed Web of Science ®Google Scholar
• Green, P. J. (1990), “On Use of the EM for Penalized Likelihood Estimation,” Journal of the Royal Statistical Society, Series B, 52.
   Google Scholar
• Griffiths, T., and Ghahramani, Z. (2005), “Infinite Latent Feature Models and the Indian Buffet Process,” Technical report, Gatsby Computational Neuroscience Unit.
   Google Scholar
• Ishwaran, H., and Rao, J. S. (2005), “Spike and Slab Variable Selection: Frequentist and Bayesian Strategies,” Annals of Statistics, 33, 730–773.
   Web of Science ®Google Scholar
• Kaiser, H. (1958), “The Varimax Criterion for Analytic Rotation in Factor Analysis,” Psychometrika, 23, 187–200.
   Web of Science ®Google Scholar
• Klami, A. (2014), “Pólya-Gamma Augmentations for Factor Models,” in JMLR: Workshop and Conference Proceedings, 29, 112–128.
   Google Scholar
• Knowles, D., and Ghahramani, Z. (2011), “Nonparametric Bayesian Sparse Factor Models With Application to Gene Expression Modeling,” The Annals of Applied Statistics, 5, 1534–1552.
   Web of Science ®Google Scholar
• Lewandowski, A., Liu, C., and van der Wiel, S. (1999), “Parameter Expansion and Efficient Inference,” Statistical Science, 25, 533–544.
   Web of Science ®Google Scholar
• Liu, C., Rubin, D., and Wu, Y. N. (1998), “Parameter Expansion to Accelerate EM: The PX-EM Algorithm,” Biometrika, 85, 755–0770.
   Web of Science ®Google Scholar
• Liu, J. S., and Wu, Y. N. (1999), “Parameter Expansion for Data Augmentation,” Journal of the American Statistical Association, 94, 1264–1274.
   Web of Science ®Google Scholar
• Luttinen, J., and Ilin, A. (2010), “Transformations in Variational Bayesian Factor Analysis to Speed up Learning,” Neurocomputing, 73, 1093–1102.
   Web of Science ®Google Scholar
• Meng, X., and Rubin, D. (1991), “Using EM to Obtain Asymptotic Variance-Covariance Matrices: The SEM Algorithm,” Journal of the American Statistical Association, 86, 899–909.
   Web of Science ®Google Scholar
• Meng, X., and van Dyk, D. (1999), “Seeking Efficient Data Augmentation Schemes via Conditional and Marginal Augmentation,” Biometrika, 86, 301–320.
   Web of Science ®Google Scholar
• Minka, T. (2001), “Using Lower Bounds to Approximate Integrals,” Technical report, Microsoft Research.
   Google Scholar
• Paisley, B., and Carin, L. (2009), “Nonparametric Factor Analysis With Beta Process Priors,” in 26th International Conference on Machine Learning, pp. 850--858.
   Google Scholar
• Pati, D., Bhattacharya, A., Pillai, N., and Dunson, D. (2014), “Posterior Contraction in Sparse Bayesian Factor Models for Massive Covariance Matrices,” The Annals of Statistics, 42, 1102–1130.
   Web of Science ®Google Scholar
• Perry, P. O., and Owen, A. B. (2010), “A Rotation Test to Verify Latent Structure,” Journal of Machine Learning Research, 11, 603–624.
   Web of Science ®Google Scholar
• Polson, N., Scott, J., and Windle, J. (2013), “Bayesian Inference for Logistic Models Using Pólya-Gamma Latent Variables,” Journal of the American Statistical Association, 108, 1339–1349.
   Web of Science ®Google Scholar
• Qi, Y., and Jaakkola, T. (2006), “Parameter Expanded Variational Bayesian Methods,” Neural Information Processing Systems, 19, available at https://papers.nips.cc/paper/3041-parameter-expanded-variational-bayesian-methods.
   Google Scholar
• Rai, P., and Daumé, H. (2008), “The Infinite Hierarchical Factor Regression Model,” Neural Information Processing Systems, 21, available at https://papers.nips.cc/paper/3627-the-infinite-hierarchical-factor-regression-model.
   Google Scholar
• Ročková, V. (2016), “Bayesian Estimation of Sparse Signals With a Continuous Spike-and-Slab Prior,” Annals of Statistics, under revision.
   Google Scholar
• Ročková, V., and George, E. (2014), “EMVS: The EM Approach to Bayesian Variable Selection,” Journal of the American Statistical Association, 109, 828–846.
   Web of Science ®Google Scholar
• Ročková, V. (2016), “The Spike-and-Slab LASSO,” Journal of the American Statistical Association, under revision.
   Google Scholar
• Teh, Y., Gorur, D., and Ghahramani, Z. (2007), “Stick-Breaking Construction for the Indian Buffet Process,” in 11th Conference on Artificial Intelligence and Statistics, pp. 556--563.
   Google Scholar
• Tipping, M. E., and Bishop, C. M. (1999), “Probabilistic Principal Component Analysis,” Journal of the Royal Statistical Society, Series B, 61, 611–622.
   Google Scholar
• Ueda, N., and Nakano, R. (1998), “Deterministic Annealing EM Algorithm,” Neural Networks, 11, 271–282.
   PubMed Web of Science ®Google Scholar
• van Dyk, D., and Meng, X. L. (2001), “The Art of Data Augmentation,” Journal of Computational and Graphical Statistics, 10, 1–111.
   Web of Science ®Google Scholar
• van Dyk, D. (2010), “Cross-Fertilizing Strategies for Better EM Mountain Climbing and DA Field Exploration: A Graphical Guide Book,” Statistical Science, 25, 429–449.
   Web of Science ®Google Scholar
• van Dyk, D., and Tang, R. (2003), “The One-Step-Late PXEM Algorithm,” Statistics and Computing, 13, 137–152.
   Web of Science ®Google Scholar
• West, M. (2003), “Bayesian Factor Regression Models in the ”Large p, Small n” Paradigm,” in Bayesian Statistics, Oxford University Press, pp. 723–732.
   Google Scholar
• Witten, D., Tibshirani, R., and Hastie, T. (2009), “A Penalized Matrix Decomposition, With Applications to Sparse Principal Components and Canonical Correlation Analysis,” Biostatistics, 10, 515–534.
   PubMed Web of Science ®Google Scholar
• Yoshida, R., and West, M. (2010), “Bayesian Learning in Sparse Graphical Factor Models via Variational Mean-Field Annealing,” Journal of Machine Learning Research, 11, 1771–1798.
   PubMed Web of Science ®Google Scholar
• Zahn, J. M. and et al. (2007), “AGEMAP: A Gene Expression Database for Aging in Mice,” PLOS Genetics, 3, 2326–2337.
   Web of Science ®Google Scholar