Bayesian Dimensionality Reduction With PCA Using Penalized Semi-Integrated Likelihood

References

• Agarwal, P. K., and Mustafa, N. H. (2004), “K-Means Projective Clustering,” in Proceedings of the Twenty-third ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS ’04, ACM, pp. 155–165.
   Google Scholar
• Allen, G. I., Grosenick, L., and Taylor, J. (2014), “A Generalized Least-Square Matrix Decomposition,” Journal of the American Statistical Association, 109, 145–159.
   Web of Science ®Google Scholar
• Bai, J., and Ng, S. (2002), “Determining the Number of Factors in Approximate Factor Models,” Econometrica, 70, 191–221.
   Web of Science ®Google Scholar
• Bishop, C. M. (1999a), “Bayesian PCA,” in Proceedings of the 1998 Conference on Advances in Neural Information Processing Systems II, Cambridge, MA: MIT Press, pp. 382–388.
   Google Scholar
• ——— (1999b), “Variational Principal Components,” in Proceedings of the Ninth International Conference on Artificial Neural Networks, ICANN’99 (Vol. 1), IEE, pp. 509–514.
   Google Scholar
• Caussinus, H. (1986), “Models and Uses of Principal Component Analysis,” in Multidimensional Data Analysis, eds. J. de Leeuw, W. Heiser, J. Meulman, and F. Critchley, Leiden: DSWO Press, pp. 149–178.
   Google Scholar
• Chikuse, Y. (2003), Statistics on Special Manifolds ( Lecture Notes in Statistics), New York: Springer.
   Google Scholar
• Choi, Y., Taylor, J., and Tibshirani, R. (2014), “Selecting the Number of Principal Components: Estimation of the True Rank of a Noisy Matrix.” arXiv:1410.8260.
   Google Scholar
• D’agostino, R. B., and Russell, H. K. (2005), “Scree Test,” in Encyclopedia of Biostatistics, eds. P. Armitage and T. Colton, New York: Wiley.
   Google Scholar
• de Bruijn, N. G. (1970), Asymptotic Methods in Analysis, New York: Dover Publications.
   Google Scholar
• Hastie, T., and Mazumder, R. (2015), softImpute: Matrix Completion via Iterative Soft-Thresholded SVD, R Package Version 1.4. Available at https://CRAN.R-project.org/package=softImpute.
   Google Scholar
• Hoff, P. D. (2007), “Model Averaging and Dimension Selection for the Singular Value Decomposition,” Journal of the American Statistical Association, 102, 674–685.
   Web of Science ®Google Scholar
• Hoyle, D. C. (2008), “Automatic PCA Dimension Selection for High Dimensional Data and Small Sample Sizes,” Journal of Machine Learning Research, 9, 2733–2759.
   Web of Science ®Google Scholar
• Husson, F., Josse, J., Le, S., and Mazet, J. (2014), FactoMineR: Multivariate Exploratory Data Analysis and Data Mining with R, R Package Version 1.27. Available at https://cran.r-project.org/web/packages/FactoMineR/index.html
   Google Scholar
• Husson, F., Lê, S., and Pagès, J. (2010), Exploratory Multivariate Analysis by Example Using R, Boca Raton, FL: Chapman & Hall.
   Google Scholar
• Ilin, A., Raiko, T., and Jaakkola, T. (2010), “Practical Approaches to Principal Component Analysis in the Presence of Missing Values,” Journal of Machine Learning Research, 11, 1957–2000.
   Web of Science ®Google Scholar
• Jackson, D. A. (1993), “Stopping Rules in Principal Components Analysis: A Comparison of Heuristical and Statistical Approaches,” Ecology, 74, 2204–2214.
   Web of Science ®Google Scholar
• James, A. T. (1954), “Normal Multivariate Analysis and the Orthogonal Group,” Annals of Mathematical Statistics, 25, 40–75.
   Google Scholar
• Jolliffe, I. T. (2002), Principal Component Analysis ( Springer Series in Statistics), New York: Springer.
   Google Scholar
• Josse, J., and Husson, F. (2012), “Selecting the Number of Components in Principal Component Analysis Using Cross-Validation Approximations,” Computational Statistics & Data Analysis, 56, 1869–1879.
   Web of Science ®Google Scholar
• Josse, J., Husson, F., and Pagès, J. (2009), “Gestion des Données Manquantes en Analyse en Composantes Principales,” Journal de la Société Française de Statistique, 150, 28–51.
   Google Scholar
• Josse, J., Pagès, J., and Husson, F. (2011), “Multiple Imputation in Principal Component Analysis,” Advances in Data Analysis and Classification, 5, 231–246.
   Web of Science ®Google Scholar
• Minka, T. P. (2000), “Automatic Choice of Dimensionality for PCA,” in NIPS (Vol. 13), Cambridge, MA: MIT Press, pp. 514.
   Google Scholar
• Nakajima, S., Tomioka, R., Sugiyama, M., and Babacan, S. D. (2015), “Condition for Perfect Dimensionality Recovery by Variational Bayesian PCA,” Journal of Machine Learning Research, 16, 3757–3811. Available at http://jmlr.org/papers/v16/nakajima15a.html.
   Web of Science ®Google Scholar
• Owen, A. B., and Perry, P. O. (2009), “Bi-Cross-Validation of the SVD and the Nonnegative Matrix Factorization,” The Annals of Applied Statistics, 3, 564–594.
   Web of Science ®Google Scholar
• Passemier, D., Li, Z., and Yao, J. (2017), “On Estimation of the Noise Variance in High-Dimensional Probabilistic Principal Component Analysis,” Journal of the Royal Statistical Society, Series B, 7, 51–67.
   Google Scholar
• Pearson, K. (1901), “On Lines and Planes of Closest fit to Systems of Points in Space,” Philosophical Magazine, 2, 559–572.
   Google Scholar
• Rajan, J. J., and Rayner, P. J. W. (1997), “Model Order Selection for the Singular Value Decomposition and the Discrete Karhunen-Loeve Transform Using a Bayesian Approach,” IEE Proceedings on Vision, Image and Signal Processing, 144, 116–123.
   Google Scholar
• R Core Team (2016), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing.
   Google Scholar
• Sobczyk, P., Josse, J., and Bogdan, M. (2017), pesel: Automatic Estimation of Number of Principal Components in PCA, R Package Version 0.6. Available at https://github.com/psobczyk/pesel.
   Google Scholar
• Tipping, M. E., and Bishop, C. M. (1999), “Probabilistic Principal Component Analysis,” Journal of the Royal Statistical Society, Series B, 61, 611–622.
   Google Scholar
• Witten, R., and Candès, E. J. (2013), “Randomized Algorithms for Low-Rank Matrix Factorizations: Sharp Performance Bounds,” Algorithmica, 72, 264–281.
   Web of Science ®Google Scholar