Bayesian Factorizations of Big Sparse Tensors

REFERENCES

• Agresti, A. (2002), Categorical Data Analysis (vol. 359), New York: Wiley-Interscience.
   Google Scholar
• Arias-Castro, E., and Lounici, K. (2012), “Variable Selection With Exponential Weights and l_0-Penalization,” Electronic Journal of Statistics 8, 328–354.
   Web of Science ®Google Scholar
• Armagan, A., Dunson, D., and Lee, J. (2013a), “Generalized Double Pareto Shrinkage,” Statistica Sinica, 23, 119–143.
   PubMed Web of Science ®Google Scholar
• Armagan, A., Dunson, D.B., Lee, J., Bajwa, W.U., and Strawn, N. (2013b), “Posterior Consistency in Linear Models Under Shrinkage Priors,” Biometrika, 100, 1011–1018.
   Web of Science ®Google Scholar
• Belitser, E., and Ghosal, S. (2003), “Adaptive Bayesian Inference on the Mean of an Infinite-Dimensional Normal Distribution,” The Annals of Statistics, 31, 536–559.
   Web of Science ®Google Scholar
• Bhattacharya, A., and Dunson, D. (2011), “Sparse Bayesian Infinite Factor Models,” Biometrika, 98, 291–306.
   PubMed Web of Science ®Google Scholar
• Bontemps, D. (2011), “Bernstein–von Mises Theorems for Gaussian Regression With Increasing Number of Regressors,” The Annals of Statistics, 39, 2557–2584.
   Web of Science ®Google Scholar
• Bro, R. (1997), “PARAFAC. Tutorial and Applications,” Chemometrics and Intelligent Laboratory Systems, 38, 149–171.
   Web of Science ®Google Scholar
• Carvalho, C., Lucas, J., Wang, Q., Nevins, J., and West, M. (2008), “High-Dimensional Sparse Factor Modelling: Applications in gene Expression Genomics,” Journal of the American Statistical Association, 103, 1438–1456.
   PubMed Web of Science ®Google Scholar
• Carvalho, C., Polson, N., and Scott, J. (2010), “The Horseshoe Estimator for Sparse Signals,” Biometrika, 97, 465–480.
   Web of Science ®Google Scholar
• Castillo, I., and van der Vaart, A. (2012), “Needles and Straws in a Haystack: Posterior Concentration for Possibly Sparse Sequences,” The Annals of Statistics, 40, 2069–2101.
   Web of Science ®Google Scholar
• Dunson, D.B., and Xing, C. (2009), “Nonparametric Bayes Modeling of Multivariate Categorical Data,” Journal of the American Statistical Association, 104, 1042–1051.
   Web of Science ®Google Scholar
• Fienberg, S., and Rinaldo, A. (2007), “Three Centuries of Categorical Data Analysis: Log-Linear Models and Maximum Likelihood Estimation,” Journal of Statistical Planning and Inference, 137, 3430–3445.
   Web of Science ®Google Scholar
• Ge, Y., and Jiang, W. (2006), “On Consistency of Bayesian Inference With Mixtures of Logistic Regression,” Neural Computation, 18, 224–243.
   Web of Science ®Google Scholar
• Gelman, A., Jakulin, A., Pittau, M., and Su, Y. (2008), “A Weakly Informative Default Prior Distribution for Logistic and Other Regression Models,” Annals of Applied Statistics, 2, 1360–1383.
   Web of Science ®Google Scholar
• Ghosal, S. (1999), “Asymptotic Normality of Posterior Distributions in High-Dimensional Linear Models,” Bernoulli, 5, 315–331.
   Web of Science ®Google Scholar
• ——— (2000), “Asymptotic Normality of Posterior Distributions for Exponential Families When the Number of Parameters Tends to Infinity,” Journal of Multivariate Analysis, 74, 49–68.
   Web of Science ®Google Scholar
• Ghosal, S., Ghosh, J., and van der Vaart, A. (2000), “Convergence Rates of Posterior Distributions,” The Annals of Statistics, 28, 500–531.
   Web of Science ®Google Scholar
• Hans, C. (2011), “Elastic Net Regression Modeling With the Orthant Normal Prior,” Journal of the American Statistical Association, 106, 1383–1393.
   Web of Science ®Google Scholar
• Harshman, R. (1970), “Foundations of the PARAFAC Procedure: Models and Conditions for an ‘Explanatory’ Multi-Modal Factor Analysis,” UCLA Working Papers in Phonetics, 16, 1–84.
   Google Scholar
• Jiang, W. (2007), “Bayesian Variable Selection for High Dimensional Generalized Linear Models: Convergence Rates of the Fitted Densities,” The Annals of Statistics, 35, 1487–1511.
   Web of Science ®Google Scholar
• Kolda, T., and Bader, B. (2009), “Tensor Decompositions and Applications,” SIAM Review, 51, 455–500.
   Web of Science ®Google Scholar
• Lim, L., and Comon, P. (2009), “Nonnegative Approximations of Nonnegative Tensors,” Journal of Chemometrics, 23, 432–441.
   Web of Science ®Google Scholar
• Lopes, M. (2013), “Estimating Unknown Sparsity in Compressed Sensing,” in Proceedings of the 30th International Conference on Machine Learning (ICML-13), pp. 217–225.
   Google Scholar
• Lucas, J.E., Carvalho, C., Wang, Q., Bild, A., Nevins, J., and West, M. (2006), “Sparse Statistical Modelling in Gene Expression Genomics,” in Bayesian Inference for Gene Expression and Proteomics, eds. K. Do, P. Müller, and M. Vannucci, Cambridge, UK: Cambridge University Press, pp. 155–176.
   Google Scholar
• Massam, H., Liu, J., and Dobra, A. (2009), “A Conjugate Prior for Discrete Hierarchical Log-Linear Models,” The Annals of Statistics, 37, 3431–3467.
   Web of Science ®Google Scholar
• Park, T., and Casella, G. (2008), “The Bayesian Lasso,” Journal of the American Statistical Association, 103, 681–686.
   Web of Science ®Google Scholar
• Pati, D., Bhattacharya, A., Pillai, N.S., and Dunson, D.B. (2014), “Posterior Contraction in Sparse Bayesian Factor Models for Massive Covariance Matrices,” The Annals of Statistics, 42, 1102–1130.
   Web of Science ®Google Scholar
• Pati, D., Dunson, D.B., and Tokdar, S.T. (2013), “Posterior Consistency in Conditional Distribution Estimation,” Journal of Multivariate Analysis, 116, 456–472.
   PubMed Web of Science ®Google Scholar
• Polson, N., and Scott, J. (2010), “Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction,” in Bayesian Statistics 9, eds. J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith, and M. West, New York: Oxford University Press, pp. 501–538.
   Google Scholar
• Scott, J., and Berger, J. (2010), “Bayes and Empirical-Bayes Multiplicity Adjustment in the Variable-Selection Problem,” The Annals of Statistics, 38, 2587–2619.
   Web of Science ®Google Scholar
• Sethuraman, J. (1994), “A Constructive Definition of Dirichlet Priors,” Statistica Sinica, 4, 639–650.
   Web of Science ®Google Scholar
• Shen, W., Tokdar, S.T., and Ghosal, S. (2013), “Adaptive Bayesian Multivariate Density Estimation With Dirichlet Mixtures,” Biometrika, 100, 623–640.
   Web of Science ®Google Scholar
• Talagrand, M. (1996), “A New Look at Independence,” The Annals of Probability, 24, 1–34.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• van der Vaart, A., and van Zanten, J. (2008), “Rates of Contraction of Posterior Distributions Based on Gaussian Process Priors,” The Annals of Statistics, 36, 1435–1463.
   Web of Science ®Google Scholar
• Vershynin, R. (2010), “Introduction to the Non-Asymptotic Analysis of Random Matrices,” Arxiv preprint arxiv:1011.3027, unpublished note.
   Google Scholar
• West, M. (2003), “Bayesian Factor Regression Models in the ‘Large p, Small n’ Paradigm,” in Bayesian Statistics 7, eds. J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith. and M. West, New York: Oxford University Press, pp. 733–742.
   Google Scholar
• Yang, Y., and Dunson, D.B. (2013), “Bayesian Conditional Tensor Factorizations for High-dimensional Classification,” arXiv preprint arXiv:1301.4950.
   Google Scholar