Bayesian Regularization for Graphical Models With Unequal Shrinkage

References

• Banerjee, O., El Ghaoui, L., and d’Aspremont, A. (2008), “Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data,” The Journal of Machine Learning Research, 9, 485–516.
   Web of Science ®Google Scholar
• Banerjee, S., and Ghosal, S. (2015), “Bayesian Structure Learning in Graphical Models,” Journal of Multivariate Analysis, 136, 147–162.
   Web of Science ®Google Scholar
• Bühlmann, P., and Van De Geer, S. (2011), Statistics for High-Dimensional Data: Methods, Theory and Applications, New York: Springer Science & Business Media.
   Google Scholar
• Cai, T., Liu, W., and Luo, X. (2011), “A Constrained ℓ1 Minimization Approach to Sparse Precision Matrix Estimation,” Journal of the American Statistical Association, 106, 594–607.
   Web of Science ®Google Scholar
• Carvalho, C. M., Chang, J., Lucas, J. E., Nevins, J. R., Wang, Q., and West, M. (2008), “High-Dimensional Sparse Factor Modeling: Applications in Gene Expression Genomics,” Journal of the American Statistical Association, 103, 1438–1456.
   PubMed Web of Science ®Google Scholar
• Carvalho, C. M., and Scott, J. G. (2009), “Objective Bayesian Model Selection in Gaussian Graphical Models,” Biometrika, 96, 497–512.
   Web of Science ®Google Scholar
• Dempster, A. P. (1972), “Covariance Selection,” Biometrics, 28, 157–175.
   Google Scholar
• Deshpande, S. K., Ročková, V., and George, E. I. (2017), “Simultaneous Variable and Covariance Selection With the Multivariate Spike-and-Slab Lasso,” arXiv:1708.08911.
   Google Scholar
• Dobra, A., Lenkoski, A., and Rodriguez, A. (2011), “Bayesian Inference for General Gaussian Graphical Models With Application to Multivariate Lattice Data,” Journal of the American Statistical Association, 106, 1418–1433.
   PubMed Web of Science ®Google Scholar
• Fan, J., Fan, Y., and Lv, J. (2008), “High Dimensional Covariance Matrix Estimation Using a Factor Model,” Journal of Econometrics, 147, 186–197.
   Web of Science ®Google Scholar
• Fan, J., Feng, Y., and Wu, Y. (2009), “Network Exploration via the Adaptive LASSO and SCAD Penalties,” The Annals of Applied Statistics, 3, 521–541.
   Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.
   Web of Science ®Google Scholar
• Fan, J., Liao, Y., and Mincheva, M. (2011), “High Dimensional Covariance Matrix Estimation in Approximate Factor Models,” Annals of Statistics, 39, 3320–3356.
   Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2008), “Sparse Inverse Covariance Estimation With the Graphical Lasso,” Biostatistics, 9, 432–441.
   PubMed Web of Science ®Google Scholar
• George, E. I., and McCulloch, R. E. (1993), “Variable Selection via Gibbs Sampling,” Journal of the American Statistical Association, 88, 881–889.
   Web of Science ®Google Scholar
• ——— (1997), “Approaches for Bayesian Variable Selection,” Statistica Sinica, 7, 339–373.
   Google Scholar
• Huang, J. Z., Liu, N., Pourahmadi, M., and Liu, L. (2006), “Covariance Matrix Selection and Estimation via Penalized Normal Likelihood,” Biometrika, 93, 85–98.
   Web of Science ®Google Scholar
• Ishwaran, H., and Rao, J. S. (2005), “Spike and Slab Variable Selection: Frequentist and Bayesian Strategies,” Annals of Statistics, 33, 730–773.
   Web of Science ®Google Scholar
• Johnstone, I. M. (2001), “On the Distribution of the Largest Eigenvalue in Principal Components Analysis,” Annals of Statistics, 29, 295–327.
   Google Scholar
• Khare, K., Oh, S.-Y., and Rajaratnam, B. (2015), “A Convex Pseudolikelihood Framework for High Dimensional Partial Correlation Estimation With Convergence Guarantees,” Journal of the Royal Statistical Society, Series B, 77, 803–825.
   Google Scholar
• Lam, C., and Fan, J. (2009), “Sparsistency and Rates of Convergence in Large Covariance Matrix Estimation,” Annals of Statistics, 37, 4254–4278.
   Google Scholar
• Li, X., Zhao, T., Wang, L., Yuan, X., and Liu, H. (2015), “The flare Package for High Dimensional Linear Regression and Precision Matrix Estimation in R,” The Journal of Machine Learning Research, 16, 553–557.
   Google Scholar
• Loh, P.-L., and Wainwright, M. J. (2017), “Support Recovery Without Incoherence: A Case for Nonconvex Regularization,” The Annals of Statistics, 45, 2455–2482.
   Google Scholar
• ——— (2015), “Regularized M-Estimators with Nonconvexity: Statistical and Algorithmic Theory for Local Optima,” Journal of Machine Learning Research, 16, 559–616.
   Web of Science ®Google Scholar
• Marlin, B. M., and Murphy, K. P. (2009), “Sparse Gaussian Graphical Models With Unknown Block Structure,” in Proceedings of the 26th Annual International Conference on Machine Learning, ACM, pp. 705–712.
   Google Scholar
• Mazumder, R., and Hastie, T. (2012), “The Graphical Lasso: New Insights and Alternatives,” Electronic Journal of Statistics, 6, 2125–2149.
   Google Scholar
• Meinshausen, N., and Bühlmann, P. (2006), “High-Dimensional Graphs and Variable Selection With the Lasso,” The Annals of Statistics, 34, 1436–1462.
   Google Scholar
• Mohammadi, A., and Wit, E. C. (2015), “Bayesian Structure Learning in Sparse Gaussian Graphical Models,” Bayesian Analysis, 10, 109–138.
   Google Scholar
• Narisetty, N. N., and He, X. (2014), “Bayesian Variable Selection With Shrinking and Diffusing Priors,” Annals of Statistics, 42, 789–817.
   Web of Science ®Google Scholar
• Paul, D. (2007), “Asymptotics of Sample Eigenstructure for a Large Dimensional Spiked Covariance Model,” Statistica Sinica, 17, 1617–1642.
   Google Scholar
• Peng, J., Wang, P., Zhou, N., and Zhu, J. (2009), “Partial Correlation Estimation by Joint Sparse Regression Models,” Journal of the American Statistical Association, 104, 735–746.
   PubMed Web of Science ®Google Scholar
• Pourahmadi, M. (2013), High-Dimensional Covariance Estimation: With High-Dimensional Data (Wiley Series in Probability and Statistics), New York: Wiley.
   Google Scholar
• Ravikumar, P., Wainwright, M. J., Raskutti, G., and Yu, B. (2011), “High-Dimensional Covariance Estimation by Minimizing ℓ1-Penalized Log-Determinant Divergence,” Electronic Journal of Statistics, 5, 935–980.
   Web of Science ®Google Scholar
• Ročková, V. (2018), “Bayesian Estimation of Sparse Signals With a Continuous Spike-and-Slab Prior,” Annals of Statistics, 46, 401–437.
   Google Scholar
• Ročková, V., and George, E. I. (2014), “EMVS: The EM Approach to Bayesian Variable Selection,” Journal of the American Statistical Association, 109, 828–846.
   Web of Science ®Google Scholar
• Ročková, V., and George, E. I. (2016a), “Fast Bayesian Factor Analysis via Automatic Rotations to Sparsity,” Journal of the American Statistical Association, 111, 1608–1622.
   Web of Science ®Google Scholar
• ——— (2016b), “The Spike-and-Slab Lasso,” Journal of the American Statistical Association, accepted.
   Google Scholar
• Rothman, A. J., Bickel, P. J., Levina, E., and Zhu, J. (2008), “Sparse Permutation Invariant Covariance Estimation,” Electronic Journal of Statistics, 2, 494–515.
   Google Scholar
• Shen, H., and Huang, J. Z. (2005), “Analysis of Call centre Arrival Data Using Singular Value Decomposition,” Applied Stochastic Models in Business and Industry, 21, 251–263.
   Web of Science ®Google Scholar
• Wang, H. (2012), “Bayesian Graphical Lasso Models and Efficient Posterior Computation,” Bayesian Analysis, 7, 867–886.
   Web of Science ®Google Scholar
• Wang, H., and Li, S. (2012), “Efficient Gaussian Graphical Model Determination Under G-Wishart Prior Distributions,” Electronic Journal of Statistics, 6, 168–198.
   Web of Science ®Google Scholar
• Wille, A., Zimmermann, P., Vranová, E., Fürholz, A., Laule, O., Bleuler, S., Hennig, L., Prelić, A., von Rohr, P., and Thiele, L. (2004), “Sparse Graphical Gaussian Modeling of the Isoprenoid Gene Network in Arabidopsis Thaliana,” Genome Biology, 5, R92.
   Google Scholar
• Yuan, M., and Lin, Y. (2007), “Model Selection and Estimation in the Gaussian Graphical Model,” Biometrika, 94, 19–35.
   Web of Science ®Google Scholar
• Zhou, S., van de Geer, S., and Bühlmann, P. (2009), “Adaptive Lasso for High Dimensional Regression and Gaussian Graphical Modeling,” arXiv:0903.2515.
   Google Scholar