Simultaneous Variable and Covariance Selection With the Multivariate Spike-and-Slab LASSO

References

• Abegaz, F., and Wit, E. (2013), “Sparse Time Series Chain Graph Models for Reconstructing Genetic Networks,” Biostatistics, 14, 586–599. DOI:10.1093/biostatistics/kxt005.
   PubMed Web of Science ®Google Scholar
• Banerjee, O., Ghaoui, L. E., and d’Aspremont, A. (2008), “Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data,” Journal of Machine Learning Research, 9, 485–516.
   Web of Science ®Google Scholar
• Banerjee, S., and Ghosal, S. (2015), “Bayesian Structure Learning in Graphical Models,” Journal of Multivariate Analysis, 136, 147–162. DOI:10.1016/j.jmva.2015.01.015.
   Web of Science ®Google Scholar
• Bhadra, A., and Mallick, B. K. (2013), “Joint High-Dimensional Bayesian Variabile and Covariance Selection With an Application to eQTL Analysis,” Biometrics, 69, 447–457. DOI:10.1111/biom.12021.
   PubMed Web of Science ®Google Scholar
• Breiman, L., and Friedman, J. H. (1997), “Predicting Multivariate Responses in Multiple Linear Regression,” Journal of the Royal Statistical Society, Series B, 59, 3–54. DOI:10.1111/1467-9868.00054.
   Google Scholar
• Brown, P. J., Vannucci, M., and Fearn, T. (1998), “Multivariate Bayesian Variable Selection and Prediction,” Journal of the Royal Statistical Society, Series B, 60, 627–641. DOI:10.1111/1467-9868.00144.
   Google Scholar
• Cai, T. T., Li, H., Liu, W., and Xie, J. (2013), “Covariate-Adjusted Precision Matrix Estimation With an Application in Genetical Genomics,” Biometrika, 100, 139–156. DOI:10.1093/biomet/ass058.
   PubMed Web of Science ®Google Scholar
• Carvalho, C. M., Massam, H., and West, M. (2007), “Simulation of Hyper-Inverse Wishart Distributions in Graphical Models,” Biometrika, 94, 647–659. DOI:10.1093/biomet/asm056.
   Web of Science ®Google Scholar
• Cochran, W. G., and Rubin, D. B. (1973), “Controlling Bias in Observational Studies: A Review,” Sankhya, 35, 417–446.
   Google Scholar
• Dawid, A., and Lauritzen, S. (1993), “Hyper Markov Laws in the Statistical Analysis of Decomposable Graphical Models,” Annals of Statistics, 21, 1272–1317. DOI:10.1214/aos/1176349260.
   Web of Science ®Google Scholar
• Dempster, A. P. (1972), “Covariance Selection,” Biometrics, 28, 157–175. DOI:10.2307/2528966.
   Web of Science ®Google Scholar
• Deshpande, S. K., Hasegawa, R. B., Rabinowitz, A. R., Whyte, J., Roan, C. L., Tabatabatei, A., Baiocchi, M., Karlawish, J. H., Master, C. L., and Small, D. S. (2017), “Association of Playing High School Football With Cognition and Mental Health Later in Life,” JAMA Neurology, 74, 909–918. DOI:10.1001/jamaneurol.2017.1317.
   PubMed Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Noncave Penalized Likelihood and Its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360. DOI:10.1198/016214501753382273.
   Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2008), “Sparse Inverse Covariance Estimation With the Graphical Lasso,” Biostatistics, 9, 432–441. DOI:10.1093/biostatistics/kxm045.
   PubMed Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2010), “Reguarilzation Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
   PubMed Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2018), “glasso: Graphical Lasso: Estimation of Gaussian Graphical Models,” R Package Version 1.10.
   Google Scholar
• Friedman, J. H., Hastie, T., Höfling, H., and Tibshirani, R. (2007), “Pathwise Coordinate Optimization,” Annals of Applied Statistics, 1, 302–332. DOI:10.1214/07-AOAS131.
   Web of Science ®Google Scholar
• Gan, L., Narisetty, N. N., and Liang, F. (2018), “Bayesian Regularization of Graphical Models With Unequal Shrinkage,” Journal of the American Statistical Association. DOI:10.1080/01621459.2018.1482755.
   Web of Science ®Google Scholar
• George, E. I., and R. E. McCulloch (1993), “Variable Selection via Gibbs Sampling,” Journal of the American Statistical Association, 88, 881–889. DOI:10.2307/2290777.
   Web of Science ®Google Scholar
• Hansen, B. B. (2004), “Full Matching in an Observational Study of Coaching for the SAT,” Journal of the American Statistical Association, 99, 609–618. DOI:10.1198/016214504000000647.
   Web of Science ®Google Scholar
• Hsieh, C.-J., Sustik, M. A., Dhillon, I. S., and Ravikumar, P. (2014), “QUIC: Quadratic Approximation for Sparse Inverse Covariance Estimation,” Journal of Machine Learning Research, 15, 2911–2947.
   Google Scholar
• Jones, B., Carvalho, C. M., Dobra, A., Hans, C., Carter, C., and West, M. (2005), “Experiments in Stochastic Computation for High-Dimensional Graphical Models,” Statistical Science, 20, 388–400. DOI:10.1214/088342305000000304.
   Web of Science ®Google Scholar
• Lee, W., and Liu, Y. (2012), “Simultaneous Multiple Response Regression and Inverse Covariate Matrix Estimation via Penalized Gaussian Maximum Likelihood,” Journal of Multivariate Analysis, 111, 241–255. DOI:10.1016/j.jmva.2012.03.013.
   PubMed Web of Science ®Google Scholar
• Li, Z. R., and T. McCormick (2017), “An Expectation Conditional Maximizaiton Algorithm for Gaussian Graphical Models,” arXiv no. 1709.06970.
   Google Scholar
• Meng, X.-L., and Rubin, D. B. (1993), “Maximum Likelihood Estimation via the ECM Algorithm: A General Framework,” Biometrika, 80, 267–278. DOI:10.1093/biomet/80.2.267.
   Web of Science ®Google Scholar
• Mitchell, T., and Beauchamp, J. (1988), “Bayesian Variable Selection in Linear Regression,” Journal of the American Statistical Association, 83, 1023–1032. DOI:10.1080/01621459.1988.10478694.
   Web of Science ®Google Scholar
• Obozinski, G., Wainwright, M. J., and Jordan, M. I. (2011), “Support Union Recovery in High-Dimensional Multivarate Regression,” Annals of Statistics, 39, 1–47. DOI:10.1214/09-AOS776.
   Web of Science ®Google Scholar
• Peng, J., Zhu, J., Bergamaschi, A., Han, W., Noh, D.-Y., Pollack, J. R., and Wang, P. (2010), “Regularized Multivarate Regression for Identifying Master Predictors With Application to Integrative Genomics Study of Breast Cancer,” Annals of Applied Statistics, 4, 53–77. DOI:10.1214/09-AOAS271.
   PubMed Web of Science ®Google Scholar
• R Core Team (2017), R: A Language and Environment for Statsitical Computing, Vienna, Austria: R Foundation for Statistical Computing.
   Google Scholar
• Richardson, S., Bottolo, L., and Rosenthal, J. S. (2010), “Bayesian Models for Sparse Regression Analysis of High Dimensional Data,” Bayesian Statistics, 9, 539–569.
   Google Scholar
• Ročková, V., and George, E. I. (2014), “EMVS: The EM Approach to Bayesian Variable Selection,” Journal of the American Statistical Association, 109, 828–846. DOI:10.1080/01621459.2013.869223.
   Web of Science ®Google Scholar
• Ročková, V., and George, E. I. (2018), “The Spike-and-Slab LASSO,” Journal of the American Statistical Association, 113, 431–444. DOI:10.1080/01621459.2016.1260469.
   Web of Science ®Google Scholar
• Rosenbaum, P. R. (2002), Observational Studies, New York: Springer.
   Google Scholar
• Rothman, A. J. (2017), “MRCE: Multivariate Regression With Covariance Estimation,” R Package Version.
   Google Scholar
• Rothman, A. J., Levina, E., and Zhu, J. (2010), “Sparse Multivariate Regression With Covariance Estimation,” Journal of Computational and Graphical Statistics, 19, 947–962. DOI:10.1198/jcgs.2010.09188.
   PubMed Web of Science ®Google Scholar
• Rubin, D. B. (1973), “The Use of Matched Sampling and Regression Adjustment to Remove Bias in Observational Studies,” Biometrics, 29, 185–203. DOI:10.2307/2529685.
   Web of Science ®Google Scholar
• Rubin, D. B. (1979), “Using Multivariate Matched Sampling and Regression Adjustment to Control Bias in Observational Studies,” Journal of the American Statistical Association, 74, 318–328. DOI:10.2307/2286330.
   Web of Science ®Google Scholar
• Scott, J. G., and Berger, J. O. (2010), “Bayes and Empirical-Bayes Multiplicity Adjustment in the Variable-Selection Problem,” Annals of Statistics, 38, 2587–2619. DOI:10.1214/10-AOS792.
   Web of Science ®Google Scholar
• Silber, J. H., Rosenbaum, P. R., Trudeau, M. E., Evan-Shoshan, O., Chen, W., Zhang, X., and Mosher, R. E. (2001), “Multivariate Matching and Bias Reduction in the Surgical Outcomes Study,” Medical Care, 39, 1048–1064. DOI:10.1097/00005650-200110000-00003.
   PubMed Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288. DOI:10.1111/j.2517-6161.1996.tb02080.x.
   Google Scholar
• Turlach, B. A., Venables, W. N., and Wright, S. J. (2005), “Simultaneous Variable Selection,” Technometrics, 47, 349–363. DOI:10.1198/004017005000000139.
   Web of Science ®Google Scholar
• Uhler, C., Lenkoski, A., and Richards, D. (2018), “Exact Formulas for the Normalizing Constants of Wishart Distributions for Graphical Models,” Annals of Statistics, 46, 90–118. DOI:10.1214/17-AOS1543.
   Web of Science ®Google Scholar
• Wang, H. (2015), “Scaling It Up: Stochastic Search Structure Learning in Graphical Models,” Bayesian Analysis, 10, 351–377. DOI:10.1214/14-BA916.
   Web of Science ®Google Scholar
• Witten, D. M., Friedman, J. H., and Simon, N. (2011), “New Insights and Faster Computations for the Graphical Lasso,” Journal of Computational and Graphical Statistics, 20, 892–900. DOI:10.1198/jcgs.2011.11051a.
   Web of Science ®Google Scholar
• Yin, J., and Li, H. (2011), “A Sparse Conditional Gaussian Graphical Model for Analysis of Genetical Genomics Data,” Annals of Applied Statistics, 5, 2630–2650. DOI:10.1214/11-AOAS494.
   PubMed Web of Science ®Google Scholar
• Yuan, M., and Lin, Y. (2007), “Model Selection and Estimation in the Gaussian Graphical Model,” Biometrika, 94, 19–35. DOI:10.1093/biomet/asm018.
   Web of Science ®Google Scholar
• Zellner, A. (1962), “An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias,” Journal of the American Statistical Association, 57, 348–368. DOI:10.1080/01621459.1962.10480664.
   Web of Science ®Google Scholar
• Zhang, C.-H. (2010), “Nearly Unbaised Variable Selection Under Minimax Concave Penalty,” Annals of Statistics, 38, 894–942. DOI:10.1214/09-AOS729.
   Web of Science ®Google Scholar
• Zhang, C.-H., and Zhang, T. (2012), “A General Theory of Concave Regularization for High-Dimensional Sparse Estimation Problems,” Statistical Science, 27, 576–593. DOI:10.1214/12-STS399.
   Web of Science ®Google Scholar
• Zou, H. (2006), “The Adaptive Lasso and Its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1427. DOI:10.1198/016214506000000735.
   Web of Science ®Google Scholar