Skinny Gibbs: A Consistent and Scalable Gibbs Sampler for Model Selection

References

• Albert, J. H., and Chib, S. (1993), “Bayesian Analysis of Binary and Polychotomous Response Data,” Journal of the American Statistical Association, 88, 669–679.
   Web of Science ®Google Scholar
• Barbieri, M. M., and Berger, J. O. (2004), “Optimal Predictive Model Selection,” Annals of Statistics, 32, 870–897.
   Web of Science ®Google Scholar
• Bhattacharya, A., Chakraborty, A., and Mallick, B. (2016), “Fast Sampling with Gaussian Scale Mixture Priors in High-Dimensional Regression,” Biometrika, 103, 985–991.
   PubMed Web of Science ®Google Scholar
• Bhattacharya, A., Pati, D., Pillai, N. S., and Dunson, D. B. (2015), “Dirichlet Laplace Priors for Optimal Shrinkage,” Journal of the American Statistical Association, 110, 1479–1490.
   PubMed Web of Science ®Google Scholar
• Bondell, H. D., and Reich, B. J. (2012), “Consistent High Dimensional Bayesian Variable Selection via Penalized Credible Regions,” Journal of the American Statistical Association, 107, 1610–1624.
   PubMed Web of Science ®Google Scholar
• Breheny, P., and Huang, J. (2011), “Coordinate Descent Algorithms for Nonconvex Penalized Regression, with Applications to Biological Feature Selection,” Annals of Applied Statistics, 5, 232–253.
   PubMed Web of Science ®Google Scholar
• Bühlmann, P., and van de Geer, S. (2011), Statistics for High-Dimensional Data, Berlin, Heidelberg: Springer-Verlag.
   Google Scholar
• Carbonetto, P., and Stephens, M. (2012), “Scalable Variational Inference for Bayesian Variable Selection in Regression, and Its Accuracy in Genetic Association Studies,” Bayesian Analysis, 7, 73–108.
   Web of Science ®Google Scholar
• Castillo, I., and van der Vaart, A. (2012), “Needles and Straw in a Haystack: Posterior Concentration for Possibly Sparse Sequences,” Annals of Statistics, 40, 2069–2101.
   Web of Science ®Google Scholar
• Chen, J., and Chen, Z. (2012), “Extended BIC for Small-n-Large-P Sparse GLM,” Statistica Sinica, 22, 555–574.
   Web of Science ®Google Scholar
• Chen, M. H., Huang, L., Ibrahim, J. G., and Kim, S. (2008), “Bayesian Variable Selection and Computation for Generalized Linear Models with Conjugate Priors,” Bayesian Analysis, 3, 585–614.
   PubMed Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.
   Web of Science ®Google Scholar
• Fan, J., and Peng, H. (2004), “Nonconcave Penalized Likelihood with A Diverging Number of Parameters,” Annals of Statistics, 32, 928–961.
   Web of Science ®Google Scholar
• Friedman, J. H., Hastie, T., and Tibshirani, R. (2008), “Regularized Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
   Google Scholar
• Gelman, A., Jakulin, A., Pittau, M., and Su, Y. (2008), “A Weakly Informative Default Prior Distribution for Logistic and Other Regression Models,” Annals of Applied Statistics, 4, 1360–1383.
   Web of Science ®Google Scholar
• George, E. I., and McCulloch, R. E. (1993), “Variable Selection via Gibbs Sampling,” Journal of the American Statistical Association, 88, 881–889.
   Web of Science ®Google Scholar
• Geweke, J. (1996), “Variable Selection and Model Comparison in Regression,” in Bayesian Statistics, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford: Oxford University Press, pp. 609–620.
   Google Scholar
• Guan, Y., and Stephens, M. (2011), “Bayesian Variable Selection Regression for Genome-Wide Association Studies and Other Large-scale Problems,” Annals of Applied Statistics, 5, 1780–1815.
   Web of Science ®Google Scholar
• Hans, C., Dobra, A., and West, M. (2007), “Shotgun Stochastic Search for “Large p” Regression,” Journal of the American Statistical Association, 102, 507–516.
   Web of Science ®Google Scholar
• Holmes, C. C., and Held, L. (2006), “Bayesian Auxiliary Variable Models for Binary and Multinomial Regression,” Bayesian Analysis, 1, 145–168.
   Web of Science ®Google Scholar
• Huang, J., and Zhang, C. H. (2012), “Estimation and Selection via Absolute Penalized Convex Minimization And its Multistage Adaptive Applications,” Journal of Machine Learning Research, 13, 1839–1864.
   PubMed Web of Science ®Google Scholar
• Imai, Y., Patel, H. R., Doliba, N. M., Matschinsky, F. M., Tobias, J. W., and Ahima, R. S. (2008), “Analysis of Gene Expression in Pancreatic Islets From Diet-Induced Obese Mice,” Physiological Genomics, 36, 43–51.
   PubMed Web of Science ®Google Scholar
• Ishwaran, H., and Rao, J. S. (2005), “Spike and Slab Variable Selection: Frequentist and Bayesian Strategies,” Annals of Statistics, 33, 730–773.
   Web of Science ®Google Scholar
• Johnson, V. E., and Rossell, D. (2012), “Bayesian Model Selection in High-Dimensional Settings,” Journal of the American Statistical Association, 107, 649–660.
   Web of Science ®Google Scholar
• Lan, H., Chen, M., Flowers, J. B., Yandell, B. S., Stapleton, D. S., Mata, C. M., Mui, E. T., Flowers, M. T., Schueler, K. L., Manly, K. F., Williams, R. W., Kendziorski, K., and Attie, A. D. (2006), “Combined Expression Trait Correlations and Expression Quantitative Trait Locus Mapping,” PLoS Genetics, 2, e6.
   PubMed Web of Science ®Google Scholar
• Liang, F., Liu, C., and Carroll, R. (2007), “Stochastic Approximation in Monte Carlo Computation,” Journal of the American Statistical Association, 102, 305–320.
   Web of Science ®Google Scholar
• Liang, F., Song, Q., and Yu, K. (2013), “Bayesian Subset Modeling for High Dimensional Generalized Linear Models,” Journal of the American Statistical Association, 108, 589–606.
   Web of Science ®Google Scholar
• Narisetty, N. N., and He, X. (2014), “Bayesian Variable Selection With Shrinking and Diffusing Priors,” Annals of Statistics, 42, 789–817.
   Web of Science ®Google Scholar
• O’Brien, S. M., and Dunson, D. B. (2004), “Bayesian Multivariate Logistic Regression,” Biometrics, 60, 739–746.
   PubMed Web of Science ®Google Scholar
• Park, T., and Casella, G. (2008), “The Bayesian LASSO,” Journal of the American Statistical Association, 103, 681–686.
   Web of Science ®Google Scholar
• Polson, N., Scott, J. G., and Windle, J. (2013), “Bayesian Inference for Logistic Models using Pólya-Gamma Latent Variables,” Journal of the American Statistical Association, 108, 1339–1349.
   Web of Science ®Google Scholar
• Ročková, V., and George, E. I. (2014), “EMVS: The EM Approach to Bayesian Variable Selection,” Journal of the American Statistical Association, 109, 828–846.
   Web of Science ®Google Scholar
• Scott, G., and Berger, J. (2010), “Bayes and Empirical-Bayes Multiplicity Adjustment in the Variable-Selection Problem,” Annals of Statistics, 38, 2587–2619.
   Web of Science ®Google Scholar
• Shen, X., Pan, W., and Zhu, Y. (2012), “Likelihood-Based Selection and Sharp Parameter Estimation,” Journal of the American Statistical Association, 107, 223–232.
   PubMed Web of Science ®Google Scholar
• Stefanski, L. A. (1991), “A Normal Scale Mixture Representation of the Logistic Distribution,” Statistics and Probability Letters, 11, 69–70.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• van de Geer, S. A. (2008), “High-Dimensional Generalized Linear Models and the Lasso,” Annals of Statistics, 36, 614–645.
   Web of Science ®Google Scholar
• Wendel, A. A., Li, L. O., Y., L., Cline, G. W., Shulman, G. I., and Coleman, R. A. (2010), “Glycerol-3-Phosphate Acyltransferase 1 Deficiency in ob/ob Mice Diminishes Hepatic Steatosis but Does Not Protect against Insulin Resistance or Obesity,” Diabetes, 59, 1321–1329.
   PubMed Web of Science ®Google Scholar
• Zhang, C. H. (2010), “Nearly Unbiased Variable Selection Under Minimax Concave Penalty,” The Annals of Statistics, 38, 894–942.
   Web of Science ®Google Scholar
• Zhao, P., and Yu, B. (2006), “On Model Selection Consistency of Lasso,” Efficient Empirical Bayes Variable Selection and Estimation in Linear Models, 7, 2541–2563.
   Google Scholar