Model-averaged ℓ₁ regularization using Markov chain Monte Carlo model composition

REFERENCES

• Hoeting JA, Madigan D, Raftery AE, Volinsky CT. Bayesian model averaging: a tutorial. Statist Sci. 1999;14(4):382–417. doi: 10.1214/ss/1009212519
   Web of Science ®Google Scholar
• Volinsky CT, Madigan D, Raftery AE, Kronmal RA. Bayesian model averaging in proportional hazard models: assessing stroke risk. J R Statist Soc Ser C Appl Stat. 1997;46:433–448. doi: 10.1111/1467-9876.00082
   Web of Science ®Google Scholar
• Furnival GM, Wilson RW. Regression by leaps and bounds. Technometrics. 1974;16:499–511. doi: 10.1080/00401706.1974.10489231
   Web of Science ®Google Scholar
• Madigan D, York J. Bayesian graphical models for discrete data. Int Statist Rev. 1995;63:215–232. doi: 10.2307/1403615
   Web of Science ®Google Scholar
• Yeung KY, Bumgarner RE, Raftery AE. Bayesian model averaging: development of an improved, multi-class, gene selection tool for microarray data. Bioinformatics. 2005;21:2394–2402. doi: 10.1093/bioinformatics/bti319
   PubMed Web of Science ®Google Scholar
• Yeung KY. iterativeBMA: The iterative Bayesian model averaging (BMA) algorithm; 2005. (oBioconductor; revised in 2010.)
   Google Scholar
• Fraley C, Seligman M. Model-averaged ℓ1 penalized logistic regression. Presented at: 41st Symposium on the Interface: Computing Science and Statistics; 2010 June; Seattle, WA.
   Google Scholar
• Brown PJ, Vannucci M, Fearn T. Bayes model averaging with selection of regressors. J R Statist Soc Ser B. 2002;64:519–536. doi: 10.1111/1467-9868.00348
   Google Scholar
• Savitsky T, Vannucci M, Sha N. Variable selection for nonparametric process priors. Statist Sci. 2011;26:130–149. doi: 10.1214/11-STS354
   PubMed Web of Science ®Google Scholar
• Park T, Casella G. The Bayesian lasso. J Am Statist Assoc. 2008;103:681–686. doi: 10.1198/016214508000000337
   Web of Science ®Google Scholar
• Hans C. Bayesian lasso regression. Biometrika. 2009;103:835–845. doi: 10.1093/biomet/asp047
   Web of Science ®Google Scholar
• Hans C. Model uncertainty and variable selection in Bayesian lasso regression. Stat Comput. 2010;20:221–229. doi: 10.1007/s11222-009-9160-9
   Web of Science ®Google Scholar
• Rigollet P, Tsybakov A. Exponential screening and optimal rates of sparse estimation. Ann Stat 2011;39(2):731–771. doi: 10.1214/10-AOS854
   Web of Science ®Google Scholar
• Rigollet P. Kullback–Leibler aggregation and misspecified generalized linear models. Ann Stat. 2012;40:639–665. doi: 10.1214/11-AOS961
   Web of Science ®Google Scholar
• Yang Y. Aggregating regression procedures to improve performance. Bernoulli. 2004;10(1):25–47. doi: 10.3150/bj/1077544602
   Web of Science ®Google Scholar
• Tibshirani R. Regression shrinkage and selection via the lasso. J R Statist Soc Ser B. 1996;58:385–395.
   Google Scholar
• Efron B, Hastie T, Tibshirani, R. Least angle regression. Ann Stat. May 2004;32:407–451. doi: 10.1214/009053604000000067
   Web of Science ®Google Scholar
• Zou H, Hastie T. Regularization and variable selection via the elastic net. J R Statist Soc Ser B. 2005;67:301–320. doi: 10.1111/j.1467-9868.2005.00503.x
   Google Scholar
• Friedman J, Hastie T, Tibshirani R. glmnet: lasso and elastic net regularized generalized linear models; 2008. ( R language; available through CRAN; revised in 2010.)
   Google Scholar
• Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Statist Softw. 2010;33:1–22.
   PubMed Web of Science ®Google Scholar
• Wu TT, Lange K. Coordinate descent algorithms for lasso penalized regression. Ann Appl Stat. 2008;2(1):224–244. doi: 10.1214/07-AOAS147
   Web of Science ®Google Scholar
• Yeung KY, Dombek KM, Lo K, Mittler JE, Zhu J, Schadt EE, Bumgarner RE, Raftery AE. Construction of regulatory networks using expression time-series data of a genotyped population. Proc Natl Acad Sci. 2011 Nov;108:19436–19441. doi: 10.1073/pnas.1116442108
   PubMed Web of Science ®Google Scholar
• Fraley C, Yeung KY, Raftery AE. networkBMA: regression-based network inference using BMA; 2012. R package distributed through bioconductor.
   Google Scholar
• Stolovitzky G, Califano A, Prill R, Rodriguez JS. DREAM: Dialogue for Reverse Engineering Assessments and Methods; 2009. Available from: http://wiki.c2b2.columbia.edu/dream
   Google Scholar
• Marbach D, Schaffter T, Mattiussi C, Floreano D. Generating realistic in silico gene networks for performance assessment of reverse engineering methods. J Comput Biol. 2009;16:229–239. doi: 10.1089/cmb.2008.09TT
   PubMed Web of Science ®Google Scholar
• Marbach D, Prill RJ, Schaffter T, Mattiussi C, Floreano D, Stolovitzky G. Revealing strengths and weaknesses of methods for gene network inference. Proc Natl Acad Sci. 2010;107:6286–6291. doi: 10.1073/pnas.0913357107
   PubMed Web of Science ®Google Scholar
• Prill RJ, Marbach D, Saez-Rodriguez J, Sorger PK, Alexopoulos LG, Clarke ND, Altan-Bonnet G. Towards a rigorous assessment of systems biology models: the DREAM3 challenges. PLoS ONE. 2010;5:e9202. doi: 10.1371/journal.pone.0009202
   Google Scholar
• Powers DMW. Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. J Mach Learn Technol. 2011;2:37–63.
   Web of Science ®Google Scholar
• Lo K, Raftery AE, Dombek KM, Zhu J, Schadt EE, Bumgarner RE, Yeung KY. Integrating external biological knowledge in the construction of regulatory networks from time-series expression data. BMC Syst Biol. 2012;6:101. doi: 10.1186/1752-0509-6-101
   PubMed Web of Science ®Google Scholar