Bayesian screening for feature selection

References

• Ahdesmäki, M., and K. Strimmer. 2010. Feature selection in omics prediction problems using cat scores and false nondiscovery rate control. Annals of Applied Statistics 4 (1):503–519. doi:10.1214/09-AOAS277.
   Web of Science ®Google Scholar
• Arnold, T. B., and J. W. Emerson. 2011. Nonparametric goodness-of-fit tests for discrete null distributions. The R Journal 3 (2):34–39. doi:10.32614/RJ-2011-016.
   Google Scholar
• Barnett, I., R. Mukherjee, and X. Lin. 2017. The generalized higher criticism for testing SNP-set effects in genetic association studies. Journal of the American Statistical Association 112 (517):64–76. doi:10.1080/01621459.2016.1192039.
   PubMed Web of Science ®Google Scholar
• Barrett, M., and J. Millstein. 2020. partition: A fast and flexible framework for data reduction in R. Journal of Open Source Software 5 (47):1991. doi:10.21105/joss.01991.
   PubMedGoogle Scholar
• Berk, R. H., and D. H. Jones. 1979. Goodness-of-fit test statistics that dominate the Kolmogorov statistics. Zeitschrift Fur Wahrscheinlichkeitstheorie Und Verwandte Gebiete 47 (1):47–59. doi:10.1007/BF00533250.
   Google Scholar
• Cai, T. T., J. S. Jin, and M. G. Low. 2007. Estimation and confidence sets for sparse normal mixtures. Annals of Statistics 35 (6):2421–2449. doi:10.1214/009053607000000334.
   Web of Science ®Google Scholar
• Cai, T. T., and W. G. Sun. 2017a. Large-scale global and simultaneous inference: Estimation and testing in very high dimensions. Annual review of economics 9: 411-439.
   Google Scholar
• Cai, T. T., and W. Sun. 2017b. Optimal screening and discovery of sparse signals with applications to multistage high throughput studies. Journal of the Royal Statistical Society, Series B 79 (1):197–223. doi:10.1111/rssb.12171.
   Google Scholar
• Cristescu, R., R. Mogg, M. Ayers, A. Albright, E. Murphy, J. Yearley, X. Sher, X. Q. Liu, H. C. Lu, M. Nebozhyn, et al. 2018. Pan-tumor genomic biomarkers for PD-1 checkpoint blockade-based immunotherapy. Science 362 (6411):197–+. .
   Web of Science ®Google Scholar
• Dadaneh, S. Z., X. N. Qian, and M. Y. Zhou. 2018. BNP-Seq: Bayesian nonparametric differential expression analysis of sequencing count data. Journal of the American Statistical Association 113 (521):81–94. doi:10.1080/01621459.2017.1328358.
   Web of Science ®Google Scholar
• Dickhaus, T., B. Blankertz, and F. C. Meinecke. 2013. Binary classification with pFDR-pFNR losses. Biometrical Journal 55 (3):463–477. doi:10.1002/bimj.201200054.
   PubMed Web of Science ®Google Scholar
• Do, K. A., P. Muller, and F. Tang. 2005. A Bayesian mixture model for differential gene expression. Journal of the Royal Statistical Society Series C-Applied Statistics 54 (3):627–644. doi:10.1111/j.1467-9876.2005.05593.x.
   Google Scholar
• Donoho, D., and J. S. Jin. 2004. Higher criticism for detecting sparse heterogeneous mixtures. Annals of Statistics 32 (3):962–994. doi:10.1214/009053604000000265.
   Web of Science ®Google Scholar
• Donoho, D., and J. S. Jin. 2006. Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data. Annals of Statistics 34 (6):2980–3018. doi:10.1214/009053606000000920.
   Web of Science ®Google Scholar
• Donoho, D., and J. S. Jin. 2008. “Higher criticism thresholding: Optimal feature selection when useful features are rare and weak”, Proceedings of the National Academy of Sciences of the United States of America, 105: 14790–14795.
   Google Scholar
• Donoho, D., and J. Jin. 2009a. Feature selection by higher criticism thresholding achieves the optimal phase diagram. Philosophical Transactions of the Royal Society, Series A 367 (1906):4449–4470. doi:10.1098/rsta.2009.0129.
   Google Scholar
• Donoho, D., and J. S. Jin. 2009b. Feature selection by higher criticism thresholding achieves the optimal phase diagram. Philosophical Transactions of the Royal Society Series A 367 (1906):4449–4470.
   Google Scholar
• Donoho, D., and J. S. Jin. 2015. Higher criticism for large-scale inference, especially for rare and weak effects. Statistical Science 30 (1):1–25. doi:10.1214/14-STS506.
   Web of Science ®Google Scholar
• Efron, B. 2001. Selection criteria for scatterplot smoothers. The Annals of Statistics 29 (2):470–504. doi:10.1214/aos/1009210549.
   Web of Science ®Google Scholar
• Fan, J. Q., F. Han, and H. Liu. 2014. Challenges of big data analysis. National Science Review 1 (2):293–314. doi:10.1093/nsr/nwt032.
   PubMed Web of Science ®Google Scholar
• Fan, J. Q., and J. C. Lv. 2008. Sure Independence screening for ultrahigh dimensional feature space. Journal of the Royal Statistical Society Series B-Statistical Methodology 70 (5):849–883. doi:10.1111/j.1467-9868.2008.00674.x.
   PubMed Web of Science ®Google Scholar
• Fan, J. Q., and J. C. Lv. 2010. A selective overview of variable selection in high dimensional feature space. Statistica Sinica 20 (1):101–148.
   PubMed Web of Science ®Google Scholar
• Fan, J. Q., and R. Song. 2010. Sure Independence screening in generalized linear models with NP-dimensionality. Annals of Statistics 38 (6):3567–3604. doi:10.1214/10-AOS798.
   Web of Science ®Google Scholar
• Fisher, C. K., and P. Mehta. 2015a. Bayesian feature selection for high-dimensional linear regression via the Ising approximation with applications to genomics. Bioinformatics 31 (11):1754–1761. doi:10.1093/bioinformatics/btv037.
   PubMed Web of Science ®Google Scholar
• Fisher, C. K., and P. Mehta. 2015b. Bayesian feature selection with strongly regularizing priors maps to the Ising model. Neural Computation 27 (11):2411–2422. doi:10.1162/NECO_a_00780.
   PubMed Web of Science ®Google Scholar
• Genovese, C., and L. Wasserman. 2004. A stochastic process approach to false discovery control. Annals of Statistics 32 (3):1035–1061. doi:10.1214/009053604000000283.
   Web of Science ®Google Scholar
• Golub, T. R., D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, H. Coller, M. L. Loh, J. R. Downing, M. A. Caligiuri, et al. 1999. Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science 286 (5439):531–537. doi:10.1126/science.286.5439.531.
   PubMed Web of Science ®Google Scholar
• Gould, A. L. 2008. Detecting potential safety issues in clinical trials by Bayesian screening. Biometrical Journal 50 (5):837–851. doi:10.1002/bimj.200710469.
   PubMed Web of Science ®Google Scholar
• Gould, A. L. 2013. Detecting potential safety issues in large clinical or observational trials by Bayesian screening when event counts arise from Poisson distributions. Journal of Biopharmaceutical Statistics 23 (4):829–847. doi:10.1080/10543406.2013.789887.
   PubMed Web of Science ®Google Scholar
• Gould, A. L. 2018. Unified screening for potential elevated adverse event risk and other associations. Statistics in Medicine 37 (18):2667–2689. doi:10.1002/sim.7686.
   PubMed Web of Science ®Google Scholar
• Ingster, Y. I. 1999. Minimax detection of a signal for lnp-balls. Mathematical Methods of Statistics 7:401–428.
   Google Scholar
• Jager, L., and J. A. Wellner. 2007. Goodness-of-fit tests via phi-divergences. Annals of Statistics 35 (5):2018–2053. doi:10.1214/0009053607000000244.
   Web of Science ®Google Scholar
• Ji, P. S., and J. S. Jin. 2012. UPS delivers optimal phase diagram in high-dimensional variable selection. Annals of Statistics 40 (1):73–103. doi:10.1214/11-AOS947.
   Web of Science ®Google Scholar
• Jin, J. S., and Z. T. Ke. 2016. Rare and weak effects in large-scale inference: Methods and phase diagrams. Statistica Sinica 26:1–34.
   Web of Science ®Google Scholar
• Kamerud, D. B., L. W. Deaton, A. J. Bosch, M. Driscoll, D. Young, E. Gbur, C. A. Goodsell, E. Hertz, G. S. Rogers, M. Skalsky, et al. 1978. Random variable X-Y, X, Y normal. American Mathematical Monthly 85:206–208.
   Web of Science ®Google Scholar
• Klaus, B., and K. Strimmer. 2013. Signal identification for rare and weak features: Higher criticism or false discovery rates? Biostatistics 14 (1):129–143. doi:10.1093/biostatistics/kxs030.
   PubMed Web of Science ®Google Scholar
• Lai, Y. 2017. A statistical method for the conservative adjustment of false discovery rate (q-value). Bmc Bioinformatics 18 (Supp3):69. doi:10.1186/s12859-017-1474-6:.
   PubMedGoogle Scholar
• Langaas, M., and B. H. Lindqvist. 2005. Estimating the proportion of true null hypotheses, with application to DNA microarray data. Journal of the Royal Statistical Society Series B 67 (4):555–572. doi:10.1111/j.1467-9868.2005.00515.x.
   Google Scholar
• Lewin, A., N. Bochkina, and S. Richardson. 2007. Fully Bayesian mixture model for differential gene expression: Simulations and model checks. Statistical Applications in Genetics and Molecular Biology 6 (1). doi:10.2202/1544-6115.1314.
   PubMedGoogle Scholar
• Lewin, A., S. Richardson, C. Marshall, A. Glazier, and T. Aitman. 2006. Bayesian modeling of differential gene expression. Biometrics 62 (1):1–9. doi:10.1111/j.1541-0420.2005.00394.x.
   PubMed Web of Science ®Google Scholar
• Li, K., W. Chan, R. S. Doody, J. Quinn, and S. Luo. 2017. Prediction of conversion to Alzheimer's disease with longitudinal measures and time-to-event data. Journal of Alzheimer's Disease 58:360–370.
   Web of Science ®Google Scholar
• Li, J., and D. Siegmund. 2015. Higher criticism: P-values and criticism. Annals of Statistics 43 (3):1323–1350. doi:10.1214/15-AOS1312.
   Web of Science ®Google Scholar
• Li, W., D. Xiang, F. Tsung, and P. Xiaolong. 2019. A diagnostic procedure for high-dimensional data streams via missed discovery rate control. Technometrics 62:1–27.
   Web of Science ®Google Scholar
• Liang, K. 2016. False discovery rate estimation for large-scale homogeneous discrete p -values. Biometrics 72 (2):639–648. doi:10.1111/biom.12429.
   PubMed Web of Science ®Google Scholar
• Liu, Y., M. Morley, J. Brandimarto, et al. 2015. RNA-Seq identifies novel myocardial gene expression signatures of heart failure. Genomics. 105(2):83–89. doi:10.1016/j.ygeno.2014.12.002.
   PubMed Web of Science ®Google Scholar
• Lock, E. F., and D. B. Dunson. 2015. Shared kernel Bayesian screening. Biometrika 102 (4):829–842. doi:10.1093/biomet/asv032.
   PubMed Web of Science ®Google Scholar
• Longford, N. T. 2013. Screening as an application of decision theory. Statistics in Medicine 32 (5):849–863. doi:10.1002/sim.5554.
   PubMed Web of Science ®Google Scholar
• Longford, N. T. 2014. A decision-theoretical alternative to testing many hypotheses. Biostatistics 15 (1):154–169. doi:10.1093/biostatistics/kxt030.
   PubMed Web of Science ®Google Scholar
• Millstein, J., F. Battaglin, M. Barrett, S. Cao, W. Zhang, S. Stintzing, V. Heinemann, and H. J. Lenz. 2020. Partition: A surjective mapping approach for dimensionality reduction. Bioinformatics 36 (3):676–681. doi:10.1093/bioinformatics/btz661.
   PubMed Web of Science ®Google Scholar
• Rue, H., S. Martino, and N. Chopin. 2009. Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. Journal of the Royal Statistical Society Series B-Statistical Methodology 71 (2):319–392. doi:10.1111/j.1467-9868.2008.00700.x.
   Web of Science ®Google Scholar
• Sarkar, S. K., T. Zhou, and D. Ghosh. 2008. A general decision theoretic formulation of procedures controlling FDR and FNR from a Bayesian perspective. Statistica Sinica 18:925–945.
   Web of Science ®Google Scholar
• Stephens, M. 2017. False discovery rates: A new deal. Biostatistics 18 (2):275–294. doi:10.1093/biostatistics/kxw041.
   PubMed Web of Science ®Google Scholar
• Stephens, M., P. Carbonetto, M. Lu, L. Sun, J. Willwerscheid, and N. Xiao. 2019. ashr: Methods for adaptive shrinkage using empirical Bayes. R package version 2.2-39, https://CRAN.R-project.org/package=ashr.In.
   Google Scholar
• Storey, J. D. 2002. A direct approach to false discovery rates. Journal of the Royal Statistical Society, Series B 64 (3):479–498. doi:10.1111/1467-9868.00346.
   Google Scholar
• Storey, J. D. 2003. The positive false discovery rate: A Bayesian interpretation and the q-value. The Annals of Statistics 31 (6):2013–2035. doi:10.1214/aos/1074290335.
   Web of Science ®Google Scholar
• Storey, J. D. 2007. The optimal discovery procedure: A new approach to simultaneous significance testing. Journal of the Royal Statistical Society Series B 69 (3):347–368. doi:10.1111/j.1467-9868.2007.005592.x.
   Google Scholar
• Storey, J. D., A. J. Bass, A. Dabney, and D. Robinson. 2019. qvalue: Q-value estimation for false discovery rate control. R package version 2.18.0, http://github.com/jdstorey/qvalue.
   Google Scholar
• Storey, J. D., J. E. Taylor, and D. Siegmund. 2004. Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: A unified approach. Journal of the Royal Statistical Society, Series B 66 (1):187–205. doi:10.1111/j.1467-9868.2004.00439.x.
   Google Scholar
• Storey, J. D., and R. Tibshirani. 2003. “Statistical significance for genome-wide experiments”, Proceedings of the National Academy of Sciences, 100: 9440–9445.
   Google Scholar
• Tayob, N., F. Stingo, K. A. Do, A. S. F. Lok, and Z. D. Feng. 2018. A Bayesian screening approach for hepatocellular carcinoma using multiple longitudinal biomarkers. Biometrics 74 (1):249–259. doi:10.1111/biom.12717.
   PubMed Web of Science ®Google Scholar
• Van De Wiel, M. A., G. G. R. Leday, L. Pardo, H. Rue, A. W. Van Der Vaart, and W. N. Van Wieringen. 2013. Bayesian analysis of RNA sequencing data by estimating multiple shrinkage priors. Biostatistics 14 (1):113–128. doi:10.1093/biostatistics/kxs031.
   PubMed Web of Science ®Google Scholar
• Walther, G. 2013. The average likelihood ratio for large-scale multiple testing and detecting sparse matrices. Probability to Statistics and Back: High-Dimensional Models and Processes 9:317–326.
   Google Scholar
• Wehrens, R., and P. Franceschi. 2012a. Meta-Statistics for variable selection: The R package biomark. Journal of Statistical Software 51 (10):1–18. doi:10.18637/jss.v051.i10.
   PubMed Web of Science ®Google Scholar
• Wehrens, R., and P. Franceschi. 2012b. Thresholding for biomarker selection in multivariate data using Higher Criticism. Molecular Biosystems 8 (9):2339–2346. doi:10.1039/c2mb25121c.
   PubMedGoogle Scholar
• Wellner, J. A., and V. Koltchinskii. 2003. A note on the asymptotic distribution of Berk-Jones Type statistics under the null hypothesis. Progress in Probability 55:321–332.
   Google Scholar
• Wen, X. 2017. Robust Bayesian FDR control using Bayes factors, with applications to multi-tissue eQTL discovery. Statistical Biosciences 9 (1):28–49. doi:10.1007/s12561-016-9153-0.
   Web of Science ®Google Scholar
• Wu, W. S., and E. A. Pena. 2013. Bayes multiple decision functions. Electronic Journal of Statistics 7:1272–1300. doi:10.1214/13-EJS813.
   PubMed Web of Science ®Google Scholar
• Xie, J. C., T. T. Cai, and H. Z. Li. 2011. Sample size and power analysis for sparse signal recovery in genome-wide association studies. Biometrika 98 (2):273–290. doi:10.1093/biomet/asr003.
   PubMed Web of Science ®Google Scholar
• Xu, L., T. Hanson, E. J. Bedrick, and C. Restrepo. 2010. Hypothesis tests on mixture model components with applications in ecology and agriculture. Journal of Agricultural, Biological, and Environmental Statistics 15 (3):308–326. doi:10.1007/s13253-010-0020-z.
   Web of Science ®Google Scholar
• Yu, F., M. H. Chen, and L. Ku. 2008. Detecting differentially expressed genes using calibrated Bayes factors. Statistica Sinica 18:783–802.
   Web of Science ®Google Scholar
• Yu, F., M. H. Chen, L. Kuo, H. Talbott, and J. S. Davis. 2015. Confident difference criterion: A new Bayesian differentially expressed gene selection algorithm with applications. Bmc Bioinformatics 16 (1). doi:10.1186/s12859-015-0664-3.
   Google Scholar
• Yu, C., and D. Zelterman. 2017. A parametric model to estimate the proportion from true null using a distribution for p-values. Computational Statistics & Data Analysis 114:105–118. doi:10.1016/j.csda.2017.04.008.
   PubMed Web of Science ®Google Scholar
• Zhang, H., J. Jin, and W. Zheyang. 2017. Distributions and statistical power of optimal signal-detection methods in finite cases. In. arXiv: 1702.07082v1 [ math. 1–37.
   Google Scholar
• Zhang, H., and W. Zheyang 2018. “SetTest: Group testing procedures for signal detection and goodness-of-fit. R package version 0.2.0. https://CRAN.R-project.org/package=SetTest.”
   Google Scholar
• Zhou, T. Y., L. P. Zhu, C. Xu, and R. Z. Li. 2019. Model-free forward screening via cumulative divergence. Journal of the American Statistical Association 115:1393-1405.
   Web of Science ®Google Scholar