A multiple testing protocol for exploratory data analysis and the local misclassification rate

References

• Anderson, M., and J. D. Habiger. 2012. Characterization and Identification of Productivity-Associated Rhizobacteria in Wheat. Applied and Environmental Microbiology 78:4434–46.
   PubMed Web of Science ®Google Scholar
• Anderson, T. W. 1984. An Introduction to Multivariate Statistical Analysis. New York: Wiley, 2nd ed.
   Google Scholar
• Benjamini, Y., and M. Bogomolov. 2014. Selective inference on multiple families of hypotheses. Journal of the Royal Statistical Society. Series B 76:297–318.
   Google Scholar
• Benjamini, Y., and Y. Hochberg. 1995. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society. Series B 57:289–300.
   Web of Science ®Google Scholar
• Benjamini, Y., and D. Yekutieli. 2001. The Control of the False Discovery Rate in Multiple Testing under Dependency. The Annals of Statistics 29:1165–88.
   Web of Science ®Google Scholar
• Berger, J., and T. Sellke. 1987. Testing a Point Null Hypothesis: The Irreconcilability of P-values and Evidence. Journal of the American Statistical Association 82:112–22.
   Web of Science ®Google Scholar
• Cai, T. T., and W. Sun. 2009. Simultaneous Testing of Grouped Hypotheses: Finding Needles in Multiple Haystacks. Journal of the American Statistical Association 104:1467–81.
   Web of Science ®Google Scholar
• Cao, H., W. Sun, and M. R. Kosorok. 2013. The optimal power puzzle: scrutiny of the monotone likelihood ratio assumption in multiple testing. Biometrika 495–502.
   PubMed Web of Science ®Google Scholar
• Dempster, A. P., N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B 39:1–38.
   Google Scholar
• Dudoit, S., and M. van der Laan. 2008. Multiple Testing Procedures with Applications to Genomics. New York, NY: Springer.
   Google Scholar
• Efron, B. 2004. Large-scale simultaneous hypothesis testing: the choice of a null hypothesis. Journal of the American Statistical Association 99:96–104.
   Web of Science ®Google Scholar
• ——— 2010. Large-scale inference: empirical Bayes methods for estimation, testing, and prediction. Cambridge: Cambridge University Press.
   Google Scholar
• Efron, B., R. Tibshirani, J. D. Storey, and V. Tusher. 2001. Empirical Bayes Analysis of a Microarray Experiment. Journal of the American Statistical Association 96:1151–60.
   Web of Science ®Google Scholar
• Gelman, A., and J. Carlin. 2014. Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors. Psychological Science 9:641–51.
   Web of Science ®Google Scholar
• Genovese, C., and L. Wasserman. 2002. Operating Characteristics and Extensions of the False Discovery Rate Procedure. Journal of the Royal Statistical Society. Series B 64:499–517.
   Web of Science ®Google Scholar
• Habiger, J. 2017. Adaptive False Discovery Rate Control for Heterogeneous Data. Statistica Sinica (in press), DOI: 10.5705/ss.202016.0169.
   Google Scholar
• Habiger, J., and E. Peña. 2011. Randomizes p-values and nonparametric procedures in multiple testing. Journal of Nonparametric Statistics 23:583–604.
   PubMed Web of Science ®Google Scholar
• Habiger, J., D. Watts, and M. Anderson. 2016. Multiple testing with heterogeneous multinomial distributions. Biometrics, DOI: 10.1111/biom.1286.
   PubMed Web of Science ®Google Scholar
• He, L., S. K. Sarkar, and Z. Zhao. 2015. Capturing the severity of type {II} errors in high-dimensional multiple testing. Journal of Multivariate Analysis 142:106–16.
   Web of Science ®Google Scholar
• Liang, K., and D. Nettleton. 2012. Adaptive and dynamic adaptive procedures for false discovery rate control and estimation. Journal of the Royal Statistical Society. Series B 74:163–82.
   Google Scholar
• Lindquist, M. A. 2008. The statistical analysis of fMRI data. Statistical Science 23:439–64.
   Web of Science ®Google Scholar
• McCullagh, P., and J. A. Nelder. 1989. Generalized linear models. vol. 37.; 37, New York; London: Chapman and Hall, 2nd ed.
   Google Scholar
• McLachlan, G. J., and T. Krishnan. 2008. The EM Algorithm and Extensions. Hoboken, NJ: Wiley-Interscience.
   Google Scholar
• McLachlan, G. J., and D. Peel. 2000. Finite Mixture Models. New York: Wiley.
   Google Scholar
• R Core Team 2015. R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria.
   Google Scholar
• Roeder, K., and L. Wasserman. 2009. Genome-Wide Significance Levels and Weighted Hypothesis Testing. Statistical Science 24:398–413.
   PubMed Web of Science ®Google Scholar
• Ruppert, D., D. Nettleton, and J. T. G. Hwang. 2007. Exploring the Information in p-Values for the Analysis and Planning of Multiple-Test Experiments. Biometrics 63:483–95.
   PubMed Web of Science ®Google Scholar
• Sarkar, S. K. 2007. Stepup procedures controlling generalized FWER and generalized FDR. The Annals of Statistics 35:2405–20.
   Web of Science ®Google Scholar
• Storey, J. D. 2002. A Direct Approach to False Discovery Rates. Journal of the Royal Statistical Society. Series B 64:479–98.
   Google Scholar
• ——— 2003. The positive false discovery rate: a Bayesian interpretation and the q-value. The Annals of Statistics 31:2013–35.
   Web of Science ®Google Scholar
• ——— 2007. The optimal discovery procedure: a new approach to simultaneous significance testing. Journal of the Royal Statistical Society. Series B 69:347–68.
   Google Scholar
• Storey, J. D., J. E. Taylor, and D. Siegmund. 2004. Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach. Journal of the Royal Statistical Society. Series B 66:187–205.
   Google Scholar
• Sun, W., and T. T. Cai. 2007. Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control. Journal of the American Statistical Association 102:901–12.
   Web of Science ®Google Scholar
• Sun, W., and A. C. McLain. 2012. Multiple testing of composite null hypotheses in heteroscedastic models. Journal of the American Statistical Association 107:673–87.
   Web of Science ®Google Scholar
• Sun, W., B. J. Reich, T. Tony Cai, M. Guindani, and A. Schwartzman. 2015. False discovery control in large-scale spatial multiple testing. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 77:59–83.
   PubMed Web of Science ®Google Scholar