An Empirical Bayes Approach to Controlling the False Discovery Exceedance

References

• Basu, P. (2016). “Model Selection Principles and False Discovery Rate Control,” Ph. D. thesis. University of Southern California.
   Google Scholar
• Basu, P., Cai, T. T., Das, K., and Sun, W. (2018), “Weighted False Discovery Rate Control in Large-Scale Multiple Testing,” Journal of the American Statistical Association, 113, 1172–1183. DOI: 10.1080/01621459.2017.1336443.
   PubMed Web of Science ®Google Scholar
• Benjamini, Y., and Hochberg, Y. (1995), “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing,” Journal of the Royal Statistical Society, Series B, 57, 289–300. DOI: 10.1111/j.2517-6161.1995.tb02031.x.
   Web of Science ®Google Scholar
• Biscarri, W., Zhao, S. D., and Brunner, R. (2018), “A Simple and Fast Method for Computing the Poisson Binomial Distribution Function,” Computational Statistics and Data Analysis, 122, 92–100. DOI: 10.1016/j.csda.2018.01.007.
   Web of Science ®Google Scholar
• Blanchard, G., Neuvial, P., and Roquain, E. (2020), “Post Hoc Confidence Bounds on False Positives Using Reference Families,” The Annals of Statistics, 48, 1281–1303. DOI: 10.1214/19-AOS1847.
   Web of Science ®Google Scholar
• Carpentier, A., Delattre, S., Roquain, E., and Verzelen, N. (2021), “Estimating Minimum Effect with Outlier Selection,” The Annals of Statistics, 49, 272–294. DOI: 10.1214/20-AOS1956.
   Web of Science ®Google Scholar
• Chen, A., and Zimmermann, T. (2021), “Open-Source Cross-Sectional Asset Pricing,” Critical Finance Review, forthcoming. DOI: 10.2139/ssrn.3604626.
   Google Scholar
• Chen, S. X., and Liu, J. S. (1997), “Statistical Applications of the Poisson-Binomial and Conditional Bernoulli Distributions,” Statistica Sinica, 7, 875–892.
   Web of Science ®Google Scholar
• Chi, Z., and Tan, Z. (2008), “Positive False Discovery Proportions: Intrinsic Bounds and Adaptive Control,” Statistica Sinica, 18, 837–860.
   Web of Science ®Google Scholar
• Chordia, T., Goyal, A., and Saretto, A. (2020), “Anomalies and False Rejections,” The Review of Financial Studies, 33, 2134–2179. DOI: 10.1093/rfs/hhaa018.
   Web of Science ®Google Scholar
• Dawid, A. (1994), “Selection Paradoxes of Bayesian Inference,” Lecture Notes-Monograph Series, 24, 211–220. DOI: 10.1214/lnms/1215463797.
   Google Scholar
• Delattre, S., and Roquain, E. (2015), “New Procedures Controlling the False Discovery Proportion via Romano-Wolf’s Heuristic,” The Annals of Statistics, 43, 1141–1177. DOI: 10.1214/14-AOS1302.
   Web of Science ®Google Scholar
• Döhler, S., and Roquain, E. (2020), “Controlling the False Discovery Exceedance for Heterogeneous Tests,” Electronic Journal of Statistics, 14, 4244–4272. DOI: 10.1214/20-EJS1771.
   Google Scholar
• Efron, B. (2004), “Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis,” Journal of the American Statistical Association, 99, 96–104. DOI: 10.1198/016214504000000089.
   Web of Science ®Google Scholar
• ——— (2008), “Microarrays, Empirical Bayes and the Two-Groups Model,” Statistical Science, 23, 1–22. DOI: 10.1214/07-sts236.
   Web of Science ®Google Scholar
• ——— (2009), “Empirical Bayes Estimates for Large-Scale Prediction Problems,” Journal of the American Statistical Association, 104, 1015–1028. DOI: 10.1198/jasa.2009.tm08523.
   PubMed Web of Science ®Google Scholar
• Efron, B., Tibshirani, R., Storey, J. D., and Tusher, V. (2001), “Empirical Bayes Analysis of a Microarray Experiment,” Journal of the American Statistical Association, 96, 1151–1160. DOI: 10.1198/016214501753382129.
   Web of Science ®Google Scholar
• Farcomeni, A. (2008), “A Review of Modern Multiple Hypothesis Testing, with Particular Attention to the False Discovery Proportion,” Statistical Methods in Medical Research, 17, 347–388. DOI: 10.1177/0962280206079046.
   PubMed Web of Science ®Google Scholar
• ——— (2009), “Generalized Augmentation to Control the False Discovery Exceedance in Multiple Testing,” Scandinavian Journal of Statistics, 36, 501–517. DOI: 10.1111/j.1467-9469.2008.00633.x.
   Web of Science ®Google Scholar
• Fraley, C., and Raftery, A. E. (2002), “Model-based Clustering, Discriminant Analysis, and Density Estimation,” Journal of the American Statistical Association, 97, 611–631. DOI: 10.1198/016214502760047131.
   Web of Science ®Google Scholar
• Fu, L. (2018), “Nonparametric Empirical Bayes Methods for Large-Scale Inference Under Heteroscedasticity,” Ph. D. thesis. University of Southern California.
   Google Scholar
• Genovese, C., and Wasserman, L. (2004), “A Stochastic Process Approach to False Discovery Control,” The Annals of Statistics, 32, 1035–1061. DOI: 10.1214/009053604000000283.
   Web of Science ®Google Scholar
• Genovese, C. R., and Wasserman, L. (2006), “Exceedance Control of the False Discovery Proportion,” Journal of the American Statistical Association, 101, 1408–1417. DOI: 10.1198/016214506000000339.
   Web of Science ®Google Scholar
• Goeman, J. J., Hemerik, J., and Solari, A. (2021), “Only Closed Testing Procedures are Admissible for Controlling False Discovery Proportions,” The Annals of Statistics, 49, 1218–1238. DOI: 10.1214/20-AOS1999.
   Web of Science ®Google Scholar
• Gordon, A. Y., and Salzman, P. (2008), “Optimality of the Holm Procedure among General Step-Down Multiple Testing Procedures,” Statistics & Probability Letters, 78, 1878–1884. DOI: 10.1016/j.spl.2008.01.055.
   PubMed Web of Science ®Google Scholar
• Gu, J., and Koenker, R. (2020), “Invidious Comparisons: Ranking and Selection as Compound Decisions,” arXiv preprint arXiv:2012.12550.
   Google Scholar
• Guo, W., and Romano, J. (2007), “A Generalized Sidak-Holm Procedure and Control of Generalized Error Rates Under Independence,” Statistical Applications in Genetics and Molecular Biology, 6, 1–35. DOI: 10.2202/1544-6115.1247.
   Web of Science ®Google Scholar
• Heller, R., and Rosset, S. (2021), “Optimal Control of False Discovery Criteria in the Two-Group Model,” Journal of the Royal Statistical Society, Series B, 83, 133–155. DOI: 10.1111/rssb.12403.
   Google Scholar
• Hemerik, J., Solari, A., and Goeman, J. J. (2019), “Permutation-based Simultaneous Confidence Bounds for the False Discovery Proportion,” Biometrika, 106, 635–649. DOI: 10.1093/biomet/asz021.
   Google Scholar
• Jin, J., and Cai, T. T. (2007), “Estimating the Null and the Proportion of Nonnull Effects in Large-Scale Multiple Comparisons,” Journal of the American Statistical Association, 102, 495–506. DOI: 10.1198/016214507000000167.
   Web of Science ®Google Scholar
• Katsevich, E., and Ramdas, A. (2020), “Simultaneous High-Probability Bounds on the False Discovery Proportion in Structured, Regression and Online Settings,” The Annals of Statistics, 48, 3465–3487. DOI: 10.1214/19-AOS1938.
   Web of Science ®Google Scholar
• Korn, E. L., Troendle, J. F., McShane, L. M., and Simon, R. (2004), “Controlling the Number of False Discoveries: Application to High-Dimensional Genomic Data,” Journal of Statistical Planning and Inference, 124, 379–398. DOI: 10.1016/s0378-3758(03)00211-8.
   Web of Science ®Google Scholar
• Lehmann, E. L., and Romano, J. P. (2005), “Generalizations of the Familywise Error Rate,” The Annals of Statistics, 33, 1138–1154. DOI: 10.1214/009053605000000084.
   Web of Science ®Google Scholar
• Perone Pacifico, M., Genovese, C., Verdinelli, I., and Wasserman, L. (2004), “False Discovery Control for Random Fields,” Journal of the American Statistical Association, 99, 1002–1014. DOI: 10.1198/0162145000001655.
   Web of Science ®Google Scholar
• Romano, J. P., Shaikh, A. M., and Wolf, M. (2008), “Formalized Data Snooping based on Generalized Error Rates,” Econometric Theory, 24, 404–447. DOI: 10.1017/S0266466608080171.
   Web of Science ®Google Scholar
• Romano, J. P., and Wolf, M. (2007), “Control of Generalized Error Rates in Multiple Testing,” The Annals of Statistics, 35, 1378–1408. DOI: 10.1214/009053606000001622.
   Web of Science ®Google Scholar
• Roquain, E., and Verzelen, N. (2021), “False Discovery Rate Control with Unknown Null Distribution: Is It Possible to Mimic the Oracle?” The Annals of Statistics, Forthcoming. DOI: 10.1214/21-AOS2141.
   Google Scholar
• Roquain, E., and Villers, F. (2011), “Exact Calculations for False Discovery Proportion with Application to Least Favorable Configurations,” The Annals of Statistics, 39, 584–612. DOI: 10.1214/10-AOS847.
   Web of Science ®Google Scholar
• Shaked, M., and Shanthikumar, J. G. (2007), Stochastic Orders, New York: Springer.
   Google Scholar
• Sun, W., and Cai, T. T. (2007), “Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control,” Journal of the American Statistical Association, 102, 901–912. DOI: 10.1198/016214507000000545.
   Web of Science ®Google Scholar
• van der Laan, M. J., Birkner, M. D., and Hubbard, A. E. (2005), “Empirical Bayes and Resampling based Multiple Testing Procedure Controlling Tail Probability of the Proportion of False Positives,” Statistical Applications in Genetics and Molecular Biology, 4, 1–32. DOI: 10.2202/1544-6115.1143.
   Web of Science ®Google Scholar
• van der Laan, M. J., Dudoit, S., and Pollard, K. S. (2004), “Augmentation Procedures for Control of the Generalized Family-Wise Error Rate and Tail Probabilities for the Proportion of False Positives,” Statistical Applications in Genetics and Molecular Biology, 3, 1–27. DOI: 10.2202/1544-6115.1042.
   Google Scholar