212
Views
0
CrossRef citations to date
0
Altmetric
Dimension Reduction and Sparse Modeling

Accurate and Ultra-Efficient p-Value Calculation for Higher Criticism Tests

, , &
Pages 463-476 | Received 18 Feb 2023, Accepted 29 Sep 2023, Published online: 27 Nov 2023

References

  • Barnett, I., Mukherjee, R., and Lin, X. (2016), “The Generalized Higher Criticism for Testing SNP-Set Effects in Genetic Association Studies,” Journal of the American Statistical Association, 112, 64–76. DOI: 10.1080/01621459.2016.1192039.
  • Barnett, I. J., and Lin, X. (2014), “Analytical p-value Calculation for the Higher Criticism Test in Finite-d Problems,” Biometrika, 101, 964–970. DOI: 10.1093/biomet/asu033.
  • Berk, R., and Jones, D. (1979), “Goodness-of-Fit Test Statistics that Dominate the Kolmogorov Statistics,” Probability Theory and Related Fields, 47, 47–59. DOI: 10.1007/BF00533250.
  • Cai, T. T., and Wu, Y. (2014), “Optimal Detection of Sparse Mixtures Against a Given Null Distribution,” IEEE Transactions on Information Theory, 60, 2217–2232. DOI: 10.1109/TIT.2014.2304295.
  • Cayón, L., Jin, J., and Treaster, A. (2005), “Higher Criticism Statistic: Detecting and Identifying Non-Gaussianity in the WMAP First-Year Data,” Monthly Notices of the Royal Astronomical Society, 362, 826–832. DOI: 10.1111/j.1365-2966.2005.09277.x.
  • Darling, D., and Erdös, P. (1956), “A Limit Theorem for the Maximum of Normalized Sums of Independent Random Variables,” Duke Mathematical Journal, 23, 143–155. DOI: 10.1215/S0012-7094-56-02313-4.
  • Donoho, D., and Jin, J. (2004), “Higher Criticism for Detecting Sparse Heterogeneous Mixtures,” The Annals of Statistics, 32, 962–994. http://www.jstor.org/stable/3448581. DOI: 10.1214/009053604000000265.
  • Dwass, M. (1957), “Modified Randomization Tests for Nonparametric Hypotheses,” The Annals of Mathematical Statistics, 28, 181–187. DOI: 10.1214/aoms/1177707045.
  • Hall, P., and Jin, J. (2009), “Innovated Higher Criticism for Detecting Sparse Signals in Correlated Noise,” The Annals of Statistics, 38, 1686–1732. DOI: 10.1214/09-AOS764.
  • Huo, Z., Tang, S., Park, Y., and Tseng, G. (2019), “P-value Evaluation, Variability Index and Biomarker Categorization for Adaptively Weighted Fisher’s Meta-Analysis Method in Omics Applications,” Bioinformatics, 36, 524–532. DOI: 10.1093/bioinformatics/btz589.
  • Jaeschke, D. (1979), “The Asymptotic Distribution of the Supremum of the Standardized Empirical Distribution Function on Subintervals,” The Annals of Statistics, 7, 108–115. DOI: 10.1214/aos/1176344558.
  • Jeng, X. J., Cai, T. T., and Li, H. (2010), “Optimal Sparse Segment Identification with Application in Copy Number Variation Analysis,” Journal of the American Statistical Association, 105, 1156–1166. DOI: 10.1198/jasa.2010.tm10083.
  • Jin, J. (2009), “Impossibility of Successful Classification When Useful Features are Rare and Weak,” Proceedings of the National Academy of Sciences, 106, 8859–8864. DOI: 10.1073/pnas.0903931106.
  • Jin, J., Starck, J.-L., Donoho, D., Aghanim, N., and Forni, O. (2005), “Cosmological non-Gaussian Signature Detection: Comparing Performance of Different Statistical Tests,” EURASIP Journal on Advances in Signal Processing, 2005, 297184. DOI: 10.1155/ASP.2005.2470.
  • Kulldorff, M., Heffernan, R., Hartman, J., Assunção, R., and Mostashari, F. (2005), “A Space–Time Permutation Scan Statistic for Disease Outbreak Detection,” PLOS Medicine, 2, e59. DOI: 10.1371/journal.pmed.0020059.
  • Li, J., and Siegmund, D. (2015), “Higher Criticism: p-Values and Criticism,” The Annals of Statistics, 43, 1323–1350. DOI: 10.1214/15-AOS1312.
  • Martin, L., Gao, G., Kang, G., Fang, Y., and Woo, J. (2009), “Improving the Signal-to-Noise Ratio in Genome-Wide Association Studies,” Genetic Epidemiology, 33, S29–S32. DOI: 10.1002/gepi.20469.
  • Meinshausen, N., and Rice, J. (2006), “Estimating the Proportion of False Null Hypotheses among a Large Number of Independently Tested Hypotheses,” The Annals of Statistics, 34, 373–393. DOI: 10.1214/009053605000000741.
  • Moscovich, A., Nadler, B., and Spiegelman, C. (2016), “On the Exact Berk-Jones Statistics and their p-value Calculation,” Electronic Journal of Statistics, 10, 2329–2354. DOI: 10.1214/16-EJS1172.
  • Neill, D. B., and Lingwall, J. (2007), “A Nonparametric Scan Statistic for Multivariate Disease Surveillance,” Advances in Disease Surveillance, 4, 570.
  • Oh, M.-S., and Berger, J. O. (1992), “Adaptive Importance Sampling in Monte Carlo Integration,” Journal of Statistical Computation and Simulation, 41, 143–168. DOI: 10.1080/00949659208810398.
  • Rubinstein, R. Y. (2002), “Cross-Entropy and Rare Events for Maximal Cut and Partition Problems,” ACM Transactions on Modeling and Computer Simulation, 12, 27–53. DOI: 10.1145/511442.511444.
  • Sabatti, C., Service, S., Hartikainen, A.-L., Pouta, A., Ripatti, S., Brodsky, J., Jones, C., Zaitlen, N., Varilo, T., Kaakinen, M., Sovio, U., Ruokonen, A., Laitinen, J., Jakkula, E., St. Pourcain, B., Hoggart, C., Collins, A., Turunen, H., Gabriel, S., and Peltonen, L. (2009), “Genome-Wide Association Analysis of Metabolic Traits in a Birth Cohort from a Founder Population,” Nature Genetics, 41, 35–46. DOI: 10.1038/ng.271.
  • Sun, R., and Lin, X. (2020), “Genetic Variant Set-based Tests Using the Generalized Berk–Jones Statistic with Application to a Genome-Wide Association Study of Breast Cancer,” Journal of the American Statistical Association, 115, 1079–1091. DOI: 10.1080/01621459.2019.1660170.
  • Vázquez-Abad, F. J., and Dufresne, D. (1998), “Accelerated Simulation for Pricing Asian Options,” in Proceedings of the 30th Conference on Winter Simulation, WSC ’98, pp. 1493–1500, Washington, DC, USA. IEEE Computer Society Press.
  • Wehrens, R., and Franceschi, P. (2012), “Thresholding for Biomarker Selection in Multivariate Data Using Higher Criticism,” Molecular bioSystems, 8, 2339–2346. DOI: 10.1039/c2mb25121c.
  • Zhang, H., Jin, J., and Wu, Z. (2020), “Distributions and Power of Optimal Signal-Detection Statistics in Finite Case,” IEEE Transactions on Signal Processing, 68, 1021–1033. DOI: 10.1109/TSP.2020.2967179.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.