A Simple Algorithm for Exact Multinomial Tests

References

• Baglivo, J., Olivier, D., and Pagano, M. (1992), “Methods for Exact Goodness-of-Fit Tests,” Journal of the American Statistical Association, 87, 464–469. DOI: 10.1080/01621459.1992.10475227.
   Web of Science ®Google Scholar
• Beals, R., and Wong, R. (2010), Special Functions: A Graduate Text (Vol. 126), Cambridge: Cambridge University Press.
   Google Scholar
• Bejerano, G. (2006), “Branch and Bound Computation of Exact p-values,” Bioinformatics, 22, 2158–2159. DOI: 10.1093/bioinformatics/btl357.
   PubMed Web of Science ®Google Scholar
• Bejerano, G., Friedman, N., and Tishby, N. (2004), “Efficient Exact p-value Computation for Small Sample, Sparse, and Surprising Categorical Data,” Journal of Computational Biology, 11, 867–886. DOI: 10.1089/cmb.2004.11.867.
   PubMed Web of Science ®Google Scholar
• Bröcker, J., and Smith, L. A. (2007), “Increasing the Reliability of Reliability Diagrams,” Weather and Forecasting, 22, 651–661. DOI: 10.1175/WAF993.1.
   Web of Science ®Google Scholar
• Chafai, D., and Concordet, D. (2009), “Confidence Regions for the Multinomial Parameter with Small Sample Size,” Journal of the American Statistical Association, 104, 1071–1079. DOI: 10.1198/jasa.2009.tm08152.
   Web of Science ®Google Scholar
• Cohen, A., and Sackrowitz, H. B. (1975), “Unbiasedness of the Chi-square, Likelihood Ratio, and other Goodness of Fit Tests for the Equal Cell Case,” The Annals of Statistics, 3, 959–964. DOI: 10.1214/aos/1176343197.
   Web of Science ®Google Scholar
• Cressie, N., and Read, T. R. C. (1984), “Multinomial Goodness-of-Fit Tests,” Journal of the Royal Statistical Society, Series B, 46, 440–464. DOI: 10.1111/j.2517-6161.1984.tb01318.x.
   Google Scholar
• Cressie, N., and Read, T. R. C. (1989), “Pearson’s X2 and the Loglikelihood Ratio Statistic G2: A Comparative Review,” International Statistical Review, 57, 19–43. DOI: 10.2307/1403582.
   Web of Science ®Google Scholar
• Engels, B. (2015), XNomial: Exact Goodness-of-Fit Test for Multinomial Data with Fixed Probabilities. R package version 1.0.4. Available at https://CRAN.R-project.org/package=XNomial.
   Google Scholar
• Gibbons, J. D., and Pratt, J. W. (1975), “P-values: Interpretation and Methodology,” The American Statistician, 29, 20–25.
   Web of Science ®Google Scholar
• Gneiting, T., and Katzfuss, M. (2014), “Probabilistic Forecasting,” Annual Review of Statistics and its Application, 1, 125–151. DOI: 10.1146/annurev-statistics-062713-085831.
   Web of Science ®Google Scholar
• Hirji, K. F. (1997), “A Comparison of Algorithms for Exact Goodness-of-Fit Tests for Multinomial Data,” Communications in Statistics - Simulation and Computation, 26, 1197–1227. DOI: 10.1080/03610919708813435.
   Web of Science ®Google Scholar
• Keich, U., and Nagarajan, N. (2006), “A Fast and Numerically Robust Method for Exact Multinomial Goodness-of-Fit Test,” Journal of Computational and Graphical Statistics, 15, 779–802. DOI: 10.1198/106186006X159377.
   Web of Science ®Google Scholar
• Koehler, K. J., and Larntz, K. (1980), “An Empirical Investigation of Goodness-of-Fit Statistics for Sparse Multinomials,” Journal of the American Statistical Association, 75, 336–344. DOI: 10.1080/01621459.1980.10477473.
   Web of Science ®Google Scholar
• Kotze, T. J. V. W., and Gokhale, D. V. (1980), “A Comparison of the Pearson-X2 and Log-Likelihood-Ratio Statistics for Small Samples by Means of Probability Ordering,” Journal of Statistical Computation and Simulation, 12, 1–13. DOI: 10.1080/00949658008810422.
   Web of Science ®Google Scholar
• Lehmann, E. L., and Romano, J. P. (2005), Testing Statistical Hypotheses. Springer Texts in Statistics (3rd ed.), New York: Springer.
   Google Scholar
• Malloy, M. L., Tripathy, A., and Nowak, R. D. (2021), “Optimal Confidence Sets for the Multinomial Parameter,” in 2021 IEEE International Symposium on Information Theory (ISIT), pp. 2173–2178. DOI: 10.1109/ISIT45174.2021.9517964.
   Google Scholar
• McDonald, J. H. (2009), Handbook of Biological Statistics (2nd ed.), Baltimore: Sparky House Publishing.
   Google Scholar
• Menzel, U. (2013), EMT: Exact Multinomial Test: Goodness-of-Fit Test for Discrete Multivariate Data. R package version 1.1. Available at https://CRAN.R-project.org/package=EMT.
   Google Scholar
• Murota, K. (2003), Discrete Convex Analysis. SIAM Monographs on Discrete Mathematics and Applications, Philadelphia: Society for Industrial and Applied Mathematics (SIAM).
   Google Scholar
• Pérez, T., and Pardo, J. A. (2003), “On Choosing a Goodness-of-Fit Test for Discrete Multivariate Data,” Kybernetes, 32, 1405–1424. DOI: 10.1108/03684920310493323.
   Web of Science ®Google Scholar
• R Core Team (2020), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing. Available at https://www.R-project.org/.
   Google Scholar
• Radlow, R., and Alf, E. F. J. (1975), “An Alternate Multinomial Assessment of the Accuracy of the χ2 Test of Goodness of Fit,” Journal of the American Statistical Association, 70, 811–813.
   Web of Science ®Google Scholar
• Rahmann, S. (2003), “Dynamic Programming Algorithms for Two Statistical Problems in Computational Biology,” in Algorithms in Bioinformatics. WABI 2003., Lecture Notes in Computer Science (Vol. 2812), pp. 151–164, Berlin, Heidelberg: Springer.
   Google Scholar
• Resin, J. (2020), ExactMultinom: Multinomial Goodness-of-Fit Tests. R package version 0.1.2. Available at https://CRAN.R-project.org/package=ExactMultinom.
   Google Scholar
• Resin, J. (2021), CalSim: The Calibration Simplex. R package version 0.5.2. Available at https://CRAN.R-project.org/package=CalSim.
   Google Scholar
• Tate, M. W., and Hyer, L. A. (1973), “Inaccuracy of the X2 Test of Goodness of Fit when Expected Frequencies are Small,” Journal of the American Statistical Association, 68, 836–841.
   Web of Science ®Google Scholar
• Van der Vaart, A. W. (1998), Asymptotic Statistics, Volume 3 of Cambridge Series in Statistical and Probabilistic Mathematics, Cambridge: Cambridge University Press.
   Google Scholar
• Wakimoto, K., Odaka, Y., and Kang, L. (1987), “Testing the Goodness of Fit of the Multinomial Distribution based on Graphical Representation,” Computational Statistics & Data Analysis, 5, 137–147.
   Web of Science ®Google Scholar
• West, E. N., and Kempthorne, O. (1972), “A Comparison of the Chi2 and Likelihood Ratio Tests for Composite Alternatives,” Journal of Statistical Computation and Simulation, 1, 1–33. DOI: 10.1080/00949657208810001.
   Google Scholar
• Wilks, D. S. (2013), “The Calibration Simplex: A Generalization of the Reliability Diagram for Three-Category Probability Forecasts,” Weather and Forecasting, 28, 1210–1218. DOI: 10.1175/WAF-D-13-00027.1.
   Web of Science ®Google Scholar