Hypervolume under ROC manifold for discrete biomarkers with ties

References

• Zhou XH, Obuchowski NA, McClish DK. Statistical methods in diagnostic medicine. New York (NY): John Wiley & Sons; 2002.
   Google Scholar
• Pepe MS. The statistical evaluation of medical tests for classification and prediction. Oxford: Oxford University Press; 2003.
   Google Scholar
• Krzanowski WJ, Hand DJ. ROC curves for continuous data. New York (NY): Chapman and Hall/CRC; 2009.
   Google Scholar
• Zou K, Liu A, Bandos A, et al. Statistical evaluation of diagnostic performance: topics in ROC analysis. New York (NY): CRC Press; 2012.
   Google Scholar
• Hand D, Till R. A simple generalisation of the area under the ROC curve for multiple class classification problems. Mach Learn. 2001;45:171–186.
   Web of Science ®Google Scholar
• Van Calster B, Vergouwe Y, Looman CWN, et al. Assessing the discriminative ability of risk models for more than two outcome categories: a perspective. Eur J Epidemiol. 2012;27:761–770.
   PubMed Web of Science ®Google Scholar
• Obuchowski NA. Estimating and comparing diagnostic tests accuracy when the gold standard is not binary. Acad Radiol. 2005;12:1198–1204.
   PubMed Web of Science ®Google Scholar
• Nakas CT, Yiannoutsos CT. Ordered multiple-class ROC analysis with continuous measurements. Stat Med. 2004;23:3437–3449.
   PubMed Web of Science ®Google Scholar
• Li J, Fine JP. ROC analysis with multiple tests and multiple classes: methodology and applications in microarray studies. Biostatistics. 2008;9:566–576.
   PubMed Web of Science ®Google Scholar
• Van Calster B, Van Belle V, Vergouwe Y, et al. Extending the c-statistic to nominal polytomous outcomes: the polytomous discrimination index. Stat Med. 2012;31:2610–2626.
   PubMed Web of Science ®Google Scholar
• Li J, Feng Q, Fine J, et al. Nonparametric estimation and inference for polytomous discrimination index. Stat Methods Med Res. 2018;27(10):3092–3103.
   PubMed Web of Science ®Google Scholar
• Li J, Zhou XH. Nonparametric and semiparametric estimation of the three way receiver operating characteristic surface. J Stat Plan Inference. 2009;139:4133–4142.
   Web of Science ®Google Scholar
• Li J, Zhou XH, Fine JP. A regression approach to ROC surfaces, with applications to Alzheimer's disease. Sci China Math. 2012;55:1583–1595.
   PubMed Web of Science ®Google Scholar
• Nakas CT, Dalrymple-Alford JC, Anderson TJ, et al. Generalization of Youden index for multiple-class classification problems applied to the assessment of externally validated cognition in Parkinson disease screening. Stat Med. 2012;95:995–1003.
   Google Scholar
• Pencina MJ, D'Agostino Sr. RB, Demler OV. Novel metrics for evaluating improvement in discrimination: net reclassification and integrated discrimination improvements for normal variables and nested models. Stat Med. 2012;31:101–113.
   PubMed Web of Science ®Google Scholar
• Shiu SY, Gatsonis C. On ROC analysis with non-binary reference standard. Biom J. 2012;54:457–480.
   PubMed Web of Science ®Google Scholar
• Austin P, Steyerberg E. Predictive accuracy of risk factors and markers: a simulation study of the effect of novel markers on different performance measures for logistic regression models. Stat Med. 2013;32:661–672.
   PubMed Web of Science ®Google Scholar
• Kang C, Janes H, Huang Y. Combining biomarkers to optimize patient treatment recommendations. Biometrics. 2014;70:695–720.
   PubMed Web of Science ®Google Scholar
• Kruppa J, Liu Y, Biau G, et al. Probability estimation with machine learning methods for dichotomous and multi-category outcome: theory. Biom J. 2014;56:534-–563.
   PubMed Web of Science ®Google Scholar
• Kruppa J, Liu Y, Biau G, et al. Probability estimation with machine learning methods for dichotomous and multi-category outcome: application. Biom J. 2014;56:564–583.
   PubMed Web of Science ®Google Scholar
• Shao F, Li J, Fine J, et al. Inference for reclassification statistics under nested and non-nested models for biomarker evaluation. Biomarkers. 2015;20:240–252.
   PubMed Web of Science ®Google Scholar
• Mossman D. Three-way ROCs. Med Decis Making. 1999;19:78–89.
   PubMed Web of Science ®Google Scholar
• Scurfield BK. Multiple-event forced-choice tasks in the theory of signal detectability. J Math Psychol. 1996;40:253–269.
   PubMed Web of Science ®Google Scholar
• Xiong C, Belle G, Miller JP, et al. Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groups. Stat Med. 2006;25:1251–1273.
   PubMed Web of Science ®Google Scholar
• Wang Z, Zhou X, Wang M. Evaluation of diagnostic accuracy in detecting ordered symptom statuses without a gold standard. Biostatistics. 2011;12:567–581.
   PubMed Web of Science ®Google Scholar
• Li J, Chow Y, Wong WK, et al. Sorting multiple classes in multi-dimensional ROC analysis: parametric and nonparametric approaches. Biomarkers. 2014;19(1):1–8.
   PubMed Web of Science ®Google Scholar
• Obuchowski NA. Multireader receiver operating characteristic studies: a comparison of study designs. Acad Radiol. 1995;2:709–716.
   PubMed Web of Science ®Google Scholar
• Rockette H, Gur D, Metz C. The use of continuous and discrete confidence judgment in ROC studies of diagnostic imaging techniques. Invest Radiol. 1992;27:169–172.
   PubMed Web of Science ®Google Scholar
• Coffin M, Sukhatme S. Receiver operating characteristic studies and measurement errors. Biometrics. 1997;53:823–837.
   PubMed Web of Science ®Google Scholar
• Dempster A, Rubin D. Rounding error in regression: the appropriateness of Sheppard's corrections. J R Stat Soc Ser B. 1983;45:51–59.
   Google Scholar
• Li J, Gao M, DAgostino R. Evaluating classification accuracy for modern learning approaches. Stat Med. 2019;38:2477–2503.
   PubMed Web of Science ®Google Scholar
• Novoselova N, Beffa C, Wang J, et al. HUM calculator and HUM package for R: easy-to-use software tools for multicategory receiver operating characteristic analysis. Bioinformatics. 2014;30:1635–1636.
   PubMed Web of Science ®Google Scholar
• Lehmann EL. Elements of large-sample theory. New York (NY): Springer; 1999.
   Google Scholar
• Condous G, Van Calster B, Kirk E, et al. Clinical information does not improve the performance of mathematical models in predicting the outcome of pregnancies of unknown location. Fertil Steril. 2007;88:572–580.
   PubMed Web of Science ®Google Scholar
• Van Calster B, Condous G, Kirk E, et al. An application of methods for the probabilistic three-class classification of pregnancies of unknown location. Artif Intell Med. 2009;46:139–154.
   PubMed Web of Science ®Google Scholar
• Shao J. Mathematical statistics. 2nd ed. New York (NY): Springer; 2003.
   Google Scholar