191
Views
1
CrossRef citations to date
0
Altmetric
Research Article

Assessing model accuracy using random data split: a simulation study

&
Pages 131-139 | Received 15 Sep 2021, Accepted 03 Jun 2022, Published online: 22 Jun 2022

References

  • Altman, D. G. 2000. What do we mean by validating a prognostic model? Statistics in Medicine 19:453–473. doi:10.1002/(SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5.
  • Altman, D. G., Y. Vergouwe, P. Royston, and K. G. Moons. 2009. Prognosis and prognostic research: Validating a prognostic model. BMJ 338:b605. doi:10.1136/bmj.b605.
  • Efron, B., and R. Tibshirani. 1991. Improvements on cross validation: The bootstrap method. Journal of the American Statistical Association 92:548–560.
  • Efron, B. 2020. Prediction, estimation, and attribution. Journal of the American Statistical Association 115 (530):636–655. doi:10.1080/01621459.2020.1762613.
  • Gianfrancesco, M. A., S. Tamang, J. Yazdany, and G. Schmajuk. 2018. Potential biases in machine learning algorithms using electronic health record data. JAMA Internal Medicine 178 (11):1544–1547. doi:10.1001/jamainternmed.2018.3763.
  • McShane, L. M., and M. Y. C. Polley. 2013. Development of omics-based clinical tests for prognosis and therapy selection: The challenge of achieving statistical robustness and clinical utility. Clinical Trials 10:653–665. doi:10.1177/1740774513499458.
  • Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P., Macaskill, P., Steyerberg, E.W., Vickers, A.J., Ransohoff, D.F., and Collins, G.S. 2015. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): Explanation and elaboration. Annals of Internal Medicine 162:W1–W73. doi:10.7326/M14-0698.
  • Qin, L. X., and H. C. Huang. 2016. Cautionary note on using cross-validation for molecular classification. Journal of Clinical Oncology 34 (32):3931–3938. doi:10.1200/JCO.2016.68.1031.
  • Steyerberg, E. W., Harrell Jr, F. E., Borsboom, G. J., Eijkemans, M. J. C., Vergouwe, Y.,and Habbema, J. D. F. 2001. Internal validation of predictive models: Efficiency of some procedures for logistic regression analysis. Journal of Clinical Epidemiology 54 (8):774–781. doi:10.1016/S0895-4356(01)00341-9.
  • Terrin, N., C. H. Schmid, J. L. Griffith, R. B. D’Agostino, and H. P. Selker. 2003. External validity of predictive models: A comparison of logistic regression, classification trees, and neural networks. Journal of Clinical Epidemiology 56:721–729. doi:10.1016/S0895-4356(03)00120-3.
  • Vishnuvajjala, R. L. 0000. Issues with training, testing and validation datasets in the development of diagnostics. Proceedings of 2015 Joint Statistical Meetings Seattle, WA.
  • Wyatt, J. C., and D. G. Altman. 1995. Prognostic models: Clinically useful or quickly forgotten? British Medical Journal 311:1539–1541. doi:10.1136/bmj.311.7019.1539.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.