Statistical Challenges in Development of Prognostic Models in Diffuse Large B-Cell Lymphoma: Comparison Between Existing Models – A Systematic Review

References

• Shipp MA. A predictive model for aggressive non-hodgkin’s lymphoma. the international non-hodgkin’s lymphoma prognostic factors project. N Engl J Med. 1993;329:987–994.8141877
   PubMed Web of Science ®Google Scholar
• Zhou Z, Sehn LH, Rademaker AW, et al. An enhanced international prognostic index (NCCN-IPI) for patients with diffuse large B-cell lymphoma treated in the rituximab era. Blood. 2014;123(6):837–842. doi:10.1182/blood-2013-09-52410824264230
   PubMed Web of Science ®Google Scholar
• Advani RH, Chen H, Habermann TM, et al. Comparison of conventional prognostic indices in patients older than 60 years with diffuse large B-cell lymphoma treated with R-CHOP in the US Intergroup Study (ECOG 4494, CALGB 9793): consideration of age greater than 70 years in an elderly prognostic index (E-IPI). Br J Haematol. 2010;151(2):143–151. doi:10.1111/j.1365-2141.2010.08331.x20735398
   PubMed Web of Science ®Google Scholar
• Sehn LH, Berry B, Chhanabhai M, et al. The revised international prognostic index (R-IPI) is a better predictor of outcome than the standard IPI for patients with diffuse large B-cell lymphoma treated with R-CHOP. Blood. 2007;109(5):1857–1861. doi:10.1182/blood-2006-08-03825717105812
   PubMed Web of Science ®Google Scholar
• Hong J, Kim SJ, Chang MH, et al. Improved prognostic stratification using NCCN- and GELTAMO-international prognostic index in patients with diffuse large B-cell lymphoma. Oncotarget. 2017;8(54):92171–92182. doi:10.18632/oncotarget.2098829190906
   PubMedGoogle Scholar
• Saygin C, Jia X, Hill B, et al. Impact of comorbidities on outcomes of elderly patients with diffuse large B-cell lymphoma. Am J Hematol. 2017;92:989–996.28612386
   PubMed Web of Science ®Google Scholar
• Salles G, de Jong D, Xie W, et al. Prognostic significance of immunohistochemical biomarkers in diffuse large B-cell lymphoma: a study from the lunenburg lymphoma biomarker consortium. Blood. 2011;117:7070–7078.21536860
   PubMed Web of Science ®Google Scholar
• Tomita N, Sakai R, Fujisawa S, et al. SIL index, comprising stage, soluble interleukin-2 receptor, and lactate dehydrogenase, is a useful prognostic predictor in diffuse large B-cell lymphoma. Cancer Sci. 2012;103:1518–1523.22587388
   PubMed Web of Science ®Google Scholar
• Huang Y-C, Liu C-Y, Lu H-J, et al. Comparison of prognostic models for patients with diffuse large B-cell lymphoma in the rituximab era. Ann Hematol. 2013;92:1513–1520.23775580
   PubMed Web of Science ®Google Scholar
• Melchardt T, Troppan K, Weiss L, et al. A modified scoring of the NCCN-IPI is more accurate in the elderly and is improved by albumin and β 2 -microglobulin. Br J Haematol. 2015;168(2):239–245. doi:10.1111/bjh.1311625236324
   PubMed Web of Science ®Google Scholar
• Xu-Monette ZY, Li L, Byrd JC, et al. Assessment of CD37 B-cell antigen and cell-of-origin significantly improves risk prediction in diffuse large B-cell lymphoma. Blood. 2016;128(26):3083–3100. doi:10.1182/blood-2016-05-71509427760757
   PubMed Web of Science ®Google Scholar
• Lanic H, Mareschal S, Mechken F, et al. Interim positron emission tomography scan associated with international prognostic index and germinal center B cell-like signature as prognostic index in diffuse large B-cell lymphoma. Leuk Lymphoma. 2012;53(1):34–42. doi:10.3109/10428194.2011.60048221806349
   PubMed Web of Science ®Google Scholar
• Barrans SL, Carter I, Owen RG, et al. Germinal center phenotype and bcl-2 expression combined with the International Prognostic Index improves patient risk stratification in diffuse large B-cell lymphoma. Blood. 2002;99(4):1136–1143. doi:10.1182/blood.V99.4.113611830458
   PubMed Web of Science ®Google Scholar
• Jung S-H, Yang D-H, Ahn J-S, Kim Y-K, Kim H-J, Lee -J-J. Serum lactate dehydrogenase with a systemic inflammation score is useful for predicting response and survival in patients with newly diagnosed diffuse large B-cell lymphoma. Acta Haematol. 2015;133(1):10–17. doi:10.1159/00036006824969101
   PubMed Web of Science ®Google Scholar
• Kim S-H, Go S-I, Seo J, et al. Prognostic impact of pretreatment albumin to globulin ratio in patients with diffuse large B-cell lymphoma treated with R-CHOP. Leuk Res. 2018;71:100–105. doi:10.1016/j.leukres.2018.07.01430048838
   PubMed Web of Science ®Google Scholar
• Gao R, Liang J-H, Wang L, et al. Low serum cholesterol levels predict inferior prognosis and improve NCCN-IPI scoring in diffuse large B cell lymphoma. Int J Cancer. 2018;143(8):1884–1895. doi:10.1002/ijc.3159029744861
   PubMed Web of Science ®Google Scholar
• Caetano SJ, Sonpavde G, Pond GR. C-statistic: a brief explanation of its construction, interpretation and limitations. Eur J Cancer. 2018;90:130–132. doi:10.1016/j.ejca.2017.10.02729221899
   PubMed Web of Science ®Google Scholar
• Vrieze SI. Model selection and psychological theory: a discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC). Psychol Methods. 2012;17(2):228–243. doi:10.1037/a002712722309957
   PubMed Web of Science ®Google Scholar
• Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21(1):128–138. doi:10.1097/EDE.0b013e3181c30fb220010215
   PubMed Web of Science ®Google Scholar
• Tripepi G, Jager KJ, Dekker FW, Zoccali C. Statistical methods for the assessment of prognostic biomarkers (Part I): discrimination. Nephrol Dial Transplant. 2010;25(5):1399–1401. doi:10.1093/ndt/gfq01820139066
   PubMed Web of Science ®Google Scholar
• Tripepi G, Jager KJ, Dekker FW, Zoccali C. Testing for causality and prognosis: etiological and prognostic models. Kidney Int. 2008;74(12):1512–1515. doi:10.1038/ki.2008.41618716602
   PubMed Web of Science ®Google Scholar
• Uno H, Cai T, Pencina MJ, D’Agostino RB, Wei LJ. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med. 2011;30(10):1105–1117. doi:10.1002/sim.415421484848
   PubMed Web of Science ®Google Scholar
• Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100. doi:10.1371/journal.pmed.100010019621070
   PubMed Web of Science ®Google Scholar
• Jelicic J, Larsen TS, Maksimovic M, Trajkovic G. Available prognostic models for risk stratification of diffuse large B cell lymphoma patients: a systematic review. Crit Rev Oncol Hematol. 2019;133:1–16. doi:10.1016/j.critrevonc.2018.10.00630661646
   PubMed Web of Science ®Google Scholar
• Chow A, Phillips M, Siew T, et al. Prognostic nomogram for diffuse large B-cell lymphoma incorporating the international prognostic index with interim-positron emission tomography findings. Intern Med J. 2013;43(8):932–939. doi:10.1111/imj.1219423692386
   PubMed Web of Science ®Google Scholar
• Zhong H, Chen J, Cheng S, et al. Prognostic nomogram incorporating inflammatory cytokines for overall survival in patients with aggressive non-Hodgkin’s lymphoma. EBioMedicine. 2019;41:167–174. doi:10.1016/j.ebiom.2019.02.04830827933
   PubMed Web of Science ®Google Scholar
• Han Y, Yang J, Liu P, et al. Prognostic nomogram for overall survival in patients with diffuse large B-cell lymphoma. Oncologist. 2019;24(11):e1251–e1261. doi:10.1634/theoncologist.2018-036130952824
   PubMed Web of Science ®Google Scholar
• Biccler JL, Eloranta S, de Nully Brown P, et al. Optimizing outcome prediction in diffuse large B-cell lymphoma by use of machine learning and nationwide lymphoma registries: a nordic lymphoma group study. JCO Clin Cancer Informatics. 2018;2(2):1–13. doi:10.1200/CCI.18.00025
   Web of Science ®Google Scholar
• Go S-I, Park MJ, Song H-N, et al. Prognostic impact of sarcopenia in patients with diffuse large B-cell lymphoma treated with rituximab plus cyclophosphamide, doxorubicin, vincristine, and prednisone. J Cachexia Sarcopenia Muscle. 2016;7(5):567–576. doi:10.1002/jcsm.1211527104110
   PubMed Web of Science ®Google Scholar
• Go S-I, Park S, Kim JH, et al. A new prognostic model using the NCCN-IPI and neutrophil-to-lymphocyte ratio in diffuse large B-cell lymphoma. Tumori J. 2018;104(4):292–299. doi:10.5301/tj.5000694
   PubMed Web of Science ®Google Scholar
• Procházka V, Pytlík R, Janíková A, et al. A new prognostic score for elderly patients with diffuse large B-cell lymphoma treated with R-CHOP: the prognostic role of blood monocyte and lymphocyte counts is absent. PLoS One. 2014;9(7):e102594. doi:10.1371/journal.pone.010259425058337
   PubMed Web of Science ®Google Scholar
• Gang AO, Pedersen M, d’Amore F, et al. A clinically based prognostic index for diffuse large B-cell lymphoma with a cut-off at 70 years of age significantly improves prognostic stratification: population-based analysis from the danish lymphoma registry. Leuk Lymphoma. 2015;56(9):2556–2562. doi:10.3109/10428194.2015.101007825629994
   PubMed Web of Science ®Google Scholar
• Keane C, Tobin J, Talaulikar D, et al. A high LDH to absolute lymphocyte count ratio in patients with DLBCL predicts for a poor intratumoral immune response and inferior survival. Oncotarget. 2018;9(34):23620–23627. doi:10.18632/oncotarget.2530629805761
   PubMedGoogle Scholar
• Kobayashi T, Kuroda J, Yokota I, et al. The kyoto prognostic index for patients with diffuse large B-cell lymphoma in the rituximab era. Blood Cancer J. 2016;6(1):e383–e383. doi:10.1038/bcj.2015.11126771809
   PubMed Web of Science ®Google Scholar
• Miura K, Konishi J, Miyake T, et al. A host-dependent prognostic model for elderly patients with diffuse large B-cell lymphoma. Oncologist. 2017;22(5):554–560. doi:10.1634/theoncologist.2016-026028408622
   PubMed Web of Science ®Google Scholar
• Montalbán C, Díaz-López A, Dlouhy I, et al. Validation of the NCCN-IPI for diffuse large B-cell lymphoma (DLBCL): the addition of β 2 -microglobulin yields a more accurate GELTAMO-IPI. Br J Haematol. 2017;176(6):918–928. doi:10.1111/bjh.1448928106247
   PubMed Web of Science ®Google Scholar
• Chen Y, Neelapu S, Feng L, et al. Prognostic significance of baseline peripheral absolute neutrophil, monocyte and serum β2-microglobulin level in patients with diffuse large b-cell lymphoma: a new prognostic model. Br J Haematol. 2016;175(2):290–299. doi:10.1111/bjh.1423727448187
   PubMed Web of Science ®Google Scholar
• Kang J, Yoon S, Suh C. Relevance of prognostic index with β2-microglobulin for patients with diffuse large B-cell lymphoma in the rituximab era. Blood Res. 2017;52(4):276. doi:10.5045/br.2017.52.4.27629333404
   PubMed Web of Science ®Google Scholar
• Antic D, Jelicic J, Trajkovic G, et al. Is it possible to improve prognostic value of NCCN-IPI in patients with diffuse large B cell lymphoma? The prognostic significance of comorbidities. Ann Hematol. 2018;97(2):267–276. doi:10.1007/s00277-017-3170-z29130134
   PubMed Web of Science ®Google Scholar
• Kanemasa Y, Shimoyama T, Sasaki Y, et al. Beta-2 microglobulin as a significant prognostic factor and a new risk model for patients with diffuse large B-cell lymphoma. Hematol Oncol. 2017;35(4):440–446. doi:10.1002/hon.231227238634
   PubMed Web of Science ®Google Scholar
• Yue W, Liu B, Gao L, et al. The pretreatment albumin to globulin ratio as a significant predictor in patients with diffuse large B cell lymphoma. Clin Chim Acta. 2018;485:316–322. doi:10.1016/j.cca.2018.07.01530006285
   PubMed Web of Science ®Google Scholar
• Wilcox RA, Ristow K, Habermann TM, et al. The absolute monocyte and lymphocyte prognostic score predicts survival and identifies high-risk patients in diffuse large-B-cell lymphoma. Leukemia. 2011;25(9):1502–1509. doi:10.1038/leu.2011.11221606957
   PubMed Web of Science ®Google Scholar
• Ho C-L, Lu C-S, Chen J-H, Chen Y-G, Huang T-C, Wu -Y-Y. Neutrophil/lymphocyte ratio, lymphocyte/monocyte ratio, and absolute lymphocyte count/absolute monocyte count prognostic score in diffuse large B-cell lymphoma. Medicine (Baltimore). 2015;94(24):e993. doi:10.1097/MD.000000000000099326091479
   PubMed Web of Science ®Google Scholar
• Sun F, Zhu J, Lu S, et al. An inflammation-based cumulative prognostic score system in patients with diffuse large B cell lymphoma in rituximab era. BMC Cancer. 2018;18:5.29291712
   PubMed Web of Science ®Google Scholar
• Zhao P, Zang L, Zhang X, et al. Novel prognostic scoring system for diffuse large B-cell lymphoma. Oncol Lett. 2018;15(4):5325–5332. doi:10.3892/ol.2018.796629552174
   PubMed Web of Science ®Google Scholar
• Toledano MN, Vera P, Tilly H, Jardin F, Becker S. Comparison of therapeutic evaluation criteria in FDG-PET/CT in patients with diffuse large-cell B-cell lymphoma: prognostic impact of tumor/liver ratio. PLoS One. 2019;14(2):e0211649. doi:10.1371/journal.pone.021164930730936
   PubMed Web of Science ®Google Scholar
• Li X, Sun X, Li J, et al. Interim PET/CT based on visual and semiquantitative analysis predicts survival in patients with diffuse large B-cell lymphoma. Cancer Med. 2019;8;cam4.2404.
   Web of Science ®Google Scholar
• Chen Z, Deng X, Ye Y, et al. Novel risk stratification of de novo diffuse large B cell lymphoma based on tumour-infiltrating T lymphocytes evaluated by flow cytometry. Ann Hematol. 2019;98:391–399.30377764
   PubMed Web of Science ®Google Scholar
• Aoki K, Tabata S, Yonetani N, Matsushita A, Ishikawa T. The prognostic impact of absolute lymphocyte and monocyte counts at diagnosis of diffuse large B-cell lymphoma in the rituximab era. Acta Haematol. 2013;130(4):242–246. doi:10.1159/00035048423860478
   PubMed Web of Science ®Google Scholar
• Batty N, Ghonimi E, Feng L, et al. The absolute monocyte and lymphocyte prognostic index for patients with diffuse large B-cell lymphoma who receive R-CHOP. Clin Lymphoma Myeloma Leuk. 2013;13(1):15–18. doi:10.1016/j.clml.2012.09.00923137719
   PubMed Web of Science ®Google Scholar
• Ochi Y, Kazuma Y, Hiramoto N, et al. Utility of a simple prognostic stratification based on platelet counts and serum albumin levels in elderly patients with diffuse large B cell lymphoma. Ann Hematol. 2017;96(1):1–8. doi:10.1007/s00277-016-2819-3
   PubMed Web of Science ®Google Scholar
• Nakayama S, Matsuda M, Adachi T, et al. Novel prognostic index based on hemoglobin level and platelet count for diffuse large B-cell lymphoma, not otherwise specified in the R-CHOP era. Platelets. 2019;30:637–645.30047815
   PubMed Web of Science ®Google Scholar
• Conconi A, Zucca E, Roggero E, et al. Prognostic models for diffuse large B-cell lymphoma. Hematol Oncol. 2000;18:61–73.10960876
   PubMed Web of Science ®Google Scholar
• Candelaria M, Reynoso-Noverón N, Ponce M, Castillo-Llanos R, Nolasco-Medina D, Cantú-De-Leon D. A prognostic score for survival in patients older than 65 years with diffuse large B-cell lymphoma. Rev Invest Clin. 2018;70:46–52.29513304
   PubMedGoogle Scholar
• Cox MC, Nofroni I, Ruco L, et al. Low absolute lymphocyte count is a poor prognostic factor in diffuse-large-B-cell-lymphoma. Leuk Lymphoma. 2008;49:1745–1751.18798109
   PubMed Web of Science ®Google Scholar
• Kong Y, Qu L, Li Y, Liu D, Lv X, Han J. Predictive significance of a new prognostic score for patients with diffuse large B-cell lymphoma in the interim-positron emission tomography findings. Medicine (Baltimore). 2016;95:e2808.26871850
   PubMed Web of Science ®Google Scholar
• Pardal E, Díez Baeza E, Salas Q, et al. A new prognostic model identifies patients aged 80 years and older with diffuse large B-cell lymphoma who may benefit from curative treatment: a multicenter, retrospective analysis by the Spanish GELTAMO group. Am J Hematol. 2018;93:867–873.29658143
   PubMed Web of Science ®Google Scholar
• Matsumoto K, Fujisawa S, Ando T, et al. Anemia associated with worse outcome in diffuse large B-cell lymphoma patients: a single-center retrospective study. Turkish J Haematol off J Turkish Soc Haematol. 2018;35:181–184.
   Web of Science ®Google Scholar
• Gao R, Liang J-H, Man T-S, et al. Diabetes mellitus predicts inferior survival in diffuse large B-cell lymphoma: a propensity score-matched analysis. Cancer Manag Res. 2019;11:2849–2870.31114337
   PubMed Web of Science ®Google Scholar
• Nols N, Mounier N, Bouazza S, et al. Quantitative and qualitative analysis of metabolic response at interim positron emission tomography scan combined with International Prognostic Index is highly predictive of outcome in diffuse large B-cell lymphoma. Leuk Lymphoma. 2014;55:773–780.23927393
   PubMed Web of Science ®Google Scholar
• Liu H, Zhang C-L, Feng R, Li J-T, Tian Y, Wang T. Validation and refinement of the age, comorbidities, and albumin index in elderly patients with diffuse large b-cell lymphoma: an effective tool for comprehensive geriatric assessment. Oncologist. 2018;23:722–729.29317552
   PubMed Web of Science ®Google Scholar
• Wang M, Long Q. Addressing issues associated with evaluating prediction models for survival endpoints based on the concordance statistic. Biometrics. 2016;72:897–906.26756274
   PubMed Web of Science ®Google Scholar
• Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating the yield of medical tests. JAMA. 1982;247:2543–2546.7069920
   PubMed Web of Science ®Google Scholar
• Akaike H Information theory and an extension of the maximum likelihood principle. Second International Symposium on Information Theory 1973, p 267–281.
   Google Scholar
• Burnham KP, Anderson DR. Multimodel inference: understanding AIC and BIC in model selection. Sociol Methods Res. 2004;33:261–304.
   Web of Science ®Google Scholar
• Pan W. Akaike’s information criterion in generalized estimating equations. Biometrics. 2001;57:120–125.11252586
   PubMed Web of Science ®Google Scholar
• Hosmer DW Jr LS. Applied Logistic Regression. Hoboken, NJ: John Wiley & Sons, Inc; 2004.
   Google Scholar
• Crowson CS, Atkinson EJ, Therneau TM. Assessing calibration of prognostic risk scores. Stat Methods Med Res. 2016;25:1692–1706.23907781
   PubMed Web of Science ®Google Scholar
• Gerds TA, Andersen PK, Kattan MW. Calibration plots for risk prediction models in the presence of competing risks. Stat Med. 2014;33:3191–3203.24668611
   PubMed Web of Science ®Google Scholar
• Hoo ZH, Candlish J, Teare D. What is an ROC curve? Emerg Med J. 2017;34:357–359.28302644
   PubMed Web of Science ®Google Scholar
• Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. 2008;26:1364–1370.18323559
   PubMed Web of Science ®Google Scholar
• Shariat SF, Karakiewicz PI, Suardi N, Kattan MW. Comparison of nomograms with other methods for predicting outcomes in prostate cancer: a critical analysis of the literature. Clin Cancer Res. 2008;14:4400–4407.18628454
   PubMed Web of Science ®Google Scholar
• He Y, Ong Y, Li X, et al. Performance of prediction models on survival outcomes of colorectal cancer with surgical resection: a systematic review and meta-analysis. Surg Oncol. 2019;29:196–202.31196488
   PubMed Web of Science ®Google Scholar
• Harkins RA, Chang A, Patel SP, et al. Remaining challenges in predicting patient outcomes for diffuse large B-cell lymphoma. Expert Rev Hematol. 2019;12:959–973.31513757
   PubMed Web of Science ®Google Scholar
• Da Costa CBT. Machine learning provides an accurate classification of diffuse large B-cell lymphoma from immunohistochemical data. J Pathol Inform. 2018;9:21.30034919
   PubMedGoogle Scholar
• Shipp MA, Ross KN, Tamayo P, et al. Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat Med. 2002;8:68–74.11786909
   PubMed Web of Science ®Google Scholar