Analytical approaches and estimands to take account of missing patient-reported data in longitudinal studies

References

• Food and Drug Administration. Guidance for industry on patient reported outcome measures: use in medical product development to support labeling claims. Fed Regist. 2009;74:65132–65133.
   Google Scholar
• Avorn J, Kesselheim AS. The 21st Century Cures Act–will it take us back in time? N Engl J Med. 2015;372(26):2473–2475. doi:10.1056/NEJMp150696426039522
   PubMed Web of Science ®Google Scholar
• Chan EK, Jamieson C, Metin H, Hudgens S. Missing data in patient-reported outcomes: regulatory, statistical, and operational perspectives. Value Health. 2018;21:S227. doi:10.1016/j.jval.2018.04.1539
   Web of Science ®Google Scholar
• Bell ML, Fiero M, Horton NJ, Hsu CH. Handling missing data in RCTs; a review of the top medical journals. BMC Med Res Methodol. 2014;14(1):118. doi:10.1186/1471-2288-14-11825407057
   PubMed Web of Science ®Google Scholar
• Fiero MH, Huang S, Oren E, Bell ML. Statistical analysis and handling of missing data in cluster randomized trials: a systematic review. Trials. 2016;17(1):1–10. doi:10.1186/s13063-015-1128-926725476
   PubMed Web of Science ®Google Scholar
• Rabe BA, Day S, Fiero MH, Bell ML. Missing data handling in non-inferiority and equivalence trials: a systematic review. Pharm Stat. 2018. doi:10.1002/pst.1867
   Web of Science ®Google Scholar
• National Research Council. The Prevention and Treatment of Missing Data in Clinical Trials. Washington (DC): National Academies Press; 2010.
   Google Scholar
• Rubin DB. Inference and missing data. Biometrika. 1976;63:581–592.
   Web of Science ®Google Scholar
• Mallinckrodt C, Lipkovich I. Analyzing Longitudinal Clinical Trial Data: A Practical Guide. Boca Raton, FL: Chapman and Hall/CRC; 2016.
   Google Scholar
• Bell ML, Fairclough DL. Practical and statistical issues in missing data for longitudinal patient-reported outcomes. Stat Methods Med Res. 2014;23(5):440–459. doi:10.1177/096228021347637823427225
   PubMed Web of Science ®Google Scholar
• Kenward MG, Molenberghs G. Last observation carried forward: a crystal ball? J Biopharm Stat. 2009;19:872–888. doi:10.1080/1054340090310540620183449
   PubMed Web of Science ®Google Scholar
• Little RJ, D’Agostino R, Cohen ML, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367(14):1355–1360. doi:10.1056/NEJMsr120373023034025
   PubMed Web of Science ®Google Scholar
• LaVange LM, Permutt T. A regulatory perspective on missing data in the aftermath of the NRC report. Stat Med. 2015:2853–2864.
   Web of Science ®Google Scholar
• Little RJ, Cohen ML, Dickersin K, et al. The design and conduct of clinical trials to limit missing data. Stat Med. 2012;31(28):3433–3443. doi:10.1002/sim.551922829439
   PubMed Web of Science ®Google Scholar
• Mallinckrodt CH, Lin Q, Lipkovich I, Molenberghs G. A structured approach to choosing estimands and estimators in longitudinal clinical trials. Pharm Stat. 2012;11(6):456–461. doi:10.1002/pst.153622962024
   PubMed Web of Science ®Google Scholar
• Permutt T. Sensitivity analysis for missing data in regulatory submissions. Stat Med. 2015;35(17):2876–2879. doi:10.1002/sim.675326567763
   PubMed Web of Science ®Google Scholar
• Carpenter J, Roger J, Kenward M. Analysis of longitudinal trials with protocol deviations: a framework for relevant, accessible assumptions and inference via multiple imputation. J Biopharm Stat. 2013;23(6):1352–1371. doi:10.1080/10543406.2013.83491124138436
   PubMed Web of Science ®Google Scholar
• Harmonisation ICo. ICH E9(R1) estimands and sensitivity analysis in clinical trials; 2017 Available from: http://www.ich.org/products/guidelines/efficacy/article/efficacy-guidelines.html. Accessed August 20, 2018.
   Google Scholar
• Alshurafa M, Briel M, Akl EA, et al. Inconsistent definitions for intention-to-treat in relation to missing outcome data: systematic review of the methods literature. PLoS One. 2012;7(11):e49163. doi:10.1371/journal.pone.004916323166608
   PubMed Web of Science ®Google Scholar
• Hernan MA, Robins JM. Per-protocol analyses of pragmatic trials. N Engl J Med. 2017;377(14):1391–1398. doi:10.1056/NEJMsm160538528976864
   PubMed Web of Science ®Google Scholar
• White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trials. 2012;9:396–407. doi:10.1177/174077451245009822752633
   PubMed Web of Science ®Google Scholar
• Dhillon HM, van der Ploeg HP, Bell ML, Boyer M, Clarke S, Vardy J. The impact of physical activity on fatigue and quality of life in lung cancer patients: a randomised controlled trial protocol. BMC Cancer. 2012;12(1):572. doi:10.1186/1471-2407-12-57223216897
   PubMed Web of Science ®Google Scholar
• Butow PN, Bell ML, Smith AB, et al. Conquer fear: protocol of a randomised controlled trial of a psychological intervention to reduce fear of cancer recurrence. BMC Cancer. 2013;13(1):201. doi:10.1186/1471-2407-13-20123617696
   PubMed Web of Science ®Google Scholar
• Mallinckrodt C, Molenberghs G, Rathmann S. Choosing estimands in clinical trials with missing data. Pharm Stat. 2017;16(1):29–36. doi:10.1002/pst.176527492760
   PubMed Web of Science ®Google Scholar
• Groenwold RHH, Moons KGM, Vandenbroucke JP. Randomized trials with missing outcome data: how to analyze and what to report. CMAJ. 2014;186(15):1153–1157. doi:10.1503/cmaj.13135324778353
   PubMed Web of Science ®Google Scholar
• Bell ML, Horton NJ, Dhillon HM, Bray VJ, Vardy J. Using generalized estimating equations and extensions in randomized trials with missing longitudinal patient reported outcome data. Psychooncology. 2018;27(9):2125–2131. doi:10.1002/pon.477729802657
   PubMed Web of Science ®Google Scholar
• Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.
   Google Scholar
• Carpenter J, Kenward M. Missing Data in Randomised Controlled Trials - a Practical Guide. Vol Publication RM03/JH17/MK. Birmingham: National Institute for Health Research; 2008 Available from: http://www.pcpoh.bham.ac.uk/publichealth/methodology/projects/RM03_JH17_MK.shtml. Accessed May 26, 2010.
   Google Scholar
• Fairclough DL. Design and Analysis of Quality of Life Studies in Clincial Trials. 2nd ed. Boca Raton (FL): Chapman & Hall/CRC; 2010.
   Google Scholar
• Bell ML, McKenzie JE. Designing psycho‐oncology randomised trials and cluster randomised trials: variance components and intra‐cluster correlation of commonly used psychosocial measures. Psycho‐Oncol. 2013;22(8):1738–1747. doi:10.1002/pon.3205
   Web of Science ®Google Scholar
• Mallinckrodt CH, Lane PW, Schnell D, Peng Y, Mancuso JP. Recommendations for the primary analysis of continuous endpoints in longitudinal clinical trials. Drug Inf J. 2008;42(4):303–319. doi:10.1177/009286150804200402
   Web of Science ®Google Scholar
• Fitzmaurice GM, Laird NM, Ware JH. Applied Longitudinal Analysis. 2nd ed. Hoboken (NJ): Wiley; 2011.
   Google Scholar
• Bell ML, King MT, Fairclough DL. Bias in area under the curve for longitudinal clinical trials with missing patient reported outcome data summary measures versus summary statistics. SAGE Open. 2014;4(2):2158244014534858. doi:10.1177/2158244014534858
   Google Scholar
• Tilling K, Williamson EJ, Spratt M, Sterne JA, Carpenter JR. Appropriate inclusion of interactions was needed to avoid bias in multiple imputation. J Clin Epidemiol. 2016;80:107–115. doi:10.1016/j.jclinepi.2016.07.00427445178
   PubMed Web of Science ®Google Scholar
• Graham JW, Olchowski AE, Gilreath TD. How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prev Sci. 2007;8(3):206–213. doi:10.1007/s11121-007-0070-917549635
   PubMed Web of Science ®Google Scholar
• Sullivan TR, White IR, Salter AB, Ryan P, Lee KJ. Should multiple imputation be the method of choice for handling missing data in randomized trials? Stat Methods Med Res. 2018;27(9):2610–2626. doi:10.1177/096228021668357028034175
   PubMed Web of Science ®Google Scholar
• Rodwell L, Lee KJ, Romaniuk H, Carlin JB. Comparison of methods for imputing limited-range variables: a simulation study. BMC Med Res Methodol. 2014;14:57. doi:10.1186/1471-2288-14-5724766825
   PubMed Web of Science ®Google Scholar
• Azur MJ, Stuart EA, Frangakis C, Leaf PJ. Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res. 2011;20(1):40–49. doi:10.1002/mpr.32921499542
   PubMed Web of Science ®Google Scholar
• Van Buuren S. Multiple imputation of discrete and continuous data by fully conditional specification. Stat Methods Med Res. 2007;16:219–242. doi:10.1177/096228020607446317621469
   PubMed Web of Science ®Google Scholar
• Van Buuren S. Multiple imputation of multilevel data In: Handbook of Advanced Multilevel Analysis. 2011:173–196.
   Google Scholar
• Carpenter J, Kenward M. Multiple Imputation and Its Application. New York: John Wiley & Sons; 2013.
   Google Scholar
• Van Buuren S. Flexible Imputation of Missing Data. 2nd ed. Boca Raton (FL): CRC/Chapman; 2012.
   Google Scholar
• Preisser JS, Lohman KK, Rathouz PJ. Performance of weighted estimating equations for longitudinal binary data with drop-outs missing at random. Stat Med. 2002;21(20):3035–3054. doi:10.1002/sim.124112369080
   PubMed Web of Science ®Google Scholar
• Lin G, Rodriguez RN. Weighted methods for analyzing missing data with the GEE procedure. Paper SAS166-2015. 2015.
   Google Scholar
• Hedeker D, Mermelstein RJ, Demirtas H. Analysis of binary outcomes with missing data: missing= smoking, last observation carried forward, and a little multiple imputation. Addiction. 2007;102(10):1564–1573. doi:10.1111/j.1360-0443.2007.01946.x17854333
   PubMed Web of Science ®Google Scholar
• Nelson DB, Partin MR, Fu SS, Joseph AM, An LC. Why assigning ongoing tobacco use is not necessarily a conservative approach to handling missing tobacco cessation outcomes. Nicotine Tob Res. 2009;11(1):77–83. doi:10.1093/ntr/ntn01319246444
   PubMed Web of Science ®Google Scholar
• Freemantle N, Calvert M, Wood J, Eastaugh J, Griffin C. Composite outcomes in randomized trials: greater precision but with greater uncertainty? JAMA. 2003;289(19):2554–2559. doi:10.1001/jama.289.19.255412759327
   PubMed Web of Science ®Google Scholar
• Bell ML, Dhillon HM, Bray VJ, Vardy JL. Important differences and meaningful changes for the Functional Assessment of Cancer Therapy-Cognitive Function (FACT-Cog). JPRO. 2018;2:48. doi:10.1186/s41687-018-0071-4
   Google Scholar
• Mallinckrodt C, Roger J, Chuang-Stein C, et al. Missing data: turning guidance into action. Stat Biopharm Res. 2013;5(4):369–382. doi:10.1080/19466315.2013.848822
   Web of Science ®Google Scholar
• Permutt T, Li F. Trimmed means for symptom trials with dropouts. Pharm Stat. 2017;16(1):20–28. doi:10.1002/pst.176827523396
   PubMed Web of Science ®Google Scholar
• Ayele BT, Lipkovich I, Molenberghs G, Mallinckrodt CH. A multiple-imputation-based approach to sensitivity analyses and effectiveness assessments in longitudinal clinical trials. J Biopharm Stat. 2014;24(2):211–228. doi:10.1080/10543406.2013.85914824605966
   PubMed Web of Science ®Google Scholar
• Liu GF, Pang L. On analysis of longitudinal clinical trials with missing data using reference-based imputation. J Biopharm Stat. 2016;26(5):924–936. doi:10.1080/10543406.2015.109481026418282
   PubMed Web of Science ®Google Scholar
• Yuan Y. Sensitivity Analysis in Multiple Imputation for Missing Data. Cary, NC: SAS Intitute Inc; 2014.
   Google Scholar
• Leacy FP, Floyd S, Yates TA, White IR. Analyses of sensitivity to the missing-at-random assumption using multiple imputation with delta adjustment: application to a tuberculosis/HIV prevalence survey with incomplete HIV-status data. Am J Epidemiol. 2017;185(4):304–315. doi:10.1093/aje/kww10728073767
   PubMed Web of Science ®Google Scholar
• Tompsett DM, Leacy F, Moreno-Betancur M, Heron J, White IR. On the use of the not-at-random fully conditional specification (NARFCS) procedure in practice. Stat Med. 2018;37(15):2338–2353. doi:10.1002/sim.764329611205
   PubMed Web of Science ®Google Scholar
• Bray VJ, Dhillon HM, Bell ML, et al. Evaluation of a web-based cognitive rehabilitation program in cancer survivors reporting cognitive symptoms after chemotherapy. J Clin Oncol. 2017;35(2):217–225. doi:10.1200/JCO.2016.67.820128056205
   PubMed Web of Science ®Google Scholar
• Science P. Brain training that works. Available from: http://www.brainhq.com/. Accessed February 2, 2017.
   Google Scholar