Estimands in Real-World Evidence Studies

References

• Aalen, O. O., Cook, R. J., and Røysland, K. (2015), “Does Cox Analysis of a Randomized Survival Study Yield a Causal Treatment Effect?” Lifetime Data Analysis, 21, 579–593. DOI: 10.1007/s10985-015-9335-y.
   PubMed Web of Science ®Google Scholar
• Akacha, M., Bretz, F., and Ruberg, S. (2017), “Estimands in Clinical Trials–Broadening the Perspective,” Statistics in Medicine, 36, 5–19. DOI: 10.1002/sim.7033.
   PubMed Web of Science ®Google Scholar
• Anes, A., Arana, A., Blake, K., Bonhoeffer, J., Evans, S., and Fourrier-Réglat, A. (2021), “Guide on Methodological Standards in Pharmacoepidemiology (Revision 9, 2021),” European Medicines Agency. The European Network of Centres for Pharmacoepidemiology and Pharmacovigilance (ENCePP). Accessed September 22, 2021. Available at http://www.encepp.eu/standards_and_guidances/documents/1.ENCePPMethodsGuideRev.9.pdf
   Google Scholar
• Burger, H. U., Gerlinger, C., Harbron, C., Koch, A., Posch, M., Rochon, J., and Schiel, A. (2021), “The Use of External Controls: To What Extent Can It Currently be Recommended?” Pharmaceutical Statistics, 20, 1002–1016. DOI: 10.1002/pst.2120.
   PubMed Web of Science ®Google Scholar
• Chiodini, P., Arenare, L., Piccirillo, M. C., Perrone, F., and Gallo, C. (2020), “A Phase 2, Open Label, Multicenter, Single Arm Study of Tocilizumab on the Efficacy and Tolerability of Tocilizumab in the Treatment of Patients with COVID-19 Pneumonia (TOCIVID-19 Trial): Statistical Analysis Plan,” Contemporary Clinical Trials Communications, 20, 100665. DOI: 10.1016/j.conctc.2020.100665.
   PubMed Web of Science ®Google Scholar
• Collins, R., Bowman, L., Landray, M., and Peto, R. (2020), “The Magic of Randomization versus the Myth of Real-World Evidence,” New England Journal of Medicine, 382, 674–678. DOI: 10.1056/NEJMsb1901642.
   PubMed Web of Science ®Google Scholar
• Fang, Y., He, W., Wang, H., and Wu, M. (2020), “Key Considerations in the Design of Real-World Studies,” Contemporary Clinical Trials, 96, 106091. DOI: 10.1016/j.cct.2020.106091.
   PubMed Web of Science ®Google Scholar
• FDA (2016), “BEST (Biomarkers, EndpointS, and other Tools) Resource,” FDA-NIH Biomarker Working Group, Food and Drug Administration (US), Silver Spring, MD. Date of access: Sept. 15, 2021. Available at https://www.ncbi.nlm.nih.gov/books/NBK326791/
   Google Scholar
• ——— (2018), “Framework for FDA’s Real-World Evidence Program,” U.S. Department of Health and Human Services, Food and Drug Administration. Available at https://www.fda.gov/media/120060/download
   Google Scholar
• ——— (2019), Rare Diseases: Common Issues in Drug Development (Draft Guidance), Silver Spring, MD: US Food and Drug Administration. Available at https://www.fda.gov/media/119757/download
   Google Scholar
• ——— (2021), “Real-World Data: Assessing Registries to Support Regulatory Decision-Making for Drug and Biological Products,” US Food and Drug Administration, Department of Health and Human Services. Available at https://www.fda.gov/media/154449/download
   Google Scholar
• Frank, L., Basch, E., Selby, J. V., and PCOR Institute (2014), “The PCORI Perspective on Patient-Centered Outcomes Research,” JAMA, 312, 1513–1514. DOI: 10.1001/jama.2014.11100.
   PubMed Web of Science ®Google Scholar
• Gökbuget, N., Kelsh, M., Chia, V., Advani, A., Bassan, R., Dombret, H., Doubek, M., Fielding, A. K., Giebel, S., and Haddad, V. (2016), “Blinatumomab vs Historical Standard Therapy of Adult Relapsed/Refractory Acute Lymphoblastic Leukemia,” Blood Cancer Journal, 6, e473. DOI: 10.1038/bcj.2016.84.
   PubMed Web of Science ®Google Scholar
• Greifer, N., and Stuart, E. A. (2021), “Choosing the Estimand When Matching or Weighting in Observational Studies,” arXiv preprint arXiv:2106.10577. Available at https://arxiv.org/abs/2106.10577
   Google Scholar
• Gruber, S., Lee, H., Phillips, R., Ho, M., and van der Laan, M. (2022), “Developing a Targeted Learning-Based Statistical Analysis Plan,” Statistics in Biopharmaceutical Research, 15, 468–475. DOI: 10.1080/19466315.2022.2116104.
   Web of Science ®Google Scholar
• Hernán, M. A. (2010), “The Hazard of Harzard Ratio,” Epidemiology, 21, 13–15. DOI: 10.1097/EDE.0b013e3181c1ea43.
   PubMed Web of Science ®Google Scholar
• Hernán, M. A., and Robins, J. M. (2016), “Using Big Data to Rmulate a Target Trial When a Randomized Trial is Not Available,” American Journal of Epidemiology, 183, 758–764. DOI: 10.1093/aje/kwv254.
   PubMed Web of Science ®Google Scholar
• Hernán, M. A., and Scharfstein, D. (2018), “Cautions as Regulators Move to End Exclusive Reliance on Intention To Treat,” Annals of Internal Medicine, 168, 515–516. DOI: 10.7326/M17-3354.
   PubMed Web of Science ®Google Scholar
• Ho, M., van der Laan, M., Lee, H., Chen, J., Lee, K., Fang, Y., He, W., Irony, T., Jiang, Q., and Lin, X. (2023), “The Current Landscape in Biostatistics of Real-World Data and Evidence: Causal Inference Frameworks for Study Design and Analysis,” Statistics in Biopharmaceutical Research, 15, 43–56. DOI: 10.1080/19466315.2021.1883475.
   Web of Science ®Google Scholar
• ICH (2001), “E10: Choice of Control Group in Clinical Trials,” in The International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH). Available at https://database.ich.org/sites/default/files/E10/_Guideline.pdf
   Google Scholar
• ——— (2019), “E8(R1) General Considerations for Clinical Trials,” in International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use. Accessed September 3, 2021. Available at https://www.fda.gov/media/129527/download
   Google Scholar
• ——— (2021), “E9(R1) Statistical Principles for Clinical Trials: Addendum: Estimands and Sensitivity Analysis in Clinical Trials,” in International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. Available at https://www.fda.gov/media/148473/download
   Google Scholar
• Kahan, B. C., Morris, T. P., White, I. R., Tweed, C. D., Cro, S., Dahly, D., Pham, T. M., Esmail, H., Babiker, A., and Carpenter, J. R. (2020), “Treatment Estimands in Clinical Trials of Patients Hospitalised for COVID-19: Ensuring Trials Ask the Right Questions,” BMC Medicine, 18, 1–8. DOI: 10.1186/s12916-020-01737-0.
   PubMed Web of Science ®Google Scholar
• Levenson, M., He, W., Chen, J., Fang, Y., Faries, D., Goldstein, B. A., Ho, M., Lee, K., Mishra-Kalyani, P., and Rockhold, F. (2023), “Biostatistical Considerations When Using RWD and RWE in Clinical Studies for Regulatory Purposes: A Landscape Assessment,” Statistics in Biopharmaceutical Research, 15, 3–13. DOI: 10.1080/19466315.2021.1883473.
   Web of Science ®Google Scholar
• Levenson, M., He, W., Chen, L., Dharmarajan, S., Izem, R., Meng, Z., Pang, H., and Rockhold, F. (2022), “Statistical Consideration for Fit-for-Use Real-World Data to Support Regulatory Decision Making in Drug Development,” Statistics in Biopharmaceutical Research, 15, 689–696. DOI: 10.1080/19466315.2022.2120533.
   Web of Science ®Google Scholar
• Li, C.-Y., and Sung, F.-C. (1999), “A Review of the Healthy Worker Effect in Occupational Epidemiology,” Occupational Medicine, 49, 225–229. DOI: 10.1093/occmed/49.4.225.
   PubMed Web of Science ®Google Scholar
• Li, Z., Chen, J., Laber, E., Liu, F., and Baumgartner, R. (2023), “Optimal Treatment Regimes: A Review and Empirical Comparison,” International Statistical Review. DOI: 10.1111/insr.12536.
   PubMed Web of Science ®Google Scholar
• Lipkovich, I., Ratitch, B., and Mallinckrodt, C. H. (2020), “Causal Inference and Estimands in Clinical Trials,” Statistics in Biopharmaceutical Research, 12, 54–67. DOI: 10.1080/19466315.2019.1697739.
   Web of Science ®Google Scholar
• Mahmood, S. S., Levy, D., Vasan, R. S., and Wang, T. J. (2014), “The Framingham Heart Study and the Epidemiology of Cardiovascular Disease: A Historical Perspective,” The Lancet, 383, 999–1008. DOI: 10.1016/S0140-6736(13)61752-3.
   PubMed Web of Science ®Google Scholar
• Mallinckrodt, C., Molenberghs, G., Lipkovich, I., and Ratitch, B. (2019), Estimands, Estimators and Sensitivity Analysis in Clinical Trials, New York: CRC Press. DOI: 10.1201/9780429488825.
   Google Scholar
• Mercon, K., Mahendraratnam, N., Eckert, J., Silcox, C., Romine, M., Lallinger, K., Kroetsch, A., Fazili, H., Wosióska, M., and McClellan, M. (2020), “A Roadmap for Developing Study Endpoints in Real-World Settings,” Center for Health Policy at Duke University. Date of access: Sept. 15, 2021. https://healthpolicy.duke.edu/sites/default/files/2020-08/Real-World/%20Endpoints.pdf.
   Google Scholar
• Miettinen, O., and Nurminen, M. (1985), “Comparative Analysis of Two Rates,” Statistics in Medicine, 4, 213–226. DOI: 10.1002/sim.4780040211.
   PubMed Web of Science ®Google Scholar
• Nicholas, J. A., Edwards, N. C., Edwards, R. A., Dellarole, A., Grosso, M., and Phillips, A. L. (2020), “Real-World Adherence to, and Persistence with, Once-and Twice-Daily Oral Disease-Modifying Drugs in Patients with Multiple Sclerosis: A Systematic Review and Meta-Analysis,” BMC Neurology, 20, 1–15. DOI: 10.1186/s12883-020-01830-0.
   PubMed Web of Science ®Google Scholar
• Ogundipe, O., Mazidi, M., Chin, K. L., Gor, D., McGovern, A., Sahle, B. W., Jermendy, G., Korhonen, M. J., Appiah, B., and Ademi, Z. (2021), “Real-World Adherence, Persistence, and In-class Switching During Use of Dipeptidyl Peptidase-4 Inhibitors: A Systematic Review and Meta-Analysis Involving 594,138 Patients with Type 2 Diabetes,” Acta Diabetologica, 58, 39–46. DOI: 10.1007/s00592-020-01590-w.
   PubMed Web of Science ®Google Scholar
• Patorno, E., Schneeweiss, S., Gopalakrishnan, C., Martin, D., and Franklin, J. M. (2019), “Using Real-World Data to Predict Findings of An Ongoing Phase IV Cardiovascular Outcome Trial: Cardiovascular Safety of Linagliptin versus Glimepiride,” Diabetes Care, 42, 2204–2210. DOI: 10.2337/dc19-0069.
   PubMed Web of Science ®Google Scholar
• Pearl, J. (2009). Causality: Models, Reasoning, and Inference (2nd ed.), New York: Cambridge University Press (Original edition, 2000).
   Google Scholar
• Qu, Y., Fu, H., Luo, J., and Ruberg, S. J. (2020), “A General Framework for Treatment Effect Estimators Considering Patient Adherence,” Statistics in Biopharmaceutical Research, 12, 1–18. DOI: 10.1080/19466315.2019.1700157.
   Web of Science ®Google Scholar
• Qu, Y., Shurzinske, L., and Sethuraman, S. (2021), “Defining Estimands using a Mix of Strategies to Handle Intercurrent Events in Clinical Trials,” Pharmaceutical Statistics, 20, 314–323. DOI: 10.1002/pst.2078.
   PubMed Web of Science ®Google Scholar
• Ratitch, B., Bell, J., Mallinckrodt, C., Bartlett, J. W., Goel, N., Molenberghs, G., O’Kelly, M., Singh, P., and Lipkovich, I. (2020), “Choosing Estimands in Clinical Trials: Putting the ICH E9 (R1) into Practice,” Therapeutic Innovation & Regulatory Science, 54, 324–341. DOI: 10.1007/s43441-019-00061-x.
   PubMed Web of Science ®Google Scholar
• Rios, L. P., Ye, C., and Thabane, L. (2010), “Association between Framing of the Research Question Using the PICOT Format and Reporting Quality of Randomized Controlled Trials,” BMC Medical Research Methodology, 10, 1–8. DOI: 10.1186/1471-2288-10-11.
   PubMed Web of Science ®Google Scholar
• Riva, J. J., Malik, K. M., Burnie, S. J., Endicott, A. R., and Busse, J. W. (2012), “What is your Research Question? An Introduction to the PICOT Format for Clinicians,” The Journal of the Canadian Chiropractic Association, 56, 167–171. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3430448/
   PubMedGoogle Scholar
• Rosenstock, J., Kahn, S. E., Johansen, O. E., Zinman, B., Espeland, M. A., Woerle, H. J., Pfarr, E., Keller, A., Mattheus, M., and Baanstra, D. (2019), “Effect of Linagliptin vs Glimepiride on Major Adverse Cardiovascular Outcomes in Patients with Type 2 Diabetes: The CAROLINA Randomized Clinical Trial,” JAMA, 322, 1155–1166. DOI: 10.1001/jama.2019.13772.
   PubMed Web of Science ®Google Scholar
• Scharfstein, D. O. (2019), “A Constructive Critique of the Draft ICH E9 Addendum,” Clinical Trials, 16, 375–380. DOI: 10.1177/1740774519853566.
   PubMed Web of Science ®Google Scholar
• Sheffield, K. M., Dreyer, N. A., Murray, J. F., Faries, D. E., and Klopchin, M. N. (2020), “Replication of Randomized Clinical Trial Results Using Real-World Data: Paving the Way for Effectiveness Decisions,” Journal of Comparative Effectiveness Research, 9, 1043–1050. DOI: 10.2217/cer-2020-0161.
   PubMed Web of Science ®Google Scholar
• Topp, M. S., Gökbuget, N., Stein, A. S., Zugmaier, G., O’Brien, S., Bargou, R. C., Dombret, H., Fielding, A. K., Heffner, L., and Larson, R. A. (2015), “Safety and Activity of Blinatumomab for Adult Patients with Relapsed or Refractory B-Precursor Acute Lymphoblastic Leukaemia: A Multicentre, Single-Arm, Phase 2 Study,” The Lancet Oncology, 16, 57–66. DOI: 10.1016/S1470-2045(14)71170-2.
   PubMed Web of Science ®Google Scholar
• Unger, J. M., Vaidya, R., Hershman, D. L., Minasian, L. M., and Fleury, M. E. (2019), “Systematic Review and Meta-Analysis of the Magnitude of Structural, Clinical, and Physician and Patient Barriers to Cancer Clinical Trial Participation,” Journal of the National Cancer Institute, 111, 245–255. DOI: 10.1093/jnci/djy221.
   PubMedGoogle Scholar
• VanderWeele, T. J., and Vansteelandt, S. (2009), “Conceptual Issues Concerning Mediation, Interventions and Composition,” Statistics and Its Interface, 2, 457–468. DOI: 10.4310/SII.2009.v2.n4.a7.
   Web of Science ®Google Scholar
• Vestbo, J., Leather, D., Diar Bakerly, N., New, J., Gibson, J. M., McCorkindale, S., Collier, S., Crawford, J., Frith, L., and Harvey, C. (2016), “Effectiveness of Fluticasone Furoate–Vilanterol for COPD in Clinical Practice,” New England Journal of Medicine, 375, 1253–1260. DOI: 10.1056/NEJMoa1608033.
   PubMed Web of Science ®Google Scholar
• Wale, J. L., Thomas, S., Hamerlijnck, D., and Hollander, R. (2021). Patients and Public are Important Stakeholders in Health Technology Assessment but the Level of Involvement is Low–A Call to Action,” Research Involvement and Engagement, 7, 1–11. DOI: 10.1186/s40900-020-00248-9.
   PubMedGoogle Scholar
• Wu, Y., Wang, H., Chen, J., and Lee, L. (2023), “Estimand in Real-World Evidence Study: From Frameworks to Application,” in Practical Approaches and Considerations for Translating Real-World Data into Robust Real-World Evidence for Regulatory Decisions, eds. W. He, Y. Fang, and H. Wang, pp. 145–165, New York: Springer Nature. DOI: 10.1007/978-3-031-26328-6_9.
   Google Scholar
• Zhang, X., Faries, D. E., Li, H., Stamey, J. D., and Imbens, G. W. (2018). Addressing Unmeasured Confounding in Comparative Observational Research,” Pharmacoepidemiology and Drug Safety, 27, 373–382. DOI: 10.1002/pds.4394.
   PubMed Web of Science ®Google Scholar