The Current Landscape in Biostatistics of Real-World Data and Evidence: Causal Inference Frameworks for Study Design and Analysis

References

• Abadie, A., and Imbens, G. W. (2016), “Matching on the Estimated Propensity Score,” Econometrica, 84, 781–807. DOI: 10.3982/ECTA11293.
   Web of Science ®Google Scholar
• Balzer, L. (2017), “Causal Inference in a Big Data World: The Roadmap,” X Congresso Brasileiro de Epidemiologia.
   Google Scholar
• Balzer, L. B., Petersen, M. L., and van der Laan, M. J. (2016), “Targeted Estimation and Inference for the Sample Average Treatment Effect in Trials With and Without Pair-Matching,” Statistics in Medicine, 35, 3717–3732. DOI: 10.1002/sim.6965.
   PubMed Web of Science ®Google Scholar
• Bang, H., and Robins, J. M. (2005), “Doubly Robust Estimation in Missing Data and Causal Inference Models,” Biometrics, 61, 962–973. DOI: 10.1111/j.1541-0420.2005.00377.x.
   PubMed Web of Science ®Google Scholar
• Bembom, O., and van der Laan, M. J. (2008), “Analyzing Sequentially Randomized Trials Based on Causal Effect Models for Realistic Individualized Treatment Rules,” Statistics in Medicine, 27, 3689–3716, DOI: 10.1002/sim.3268.
   PubMed Web of Science ®Google Scholar
• Chen, J., Ho, M., Lee, K., Song, Y., Fang, Y., He, W., Irony, T., Jiang, Q., van der Laan, M., Lee, X., Hana Lin, Meng, Z., Mishra-Kalyani, P., Rockhold, F., Wang, H., White, R., and Zink, R. (2020), “The Current Landscape in Biostatistics of Real-World Data and Evidence: Use of RWD/RWE to Inform Clinical Study Design and Analysis (to be submitted).”
   Google Scholar
• Colson, K. E., Rudolph, K. E., Zimmerman, S. C., Goin, D. E., Stuart, E. A., van der Laan, M., and Ahern, J. (2016), “Optimizing Matching and Analysis Combinations for Estimating Causal Effects,” Scientific Reports, 6, 23222. DOI: 10.1038/srep23222.
   PubMed Web of Science ®Google Scholar
• Crown, W. H. (2019), “Real-World Evidence, Causal Inference, and Machine Learning,” Value in Health, 22, 587–592. DOI: 10.1016/j.jval.2019.03.001.
   PubMed Web of Science ®Google Scholar
• de los Angeles Resa, M., and Zubizarreta, J. R. (2016), “Evaluation of Subset Matching Methods and Forms of Covariate Balance,” Statistics in Medicine, 35, 4961–4979. DOI: 10.1002/sim.7036.
   PubMed Web of Science ®Google Scholar
• Díaz, I., and van der Laan, M. J. (2013), “Sensitivity Analysis for Causal Inference Under Unmeasured Confounding and Measurement Error Problems,” The International Journal of Biostatistics, 9, 149–160. DOI: 10.1515/ijb-2013-0004.
   PubMedGoogle Scholar
• Díaz, I., Luedtke, A. R., and van der Laan, M. J. (2018), “Sensitivity Analysis,” in Targeted Learning in Data Science, eds. M. J. Van der Laan and R. Sherri, Switzerland: Springer, pp. 511–522.
   Google Scholar
• Ewald, H., Speich, B., Ladanie, A., Bucher, H. C., Ioannidis, J. P. A., and Hemkens, L. G. (2019), “Marginal Structural Models and Other Analyses Allow Multiple Estimates of Treatment Effects in Randomized Clinical Trials: Meta-Epidemiological Analysis,” Journal of Clinical Epidemiology, 107, 12–26. DOI: 10.1016/j.jclinepi.2018.11.001.
   PubMed Web of Science ®Google Scholar
• Fang, Y., Wang, H., and He, W. (2020), “A Statistical Roadmap for Journey From Real-World Data to Real-World Evidence,” Therapeutic Innovation & Regulatory Science, 54, 749–757.
   PubMed Web of Science ®Google Scholar
• FDA (2013), “Best Practices for Conducting and Reporting Pharmacoepidemiologic Safety Studies Using Electronic Healthcare Data Sets.”
   Google Scholar
• FDA (2017a), “PDUFA Reauthorization Performance Goals and Procedures Fiscal Years 2018 Through 2022.”
   Google Scholar
• FDA (2017b), “Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices—Guidance for Industry and Food and Drug Administration Staff,” FDA.
   Google Scholar
• FDA (2018), “Framework for FDA’s Real-World Evidence Program,” FDA.
   Google Scholar
• Frangakis, C. E., and Rubin, D. B. (2002), “Principal Stratification in Causal Inference,” Biometrics, 58, 21–29. DOI: 10.1111/j.0006-341x.2002.00021.x.
   PubMed Web of Science ®Google Scholar
• Glass, T. A., Goodman, S. N., Hernán, M. A., and Samet, J. M. (2013), “Causal Inference in Public Health,” Annual Review of Public Health, 34, 61–75, DOI: 10.1146/annurev-publhealth-031811-124606.
   PubMed Web of Science ®Google Scholar
• Goodman, S. N., Schneeweiss, S., and Baiocchi, M. (2017), “Using Design Thinking to Differentiate Useful From Misleading Evidence in Observational Research,” JAMA, 317, 705–707. DOI: 10.1001/jama.2016.19970.
   PubMed Web of Science ®Google Scholar
• Greenland, S., and Pearl, J. (2017), “Causal Diagrams,” Wiley StatsRef: Statistics Reference Online, DOI: 10.1002/9781118445112.stat03732.pub2.
   Google Scholar
• Hansen, B. B. (2008), “The Prognostic Analogue of the Propensity Score,” Biometrika, 95, 481–488. DOI: 10.1093/biomet/asn004.
   Web of Science ®Google Scholar
• Herrmann, H. C., Thourani, V. H., Kodali, S. K., Makkar, R. R., Szeto, W. Y., Anwaruddin, S., Desai, N., Lim, S., Malaisrie, S. C., and Kereiakes, D. J. (2016), “One-Year Clinical Outcomes With SAPIEN 3 Transcatheter Aortic Valve Replacement in High-Risk and Inoperable Patients With Severe Aortic Stenosis,” Circulation, 134, 130–140. DOI: 10.1161/CIRCULATIONAHA.116.022797.
   PubMed Web of Science ®Google Scholar
• ICH (2019), “Addendum on Estimands and Sensitivity Analysis in Clinical Trials to the Guideline on Statistical Principles for Clinical Trials E9(R1),” International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use.
   Google Scholar
• Imbens, G. W., and Rubin, D. B. (2017), “Rubin Causal Model,” in The New Palgrave Dictionary of Economics, eds. S. Durlauf and L. E. Blum, London: Palgrave Macmillan UK, pp. 1–10.
   Google Scholar
• Lendle, S. D., Fireman, B., and van der Laan, M. J. (2015), “Balancing Score Adjusted Targeted Minimum Loss-based Estimation,” Journal of Causal Inference, 3, 139–155. DOI: 10.1515/jci-2012-0012.
   PubMed Web of Science ®Google Scholar
• Levenson, M. S. (2020), “Regulatory-Grade Clinical Trial Design Using Real-World Data,” Clinical Trials, 17, 377–382. DOI: 10.1177/1740774520905576.
   PubMed Web of Science ®Google Scholar
• Li, F., Morgan, K. L., and Zaslavsky, A. M. (2018), “Balancing Covariates via Propensity Score Weighting,” Journal of the American Statistical Association, 113, 390–400. DOI: 10.1080/01621459.2016.1260466.
   Web of Science ®Google Scholar
• Mansournia, M. A., and Altman, D. G. (2016), “Inverse Probability Weighting,” BMJ, 352, i189.
   PubMedGoogle Scholar
• Mao, H., Li, L., and Greene, T. (2019), “Propensity Score Weighting Analysis and Treatment Effect Discovery,” Statistical Methods in Medical Research, 28, 2439–2454. DOI: 10.1177/0962280218781171.
   PubMed Web of Science ®Google Scholar
• Neyman, J. (1923), “On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9,” Annals of Agricultural Sciences, 1–51.
   Google Scholar
• Pearl, J. (1995), “Causal Diagrams for Empirical Research,” Biometrika, 82, 669–688. DOI: 10.1093/biomet/82.4.669.
   Web of Science ®Google Scholar
• Pearl, J. (2009a), Causality: Models, Reasoning, and Inference, Cambridge University Press, New York.
   Google Scholar
• Pearl, J. (2009b), “Letter to the Editor: Remarks on the Method of Propensity Score.”
   Google Scholar
• Pearl, J. (2009c), “Remarks on the Method of Propensity Score,” Statistics in Medicine, 28, 1415–1416; author reply 1420–1423.
   PubMed Web of Science ®Google Scholar
• Pearl, J., Glymour, M., and Jewell, N. (2016), Causal Inference in Statistics: A Primer, West Sussex, UK: Wiley.
   Google Scholar
• Petersen, M. L., and van der Laan, M. J. (2014), “Causal Models and Learning From Data: Integrating Causal Modeling and Statistical Estimation,” Epidemiology, 25, 418. DOI: 10.1097/EDE.0000000000000078.
   PubMed Web of Science ®Google Scholar
• Petersen, M., Schwab, J., Gruber, S., Blaser, N., Schomaker, M., and van der Laan, M. (2014), “Targeted Maximum Likelihood Estimation for Dynamic and Static Longitudinal Marginal Structural Working Models,” Journal of Causal Inference, 2, 147–185. DOI: 10.1515/jci-2013-0007.
   PubMedGoogle Scholar
• Robins, J. (1986), “A New Approach to Causal Inference in Mortality Studies With a Sustained Exposure Period—Application to Control of the Healthy Worker Survivor Effect,” Mathematical Modelling, 7, 1393–1512. DOI: 10.1016/0270-0255(86)90088-6.
   Web of Science ®Google Scholar
• Robins, J. M., Hernán, M. Á., and Brumback, B. (2000), “Marginal Structural Models and Causal Inference in Epidemiology,” Epidemiology, 11, 550.
   PubMed Web of Science ®Google Scholar
• Rosenbaum, P. R., and Rubin, D. B. (1983), “The Central Role of the Propensity Score in Observational Studies for Causal Effects,” Biometrika, 70, 41–55. DOI: 10.1093/biomet/70.1.41.
   Web of Science ®Google Scholar
• Rosenbaum, P. R., and Rubin, D. B. (1985), “Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score,” The American Statistician, 39, 33–38.
   Web of Science ®Google Scholar
• Rotnitzky, A., and Robins, J. M. (2014), “Inverse Probability Weighting in Survival Analysis,” Wiley StatsRef: Statistics Reference Online, DOI: 10.1002/9781118445112.stat06031.
   Google Scholar
• Rubin, D. B. (1973), “Matching to Remove Bias in Observational Studies,” Biometrics, 29, 159–183. DOI: 10.2307/2529684.
   Web of Science ®Google Scholar
• Rubin, D. B. (2005), “Basic Concepts of Statistical Inference for Causal Effects in Experiments and Observational Studies,” 140.
   Google Scholar
• Rubin, D. B. (2007), “The Design Versus the Analysis of Observational Studies for Causal Effects: Parallels With the Design of Randomized Trials,” Statistics in Medicine, 26, 20–36.
   PubMed Web of Science ®Google Scholar
• Rubin, D. B. (2008), “For Objective Causal Inference, Design Trumps Analysis,” The Annals of Applied Statistics, 2, 808–840.
   Web of Science ®Google Scholar
• Rubin, D. B., and Stuart, E. A. (2005), “Matching With Multiple Control Groups, and Adjusting for Group Differences,” in 2005 Proceedings of the American Statistical Association, p. 12.
   Google Scholar
• Saddiki, H., and Balzer, L. B. (2018), “A Primer on Causality in Data Science,” arXiv no. 1809.02408.
   Google Scholar
• Stuart, E. A. (2010), “Matching Methods for Causal Inference: A Review and a Look Forward,” Statistical Science, 25, 1–21. DOI: 10.1214/09-STS313.
   PubMed Web of Science ®Google Scholar
• Stuart, E. A., Cole, S. R., Bradshaw, C. P., and Leaf, P. J. (2011), “The Use of Propensity Scores to Assess the Generalizability of Results From Randomized Trials,” Journal of the Royal Statistical Society, Series A, 174, 369–386. DOI: 10.1111/j.1467-985X.2010.00673.x.
   Web of Science ®Google Scholar
• Stuart, E. A., Huskamp, H. A., Duckworth, K., Simmons, J., Song, Z., Chernew, M. E., and Barry, C. L. (2014), “Using Propensity Scores in Difference-in-Differences Models to Estimate the Effects of a Policy Change,” Health Services and Outcomes Research Methodology, 14, 166–182. DOI: 10.1007/s10742-014-0123-z.
   PubMedGoogle Scholar
• Stuart, E. A., Lee, B. K., and Leacy, F. P. (2013), “Prognostic Score-Based Balance Measures Can Be a Useful Diagnostic for Propensity Score Methods in Comparative Effectiveness Research,” Journal of Clinical Epidemiology, 66, S84–S90.e1. DOI: 10.1016/j.jclinepi.2013.01.013.
   PubMed Web of Science ®Google Scholar
• van der Laan, M. J., and Robins, J. (2003), Unified Methods for Censored Longitudinal Data and Causality, New York: Springer-Verlag.
   Google Scholar
• van der Laan, M. J., and Rose, S. (2011), Targeted Learning: Causal Inference for Observational and Experimental Data, New York: Springer-Verlag.
   Google Scholar
• van der Laan, M. J., and Rose, S. (2018), Targeted Learning in Data Science, Cham: Springer.
   Google Scholar
• VanderWeele, T. J. (2019), “Principles of Confounder Selection,” European Journal of Epidemiology, 34, 211–219. DOI: 10.1007/s10654-019-00494-6.
   PubMed Web of Science ®Google Scholar
• Wang, Y., Petersen, M., Bangsberg, D., and Laan, M. van der (2006), “Diagnosing Bias in the Inverse Probability of Treatment Weighted Estimator Resulting from Violation of Experimental Treatment Assignment,” U.C. Berkeley Division of Biostatistics Working Paper Series.
   Google Scholar
• Yue, L. Q. (2018), “Leveraging Real-World Evidence Derived From Patient Registries for Premarket Medical Device Regulatory Decision-Making,” Statistics in Biopharmaceutical Research, 10, 98–103. DOI: 10.1080/19466315.2017.1422436.
   Web of Science ®Google Scholar
• Yue, L. Q., Lu, N., and Xu, Y. (2014), “Designing Premarket Observational Comparative Studies Using Existing Data as Controls: Challenges and Opportunities,” Journal of Biopharmaceutical Statistics, 24, 994–1010. DOI: 10.1080/10543406.2014.926367.
   PubMed Web of Science ®Google Scholar