Advanced search
Publication Cover
Statistics in Biopharmaceutical Research Volume 12, 2020 - Issue 4
Submit an article Journal homepage
12,975
Views
34
CrossRef citations to date
0
Altmetric
Special Issue on COVID-19

Machine learning for clinical trials in the era of COVID-19

William R. ZameDepartment of Economics and Mathematics, UCLA, Los Angeles, CA, USA;;
,
Ioana BicaUniversity of Oxford, Oxford, UK;; ;The Alan Turing Institute, London, UK;
,
Cong ShenDepartment of Electrical and Computer Engineering, University of Virginia, Charlottesville, VA, USA;;
,
Alicia CurthUniversity of Oxford, Oxford, UK;;
,
Hyun-Suk LeeDepartment of Applied Mathematics and Theoretical Physics, University of Cambridge, UK;;
,
Stuart BaileyNovartis Pharmaceuticals, Cambridge, MA, USA;
,
James WeatherallAstraZeneca, Cambridge, UK;;
,
David WrightAstraZeneca, Cambridge, UK;;
,
Frank BretzNovartis Pharma AG, Basel, Switzerland;; ;Section for Medical Statistics, Medical University of Vienna, Vienna, Austria;
&
Mihaela van der SchaarThe Alan Turing Institute, London, UK; ;Department of Applied Mathematics and Theoretical Physics, University of Cambridge, UK;; ;Department of Electrical and Computer Engineering, UCLA, Los Angeles, CA, USACorrespondence[email protected]
 show all
Pages 506-517 | Received 15 May 2020, Accepted 03 Jul 2020, Published online: 18 Aug 2020

References

  • Akacha, M., Branson, J., Bretz, F., Dharan, B., Gallo, P., Gathmann, I., Hemmings, R., Jones, J., Xi, D., and Zuber, E. (2020), “Challenges in assessing the impact of the COVID-19 pandemic on the integrity and interpretability of clinical trials”, Statistics in Biopharmaceutical Research, DOI: 10.1080/19466315.2020.1788984
  • Alaa, A. M., and van der Schaar, M. (2017), “Bayesian inference of individualized treatment effects using multi-task Gaussian processes,” in Advances in Neural Information Processing Systems 30, 3424–3432.
  • Alaa, A. M., and van der Schaar, M. (2017), “Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosis,” in Proceedings of the 34th International Conference on Machine Learning, PMLR, 70, 60-69.
  • Alaa, A. M., and van der Schaar, M. (2018), “Limits of estimating heterogeneous treatment effects: Guidelines for practical algorithm design,” in Proceedings of the 35th International Conference on Machine Learning, PMLR, 80, 129–138.
  • Alaa, A. M. and van der Schaar, M. (2019), “Validating causal inference models via influence functions,” in Proceedings of the 36th International Conference on Machine Learning, PMLR, 97, 191–201.
  • Alaa, A. M., and van der Schaar, M. (2019), “Adjutorium COVID-19: Technical documentation,” available on line at http://www.vanderschaar-lab.com/NewWebsite/covid-19/200414_Adjutorium_Documentation.pdf
  • Alaa, A. M., Weisz, M., and van der Schaar, M. (2017), “Deep counterfactual networks with propensity-dropout,” International Conference on Machine Learning – Deep learning workshop, 1-6
  • Alaimo, S. and Pulvirenti, A. (2018), “Network-based drug repositioning: Approaches, resources and research directions,” in Computational Methods for Drug Repurposing, Humana Press, New York, NY, Springer, 97-113.
  • Atan, O., Zame, W. R., and van der Schaar, M. (2019), “Sequential patient recruitment and allocation for adaptive clinical trials,” in Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS), PMLR, 89, 1891–1900.
  • Athey, S., and Imbens, G. (2016), “Recursive partitioning for heterogeneous causal effects,” Proceedings of the National Academy of Sciences, 113, 7353–7360.
  • Bekele, B. N., and Shen, Y. (2005), “A Bayesian approach to jointly modeling toxicity and biomarker expression in a phase I/II dose-finding trial,” Biometrics, 61, 343–354.
  • Berry, D. A. (2004), “Bayesian statistics and the efficiency and ethics of clinical trials,” Statistical Science, 19, 175–187.
  • Bica, I., Alaa, A. M., Jordon, J., and van der Schaar, M. (2020), “Estimating counterfactual treatment outcomes over time through adversarially balanced representations,” in Proceedings of the 8th International Conference on Learning Representations, 1-28
  • Bica, I., Alaa, A.M., Lambert, C. and van der Schaar, M. (2020), From real-world patient data to individualized treatment effects using machine learning: Current and future methods to address underlying challenges. Clin. Pharmacol. Ther. Accepted Author Manuscript. doi:10.1002/cpt.1907.
  • Bica, I., Jordon, J., and van der Schaar, M. (2020), “Estimating the effects of continuous-valued interventions using generative adversarial networks,” arXiv preprint arXiv:2002.12326.
  • Breiman, L., Friedman, J., Stone, C.J. and Olshen, R.A. Classification and Regression Trees. CRC Press (1984)
  • Bretz, F., Gallo, P., and Maurer, W. (2017), “Adaptive designs: The Swiss Army knife among clinical trial designs?” Clinical Trials, 14, 417–424.
  • Committee for Medicinal Products for Human Use [CHMP] (2020), “A call to pool EU research resources into large-scale, multi-centre, multi-arm clinical trials against COVID-19,” [online]. Available at https://www.ema.europa.eu/en/documents/other/call-pool-eu-research-resources-large-scale-multi-centre-multi-arm-clinical-trials-against-COVID-19_en.pdf.
  • Cruz-Roa, A., Gilmore, H., Basavanhally, A., Feldman, M., Ganesan, S., Shih, N.N.C., Tomaszewski,J.,Gonzalez, F.A. and Madabhushi, A. (2017), “Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent,” Scientific Reports 7 (Article number 46450).  
  • Dette, H., Möllenhoff, K., and Bretz, F. (2019), “Equivalence tests for binary efficacy-toxicity responses,” arXiv preprint arXiv:1910.08769.
  • Dodd, L. E., Proschan, M. A., Neuhaus, J., Koopmeiners, J. S., Neaton, J., Beigel, J. D., Barrett, K., Lane, H. C., and Davey Jr, R. T. (2016), “Design of a randomized controlled trial for Ebola virus disease medical countermeasures: PREVAIL II, the Ebola MCM Study,” The Journal of Infectious Diseases, 213(12), 1906–1913.
  • European Medicines Agency [EMA] (2020a), “Points to consider on implications of Coronavirus disease (COVID-19) on methodological aspects of ongoing clinical trials,” [online]. Available at https://www.ema.europa.eu/en/documents/scientific-guideline/points-consider-implications-coronavirus-disease-COVID-19-methodological-aspects-ongoing-clinical_en.pdf.
  • European Medicines Agency [EMA] (2020b), “Guidance on the management of clinical trials during the COVID-19 (Coronavirus) pandemic,” [online]. Available at https://ec.europa.eu/health/sites/health/files/files/eudralex/vol-10/guidanceclinicaltrials_covid19_en.pdf.
  • European Medicines Agency [EMA] (2020c), “Coronavirus disease (COVID-19),” [online]. Available at https://www.ema.europa.eu/en/human-regulatory/overview/public-health-threats/coronavirus-disease-COVID-19.
  • Filipovych, R., Resnick, S.M., and Davatzikos, C. (2011), “Semi-supervised cluster analysis of imaging data,” NeuroImage, 54, 2185-2197
  • Food and Drug Administration [FDA] (2020a), “Letter of Emergency Use Authorization (EUA) for emergency use of remdesivir for the treatment of hospitalized 2019 coronavirus disease (COVID-19) patients”. Available at https://www.fda.gov/media/137564/download.
  • Food and Drug Administration [FDA] (2020b), “US Food and Drug Administration. Guidance for Industry, Investigators, and Institutional Review Boards. FDA Guidance on Conduct of Clinical Trials of Medical Products during COVID-19 Pandemic.” Available at https://www.fda.gov/media/136238/download.
  • Gittins, J. C. (1979). Bandit processes and dynamic allocation indices. Journal of the Royal Statistical Society, Series B (Methodological), 41, 148-164.
  • Harrer, S., Shah, P., Antony, B., and Hu, J. (2019), “Artificial intelligence for clinical trial design,” Trends in Pharmacological Sciences, 40, 577-591.
  • Hill, J. L. (2011). Bayesian nonparametric modeling for causal inference. Journal of Computational and Graphical Statistics, 20, 217-240.
  • Hobbs, B. P., Carlin, B. P., Mandrekar, S. J., and Sargent, D. J. (2011), “Hierarchical commensurate and power prior models for adaptive incorporation of historical information in clinical trials,” Biometrics, 67, 1047–1056.
  • Infectious Diseases Data Observatory [IDDO] (2020), “Living systematic review COVID-19. Coronavirus disease 2019 registered clinical trials,” [online]. Available at https://www.iddo.org/research-themes/COVID-19/live-systematic-clinical-trial-review.
  • Johansson, U., Linusson, H., Löfström, T. and Boström, H., (2018) “Interpretable regression trees using conformal prediction”, Expert Systems with Applications, 97:394–404, 2018.
  • Kunz, C. U., Joergens, S., Bretz, F., Stallard, N., Van Lancker, K., Xi, D., Zohar, S., Gerlinger, C., and Friede, T. (2020) “Clinical trials impacted by the COVID-19 pandemic: Adaptive designs to the rescue?” Statistics in Biopharmaceutical Research (under review)
  • Lai, T. L., and Robbins, H. (1985). Asymptotically efficient adaptive allocation rules. Advances in Applied Mathematics, 6, 4-22.
  • Lee, H.-S., Shen, C., Jordon, J., and van der Schaar, M. (2020a), “Contextual constrained learning for dose-finding clinical trials”, in Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics (AISTATS), PMLR, 108, 2645-2654.
  • Lee, H.-S., Zhang, Y., Zame, W., Shen, C., Lee, J.-W. and van der Schaar, M. (2020b),”Robust Recursive Partitioning for Heterogeneous Treatment Effects with Uncertainty Quantification,” arXiv preprint arXiv:2006.07917.
  • Lee, J. J., and Chu, C. T. (2012), “Bayesian clinical trials in action,” Statistics in Medicine, 31, 2955–2972.
  • Lei, J., G’Sell, M., Rinaldo, A., Tibshirani, R. J., and Wasserman, L. (2018), “Distribution-free predictive inference for regression,” Journal of the American Statistical Association, 113, 1094–1111.
  • Lim, B., Alaa, A. M., and van der Schaar, M. (2018), “Forecasting treatment responses over time using recurrent marginal structural networks,” in Advances in Neural Information Processing Systems 31, 7483–7493.
  • Meyer, R. D., Ratitch, B., Wolbers, M., Marchenko, O., Quan, H., Li, D., Fletcher, C., Li, X., Wright, D., Shentu, Y., Englert, S., Shen, W., Dey, J., Liu, T., Zhou, M., Bohidar, N., Zhao, P.-L., and Hale, M. (2020) “Statistical issues and recommendations for clinical trials conducted during the COVID-19 pandemic,” Statistics in Biopharmaceutical Research, doi: 10.1080/19466315.2020.1779122.
  • Mulangu, S., Dodd, L. E., Davey Jr, R. T., Tshiani Mbaya, O., Proschan, M., Mukadi, D., Lusakibanza Manzo, M., Nzolo, D., Tshomba Oloma, A., Ibanda, A., et al. (2019), “A randomized, controlled trial of Ebola virus disease therapeutics,” New England Journal of Medicine, 381(24), 2293–2303.
  • Neil, D., Pfeiffer, M., and Liu, S.-C. (2016), “Phased LSTM: Accelerating recurrent network training for long or event-based sequences,” in Advances in neural information processing systems 29, 3882–3890.
  • Neyman, J. (1923), “Sur les applications de la théorie des probabilités aux experiences agricoles: Essai des principes,” Roczniki Nauk Rolniczych, 10, 1–51.
  • Oxford (2020), “University of Oxford “RECOVERY” trial for COVID-19 treatments,” [online]. Available at https://www.recoverytrial.net/.
  • Pallmann, P., Bedding, A. W., Choodari-Oskooei, B., Dimairo, M., Flight, L., Hampson, L. V., Holmes, J., Mander, A. P., Sydes, M. R., Villar, S. S., Wason, J. M. S., Weir, C. J., Wheeler, G. M., Yap, C., and Jaki, T. (2018), “Adaptive designs in clinical trials: why use them, and how to run and report them,” BMC medicine, 16(1), 29.
  • Park, J. J., Thorlund, K., and Mills, E. J. (2018), “Critical concepts in adaptive clinical trials,” Clinical epidemiology, 10, 343-351.
  • Printz, C. (2015), “Failure rate: Why many cancer drugs don’t receive FDA approval, and what can be done about it,” Cancer, 121(10), 1529–1530.
  • Proschan, M. A., Dodd, L. E., and Price, D. (2016), “Statistical considerations for a trial of Ebola virus disease therapeutics,” Clinical Trials, 13(1), 39–48.
  • Rubin, D. B. (1978), “Bayesian inference for causal effects: The role of randomization,” The Annals of statistics, 6(1) 34–58.
  • Schmidli, H., Häring, D. A., Thomas, M., Cassidy, A., Weber, S., and Bretz, F. (2019), “Beyond randomized clinical trials: Use of external controls,” Clinical Pharmacology & Therapeutics, 107(4), 806-816.
  • Segar.,M., Patel, K.V., Ayers, C., Basit, M., Tang, W.H.W., Willett, D., Berry, J., Grodin, J.L. and Pandey. A. (2020), “Phenomapping of patients with heart failure with preserved ejection fraction using machine learning based unsupervised cluster analysis,” European Journal of Heart Failure 22, 148-158.
  • Shalit, U., Johansson, F. D., and Sontag, D. (2017), “Estimating individual treatment effect: generalization bounds and algorithms,” in Proceedings of the 34th International Conference on Machine Learning, PMLR, 70, 3076–3085.
  • Shen, C., Wang, Z., Villa, S., and van der Schaar, M. (2020). Learning for Dose Allocation in Adaptive Clinical Trials with Safety Constraints. in Proceedings of the 37th International Conference on Machine Learning.
  • Shukla, S. N., and Marlin, B. (2019), “Interpolation-prediction networks for irregularly sampled time series,” in Proceedings of the 7th International Conference on Learning Representations.
  • Stallard, N., Hampson, L., Benda, N., Brannath, W., Burnett, T., Friede, T., Kimani, P.K., Koenig, F., Krisam, J., Mozgunov, P., Posch, M., Wason, J., Wassmer, G., Whitehead, J., Williamson, S.F., Zohar, S., and Jaki, T. (2020) "Efficient adaptive designs for clinical trials of interventions for COVID-19," Statistics in Biopharmaceutical Research, DOI: 10.1080/19466315.2020.1790415
  • Su, Q., Ma, F., Yuan, Y., Huai, M., Zhong, W., Gao, J., and Zhang, A. (2018), “Deep patient similarity learning for personalized healthcare,” IEEE Transactions on Nanobioscience, 17(3), 219–227.
  • Thompson, W. R. (1933). On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika, 25(3/4), 285-294.
  • Tibshirani, R. J., Barber, R. F., Candes, E., and Ramdas, A. (2019), “Conformal prediction under covariate shift,” in Advances in Neural Information Processing Systems 32, 2526–2536.
  • Tran, C., and Zheleva, E. (2019), “Learning triggers for heterogeneous treatment effects,” in Proceedings of the AAAI Conference on Artificial Intelligence, 33, 5183–5190.
  • Varatharajah, Y., Berry, B., Koyejo, S., and Iyer, R. (2018), “A Contextual-bandit-based approach for informed decision-making in clinical trials,” arXiv preprint arXiv:1809.00258.
  • Villar, S. S., Bowden, J., and Wason, J. (2015), “Multi-armed bandit models for the optimal design of clinical trials: benefits and challenges,” Statistical Science, 30(2), 199-215.
  • Wang, Y., Zhang, D., Du, G., Du, R., Zhao, J., Jin, Y., Fu, S., Gao, L., Cheng, Z., Lu, Q. and Hu, Y. (2020). Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. The Lancet 2020, 395, 1569-78.
  • World Health Organization [WHO] (2020), “Solidarity” clinical trial for COVID-19 treatments,” [online]. Available at https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov/solidarity-clinical-trial-for-COVID-19-treatments.
  • Yin, G., Li, Y., and Ji, Y. (2006), “Bayesian dose-finding in phase I/II clinical trials using toxicity and efficacy odds ratios,” Biometrics, 62, 777–787.
  • Yin, K., and Cheung, W. K. (2019), “Context-aware imputation for clinical time series,” in Proceedings of 2019 IEEE International Conference on Healthcare Informatics (ICHI), 1-3.
  • Yoon, J., Jordon, J., and van der Schaar, M. (2018a), “GANITE: Estimation of individualized treatment effects using generative adversarial nets,” in Proceedings of the 6th International Conference on Learning Representations, 1-22.
  • Yoon, J., Jordon, J., and van der Schaar, M. (2018b), “GAIN: Missing data imputation using generative adversarial nets,” Proceedings of the 35th International Conference on Machine Learning, PMLR 80, 5689-5698.
  • Yoon, J., Zame, W. R., and van der Schaar, M. (2017), “Multi-directional recurrent neural networks: A novel method for estimating missing data,” in Time Series Workshop at the 34th International Conference on Machine, 1-5.
  • Yoon, J., Zame, W. R., and van der Schaar, M. (2018c), “Estimating missing data in temporal data streams using multi-directional recurrent neural networks,” IEEE Transactions on Biomedical Engineering, 66, 1477–1490.
  • Zhang, W., Sargent, D. J., and Mandrekar, S. (2006), “An adaptive dose-finding design incorporating both toxicity and efficacy,” Statistics in Medicine, 25, 2365–2383.
  • Zhu, Z., Yin, C., Qian, B., Cheng, Y., Wei, J., and Wang, F. (2016), “Measuring patient similarities via a deep architecture with medical concept embedding,” in Proceedings of 2016 IEEE 16th International Conference on Data Mining (ICDM), 749–758.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.