Advanced search
Publication Cover
Expert Review of Clinical Pharmacology Volume 13, 2020 - Issue 9
Submit an article Journal homepage
4,000
Views
7
CrossRef citations to date
0
Altmetric
Perspective

Guiding principles for the use of knowledge bases and real-world data in clinical decision support systems: report by an international expert workshop at Karolinska Institutet

Mikael Hoffmanna The NEPI Foundation - Swedish Network for Pharmacoepidemiology, Linköping University, Linköping, SwedenCorrespondence[email protected]
View further author information
,
Robert Vander Sticheleb Clinical Pharmacology Research Unit, Heymans Institute of Pharmacology, Ghent University, Ghent, BelgiumView further author information
,
David W Batesc Center for Patient Safety Research and Practice, Division of General Internal Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USAView further author information
,
Johanna Björklundd Department of Computing Science, Umeå University, Umeå, SwedenView further author information
,
Steve Alexandere School of Life Sciences, University of Nottingham Medical School, Nottingham, UKView further author information
,
Marine L Anderssonf Division of Clinical Pharmacology, Department of Laboratory Medicine, Karolinska Institutet, Karolinska University Hospital, Stockholm, SwedenView further author information
,
Ane Auraaeng Organisation for Economic Cooperation and Development (OECD), Paris, FranceView further author information
,
Marion Bennieh Strathclyde Institute of Pharmacy & Biomedical Sciences, University of Strathclyde, Glasgow, UKView further author information
,
Marja-Liisa Dahlf Division of Clinical Pharmacology, Department of Laboratory Medicine, Karolinska Institutet, Karolinska University Hospital, Stockholm, SwedenView further author information
,
Birgit Eiermannf Division of Clinical Pharmacology, Department of Laboratory Medicine, Karolinska Institutet, Karolinska University Hospital, Stockholm, SwedenView further author information
,
Werner Hackli Institute of Medical Informatics, UMIT-Private University for Health Sciences, Medical Informatics and Technology, Hall in Tirol, AustriaView further author information
,
Tora Hammarj E-health Institute, Department of Medicine and Optometry, Linnaeus University, Kalmar, SwedenView further author information
,
Paul Hjemdahlk Clinical Pharmacology Unit, Clinical Epidemiology Division, Department of Medicine, Karolinska Institutet, Stockholm, Sweden;View further author information
,
Sabine Kochl Health Informatics Centre, Department of Learning, Informatics, Management and Ethics, Karolinska Institutet, Stockholm, SwedenView further author information
,
Ilkka Kunnamom The Finnish Medical Society Duodecim, Helsinki, FinlandView further author information
,
Herve Le Louëtn Council for International Organizations of Medical Sciences (CIOMS), Geneva, SwitzerlandView further author information
,
Papapetrou Panagiotiso Department of Computer and Systems Science, Stockholm University, Stockholm, SwedenView further author information
,
Lembit Rägon Council for International Organizations of Medical Sciences (CIOMS), Geneva, SwitzerlandView further author information
,
Michael Speddingp International Union of Basic and Clinical Pharmacology (IUPHAR), Paris, FranceView further author information
,
Hanna M Seidlingq Department of Clinical Pharmacology and Pharmacoepidemiology, Heidelberg University Hospital, Heidelberg University, Heidelberg, GermanyView further author information
,
Dina Demner-Fushmanr National Library of Medicine, National Institutes of Health, HHS, Bethesda, MD, USAView further author information
&
Lars L Gustafssonf Division of Clinical Pharmacology, Department of Laboratory Medicine, Karolinska Institutet, Karolinska University Hospital, Stockholm, Sweden;s Swedish Institute for Drug Informatics (SIDI), Stockholm, SwedenView further author information
 show all
Pages 925-934 | Received 27 Apr 2020, Accepted 31 Jul 2020, Published online: 29 Sep 2020

References

  • Blumenthal D, Glaser JP. Information technology comes to medicine. N Engl J Med. 2007 Jun 14;356(24):2527–2534.
  • Sjöborg B, Bäckström T, Arvidsson LB, et al. Design and implementation of a point-of-care computerized system for drug therapy in Stockholm metropolitan health region - Bridging the gap between knowledge and practice. Int J Med Inform. 2007 Jul;76(7):497–506.
  • Guidance for Industry. Patient-reported outcome measures: use in medical product development to support labeling claims. Food and Drug Administration. 2009 [cited 2020 July 23]. Available from: https://www.fda.gov/media/77832/download
  • Black N. Patient-reported outcome measures in skin cancer. Br J Dermatol. 2013 Jun;168(6):1151.
  • Framework for FDA’s real-world evidence program. Food and drug administration; 2018 [cited 2020 July 23]. Available from: https://www.fda.gov/media/120060/download
  • HMA-EMA joint big data taskforce – summary report. European Medicines Agency; 2019 [cited 2020 July 23]. Available from: https://www.ema.europa.eu/en/documents/minutes/hma/ema-joint-task-force-big-data-summary-report_en.pdf.
  • Sultana J, Trifiro G. The potential role of big data in the detection of adverse drug reactions. Expert Rev Clin Pharmacol. 2020;13(3) Mar 16;1–4.
  • Nygren E, Henriksson P. Reading the medical record. I. Analysis of physicians’ ways of reading the medical record. Comput Methods Programs Biomed. 1992 Sep-Oct;39(1–2):1–12.
  • Pryor TA. Development of decision support systems. Int J Clin Monit Comput. 1990 July;7(3):137–146.
  • Stellamanns J, Ruetters D, Dahal K, et al. Visualizing risks in cancer communication: A systematic review of computer-supported visual aids. Patient Educ Couns. 2017 Aug;100(8):1421–1431.
  • Weed LL. Medical records that guide and teach. N Engl J Med. 1968 Mar 14;278(11):593–600.
  • Duggirala HJ, Tonning JM, Smith E, et al. Use of data mining at the food and drug administration. J Am Med Inform Assoc. 2016 Mar;23(2):428–434.
  • Ventola CL, Data B. Pharmacovigilance: data mining for adverse drug events and interactions. Pham Ther. 2018 Jun;43(6):340–351.
  • Papapetrou P. Adapting real world data for use in decision support in healthcare and for patients. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from:. https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Forslund T, Wettermark B, Andersen M, et al. Stroke and bleeding with NOAC or warfarin treatment in patients with non-valvular atrial fibrillation: a population based cohort study. Europace. 2018;20:420–428.
  • Komen J, Forslund T, Hjemdahl P, et al. Effects of policy interventions on the introduction of novel oral anticoagulants in Stockholm: an interrupted time series analysis. Br J Clin Pharmacol. 2017 Mar;83(3):642–652.
  • Ramsberg J, Platt R. Opportunities and barriers for pragmatic embedded trials: triumphs and tribulations. Learn Health Syst. 2017;2(1):1–8.
  • Relton C, Torgerson D, O’Cathain A, et al. Rethinking pragmatic randomised controlled trials: introducing the “cohort multiple randomised controlled trial” design. BMJ. 2010 Mar;19(340):c1066.
  • Wang SV, Schneeweiss S, Gagne JJ, et al. Using real-world data to extrapolate evidence from randomized controlled trials. Clin Pharmacol Ther. 2019 May;105(5):1156–1163.
  • Basch E, Deal AM, Dueck AC, et al. Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment. JAMA. 2017 Jul 11;318(2):197–198.
  • Holmes JH, Soualmia LF, Seroussi B. A 21st century embarrassment of riches: the balance between health data access, usage, and sharing. Yearb Med Inform. 2018 Aug;27(1):5–6.
  • Overview of the national laws on electronic health records in the EU member states and their interaction with the provision of cross-border eHealth services. Brussels: Milieu Ltd – time.lex. 2014 [cited 2020 July 23]. Available from: https://ec.europa.eu/health/sites/health/files/ehealth/docs/laws_report_recommendations_en.pdf
  • Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation).2016 [cited 2020 July 23]. Available from: https://eur- lex europa.eu/legal- content /EN/TXT/PDF/?uri=CELEX:32016R0679&from=SV
  • The Directive on security of network and information systems (NIS Directive). European Commission; 2018 [cited 2020 July 23]. Available from: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=uriserv:OJ.L_.2016.194.01.0001.01.ENG&toc=OJ:L:2016:194:TOC
  • Wright A, Hickman TT, McEvoy D, et al. Analysis of clinical decision support system malfunctions: a case series and survey. J Am Med Inform Assoc. 2016 Nov;23(6):1068–1076.
  • Randolph AG, Haynes RB, Wyatt JC, et al. Users’ guides to the medical literature: XVIII. How to use an article evaluating the clinical impact of a computer-based clinical decision support system. JAMA. 1999 Jul 7;282(1):67–74.
  • Demner-Fushman D. Breakthroughs for user adapted medical and pharmacological knowledge bases in health-care and for patients. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm. 2019 [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019.
  • Kwag KH, Gonzalez-Lorenzo M, Banzi R, et al. Providing doctors with high-quality information: an updated evaluation of web-based point-of-care information summaries. J Med Internet Res. 2016 Jan 19;18(1):e15.
  • Vandvik PO, Brandt L, Alonso-Coello P, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest. 2013 Aug;144(2):381–389.
  • Garg AX, Adhikari NK, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005 Mar 9;293(10):1223–1238.
  • Hunt DL, Haynes RB, Hanna SE, et al. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998 Oct 21;280(15):1339–1346.
  • Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003 Jun 23;163(12):1409–1416.
  • Blum D, Raj SX, Oberholzer R, et al. Computer-based clinical decision support systems and patient-reported outcomes: a systematic review. Patient. 2015 Oct;8(5):397–409.
  • Van de Velde S, Heselmans A, Delvaux N, et al. A systematic review of trials evaluating success factors of interventions with computerised clinical decision support. Implement Sci. 2018 Aug 20;13(1):114.
  • Kilsdonk E, Peute LW, Jaspers MW. Factors influencing implementation success of guideline-based clinical decision support systems: A systematic review and gaps analysis. Int J Med Inform. 2017 Feb;98:56–64.
  • Bates DW. The situation in United states for open access and sustainable funding. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm. 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Vander Stichele R. Sketch of the situation in Europe for open access and sustainable funding. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm. 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Sittig DF, Wright A, Osheroff JA, et al. Grand challenges in clinical decision support. J Biomed Inform. 2008 Apr;41(2):387–392.
  • Horsky J, Schiff GD, Johnston D, et al. Interface design principles for usable decision support: a targeted review of best practices for clinical prescribing interventions. J Biomed Inform. 2012 Dec;45(6):1202–1216.
  • Payne R, Moe JL, Sevier CH, et al. Medication monitoring and drug testing ethics project. J Opioid Manag. 2015 Jan-Feb;11(1):82–88.
  • Koch S. User-friendly design of interfaces of CDSS (clinical decision support system) enhancing patient-healthcare interactions. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Brown N, Eghdam A, Koch S. Usability evaluation of visual representation formats for emergency department records. Appl Clin Inform. 2019 May;10(3):454–470.
  • Van de Velde S, Kunnamo I, Roshanov P, et al. The GUIDES checklist: development of a tool to improve the successful use of guideline-based computerised clinical decision support. Implement Sci. 2018 Jun 25;13(1):86.
  • Kesselheim AS, Cresswell K, Phansalkar S, et al. Clinical decision support systems could be modified to reduce ‘alert fatigue’ while still minimizing the risk of litigation. Health Affairs. 2011;30(12):2310–2317.
  • Bates DW, Kuperman GJ, Wang S, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003 Nov-Dec;10(6):523–530.
  • Bates DW. Effective implementation of medical knowledge bases for rational drug therapy. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Califf RM, Robb MA, Bindman AB, et al. Transforming evidence generation to support health and health care decisions. N Engl J Med. 2016 Dec 15;375(24):2395–2400.
  • Eichler HG, Bloechl-Daum B, Broich K, et al. Data rich, information poor: can we use electronic health records to create a learning healthcare system for pharmaceuticals? Clin Pharmacol Ther. 2019 Apr;105(4):912–922.
  • FDA draft guidance: submitting documents using real-world data and real-world evidence to FDA for drugs and biologics. Guidance for industry. Food Drug Administration. 2019. [cited 2020 July 23]. Available from: https://www.fda.gov/media/124795/download
  • Dreischulte T, Donnan P, Grant A, et al. Safer prescribing - a trial of education, informatics, and financial incentives. N Engl J Med. 2016 Mar 17;374(11):1053–1064.
  • Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003 Oct 11;362(9391):1225–1230.
  • Eriksen J, Gustafsson LL, Ateva K, et al. High adherence to the ´Wise List´ treatment recommendations in Stockholm: a 15-year retrospective review of a multifaceted approach promoting rational use of medicines. BMJ Open. 2017 May 2;7(4):e014345.
  • Evans RS. Electronic health records: then, now, and in the future. Yearb Med Inform. 2016 May;20(Suppl 1):S48–61.
  • Ammenwerth E. Evidence-based health informatics: how do we know what we know? Methods Inf Med. 2015;54(4):298–307.
  • Semantic web. [cited 2020 July 23]. Available from: https://www.w3.org/standards/semanticweb/
  • LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015 May 28;521(7553):436–444.
  • Björklund J. Technical breakthroughs in multimodal data access under timecritical conditions. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Stacey D, Legare F, Lewis K, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2017 Apr;12(4):CD001431.
  • Dreesens D, Stiggelbout A, Agoritsas T, et al. A conceptual framework for patient-directed knowledge tools to support patient-centred care: results from an evidence-informed consensus meeting. Patient Educ Couns. 2019 Oct;102(10):1898–1904.
  • Legare F, Adekpedjou R, Stacey D, et al. Interventions for increasing the use of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2018 Jul;19(7):CD006732.
  • Gagnon MP, Ndiaye MA, Larouche A, et al. Optimising patient active role with a user-centred eHealth platform (CONCERTO+) in chronic diseases management: a study protocol for a pilot cluster randomised controlled trial. BMJ Open. 2019 Apr 2;9(4):e028554.
  • Seidling HM. Implementation of decision support for chronic patients targeting needs among patients and health staff. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Marcial LH, Richardson JE, Lasater B, et al. The imperative for patient-centered clinical decision support. EGEMS (Wash DC). 2018 May 30;6(1):12.
  • Goodfellow I, Bengio Y, Courville A. Deep learning. Cambridge, Massachusetts: The MIT Press; 2016.
  • Arnold M, Bellamy R, Hind M, et al. Increasing trust in AI services through supplier’s declarations of conformity. arXiv Comput Soc. 2019.
  • Obermeyer Z, Powers B, Vogeli C, et al. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019 Oct 25;366(6464):447–453.
  • Kunnamo I. Contents, design and effects of knowledge bases for medical practice and education: the Duodecim experience. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Sönnichsen A, Trampisch US, Rieckert A, et al. Polypharmacy in chronic diseases-reduction of inappropriate medication and adverse drug events in older populations by electronic decision support (PRIMA-eDS): study protocol for a randomized controlled trial. Trials. 2016 Jan;29(17):57.
  • Kunnamo I. PRIMA-eDS. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Bhavnani V, Fisher B, Winfield M, et al. How patients use access to their electronic GP record–a quantitative study. Fam Pract. 2011 Apr;28(2):188–194.
  • Cars T, Lindhagen L, Malmstrom RE, et al. Effectiveness of drugs in routine care: a model for sequential monitoring of new medicines using dronedarone as example. Clin Pharmacol Ther. 2018 Mar;103(3):493–501.
  • Langan SM, Schmidt SA, Wing K, et al. The reporting of studies conducted using observational routinely collected health data statement for pharmacoepidemiology (RECORD-PE). BMJ. 2018 Nov;14(363):k3532.
  • Wilkinson MD, Dumontier M, Aalbersberg IJ, et al. The FAIR guiding principles for scientific data management and stewardship. Sci Data. 2016 Mar;15(3):160018.
  • Demner-Fushman D. The advantages of open knowledge data bases in medicine: the perspective by National Library of Medicine. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • NLM. A platform for biomedical discovery and data-powered health - National Library of Medicine strategic plan 2017–2027. 2017. [cited 2020 July 23]. Available from: https://www.nlm.nih.gov/pubs/plan/lrp17/NLM_StrategicReport2017_2027.html
  • Universal health coverage (UHC): World Health Organization; 2019. [cited 2020 July 23]. Available from: https://www.who.int/news-room/fact-sheets/detail/universal-health-coverage-(uhc)
  • Ogunleye OO, Fadare JO, Eriksen J, et al. Reported needs of information resources, research tools, connectivity and infrastructure among African pharmacological scientists to improve future patient care and health. Expert Rev Clin Pharmacol. 2019 May;12(5):481–489.
  • Wirtz VJ, Hogerzeil HV, Gray AL, et al. Essential medicines for universal health coverage. Lancet. 2017 Jan 28;389(10067):403–476.
  • Alexander S. Building and maintaining the GUIDE to pharmacology, immunopharmacology and drugs for malaria (www.guidetopharmacology.org). Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • CoreTrustSeal. [cited 2020 July 23]. Available from: https://www.coretrustseal.org
  • The European Open Science Cloud (EOSC). [cited 2020 July 23]. Available from: https://www.eosc-portal.eu/
  • The Data Documentation Initiative (DDI). [cited 2020 July 23]. Available from: https://www.ddialliance.org/
  • The Research Data Alliance. [cited 2020 July 23]. Available from: https://rd-alliance.org/
  • Open CDS. [cited 2020 July 23]. Available from: http://www.opencds.org/
  • Patel VN, Abramson E, Edwards AM, et al. Consumer attitudes toward personal health records in a beacon community. Am J Manag Care. 2011 Apr;17(4):e104–20.
  • Swedish National Data Service. [cited 2020 July 23]. Available from: https://snd.gu.se/en
  • Bennie M. Integrating Patient reported quality of life Ourcome Measures (PROMs) into cancer care in Scotland: vision and early scientific results. Presentation at expert workshop Improving rational use of medicines by developing and utilising knowledge bases and real world data; Stockholm, 2019. [cited 2020 July 23]. Available from: https://ki.se/en/labmed/public-videocast-of-ki-international-workshop-in-stockholm-january-2019
  • Stefik M. Introduction to knowledge systems. San Francisco, CA: Morgan Kaufman; 1995.
  • Greene RA. Clinical decision support: the road ahead. Academic Press, Cambridge, Massachusetts, USA; 2006.
  • Institute of Medicine. Best care at lower cost: the path to continuously learning health care in America. Washington, DC: The National Academies Press; 2013.
  • Krumholz HM. Big data and new knowledge in medicine: the thinking, training, and tools needed for a learning health system. Health Affairs. 2014;33(7):1163–1170.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.