Evaluating the Sensitivity, Specificity, and Accuracy of ChatGPT-3.5, ChatGPT-4, Bing AI, and Bard Against Conventional Drug-Drug Interactions Clinical Tools

References

• Mhlanga D. Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning (February 11, 2023); 2023.
   Google Scholar
• Vaishya R, Misra A, Vaish A. ChatGPT: is this version good for healthcare and research? Diabetes Metab Syndr. 2023;17(4):102744. doi:10.1016/j.dsx.2023.102744
   PubMed Web of Science ®Google Scholar
• Hauben M. Artificial intelligence and data mining for the pharmacovigilance of drug–drug interactions. Clin Ther. 2023;45(2):117–133. doi:10.1016/j.clinthera.2023.01.002
   PubMed Web of Science ®Google Scholar
• Haluza D, Jungwirth D. Artificial intelligence and ten societal megatrends: an exploratory study using GPT-3. Systems. 2023;11(3):120. doi:10.3390/systems11030120
   Web of Science ®Google Scholar
• Jain S, Naicker D, Raj R, et al. Computational intelligence in cancer diagnostics: a contemporary review of smart phone apps, current problems, and future research potentials. Diagnostics. 2023;13(9):1563. doi:10.3390/diagnostics13091563
   Web of Science ®Google Scholar
• Kriger-Sharabi OA, Kopylov U. Harnessing the power of precision medicine and novel biomarkers to treat Crohn’s disease. J Clin Med. 2023;12(7):2696. doi:10.3390/jcm12072696
   PubMed Web of Science ®Google Scholar
• Khan O, Parvez M, Kumari P, Parvez S, Ahmad S. The future of pharmacy: how AI is revolutionizing the industry. Intell Pharm. 2023;1(1):32–40. doi:10.1016/j.ipha.2023.04.008
   Google Scholar
• Bays HE, Fitch A, Cuda S, et al. Artificial intelligence and obesity management: an Obesity Medicine Association (OMA) Clinical Practice Statement (CPS) 2023. Obes Pillars. 2023;6:100065. doi:10.1016/j.obpill.2023.100065
   PubMedGoogle Scholar
• Liu L, Duffy VG. Exploring the future development of Artificial Intelligence (AI) applications in chatbots: a bibliometric analysis. Int J Soc Robot. 2023; 2023:1–14.
   Google Scholar
• Cabreja-Castillo M, Hernandez L, Mustafa A, Hungria G, Bertoli MT. COVID-19 scientific literacy in medical and nursing students. J Microbiol Biol Educ. 2023;24(1):e00219–00222. doi:10.1128/jmbe.00219-22
   PubMed Web of Science ®Google Scholar
• Rivas P, Zhao L. Marketing with chatgpt: navigating the ethical terrain of gpt-based chatbot technology. AI. 2023;4(2):375–384. doi:10.3390/ai4020019
   Google Scholar
• Giansanti D. The chatbots are invading us: a map point on the evolution, applications, opportunities, and emerging problems in the health domain. Life. 2023;13(5):1130. doi:10.3390/life13051130
   PubMedGoogle Scholar
• Hammour KA, Farha RA, Ya’acoub R, Salman Z, Basheti I. Impact of pharmacist-directed medication reconciliation in reducing medication discrepancies: a randomized controlled trial. Can J Hosp Pharm. 2022;2022:1.
   Google Scholar
• Bossaer JB, Eskens D, Gardner A. Sensitivity and specificity of drug interaction databases to detect interactions with recently approved oral antineoplastics. J Oncol Pharm Pract. 2022;28(1):82–86. doi:10.1177/1078155220984244
   PubMed Web of Science ®Google Scholar
• Rossing P, Caramori ML, Chan JC, et al. Executive summary of the KDIGO 2022 clinical practice guideline for diabetes management in chronic kidney disease: an update based on rapidly emerging new evidence. Kidney Int. 2022;102(5):990–999. doi:10.1016/j.kint.2022.06.013
   PubMed Web of Science ®Google Scholar
• Heidenreich PA, Bozkurt B, Aguilar D, et al. 2022 AHA/ACC/HFSA guideline for the management of heart failure: a report of the American College of Cardiology/American Heart Association Joint Committee on clinical practice guidelines. J Am Coll Cardiol. 2022;79(17):e263–e421. doi:10.1016/j.jacc.2021.12.012
   PubMed Web of Science ®Google Scholar
• Fleet JL, Shariff SZ, Bailey DG, et al. Comparing two types of macrolide antibiotics for the purpose of assessing population-based drug interactions. BMJ open. 2013;3(7):e002857. doi:10.1136/bmjopen-2013-002857
   PubMed Web of Science ®Google Scholar
• Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare. 2023;11(6):887. doi:10.3390/healthcare11060887
   Web of Science ®Google Scholar
• Juhi A, Pipil N, Santra S, Mondal S, Behera JK, Mondal H. The capability of ChatGPT in predicting and explaining common drug-drug interactions. Cureus. 2023;15(3):e36272. doi:10.7759/cureus.36272
   PubMed Web of Science ®Google Scholar
• Kung TH, Cheatham M, Medenilla A, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health. 2023;2(2):e0000198. doi:10.1371/journal.pdig.0000198
   PubMedGoogle Scholar
• Raimondi R, Tzoumas N, Salisbury T, et al. Comparative analysis of large language models in the Royal College of Ophthalmologists fellowship exams. Eye. 2023. doi:10.1038/s41433-023-02563-3
   Web of Science ®Google Scholar
• Gilson A, Safranek CW, Huang T, et al. How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023;9:e45312. doi:10.2196/45312
   PubMedGoogle Scholar
• Das D, Kumar N, Longjam LA, et al. Assessing the capability of ChatGPT in answering first- and second-order knowledge questions on microbiology as per competency-based medical education curriculum. Cureus. 2023;15(3):e36034. doi:10.7759/cureus.36034
   PubMed Web of Science ®Google Scholar
• Jin D, Pan E, Oufattole N, Weng W-H, Fang H, Szolovits P. What disease does this patient have? A large-scale open domain question answering dataset from medical exams. Appl Sci. 2021;11(14):6421. doi:10.3390/app11146421
   Google Scholar
• Liévin V, Hother CE, Winther OJ. Can large language models reason about medical questions?; 2022.
   Google Scholar
• Yang X, Chen A, PourNejatian N, et al. A large language model for electronic health records. NPJ Digit Med. 2022;5(1):194. doi:10.1038/s41746-022-00742-2
   PubMed Web of Science ®Google Scholar
• Steinberg E, Jung K, Fries JA, Corbin CK, Pfohl SR, Shah NH. Language models are an effective representation learning technique for electronic health record data. J Biomed Inform. 2021;113:103637. doi:10.1016/j.jbi.2020.103637
   PubMed Web of Science ®Google Scholar
• Tiu E, Talius E, Patel P, Langlotz CP, Ng AY, Rajpurkar P. Expert-level detection of pathologies from unannotated chest X-ray images via self-supervised learning. Nat Biomed Eng. 2022;6(12):1399–1406. doi:10.1038/s41551-022-00936-9
   PubMed Web of Science ®Google Scholar
• Food and Drug Administration. Artificial intelligence and machine learning (AI/ML)-enabled medical devices. Food and Drug Administration; 2023. Available from: https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-aiml-enabled-medical-devices. Accessed September 12, 2023.
   Google Scholar
• Acosta JN, Falcone GJ, Rajpurkar P, Topol EJ. Multimodal biomedical AI. Nat Med. 2022;28(9):1773–1784. doi:10.1038/s41591-022-01981-2
   PubMed Web of Science ®Google Scholar