194
Views
0
CrossRef citations to date
0
Altmetric
ORIGINAL RESEARCH

Are Different Versions of ChatGPT’s Ability Comparable to the Clinical Diagnosis Presented in Case Reports? A Descriptive Study

ORCID Icon, , , & ORCID Icon
Pages 3825-3831 | Received 23 Sep 2023, Accepted 26 Nov 2023, Published online: 05 Dec 2023

References

  • Ruksakulpiwat S, Kumar A, Ajibade A. Using ChatGPT in Medical Research: current Status and Future Directions. J Multidiscip Healthc. 2023;16:1513–1520. doi:10.2147/JMDH.S413470
  • Mann DL. Artificial Intelligence Discusses the Role of Artificial Intelligence in Translational Medicine: a JACC: basic to Translational Science Interview With ChatGPT. JACC Basic Transl Sci. 2023;8(2):221–223. doi:10.1016/j.jacbts.2023.01.001
  • Blanco-González A, Cabezón A, Seco-González A, et al. The Role of AI in Drug Discovery: challenges, Opportunities, and Strategies. Pharmaceuticals. 2023;16(6):891. doi:10.3390/ph16060891
  • Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023;27(1):75. doi:10.1186/s13054-023-04380-2
  • Ueda D, Mitsuyama Y, Takita H, et al. ChatGPT’s Diagnostic Performance from Patient History and Imaging Findings on the Diagnosis Please Quizzes. Radiology. 2023;308(1):e231040. doi:10.1148/radiol.231040
  • Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell. 2023;6:1169595. doi:10.3389/frai.2023.1169595
  • Han JW, Park J, Lee H. Analysis of the effect of an artificial intelligence chatbot educational program on non-face-to-face classes: a quasi-experimental study. BMC Med Educ. 2022;22(1):830. doi:10.1186/s12909-022-03898-3
  • Gulati R, Nawaz M, Pyrsopoulos NT. Health literacy and liver disease. Clin Liver Dis. 2018;11(2):48–51. doi:10.1002/cld.690
  • Ayers JW, Poliak A, Dredze M, et al. Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum. JAMA Intern Med. 2023;183(6):589. doi:10.1001/jamainternmed.2023.1838
  • Liu J, Wang C, Liu S. Utility of ChatGPT in Clinical Practice. J Med Internet Res. 2023;25:e48568. doi:10.2196/48568
  • Sezgin E, Sirrianni J, Linwood SL. Operationalizing and Implementing Pretrained, Large Artificial Intelligence Linguistic Models in the US Health Care System: outlook of Generative Pretrained Transformer 3 (GPT-3) as a Service Model. JMIR Med Inform. 2022;10(2):e32875. doi:10.2196/32875
  • Nath S, Marie A, Ellershaw S, Korot E, Keane PA. New meaning for NLP: the trials and tribulations of natural language processing with GPT-3 in ophthalmology. Br J Ophthalmol. 2022;106(7):889–892. doi:10.1136/bjophthalmol-2022-321141
  • Agbavor F, Liang H. Predicting dementia from spontaneous speech using large language models. PLOS Digit Health. 2022;1(12):e0000168. doi:10.1371/journal.pdig.0000168
  • Rao A, Pang M, Kim J, et al. Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: development and Usability Study. J Med Internet Res. 2023;25:e48659. doi:10.2196/48659
  • Stokel-Walker C, Van Noorden R. What ChatGPT and generative AI mean for science. Nature. 2023;614(7947):214–216. doi:10.1038/d41586-023-00340-6
  • Rao A, Kim J, Kamineni M, et al. Evaluating GPT as an Adjunct for Radiologic Decision Making: GPT-4 Versus GPT-3.5 in a Breast Imaging Pilot. J Am Coll Radiol. 2023;20(10):990–997. doi:10.1016/j.jacr.2023.05.003
  • Roosan D, Samore M, Jones M, Livnat Y, Clutter J Big-Data Based Decision-Support Systems to Improve Clinicians’ Cognition. In: 2016 IEEE International Conference on Healthcare Informatics (ICHI). IEEE; 2016:285–288. doi:10.1109/ICHI.2016.39.
  • Bieber K, Hundt JE, Yu X, et al. Autoimmune pre-disease. Autoimmun Rev. 2023;22(2):103236. doi:10.1016/j.autrev.2022.103236
  • Rose NR. Prediction and Prevention of Autoimmune Disease in the 21st Century: a Review and Preview. Am J Epidemiol. 2016;183(5):403–406. doi:10.1093/aje/kwv292
  • Mané-Damas M, Hoffmann C, Zong S, et al. Autoimmunity in psychotic disorders. Where we stand, challenges and opportunities. Autoimmun Rev. 2019;18(9):102348. doi:10.1016/j.autrev.2019.102348
  • Walsh SJ, Rau LM. Autoimmune diseases: a leading cause of death among young and middle-aged women in the United States. Am J Public Health. 2000;90(9):1463–1466. doi:10.2105/ajph.90.9.1463
  • Kim JK, Chua M, Rickard M, Lorenzo A. ChatGPT and large language model (LLM) chatbots: the current state of acceptability and a proposal for guidelines on utilization in academic medicine. J Pediatr Urol. 2023. doi:10.1016/j.jpurol.2023.05.018
  • Ferdush J, Begum M, Hossain ST. ChatGPT and Clinical Decision Support: scope, Application, and Limitations. Ann Biomed Eng. 2023. doi:10.1007/s10439-023-03329-4
  • Duey AH, Nietsch KS, Zaidat B, et al. Thromboembolic prophylaxis in spine surgery: an analysis of ChatGPT recommendations. Spine J. 2023;23(11):1684–1691. doi:10.1016/j.spinee.2023.07.015
  • Lee J, Liu C, Kim J, et al. Deep learning for rare disease: a scoping review. J Biomed Inform. 2022;135:104227. doi:10.1016/j.jbi.2022.104227
  • Molster C, Urwin D, Di Pietro L, et al. Survey of healthcare experiences of Australian adults living with rare diseases. Orphanet J Rare Dis. 2016;11(1):30. doi:10.1186/s13023-016-0409-z
  • Marwaha S, Knowles JW, Ashley EA. A guide for the diagnosis of rare and undiagnosed disease: beyond the exome. Genome Med. 2022;14(1):23. doi:10.1186/s13073-022-01026-w
  • Fernandes AC, Souto MEVC. Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine. N Engl J Med. 2023;388(25):2399–2400. doi:10.1056/NEJMc2305286
  • Wagner MW, Ertl-Wagner BB. Accuracy of Information and References Using ChatGPT-3 for Retrieval of Clinical Radiological Information. Can Assoc Radiol J. 2023;8465371231171125. doi:10.1177/08465371231171125
  • McGowan A, Gui Y, Dobbs M, et al. ChatGPT and Bard exhibit spontaneous citation fabrication during psychiatry literature search. Psychiatry Res. 2023;326:115334. doi:10.1016/j.psychres.2023.115334
  • Howard A, Hope W, Gerada A. ChatGPT and antimicrobial advice: the end of the consulting infection doctor? Lancet Infect Dis. 2023;23(4):405–406. doi:10.1016/S1473-3099(23)00113-5
  • Thapa S, Adhikari S. ChatGPT, Bard, and Large Language Models for Biomedical Research: opportunities and Pitfalls. Ann Biomed Eng. 2023;51(12):2647–2651. doi:10.1007/s10439-023-03284-0
  • Patil NS, Huang RS, Der Pol CB V, Larocque N. Comparative Performance of ChatGPT and Bard in a Text-Based Radiology Knowledge Assessment. Can Assoc Radiol J. 2023;08465371231193716. doi:10.1177/08465371231193716
  • Rahsepar AA, Tavakoli N, Kim GHJ, Hassani C, Abtin F, Bedayat A. How AI Responds to Common Lung Cancer Questions: chatGPT vs Google Bard. Radiology. 2023;307(5):e230922. doi:10.1148/radiol.230922
  • Ali R, Tang OY, Connolly ID, et al. Performance of ChatGPT, GPT-4, and Google Bard on a Neurosurgery Oral Boards Preparation Question Bank. Neurosurgery. 2023. doi:10.1227/neu.0000000000002551