Advanced search
Publication Cover
Journal of Consumer Health on the Internet Volume 28, 2024 - Issue 2
Submit an article Journal homepage
31
Views
0
CrossRef citations to date
0
Altmetric
ARTICLES

Comparing Performances of Artificial Intelligence Chatbots to Patients’ Questions on Health Information: Comprehensiveness, Accuracy and Currency

Mustafa Said YıldızInternal Audit Department, Ministry of Health, Ankara, TurkeyCorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0001-7423-1408View further author information
ORCID Icon
Pages 115-123 | Received 01 Dec 2023, Accepted 17 May 2024, Published online: 05 Jun 2024

References

  • Aggarwal, A., C.C. Tam, D. Wu, X. Li, and S. Qiao. 2023. Artificial ıntelligence–based chatbots for promoting health behavioral changes: Systematic review. Journal of Medical Internet Research 25: e40789. doi:10.2196/40789.
  • Ali, R., O. Y. Tang, I. D. Connolly, J. S. Fridley, J. H. Shin, P. L. Zadnik Sullivan, D. Cielo, et al. 2023. Performance of ChatGPT, GPT-4, and Google Bard on a neurosurgery oral boards preparation question bank. Neurosurgery 93, no. 5: 1090–1098. doi:10.1227/neu.0000000000002551.
  • Hopkins, A.M., J.M. Logan, G. Kichenadasse, and M.J. Sorich. 2023. Artificial intelligence chatbots will revolutionize how cancer patients access information: ChatGPT represents a paradigm-shift. JNCI Cancer Spectrum 7, no. 2:pkad010. doi:10.1093/jncics/pkad010.
  • Howard, A., W. Hope, and A. Gerada. 2023. ChatGPT and antimicrobial advice: The end of the consulting infection doctor? The Lancet. Infectious diseases 23, no. 4: 405–6. doi:10.1016/S1473-3099(23)00113-5.
  • Hsiao, S. 2023. What’s ahead for Bard: More global, more visual, more integrated, https://blog.google/technology/ai/google-bard-updates-io-2023/
  • IBM. 2023. What is a chatbot. Available from: https://www.ibm.com/topics/chatbots (accessed in April 30, 2023).
  • Johnson, S.B., A.J. King, E.L. Warner, S. Aneja, B.H. Kann, and C.L. Bylund. 2023. Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information. JNCI Cancer Spectrum 7, no. 2: pkad0. doi:10.1093/jncics/pkad0. https://orcid.org/0000-0002-4608-6896.
  • MedicalFuturist. 2023. Top 12 health ChatBots. Available from: https://medicalfuturist.com/top-12-health-chatbots/ (accessed in April 30, 2023).
  • Noda, R., Y. Izaki, F. Kitano, J. Komatsu, D. Ichikawa, and Y. Shibagaki. 2024. Performance of ChatGPT and Bard in self-assessment questions for nephrology board renewal. Clinical and experimental nephrology 28, no. 5: 465–9. doi:10.1007/s10157-023-02451-w.
  • OpenAI. 2023. ChatGPT technical report Available from: https://cdn.openai.com/papers/gpt-4.pdf (accessed in April 30, 2023).
  • Parviainen, J., and J. Rantala. 2022. Chatbot breakthrough in the 2020s? An ethical reflection on the trend of automated consultations in health care. Medicine, Health Care, and Philosophy 25, no. 1: 61–71. doi:10.1007/s11019-021-10049-w.
  • Pew Research Center. 2017. Nearly half of Americans use digital vocie assistants, mostly on their smartphones. https://www.pewresearch.org/short-reads/2017/12/12/nearly-half-of-americans-use-digital-voice-assistants-mostly-on-their-smartphones/
  • Plevris, V., G. Papazafeiropoulos, and A. Jiménez Rios. 2023. Chatbots put to the test in math and logic problems: A comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard. AI 4, no. 4: 949–69. doi:10.3390/ai4040048.
  • Rahsepar, A.A., T. Neda, G.H.J. Kim, C. Hassani, F. Abtin, and A. Bedayat. 2023. How AI responds to common lung cancer questions: ChatGPT vs Google Bard. Radiology 307, no. 5:e230922. doi:10.1148/radiol.230922.
  • Sallam, M. 2023. ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare 11, no. 6: 887. doi:10.3390/healthcare11060887.
  • Yeo, Y. H., J. S. Samaan, W. H. Ng, P. S. Ting, H. Trivedi, A. Vipani, W. Ayoub, et al. 2023. Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma. Clinical and Molecular Hepatology 30, no. 1: 124–125. doi:10.3350/cmh.2023.0089.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.