Dr. Google vs. Dr. ChatGPT: Exploring the Use of Artificial Intelligence in Ophthalmology by Comparing the Accuracy, Safety, and Readability of Responses to Frequently Asked Patient Questions Regarding Cataracts and Cataract Surgery

REFERENCES

• Bujnowska-Fedak MM, Węgierek P. The impact of online health information on patient health behaviours and making decisions concerning health. Int J Environ Res Public Health. 2020;17(3):880. doi:10.3390/ijerph17030880.
   PubMed Web of Science ®Google Scholar
• Van Riel N, Auwerx K, Debbaut P, Van Hees S, Schoenmakers B. The effect of dr Google on doctor–patient encounters in primary care: a quantitative, observational, cross-sectional study. BJGP Open. 2017;1(2):bjgpopen17X100833. doi:10.3399/bjgpopen17X100833.
   PubMedGoogle Scholar
• Burzyńska J, Bartosiewicz A, Januszewicz PD. Google: physicians—the web—patients triangle: Digital skills and attitudes towards e-health solutions among physicians in south eastern Poland—A cross-sectional study in a pre-COVID-19 era. Int J Environ Res Public Health. 2023;20(2):978. doi:10.3390/ijerph20020978.
   PubMed Web of Science ®Google Scholar
• Pitt MB, Hendrickson MA. Providing a second opinion to Dr. Google with the WWW framework. J Gen Intern Med. 2022;37(1):222–224. doi:10.1007/s11606-021-06895-2.
   PubMed Web of Science ®Google Scholar
• Finney Rutten LJ, Blake KD, Greenberg-Worisek AJ, Allen SV, Moser RP, Hesse BW. Online health information seeking among US adults: measuring progress toward a healthy people 2020 objective. Public Health Rep. 2019;134(6):617–625. doi:10.1177/0033354919874074.
   PubMed Web of Science ®Google Scholar
• Moorhead SA, Hazlett DE, Harrison L, Carroll JK, Irwin A, Hoving C. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. J Med Internet Res. 2013;15(4):e85. doi:10.2196/jmir.1933.
   PubMed Web of Science ®Google Scholar
• Lee K, Hoti K, Hughes JD, Emmerton LM. Consumer use of “dr google”: a survey on health information-seeking behaviors and navigational needs. J Med Internet Res. 2015;17(12):e288. doi:10.2196/jmir.4345.
   PubMed Web of Science ®Google Scholar
• Kłak A, Gawińska E, Samoliński B, Raciborski F. Dr Google as the source of health information – the results of pilot qualitative study. Polish Annals Of Medicine. 2017;24(2):188–193. doi:10.1016/j.poamed.2017.02.002.
   Google Scholar
• Cohen SA, Fisher AC, Pershing S. Analysis of the readability and accountability of online patient education materials related to glaucoma diagnosis and treatment. Clin Ophthalmol. 2023;17:779–788. doi:10.2147/OPTH.S401492.
   PubMed Web of Science ®Google Scholar
• Cohen SA, Tijerina JD, Kossler A. The readability and accountability of online patient education materials related to common oculoplastics diagnoses and treatments. Semin Ophthalmol. 2023;38(4):387–393. doi:10.1080/08820538.2022.2158039.
   PubMed Web of Science ®Google Scholar
• Cohen SA, Pershing S. Readability and accountability of online patient education materials for common retinal diseases. Ophthalmol Retina. 2022;6(7):641–643. doi:10.1016/j.oret.2022.03.015.
   PubMedGoogle Scholar
• Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell. 2023;6:1169595. doi:10.3389/frai.2023.1169595.
   PubMedGoogle Scholar
• Devlin J, Chang MW, Lee K, Toutanova KB. Pre-training of deep bidirectional transformers for language understanding. Published online May 24, 2019. 10.48550/arXiv.1810.04805.
   Google Scholar
• Peres R, Schreier M, Schweidel D, Sorescu A. On ChatGPT and beyond: how generative artificial intelligence may affect research, teaching, and practice. Interna J Res In Marke. 2023;40(2):269–275. doi:10.1016/j.ijresmar.2023.03.001.
   Web of Science ®Google Scholar
• Choudhury A, Shamszare H. Investigating the impact of user trust on the adoption and use of ChatGPT: survey analysis. J Med Internet Res. 2023;25:e47184. doi:10.2196/47184.
   PubMed Web of Science ®Google Scholar
• Singh S, Djalilian A, Ali MJ. ChatGPT and ophthalmology: exploring its potential with discharge summaries and operative notes. Semin Ophthalmol. 2023;38(5):503–507. doi:10.1080/08820538.2023.2209166.
   PubMed Web of Science ®Google Scholar
• Xie Y, Seth I, Hunter-Smith DJ, Rozen WM, Ross R, Lee M. Aesthetic surgery advice and counseling from artificial intelligence: a rhinoplasty consultation with ChatGPT. Aesth Plast Surg. 2023;47(5):1985–1993. doi:10.1007/s00266-023-03338-7.
   PubMed Web of Science ®Google Scholar
• Van Bulck L, Moons P. What if your patient switches from Dr. Google to Dr. ChatGPT? A vignette-based survey of the trustworthiness, value, and danger of ChatGPT-generated responses to health questions. Eur J Cardiovasc Nurs. Published online April 24, 2023: zvad038;23(1):95–98. doi:10.1093/eurjcn/zvad038.
   PubMed Web of Science ®Google Scholar
• IA B, Zhang Y(, Govil D, et al. Comparison of ophthalmologist and large language model chatbot responses to online patient eye care questions. JAMA Network Open. 2023;6(8):e2330320. doi:10.1001/jamanetworkopen.2023.30320.
   PubMed Web of Science ®Google Scholar
• Potapenko I, Boberg-Ans LC, Stormly Hansen M, Klefter ON, van Dijk EHC, Subhi Y. Artificial intelligence-based chatbot patient information on common retinal diseases using ChatGPT. Acta Ophthalmol. 2023;101(7):829–831. doi:10.1111/aos.15661.
   PubMed Web of Science ®Google Scholar
• Momenaei B, Wakabayashi T, Shahlaee A, et al. Appropriateness and readability of ChatGPT-4-generated responses for surgical treatment of retinal diseases. Ophthalmol Retina. 2023;7(10):862–868. doi:10.1016/j.oret.2023.05.022.
   PubMedGoogle Scholar
• Cox A, Seth I, Xie Y, Hunter-Smith DJ, Rozen WM. Utilizing ChatGPT-4 for providing medical information on blepharoplasties to patients. Aesthet Surg J. 2023;43(8):NP658–NP662. doi:10.1093/asj/sjad096.
   PubMed Web of Science ®Google Scholar
• Rossi T, Romano MR, Iannetta D, et al. Cataract surgery practice patterns worldwide: a survey. BMJ Open Ophthalmol. 2021;6(1):e000464. doi:10.1136/bmjophth-2020-000464.
   PubMed Web of Science ®Google Scholar
• Singhal K, Azizi S, Tu T, et al. Large language models encode clinical knowledge. Published online December 26, 2022. 10.48550/arXiv.2212.13138.
   Google Scholar
• Samaan JS, Yeo YH, Rajeev N, et al. Assessing the accuracy of responses by the language model ChatGPT to questions regarding bariatric surgery. Obes Surg. 2023;33(6):1790–1796. doi:10.1007/s11695-023-06603-5.
   PubMed Web of Science ®Google Scholar
• Yeo YH, Samaan JS, Ng WH, et al. Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma. Clin Mol Hepatol. 2023;29(3):721–732. doi:10.3350/cmh.2023.0089.
   PubMed Web of Science ®Google Scholar
• Ayers JW, Poliak A, Dredze M, et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern Med. 2023;183(6):589–596. doi:10.1001/jamainternmed.2023.1838.
   PubMed Web of Science ®Google Scholar
• Schultheiß S, Häußler H, Lewandowski D Does search engine optimization come along with high-quality content? A comparison between optimized and non-optimized health-related web pages. In: Proceedings of the 2022 Conference on Human Information Interaction and Retrieval. CHIIR ’22. Association for Computing Machinery; 2022:123–134. doi:10.1145/3498366.3505811
   Google Scholar
• Dunne S, Cummins NM, Hannigan A, Shannon B, Dunne C, Cullen W. A method for the design and development of medical or health care information websites to optimize search engine results page rankings on Google. J Med Internet Res. 2013;15(8):e183. doi:10.2196/jmir.2632.
   PubMed Web of Science ®Google Scholar
• Health Literacy and Patient Safety: Help Patients Understand. Manual for Clinicians. 2nd ed. Published online September 26, 2007. Accessed November 21, 2023. https://psnet.ahrq.gov/issue/health-literacy-and-patient-safety-help-patients-understand-manual-clinicians-2nd-ed
   Google Scholar
• Razdan S, Siegal AR, Brewer Y, Sljivich M, Valenzuela RJ. Assessing ChatGPT’s ability to answer questions pertaining to erectile dysfunction: can our patients trust it? Int J Impot Res. 2023;2023:1–7. doi:10.1038/s41443-023-00797-z. Published online November 20.
   Google Scholar
• Kianian R, Sun D, Crowell EL, Tsui E. The use of large language models to generate education materials about uveitis. Ophthalmol Retina. 2023;00(0). doi:10.1016/j.oret.2023.09.008.
   Google Scholar
• Newman-Casey PA, Niziol LM, Lee PP, Musch DC, Resnicow K, Heisler M. The impact of the support, educate, empower personalized glaucoma coaching pilot study on glaucoma medication adherence. Ophthalmol Glaucoma. 2020;3(4):228–237. doi:10.1016/j.ogla.2020.04.013.
   PubMedGoogle Scholar
• Redd TK, Read-Brown S, Choi D, Yackel TR, Tu DC, Chiang MF. Electronic health record impact on pediatric ophthalmologists’ productivity and efficiency at an academic center. J Aapos. 2014;18(6):584–589. doi:10.1016/j.jaapos.2014.08.002.
   PubMed Web of Science ®Google Scholar
• Chiang MF, Read-Brown S, Tu DC, et al. Evaluation of electronic health record implementation in ophthalmology at an academic medical center (an American ophthalmological society thesis). Trans Am Ophthalmol Soc. 2013;111:70–92.
   PubMedGoogle Scholar
• Chen AJ, Baxter SL, Gali HE, et al. Evaluation of Electronic Health Record Implementation in an Academic Oculoplastics Practice. Ophthalmic Plast Reconstr Surg. 2020;36(3):277–283. doi:10.1097/IOP.0000000000001531.
   PubMed Web of Science ®Google Scholar
• Top Website Statistics for 2023 – Forbes Advisor. Accessed November 21, 2023. https://www.forbes.com/advisor/business/software/website-statistics/
   Google Scholar
• Massey PA, Montgomery C, Zhang AS, Orthop Surg. Comparison of ChatGPT–3.5, ChatGPT-4, and orthopaedic resident performance on orthopaedic assessment examinations. J The American Acade Orthopa Surgeons. 2023;31(23):1173–1179. doi:10.5435/JAAOS-D-23-00396.
   PubMed Web of Science ®Google Scholar