Integrating artificial intelligence into an ophthalmologist’s workflow: obstacles and opportunities

References

• Ophthalmology busiest specialty for third year running [Internet]. Optometry Today [cited 2022 Jun 14]. Available from: https://www.aop.org.uk/ot/professional-support/health-services/2020/10/19/ophthalmology-busiest-specialty-for-third-year-running.
   Google Scholar
• New RCOphth workforce census illustrates the severe shortage of eye doctors in the UK [Internet]. The Royal College of Ophthalmologists [cited 2022 Aug 25]. Available from: https://www.rcophth.ac.uk/news-views/new-rcophth-workforce-census-illustrates-the-severe-shortage-of-eye-doctors-in-the-uk/.
   Google Scholar
• Ting DSJ, Deshmukh R, Said DG, et al. The impact of COVID-19 pandemic on ophthalmology services: are we ready for the aftermath? Ther Adv Ophthalmol. 2020;12:251584142096409.
   Web of Science ®Google Scholar
• Amisha A, Malik P, Pathania M, et al. Overview of artificial intelligence in medicine. J Fam Med Prim Care. 2019;8(7):2328–2331.
   PubMedGoogle Scholar
• The OECD Artificial Intelligence [AI] Principles [Internet]. OECD.AI. [cited 2022 Sep 24]. Available from: https://oecd.ai/en/ai-principles
   Google Scholar
• Kawamoto K, Houlihan CA, Balas EA, et al. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.
   PubMed Web of Science ®Google Scholar
• Grzybowski A. Artificial intelligence in ophthalmology. Switzerland AG: Springer; 2021.
   Google Scholar
• Tong Y, Lu W, Yu Y, et al. Application of machine learning in ophthalmic imaging modalities. Eye Vis. 2020;7(1):22.
   PubMedGoogle Scholar
• Lu W, Tong Y, Yu Y, et al. Applications of artificial intelligence in ophthalmology: general overview. J Ophthalmol. 2018;2018:5278196.
   PubMed Web of Science ®Google Scholar
• Sendak M, D’Archy J, Kashyap S, et al. A path for translation of machine learning products into healthcare delivery. EMJ Innov. 2020;10:172.
   Google Scholar
• Krishnan R, Rajpurkar P, Topol EJ. Self-supervised learning in medicine and healthcare. Nat Biomed Eng. 2022;6(12):1346–1352.
   Web of Science ®Google Scholar
• Lakhani P, Sundaram B. Deep Learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology. 2017;284(2):574–582.
   PubMed Web of Science ®Google Scholar
• Chen L, Bentley P, Rueckert D. Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks. NeuroImage Clin. 2017;15:633–643.
   PubMed Web of Science ®Google Scholar
• Menze BH, Jakab A, Bauer S, et al. The multimodal Brain Tumor Image Segmentation Benchmark [BRATS]. IEEE Trans Med Imaging. 2015;34(10):1993–2024.
   PubMed Web of Science ®Google Scholar
• Rajpurkar P, Irvin J, Zhu K, et al. CheXNet: radiologist-level pneumonia detection on chest x-rays with deep learning. arXiv: 1711.05225. 2017.
   Google Scholar
• Rajpurkar P, Hannun AY, Haghpanahi M, et al. Cardiologist-level arrhythmia detection with convolutional neural networks arXiv:1707.01836: 2017.
   Google Scholar
• Esteva A, Kuprel B, Novoa RA, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–118.
   PubMed Web of Science ®Google Scholar
• Hammoudi K, Benhabiles H, Melkemi M, et al. Deep learning on chest X-ray images to detect and evaluate pneumonia cases at the era of COVID-19. J Med Syst. 2021;45(7):75
   PubMed Web of Science ®Google Scholar
• Ghosh P, Azam S, Quadir R, et al. SkinNet-16: a deep learning approach to identify benign and malignant skin lesions. Front Oncol August. 2022;12:931141.
   PubMed Web of Science ®Google Scholar
• Liu X, Faes L, Kale AU, et al. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digit Health. 2019;1(6):e271–97.
   PubMedGoogle Scholar
• Pontikos N, Basheer K, Kortuem KU, et al. Ten years of optical coherence tomography in ophthalmology: current and future use. Invest Ophthalmol. 2018;59(9):3216–3216.
   Google Scholar
• Ting DSW, Pasquale LR, Peng L, et al. Artificial intelligence and deep learning in ophthalmology. Br J Ophthalmol. 2019;103(2):167–175.
   PubMed Web of Science ®Google Scholar
• Jill Hopkins J, Keane PA, Balaskas K. Delivering personalized medicine in retinal care: from artificial intelligence algorithms to clinical application. Curr Opin Ophthalmol. 2020;31(5):329–336.
   PubMed Web of Science ®Google Scholar
• ElTanboly A, Ismail M, Shalaby A, et al. A computer-aided diagnostic system for detecting diabetic retinopathy in optical coherence tomography images. Med Phys. 2017;44(3):914–923.
   PubMed Web of Science ®Google Scholar
• De Fauw J, Ledsam JR, Romera-Paredes B, et al. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat Med. 2018;24(9):1342–1350.
   PubMed Web of Science ®Google Scholar
• Burlina PM, Joshi N, Pekala M, et al. Automated grading of age-related macular degeneration from color fundus images using deep convolutional neural networks. JAMA Ophthalmol. 2017;135(11):1170–1176.
   PubMed Web of Science ®Google Scholar
• Gulshan V, Peng L, Coram M, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316(22):2402.
   PubMed Web of Science ®Google Scholar
• Yim J, Chopra R, Spitz T, et al. Predicting conversion to wet age-related macular degeneration using deep learning. Nat Med. 2020;26(6):892–899.
   PubMed Web of Science ®Google Scholar
• Wang M, Shen LQ, Pasquale LR, et al. An artificial intelligence approach to detect visual field progression in glaucoma based on spatial pattern analysis. Invest Ophthalmol Vis Sci. 2019;60(1):365–375.
   PubMed Web of Science ®Google Scholar
• Long E, Lin H, Liu Z, et al. An artificial intelligence platform for the multihospital collaborative management of congenital cataracts. Nat Biomed Eng. 2017;1(2):0024.
   Web of Science ®Google Scholar
• Zhang J, Whebell S, Gallifant J, et al. An interactive dashboard to track themes, development maturity, and global equity in clinical artificial intelligence research. Lancet Digit Health. 2022;4(4):e212–3.
   PubMedGoogle Scholar
• AI for human health - dashboard [Internet]. [cited 2022 Nov 28]. Available from: https://aiforhealth.app/
   Google Scholar
• Eun J, Han D, Liu X, et al. Teleophthalmology- enabled-and-artificial- intelligence-- ready-referral-pathway-for- community-optometry-referrals-of-retinal- disease-[HERMES]:-a-cluster-randomised- superiority-trial-with-a-linked-diagnostic- accuracy-study-HERMES-study-report- 1-study-protocol. BMJ Open. 2022;12:55845.
   Web of Science ®Google Scholar
• Beede E, Baylor E, Hersch F, et al. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy [Internet]. Proceedings of the CHI Conference on Human Factors in Computing Systems; 2020 April 25-30; Honolulu HI USA p. 1–12
   Google Scholar
• Held LA, Wewetzer L, Steinhäuser J. Determinants of the implementation of an artificial intelligence-supported device for the screening of diabetic retinopathy in primary care - a qualitative study. Health Informatics J. 2022;28(3):14604582221112816.
   Web of Science ®Google Scholar
• Yap A, Wilkinson B, Chen E, et al. Patients Perceptions of Artificial Intelligence in Diabetic Eye Screening. Asia-Pacific J Ophthalmol. 2022;11(3):287–293.
   PubMed Web of Science ®Google Scholar
• Robinson EL, Guidoboni G, Verticchio A, et al. Artificial intelligence-integrated approaches in ophthalmology: a qualitative pilot study of provider understanding and adoption of AI. Investigative Ophthalmology & Visual Science. Poster session presented at Association for Research in Vision and Ophthalmology; 2022 May 1- 4, Denver (CO)
   Google Scholar
• Skivington K, Matthews L, Simpson SA, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061.
   PubMed Web of Science ®Google Scholar
• Abràmoff MD, Lavin PT, Birch M, et al. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. Npj Digit Med. 2018;1(1):39.
   PubMedGoogle Scholar
• Artificial Intelligence: LC, Questions TB. Review of Ophthalmology [internet]. 2021. [cited 2022 Aug 23]. Available from: https://www.reviewofophthalmology.com/article/artificial-intelligence-the-big-questions.
   Google Scholar
• Product Announcement: optos AI for DR [Internet]. Optos [cited 2022 Oct 6]. Available from: https://www.optos.com/press-releases/2022-optos-ai-for-dr/
   Google Scholar
• RetInSight [Internet]. 2022. [cited 2022 Oct 6]. Available from: https://retinsight.com/
   Google Scholar
• Gerendas BS, Sadeghipour A, Michl M, et al. Validation of an automated fluid algorithm on real-world data of neovascular age-related macular degeneration over five years. Retina. 2022;42(9):1673–1682
   PubMed Web of Science ®Google Scholar
• Intelligence in Ophthalmology [Internet]. RetinAI. [cited 2022 Oct 6]. Available from: https://www.retinai.com/
   Google Scholar
• Aristidou A, Jena R, Topol EJ. Bridging the chasm between AI and clinical implementation. Lancet. 2022;399(10325):620.
   PubMed Web of Science ®Google Scholar
• Sanchez A, Grandes G, Cortada J, et al. Feasibility of an implementation strategy for the integration of health promotion in routine primary care: a quantitative process evaluation. BMC Fam Pract. 2017;18:1.
   PubMed Web of Science ®Google Scholar
• Paul Y, Hickok E, Sinha A, et al. Artificial Intelligence in the Healthcare Industry in India [internet]. Cis-India. [cited 2022 Aug 20]. Available from: https://cis-india.org/internet-governance/ai-and-healthcare-report
   Google Scholar
• Khan SM, Liu X, Nath S, et al. A global review of publicly available datasets for ophthalmological imaging: barriers to access, usability, and generalisability. Lancet Digit Health. 2021;3(1):e51–66.
   PubMedGoogle Scholar
• Daye D, Wiggins WF, Lungren MP, et al. Implementation of Clinical Artificial Intelligence in Radiology: who Decides and How? Radiology. 2022;305(3):212151.
   Google Scholar
• What Is Canary Deployment? [Internet]. Semaphore [cited 2022 Aug 25]. Available from: https://semaphoreci.com/blog/what-is-canary-deployment#:~:text=Insoftwareengineering%2Ccanarydeploymenttherestoftheusers.
   Google Scholar
• Liu X, Glocker B, McCradden MM, et al. The medical algorithmic audit. Lancet Digit Health. 2022;4(5):e384–97.
   PubMedGoogle Scholar
• What Is MLOps? Machine Learning Operations Explained [Internet]. BMC Software Blogs. [cited 2022 Aug 22]. Available from: https://www.bmc.com/blogs/mlops-machine-learning-ops/
   Google Scholar
• Lebovitz S, Lifshitz-Assaf H, Levina N, et al. To Engage or Not to Engage with AI for Critical Judgments: how Professionals Deal with Opacity When Using AI for Medical Diagnosis. Organ Sci. 2022;33(1):126–148.
   Web of Science ®Google Scholar
• Yang Q, Steinfeld A, Zimmerman J. Unremarkable AI: fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes. Proceedings of the CHI Conference on Human Factors in Computing Systems; 2019 May 4- 9;Glasgow Scotland UK p. 1–11
   Google Scholar
• Liu X, Cruz Rivera S, Moher D, et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nat Med. 2020;26(9):1364–1374.
   PubMed Web of Science ®Google Scholar
• Ibrahim H, Liu X, Rivera SC, et al. Reporting guidelines for clinical trials of artificial intelligence interventions: the SPIRIT-AI and CONSORT-AI guidelines. Trials. 2021;22(1):11.
   PubMed Web of Science ®Google Scholar
• Collins G, Dhiman P, Navarro CLA, et al. Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open. 2021;11:7.
   Web of Science ®Google Scholar
• DECIDE-AI Steering Group: Baptiste Vasey;Clifton DA, Collins GS, et al. DECIDE-AI: new reporting guidelines to bridge the development-to-implementation gap in clinical artificial intelligence. Nat Med. 2021;27(2):186–187.
   PubMed Web of Science ®Google Scholar
• Vasey B, Nagendran M, Campbell B, et al. Reporting guideline for the early stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. BMJ. 2022;377:e070904.
   PubMedGoogle Scholar
• Sendak MP, Gao M, Brajer N, et al. Presenting machine learning model information to clinical end users with model facts labels. Npj Digit Med. 2020;3(1):41.
   PubMed Web of Science ®Google Scholar
• Ethics and accountability in practice [Internet]. Open Government Partnership [cited 2022 Sep 28]. Available from: https://www.opengovpartnership.org/documents/algorithmic-accountability-public-sector/
   Google Scholar
• Miller T. Explanation in artificial intelligence: insights from the social sciences. Artif Intell. 2019;267:1–38.
   Web of Science ®Google Scholar
• Explainable AI [Internet]. IBM [cited 2022 Aug 19]. Available from: https://www.ibm.com/uk-en/watson/explainable-ai
   Google Scholar
• O’Sullivan. Interpretable vs Explainable Machine Learning [Internet]. Towards Data Science [cited 2022 Aug 19]. Available from: https://towardsdatascience.com/interperable-vs-explainable-machine-learning-1fa525e12f48
   Google Scholar
• The AI black box problem [Internet]. ThinkAutomation [cited 2022 Aug 19]. Available from: https://www.thinkautomation.com/bots-and-ai/the-ai-black-box-problem/
   Google Scholar
• Kelly CJ, Karthikesalingam A, Suleyman M, et al. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 2019;17(1):195.
   PubMed Web of Science ®Google Scholar
• Amann J, Blasimme A, Vayena E, et al. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med Inform Decis Mak. 2020;20(1):310.
   PubMed Web of Science ®Google Scholar
• Human Computer Interaction, Artificial Intelligence and Intelligent Augmentation. ICIS 2020 Proceedings [Internet]. [cited 2022 Aug 13]. Available from: https://aisel.aisnet.org/icis2020/hci_artintel/
   Google Scholar
• Singh RP, Hom GL. Abramoff, et al. Current Challenges and Barriers to Real-World Artificial Intelligence Adoption for Healthcare System, Provider, and the Patient Translational Vision Science & Amp: Technology. 2020;9(2):45.
   Google Scholar
• Al-Zubaidy M, Hogg J, Maniatopoulos G, et al. Stakeholder Perspectives on Clinical Decision Support Tools to Inform Clinical Artificial Intelligence Implementation: protocol for a Framework Synthesis for Qualitative Evidence. JMIR Res Protoc. 2022;11(4):e33145.
   PubMed Web of Science ®Google Scholar
• Singer SJ, Kellogg KC, Galper AB, et al. Enhancing the value to users of machine learning-based clinical decision support tools: a framework for iterative, collaborative development and implementation. Health Care Manage Rev. 2022;47(2):E21–31.
   PubMed Web of Science ®Google Scholar
• Guzman AL, Lewis SC. Artificial intelligence and communication: a human–machine communication research agenda. New Med Soc. 2019;22:70–86.
   Web of Science ®Google Scholar
• Sandhu S, Lin AL, Brajer N, et al. Integrating a machine learning system into clinical workflows: qualitative study. J Med Internet Res. 2020;22(11):e22421.
   PubMed Web of Science ®Google Scholar
• Wang S, Hogg J, Devdatta S, et al. Implementation of a machine learning algorithm to enhance primary care effectiveness and equity for peripheral arterial disease: a qualitative study [Internet]. Poster session presented at: Machine Learning for Healthcare conference; 2022 Aug 5-6, Durham, NC 27701
   Google Scholar
• Xu W, Dainoff MJ, Ge L, et al. Transitioning to human interaction with AI systems: new challenges and opportunities for HCI professionals to enable human-centered AI. Int J Human–Computer Interact. 2022;39:1–25.
   Google Scholar
• Kellogg KC, Sendak M, Balu S. AI on the Front Lines [Internet]. MIT Sloan Manag Rev. 2022 May 4;63(4). Available from https://sloanreview.mit.edu/article/ai-on-the-front-lines/
   Web of Science ®Google Scholar
• Eyes on FHIR. FHIR for Ophthalmology [Patient Care WG project] - Patient Care [Internet]. Confluence [cited 2022 Oct 7]. Available from: https://confluence.hl7.org/pages/viewpage.action?pageId=82914199
   Google Scholar
• Kras A, Oliver W, Gillies MC, et al. Extending interoperability in ophthalmology through Fast Healthcare Interoperability Resource (FHIR). Invest Ophthalmol Vis Sci. 2021;62:1708.
   Web of Science ®Google Scholar
• Wong A, Otles E, Donnelly JP, et al. External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients. JAMA Intern Med. 2021;181(8):1065–1070.
   PubMed Web of Science ®Google Scholar
• Adlung L, Cohen Y, Mor U, et al. Machine learning in clinical decision making. Med. 2021;2(6):642–665.
   Google Scholar
• Korot E, Gonçalves MB, Khan SM, et al. Clinician-driven AI in Ophthalmology: resources Enabling Democratization. Curr Opin Ophthalmol. 2021;32(5):445–451.
   PubMed Web of Science ®Google Scholar
• On-premises vs cloud: advantages and disadvantages [Internet]. Empowersuite [cited 2022 Oct 7]. Available from: https://www.empowersuite.com/en/blog/on-premise-vs-cloud
   Google Scholar
• De Carlo TE, Romano A, Waheed NK, et al. A review of optical coherence tomography angiography [OCTA]. Int J Retin Vitr. 2015;1(1):5.
   PubMedGoogle Scholar
• Bidgood WD, Horii SC, Prior FW, et al. Understanding and using DICOM, the data interchange standard for biomedical imaging. J Am Med Inform Assoc. 1997;4(3):199–212.
   PubMed Web of Science ®Google Scholar
• Caffery LJ, Rotemberg V, Weber J, et al. The role of DICOM in artificial intelligence for skin disease. Front Med. 2021;7:1163.
   Web of Science ®Google Scholar
• American academy of ophthalmology leads call for ophthalmic equipment manufacturers to standardize digital imaging [Internet]. American Academy of Ophthalmology [cited 2022 Aug 13]. Available from: https://www.aao.org/newsroom/news-releases/detail/american-academy-of-ophthalmology-leads-call-ophth
   Google Scholar
• The Royal College of Ophthalmologists endorses the AAO’s call for standardisation of digital imaging [Internet]. The Royal College of Ophthalmologists [cited 2022 Aug 13]. Available from: https://www.rcophth.ac.uk/news-views/standardisation-of-digital-imaging/
   Google Scholar
• Brusan A, Durmaz A, Ozturk C. Workflow for ensuring DICOM compatibility during radiography device software development. J Digit Imaging. 2021;34(3):717–730.
   PubMed Web of Science ®Google Scholar
• Carter RE, Anand V, Harmon DM, et al. Model drift: when it can be a sign of success and when it can be an occult problem. Intell Med. 2022;6:100058.
   Google Scholar
• Hawkins R, Paterson C, Picardi C, et al. Guidance on the Assurance of Machine Learning in Autonomous Systems (AMLAS) [Internet]. [cited 2022 Nov 28]. Available from: https://www.york.ac.uk/media/assuring-autonomy/documents/AMLASv1.1.pdf
   Google Scholar
• ISO. ISO 14971:2019.Medical devices: application of risk management to medical devices [Internet]. [cited 2022 Nov 28]. Available from: https://www.iso.org/standard/72704.html
   Google Scholar
• The duties of a doctor registered with the General Medical Council - ethical guidance [Internet]. GMC [cited 2022 Sep 25]. Available from: https://www.gmc-uk.org/ethical-guidance/ethical-guidance-for-doctors/good-medical-practice/duties-of-a-doctor
   Google Scholar
• The Belmont Report [Internet]. HHS.gov [cited 2022 Sep 25]. Available from: https://www.hhs.gov/ohrp/regulations-and-policy/belmont-report/index.html
   Google Scholar
• Abràmoff MD, Cunningham B, Patel B, et al. Foundational Considerations for Artificial Intelligence Using Ophthalmic Images. Ophthalmology. 2022;129(2):e14–32.
   PubMed Web of Science ®Google Scholar
• Abdullah YI, Schuman JS, Shabsigh R, et al. Ethics of Artificial Intelligence in Medicine and Ophthalmology. Asia-Pacific J Ophthalmol. 2021;10(3):289–298.
   PubMed Web of Science ®Google Scholar
• Gerke S, Minssen T, Cohen G. Ethical and legal challenges of artificial intelligence-driven healthcare. Artificial intelligence in healthcare. 2020:295–336. DOI:10.1016/B978-0-12-818438-7.00012-5.
   Google Scholar
• Stern AD, Goldfarb A, Minssen T, et al. AI insurance: how liability insurance can drive the responsible adoption of artificial intelligence in health care. NEJM Catal. 2022;3(4):21.
   Google Scholar
• Murphy K, Di Ruggiero E, Upshur R, et al. Artificial intelligence for good health: a scoping review of the ethics literature. BMC Med Ethics. 2021;22(1):14.
   PubMed Web of Science ®Google Scholar
• Health data and data privacy: challenges for data processors under the GDPR [Internet]. Global Data Hub Taylor Wessing’s Global Data Hub [cited 2022 Aug 20]. Available from: https://globaldatahub.taylorwessing.com/article/health-data-and-data-privacy-challenges-for-data-processors-under-the-gdpr#:~:text=TheGDPRmakesclearthat,systems%2Cincludingprocessingbythe
   Google Scholar
• Harish KB, Price WN, Aphinyanaphongs AY. Open-source clinical machine learning models: critical appraisal of feasibility, advantages, and challenges. JMIR Form Res. 2022;6(4):e33970.
   PubMedGoogle Scholar
• Johnson S. How we got to now: six innovations that made the modern world. 1st ed. New York (NY): Penguin; 2015.
   Google Scholar