Utilizing artificial intelligence in endoscopy: a clinician’s guide

References

• Yao K, Uedo N, Muto M, et al. Development of an e-learning system for teaching endoscopists how to diagnose early gastric cancer: basic principles for improving early detection. Gastric Cancer. 2017;20:S28–S38.
   PubMed Web of Science ®Google Scholar
• Menon S, Trudgill N. How commonly is upper gastrointestinal cancer missed at endoscopy? A meta-analysis. Endosc Int Open. 2014;2(2):E46–50.
   PubMedGoogle Scholar
• Yalamarthi S, Witherspoon P, McCole D, et al. Missed diagnoses in patients with upper gastrointestinal cancers. Endoscopy. 2004;36:874–879.
   PubMed Web of Science ®Google Scholar
• Hosokawa O, Hattori M, Douden K, et al. Difference in accuracy between gastroscopy and colonoscopy for detection of cancer. Hepato-gastroenterol. 2007;54(74):442–444.
   PubMedGoogle Scholar
• Hirasawa T, Aoyama K, Tanimoto T, et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic image. Gastric Cancer. 2018;21:653–660.
   PubMed Web of Science ®Google Scholar
• Ishioka M, Hirasawa T, Tada T. Detecting gastric cancer from video images using convolutional neural networks. Dig Endosc. 2019;31:e34–e35.
   PubMed Web of Science ®Google Scholar
• Wu L, Zhou W, Wan X, et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy. 2019;51:522–531.
   PubMedGoogle Scholar
• Luo H, Xu G, Li C, et al. Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: a multicentre, case-control, diagnostic study. Lancet Oncol. 2019;20:1645–1654.
   PubMed Web of Science ®Google Scholar
• Kanesaka T, Lee T-C, Uedo N, et al. Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. Gastrointest Endosc. 2018;87:1339–1344.
   PubMed Web of Science ®Google Scholar
• Li L, Chen Y, Shen Z, et al. Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging. Gastric Cancer. 2020;23:126–132.
   PubMed Web of Science ®Google Scholar
• Horiuchi Y, Aoyama K, Tokai Y, et al. Convolutional neural network for differentiating gastric cancer from gastritis using magnified endoscopy with narrow band imaging. Dig Dis Sci. 2020;65(5):1355-1363.
   Google Scholar
• Zhu Y, Wang QC, Xu MD, et al. Application of convolutional neural network in the diagnosis of the invasion depth of gastric cancer based on conventional endoscopy. Gastrointest Endosc. 2019;89:806–815.
   PubMed Web of Science ®Google Scholar
• Shichijo S, Nomura S, Aoyama K, et al. Application of convolutional neural networks in the diagnosis of Helicobacter pylori infection based on endoscopic images. EBioMedicine. 2017;25:106–111.
   PubMed Web of Science ®Google Scholar
• Itoh T, Kawahira H, Nakashima H, et al. Deep learning analyzes Helicobacter pylori infection by upper gastrointestinal endoscopy images. Endosc Int Open. 2018;06:E139–E144.
   Google Scholar
• Nakashima H, Kawahira H, Kawachi H, et al. Artificial intelligence diagnosis of Helicobacter pylori infection using blue laser imaging-bright and linked color imaging: a single-center prospective study. Ann Gastroenterol. 2018;31:462–468.
   PubMed Web of Science ®Google Scholar
• Guimarães P, Keller A, Fehlmann T, et al. Deep- learning based detection of gastric precancerous conditions. Gut. 2020;69:4–6.
   PubMed Web of Science ®Google Scholar
• Wong GL, Ma AJ, Deng H, et al. Machine learning model to predict recurrent ulcer bleeding in patients with history of idiopathic gastroduodenal ulcer bleeding. Aliment Pharmacol Ther. 2019;49:912–918.
   PubMed Web of Science ®Google Scholar
• Takiyama H, Ozawa T, Ishihara S, et al. Automatic anatomical classification of esophagogastroduodenoscopy images using deep convolutional neural networks. Sci Rep. 2018 14;8(1):7497.
   PubMedGoogle Scholar
• Wu L, Zhang J, Zhou W, et al. Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy. Gut. 2019;68:2161–2169.
   PubMed Web of Science ®Google Scholar
• Chen D, Wu L, Li Y, et al. Comparing blind spots of unsedated ultrafine, sedated, and unsedated conventional gastroscopy with and without artificial intelligence: a prospective, single-blind, 3-parallel-group, randomized, single-center trial. Gastrointest Endosc. 2020;91:332–339.
   PubMed Web of Science ®Google Scholar
• Ferlay J, Colombet M, Soerjomataram I, et al. Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods. Int J Cancer. 2019;144:1941–1945.
   PubMed Web of Science ®Google Scholar
• Enzinger PC, Mayer RJ. Esophageal cancer. N Engl J Med. 2003;349:2241–2252.
   PubMed Web of Science ®Google Scholar
• Shimizu Y, Omori T, Yokoyama A, et al. Endoscopic diagnosis of early squamous neoplasia of the esophagus with iodine staining: high-grade intra-epithelial neoplasia turns pink within a few minutes. J Gastroenterol Hepatol. 2008;23:546–550.
   PubMed Web of Science ®Google Scholar
• Muto M, Minashi K, Yano T, et al. Early detection of superficial squamous cell carcinoma in the head and neck region and esophagus by narrow band imaging: a multicenter randomized controlled trial. J Clin Oncol. 2010;28:1566–1572.
   PubMed Web of Science ®Google Scholar
• Nagami Y, Tominaga K, Machida H, et al. Usefulness of non-magnifying narrow-band imaging in screening of early esophageal squamous cell carcinoma: a prospective comparative study using propensity score matching. Am J Gastroenterol. 2014;109:845–854.
   PubMed Web of Science ®Google Scholar
• Lee YC, Wang CP, Chen CC, et al. Transnasal endoscopy with narrowband imaging and Lugol staining to screen patients with head and neck cancer whose condition limits oral intubation with standard endoscope (with video). Gastrointest Endosc. 2009;69:408–417.
   PubMed Web of Science ®Google Scholar
• Kuraoka K, Hoshino E, Tsuchida T, et al. Early esophageal cancer can be detected by screening endoscopy assisted with narrow-band imaging (NBI). Hepatogastroenterology. 2009;56:63–66.
   PubMedGoogle Scholar
• Ishihara R, Takeuchi Y, Chatani R, et al. Prospective evaluation of narrow-band imaging endoscopy for screening of esophageal squamous mucosal high-grade neoplasia in experienced and less experienced endoscopists. Dis Esoph. 2010;23:480–486.
   PubMed Web of Science ®Google Scholar
• Horie Y, Yoshio T, Aoyama K, et al. The diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest Endosc. 2019 Jan;89(1):25–32.
   PubMed Web of Science ®Google Scholar
• Ohmori M, Ishihara R, Aoyama K, et al. Endoscopic detection and differentiation of esophageal lesions using a deep neural network. Gastrointest Endsc. 2020;91(2):301-309.
   Google Scholar
• Cai SL, Li B, Tan WM, et al. Using a deep learning system in endoscopy for screening of early esophageal squamous cell carcinoma (with video). Gastrointest Endosc. 2019;90(5):745–753.e2.
   PubMed Web of Science ®Google Scholar
• Guo L, Xiao X, Wu C, et al. Real-time automated diagnosis of precancerous lesions and early esophageal squamous cell carcinoma using a deep learning model (with videos). Gastrointest Endosc. 2020;91(1):41–51.
   PubMed Web of Science ®Google Scholar
• Nonaka S, Saito Y. Endoscopic diagnosis of pharyngeal carcinoma by NBI. Endoscopy. 2008;40:347–351.
   PubMed Web of Science ®Google Scholar
• Shimizu Y, Yamamoto J, Kato M, et al. Endoscopic submucosal dissection for treatment of early stage hypopharyngeal carcinoma. Gastrointest Endosc. 2006;64:255–259. discussion 260–2.
   PubMed Web of Science ®Google Scholar
• Suzuki H, Saito Y. A case of superficial hypopharyngeal cancer treated by EMR. Jpn J Clin Oncol. 2007;37:892.
   PubMed Web of Science ®Google Scholar
• Yoshio T, Tsuchida T, Ishiyama A, et al. Efficacy of double-scope endoscopic submucosal dissection and long-term outcomes of endoscopic resection for superficial pharyngeal cancer. Dig Endosc. 2017;29(2):152–159.
   PubMed Web of Science ®Google Scholar
• Tamashiro A, Yoshio T, Ishiyama A, et al. Artificial-intelligence-based detection of pharyngeal cancer using convolutional neural networks. Dig Endsc. 2020 Feb 14. [Epub ahead of print]. DOI:10.1111/den.13653.
   PubMed Web of Science ®Google Scholar
• Tokai Y, Yoshio T, Aoyama K, et al. Application of artificial intelligence using convolutional neural networks in determining the invasion depth of esophageal squamous cell carcinoma Esophagus. 2020 January. [Epub ahead of print].
   Google Scholar
• Nakagawa K, Ishihara R, Aoyama K, et al. Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. Gastrointest Endosc. 2019;90(3):407–414.
   PubMed Web of Science ®Google Scholar
• Inoue H, Honda T, Yoshida T, et al. Ultra-high magnification endoscopy of the normal esophageal mucosa. Dig Endosc. 1996;8:134–138.
   Google Scholar
• Inoue H, Honda T, Nagai K, et al. Ultra-high magnification endoscopic observation of carcinoma in situ of the esophagus. Dig Endosc. 1997;9:16–18.
   Google Scholar
• Everson M, Herrera LCGP, Li W, et al. Artificial intelligence for the real-time classification of intrapapillary capillary loop patterns in the endoscopic diagnosis of early oesophageal squamous cell carcinoma: a proof-of-concept study. UEG journal. 2019;7(2):297–306.
   Google Scholar
• Kumagai Y, Monma K, Kawada K. Magnifying chromoendoscopy of the esophagus: in vivo pathological diagnosis using an endocytoscopy system. Endoscopy. 2004;36:590–594.
   PubMed Web of Science ®Google Scholar
• Kumagai Y, Takubo K, Kawada K, et al. A newly developed continuous zoom-focus endocytoscope. Endoscopy. 2017;49(2):176–180.
   PubMed Web of Science ®Google Scholar
• Kumagai Y, Kawada K, Higashi M, et al. Endocytoscopic observation of various esophageal lesions at ×600: can nuclear abnormality be recognized? Dis Esophagus. 2015;28:269–275.
   PubMed Web of Science ®Google Scholar
• Kumagai Y, Takubo K, Kawada K, et al. Diagnosis using deep-learning artificial intelligence based on the endocytoscopic observation of the esophagus. Esophagus. 2019 Apr;16(2):180–187.
   PubMed Web of Science ®Google Scholar
• Ebigbo A, Mendel R, Probst A, et al. Computer-aided diagnosis using deep learning in the evaluation of early oesophageal adenocarcinoma. Gut. 2019;68:1143–1145.
   PubMed Web of Science ®Google Scholar
• Ebigbo A, Mendel R, Probst A, et al. Real-time use of artificial intelligence in the evaluation of cancer in Barrett’s oesophagus. Gut. 2020;69(4):615–616.
   Google Scholar
• Hashimoto R, Requa J, Dao T, et al. Artificial intelligence using convolutional neural networks for real-time detection of early esophageal neoplasia in Barrett’s esophagus (with video). Gastrointest Endosc. 2020;91(6):1264–1271.e1. [Epub ahead of print].
   Web of Science ®Google Scholar
• de Groof AJ, Struyvenberg MR, van der Putten J, et al. Deep-learning system detects neoplasia in patients with Barrett’s Esophagus with higher accuracy than endoscopists in a multistep training and validation study with benchmarking. Gastroenterology. 2020;158(4):915–929.e4.
   PubMed Web of Science ®Google Scholar
• de Groof AJ, Struyvenberg MR, Fockens KN, et al. Deep learning algorithm detection of Barrett’s neoplasia with high accuracy during live endoscopic procedures: a pilot study (with video). Gastrointest Endosc. 2020;91(6):1242–1250. [Epub ahead of print].
   Web of Science ®Google Scholar
• He X, Wu K, Ogino S, et al. Association between risk factors for colorectal cancer and risk of serrated polyps and conventional adenomas. Gastroenterology. 2018;155(2):355–373 e18.
   PubMed Web of Science ®Google Scholar
• Nayor J, Saltzman JR, Campbell EJ, et al. Impact of physician compliance with colonoscopy surveillance guidelines on interval colorectal cancer. Gastrointest Endosc. 2017;85(6):1263–1270. .
   PubMed Web of Science ®Google Scholar
• Kominami Y, Yoshida S, Tanaka S, et al. Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. Gastrointest Endosc. 2016;83(3):643–649.
   PubMed Web of Science ®Google Scholar
• Ngu WS, Bevan R, Tsiamoulos ZP, et al. Improved adenoma detection with Endocuff Vision: the ADENOMA randomised controlled trial. Gut. 2019;68(2):280–288.
   PubMed Web of Science ®Google Scholar
• Repici A, Wallace MB, East JE, et al. Efficacy of per-oral methylene blue formulation for screening colonoscopy. Gastroenterology. 2019;156(8):2198–2207 e1.
   PubMed Web of Science ®Google Scholar
• Urban G, Tripathi P, Alkayali T, et al. Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy. Gastroenterology. 2018;155(4):1069–1078 e8.
   PubMed Web of Science ®Google Scholar
• Misawa M, Kudo SE, Mori Y, et al. Artificial intelligence-assisted polyp detection for colonoscopy: initial experience. Gastroenterology. 2018;154(8):2027–2029 e3.
   PubMed Web of Science ®Google Scholar
• Wang P, Xiao X, Glissen Brown JR, et al. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat Biomed Eng. 2018;2(10):741–748.
   PubMed Web of Science ®Google Scholar
• Yamada M, Saito Y, Imaoka H, et al. Development of a real-time endoscopic image diagnosis support system using deep learning technology in colonoscopy. Sci Rep. 2019;9(1):14465.
   PubMedGoogle Scholar
• Becq A, Chandnani M, Bharadwaj S, et al. Effectiveness of a deep-learning polyp detection system in prospectively collected colonoscopy videos with variable bowel preparation quality. J Clin Gastroenterol. 2020;54(6):554–557.
   Google Scholar
• Klare P, Sander C, Prinzen M, et al. Automated polyp detection in the colorectum: a prospective study (with videos). Gastrointest Endosc. 2019;89(3):576–582 e1.
   PubMed Web of Science ®Google Scholar
• Wang P, Berzin TM, Glissen Brown JR, et al. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study. Gut. 2019;68(10):1813–1819.
   PubMed Web of Science ®Google Scholar
• Wang P, Liu X, Berzin TM, et al. Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): a double-blind randomised study. Lancet Gastroenterol Hepatol. 2020;5(4):343–351.
   Web of Science ®Google Scholar
• Yuan Y, Meng MQ. Deep learning for polyp recognition in wireless capsule endoscopy images. Med Phys. 2017;44(4):1379–1389.
   PubMed Web of Science ®Google Scholar
• Zhou T, Han G, Li BN, et al. Quantitative analysis of patients with celiac disease by video capsule endoscopy: A deep learning method. Comput Biol Med. 2017;85:1–6.
   PubMed Web of Science ®Google Scholar
• Leenhardt R, Vasseur P, Li C, et al. A neural network algorithm for detection of GI angiectasia during small-bowel capsule endoscopy. Gastrointest Endosc. 2019;89(1):189–194.
   PubMed Web of Science ®Google Scholar
• Aoki T, Yamada A, Kato Y, et al. Automatic detection of blood content in capsule endoscopy images based on a deep convolutional neural network. J Gastroenterol Hepatol. 2019. DOI:10.1111/jgh.14941.
   Web of Science ®Google Scholar
• Aoki T, Yamada A, Aoyama K, et al. Automatic detection of erosions and ulcerations in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest Endosc. 2019;89(2):357–363.e352.
   PubMed Web of Science ®Google Scholar
• Fan S, Xu L, Fan Y, et al. Computer-aided detection of small intestinal ulcer and erosion in wireless capsule endoscopy images. Phys Med Biol. 2018;63(16):165001.
   PubMed Web of Science ®Google Scholar
• Alaskar H, Hussain A, Al-Aseem N, et al. Application of convolutional neural networks for automated ulcer detection in wireless capsule endoscopy images. Sensors (Basel). 2019;19(6):1265.
   PubMed Web of Science ®Google Scholar
• Klang E, Barash Y, Margalit RY, et al. Deep learning algorithms for automated detection of Crohn’s disease ulcers by video capsule endoscopy. Gastrointest Endosc. 2020;91(3):606–613.e602.
   PubMed Web of Science ®Google Scholar
• Tsuboi A, Oka S, Aoyama K, et al. Artificial intelligence using a convolutional neural network for automatic detection of small-bowel angioectasia in capsule endoscopy images. Dig Endosc. 2020;32(3):382–390.
   Google Scholar
• Rex DK, Kahi C, O’Brien M, et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc. 2011;73(3):419–422.
   PubMed Web of Science ®Google Scholar
• Bisschops R, East JE, Hassan C, et al. Advanced imaging for detection and differentiation of colorectal neoplasia: European Society of Gastrointestinal Endoscopy (ESGE) guideline - Update 2019. Endoscopy. 2019;51(12):1155–1179.
   PubMed Web of Science ®Google Scholar
• Iwatate M, Sano Y, Tanaka S, et al. Validation study for development of the Japan NBI expert team classification of colorectal lesions. Dig Endosc. 2018;30(5):642–651.
   PubMed Web of Science ®Google Scholar
• Rees CJ, Rajasekhar PT, Wilson A, et al. Narrow band imaging optical diagnosis of small colorectal polyps in routine clinical practice: the Detect Inspect Characterise Resect and Discard 2 (DISCARD 2) study. Gut. 2017;66(5):887–895.
   PubMed Web of Science ®Google Scholar
• Byrne MF, Chapados N, Soudan F, et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut. 2019;68(1):94–100.
   Google Scholar
• Komeda Y, Handa H, Watanabe T, et al. Computer-aided diagnosis based on convolutional neural network system for colorectal polyp classification: preliminary experience. Oncology. 2017;93(Suppl 1):30–34.
   PubMedGoogle Scholar
• Chen PJ, Lin MC, Lai MJ, et al. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology. 2018;154(3):568–575.
   PubMed Web of Science ®Google Scholar
• Song EM, Park B, Ha CA, et al. Endoscopic diagnosis and treatment planning for colorectal polyps using a deep-learning model. Sci Rep. 2020;10(1):30.
   PubMed Web of Science ®Google Scholar
• Zachariah R, Samarasena J, Luba D, et al. Prediction of polyp pathology using convolutional neural networks achieves “Resect and discard” thresholds. Am J Gastroenterol. 2020;115(1):138–144.
   PubMed Web of Science ®Google Scholar
• Mori Y, Kudo SE, Misawa M, et al. Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy: a prospective study. Ann Intern Med. 2018;169(6):357–366.
   PubMed Web of Science ®Google Scholar
• Kudo SE, Misawa M, Mori Y, et al. Artificial intelligence-assisted system improves endoscopic identification of colorectal neoplasms. Clin Gastroenterol Hepatol. 2019. DOI:10.1016/j.cgh.2019.09.009.
   Google Scholar
• Hassan C, Senore C, Radaelli F, et al. Full-spectrum (FUSE) versus standard forward-viewing colonoscopy in an organised colorectal cancer screening programme. Gut. 2017;66(11):1949–1955.
   PubMed Web of Science ®Google Scholar
• Shiotani A, Honda K, Kawakami M, et al. Analysis of small-bowel capsule endoscopy reading by using Quickview mode: training assistants for reading may produce a high diagnostic yield and save time for physicians. J Clin Gastroenterol. 2012;46(10):e92–95.
   PubMed Web of Science ®Google Scholar
• Iakovidis DK, Koulaouzidis A. Automatic lesion detection in capsule endoscopy based on color saliency: closer to an essential adjunct for reviewing software. Gastrointest Endosc. 2014;80(5):877–883.
   PubMed Web of Science ®Google Scholar
• Gulshan V, Peng L, Coram M, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316(22):2402–2410.
   PubMed Web of Science ®Google Scholar
• Esteva A, Kuprel B, Novoa RA, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–118.
   PubMed Web of Science ®Google Scholar
• Zou Y, Li L, Wang Y, et al. Classifying digestive organs in wireless capsule endoscopy images based on deep convolutional neural network. In: 2015 IEEE international conference on Digital Signal Processing (DSP),  Singapore; 2015. p. 1274–1278.
   Google Scholar
• Jia X, Meng MQ. A deep convolutional neural network for bleeding detection in wireless capsule endoscopy images. Conference proceeding IEEE engineering in medicine and biology society, Orlando, Florida, USA; 2016. p. 639–642.
   Google Scholar
• Seguí S, Drozdzal M, Pascual G, et al. Generic feature learning for wireless capsule endoscopy analysis. Comput Biol Med. 2016;79:163–172.
   PubMed Web of Science ®Google Scholar
• He JY, Wu X, Jiang YG, et al. Hookworm detection in wireless capsule endoscopy images with deep learning. IEEE Trans Image Process. 2018;27(5):2379–2392.
   PubMed Web of Science ®Google Scholar
• Li P, Li Z, Gao F, et al. Convolutional neural networks for intestinal hemorrhage detection in wireless capsule endoscopy images. In: 2017 IEEE International Conference on Multimedia and Expo (ICME),  Hong Kong; 2017. p. 1518–1523.
   Google Scholar
• Iakovidis DK, Georgakopoulos SV, Vasilakakis M, et al. Detecting and locating gastrointestinal anomalies using deep learning and iterative cluster unification. IEEE Trans Med Imaging. 2018;37(10):2196–2210.
   PubMed Web of Science ®Google Scholar
• Ding Z, Shi H, Zhang H, et al. Gastroenterologist-level identification of small-bowel diseases and normal variants by capsule endoscopy using a deep-learning model. Gastroenterology. 2019;157(4):1044–1054.e1045.
   PubMed Web of Science ®Google Scholar
• Saito H, Aoki T, Aoyama K, et al. Automatic detection and classification of protruding lesions in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest Endosc. 2020. DOI:10.1016/j.gie.2020.01.054.
   Web of Science ®Google Scholar
• Koulaouzidis A, Iakovidis DK, Yung DE, et al. KID project: an internet-based digital video atlas of capsule endoscopy for research purposes. Endosc Int Open. 2017;5(6):E477–E483.
   PubMed Web of Science ®Google Scholar
• Aoki T, Yamada A, Aoyama K, et al. Clinical usefulness of a deep learning-based system as the first screening on small-bowel capsule endoscopy reading. Dig Endosc. 2020;32(4):585–591.
   PubMed Web of Science ®Google Scholar