Automatic estimation of ulcerative colitis severity from endoscopy videos using ordinal multi-instance learning

References

• Campanella G, Hanna MG, Geneslaw L, Miraflor A, Silva VWK, Busam KJ, Brogi E, Reuter VE, Klimstra DS, Fuchs TJ. 2019. Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat Med. 25(8):1301–1309. doi:https://doi.org/10.1038/s41591-019-0508-1.
   Google Scholar
• Chen S, Zhang C, Dong M, Le J, Rao M. 2017. Using ranking-cnn for age estimation. In: IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Hawaii. p. 5183–5192.
   Google Scholar
• Daperno M, Comberlato M, Bossa F, Biancone L, Bonanomi AG, Cassinotti A, Cosintino R, Lombardi G, Mangiarotti R, Papa A, et al. 2014. Inter-observer agreement in endoscopic scoring systems: preliminary report of an ongoing study from the Italian Group for Inflammatory Bowel Disease (IG-IBD). Dig Liver Dis. 46(11):969–973. doi:https://doi.org/10.1016/j.dld.2014.07.010.
   Google Scholar
• Frank E, Hall M. 2001. A simple approach to ordinal classification. In: European Conference on Machine Learning. Freiburg, Germany.: Springer. p. 145–156.
   Google Scholar
• Gutierrez Becker B, Arcadu F, Thalhammer A, Gamez Serna C, Feehan O, Drawnel F, Oh YS, Prunotto M. 2021. Training and deploying a deep learning model for endoscopic severity grading in ulcerative colitis using multicenter clinical trial data. Therap Adv Gastrointest Endosc. 14:2631774521990623. doi:https://doi.org/10.1177/2631774521990623.
   Google Scholar
• Lu MY, Williamson DF, Chen TY, Chen RJ, Barbieri M, Mahmood F. 2021. Data-efficient and weakly supervised computational pathology on whole-slide images. Nat Biomedl Eng. 5(6):555–570. doi:https://doi.org/10.1038/s41551-020-00682-w.
   Google Scholar
• Mohammed A, Farup I, Pedersen M, Yildirim S, Hovde Ø. 2020. PS-DeVCEM: pathology-sensitive deep learning model for video capsule endoscopy based on weakly labeled data. Comput Vis Image Underst. 201:103062. doi:https://doi.org/10.1016/j.cviu.2020.103062.
   Google Scholar
• Ozawa T, Ishihara S, Fujishiro M, Saito H, Kumagai Y, Shichijo S, Aoyama K, Tada T. 2019. Novel computer-assisted diagnosis system for endoscopic disease activity in patients with ulcerative colitis. Gastrointest Endosc. 89(2):416–421. doi:https://doi.org/10.1016/j.gie.2018.10.020.
   Google Scholar
• Principi M, Contaldo A, Bianchi FP, Losurdo G, Iannone A, Ierardi E, Tafuri S, Di Leo A, Work IET. 2020. Inter-observer agreement of a new endoscopic score for ulcerative colitis activity: preliminary experience. Diagnostics. 10(4):213. doi:https://doi.org/10.3390/diagnostics10040213.
   Google Scholar
• Remedios S, Wu Z, Bermudez C, Kerley CI, Roy S, Patel MB, Butman JA, Landman BA, Pham DL. 2020. Extracting 2d weak labels from volume labels using multiple instance learning in CT hemorrhage detection. In: Medical Imaging 2020: Image Processing; vol. 11313. Houston, Texas, USA.: International Society for Optics and Photonics. p. 113130F.
   Google Scholar
• Sands BE, Sandborn WJ, Panaccione R, O’Brien CD, Zhang H, Johanns J, Adedokun OJ, Li K, Peyrin-Biroulet L, Van Assche G, et al. 2019. Ustekinumab as induction and maintenance therapy for ulcerative colitis. New England J Med. 381(13):1201–1214. doi:https://doi.org/10.1056/NEJMoa1900750.
   Google Scholar
• Schroeder KW, Tremaine WJ, Ilstrup DM. 1987. Coated oral 5-aminosalicylic acid therapy for mildly to moderately active ulcerative colitis. New England J Med. 317(26):1625–1629. doi:https://doi.org/10.1056/NEJM198712243172603.
   Google Scholar
• Schwab E, Gooßen A, Deshpande H, Saalbach A. 2020. Localization of critical findings in chest X-ray without local annotations using multi-instance learning. In: IEEE International Symposium on Biomedical Imaging (ISBI). p. 1879–1882.
   Google Scholar
• Stidham RW, Liu W, Bishu S, Rice MD, Higgins PD, Zhu J, Nallamothu BK, Waljee AK. 2019. Performance of a deep learning model vs human reviewers in grading endoscopic disease severity of patients with ulcerative colitis. JAMA Network Open. 2(5):e193963–e193963. doi:https://doi.org/10.1001/jamanetworkopen.2019.3963.
   Google Scholar
• Turner D, Ricciuto A, Lewis A, D'Amico F, Dhaliwal J, Griffiths AM, Bettenworth D, Sandborn WJ, Sands BE, Reinisch W, et al. 2020. STRIDE-II: an update on the selecting therapeutic targets in inflammatory bowel disease (STRIDE) initiative of the international organization for the study of IBD (IOIBD): determining therapeutic goals for treat-to-target strategies in IBD. Gastroenterology.
   Google Scholar
• Yao H, Najarian K, Gryak J, Bishu S, Rice MD, Waljee AK, Wilkins HJ, Stidham RW. 2020. Fully automated endoscopic disease activity assessment in ulcerative colitis. Gastrointest Endosc. 93(3):728–736.e1. doi: https://doi.org/10.1016/j.gie.2020.08.011.
   Google Scholar