Assessing fairness in performance evaluation of publicly available retinal blood vessel segmentation algorithms

References

• Orlando JI, Prokofyeva E, Blaschko MB. A discriminatively trained fully connected conditional random field model for blood vessel segmentation in fundus images. IEEE Trans Biomed Eng. 2017;64(1):16–27.
   PubMed Web of Science ®Google Scholar
• Liskowski P, Krawiec K. Segmenting retinal blood vessels with deep neural networks. IEEE Trans Med Imaging. 2016;35(11):2369–2380.
   PubMed Web of Science ®Google Scholar
• Nugroho HA, Dharmawan DA, Litasari NA, et al. Automated segmentation of foveal avascular zone in digital colour retinal fundus images. IJBET. 2017;23(1):1–18.
   Google Scholar
• Zhang J, Dashtbozorg B, Bekkers E, et al. Robust retinal vessel segmentation via locally adaptive derivative frames in orientation scores. IEEE Trans Med Imaging. 2016;35(12):2631–2644.
   PubMed Web of Science ®Google Scholar
• Dharmawan DA, Ng BP, Rahardja S. A modified dolph-chebyshev type ii function matched filter for retinal vessels segmentation. Symmetry. 2018;10(7):257.
   Google Scholar
• Li D, Dharmawan DA, Ng BP, et al. Residual u-net for retinal vessel segmentation. In: 2019 IEEE International Conference on Image Processing (ICIP); Taipei, Taiwan: IEEE; 2019. p. 1425–1429.
   Google Scholar
• Dharmawan DA, Ng BP. A new two-dimensional matched filter based on the modified Chebyshev type I function for retinal vessels detection. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, Jeju, South Korea; 2017. p. 369–372.
   Google Scholar
• Azzopardi G, Strisciuglio N, Vento M, et al. Trainable COSFIRE filters for vessel delineation with application to retinal images. Med Image Anal. 2015;19(1):46–57.
   PubMed Web of Science ®Google Scholar
• Zhao Y, Zheng Y, Liu Y, et al. Automatic 2-D/3-D vessel enhancement in multiple modality images using a weighted symmetry filter. IEEE Trans Med Imaging. 2018;37(2):438–450.
   PubMed Web of Science ®Google Scholar
• Imani E, Javidi M, Pourreza HR. Improvement of retinal blood vessel detection using morphological component analysis. Comput Methods Programs Biomed. 2015;118(3):263–279.
   PubMed Web of Science ®Google Scholar
• Roychowdhury S, Koozekanani DD, Parhi KK. Iterative vessel segmentation of fundus images. IEEE Trans Biomed Eng. 2015;62(7):1738–1749.
   PubMed Web of Science ®Google Scholar
• Zhao J, Yang J, Ai D, et al. Automatic retinal vessel segmentation using multi-scale superpixel chain tracking. Digit Signal Process Rev J. 2018;81:26–42.
   Web of Science ®Google Scholar
• Zhao Y, Rada L, Chen K, et al. Automated vessel segmentation using infinite perimeter active contour model with hybrid region information with application to retinal images. IEEE Trans Med Imaging. 2015;34(9):1797–1807.
   PubMed Web of Science ®Google Scholar
• Jiang Z, Yepez J, An S, et al. Fast, accurate and robust retinal vessel segmentation system. Biocybernetics Biomed Eng. 2017;37(3):412–421.
   Web of Science ®Google Scholar
• Primitivo D, Alma R, Erik C, et al. A hybrid method for blood vessel segmentation in images. Biocybernetics Biomed Eng. 2019;39(3):814–824.
   Web of Science ®Google Scholar
• Dharmawan DA, Ng BP, Borijindargoon N. Design of optimal adaptive filters for two-dimensional filamentary structures segmentation. IEEE Signal Process Lett. 2019;26(10):1511–1515.
   Web of Science ®Google Scholar
• Zhu C, Zou B, Xiang Y, et al. An ensemble retinal vessel segmentation based on supervised learning in fundus images. Chin J Electron. 2016;25(3):503–511.
   Web of Science ®Google Scholar
• Roychowdhury S, Koozekanani DD, Parhi KK. Blood vessel segmentation of fundus images by major vessel extraction and subimage classification. IEEE J Biomed Health Inform. 2015;19(3):1118–1128.
   PubMed Web of Science ®Google Scholar
• Aslani S, Sarnel H. Biomedical Signal Processing and Control A new supervised retinal vessel segmentation method based on robust hybrid features. Biomed Signal Process Control. 2016;30:1–12.
   Google Scholar
• Barkana BD, Saricicek I, Yildirim B. Performance analysis of descriptive statistical features in retinal vessel segmentation via fuzzy logic, ANN, SVM, and classifier fusion. Knowledge-Based Syst. 2017;118:165–176.
   Web of Science ®Google Scholar
• Dasgupta A, Singh S. A fully convolutional neural network based structured prediction approach towards the retinal vessel segmentation. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017); 2017. p. 248–251.
   Google Scholar
• Li Q, Feng B, Xie L, et al. A cross-modality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imaging. 2016;35(1):109–118.
   PubMed Web of Science ®Google Scholar
• Fu H, Xu Y, Lin S, et al. DeepVessel: retinal vessel segmentation via deep learning and conditional random field. In: Ourselin S, Joskowicz L, Sabuncu MR, et al. editors. Medical image computing and computer-assisted intervention – MICCAI 2016. Athens, Greece: Springer International Publishing; 2016. p. 132–139.
   Google Scholar
• Dharmawan DA, Li D, Ng BP, et al. A new hybrid algorithm for retinal vessels segmentation on fundus images. IEEE Access. 2019;7:41885–41896.
   Web of Science ®Google Scholar
• Yan Z, Yang X, Cheng KTT. Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng. 2018;65(9):1912–1923.
   PubMed Web of Science ®Google Scholar
• Zhou L, Yu Q, Xu X, et al. Improving dense conditional random field for retinal vessel segmentation by discriminative feature learning and thin-vessel enhancement. Comput Methods Programs Biomed. 2017;148:13–25.
   PubMed Web of Science ®Google Scholar
• Jin Q, Meng Z, Pham TD, et al. DUNet: a deformable network for retinal vessel segmentation. Knowledge-Based Systems. 2019;178:149–162.
   Web of Science ®Google Scholar
• Jiang Z, Zhang H, Wang Y, et al. Retinal blood vessel segmentation using fully convolutional network with transfer learning. Comput Med Imaging Graph. 2018;68(April):1–15.
   PubMedGoogle Scholar
• Yan Z, Yang X, Cheng KT. A three-stage deep learning model for accurate retinal vessel segmentation. IEEE J Biomed Health Inform. 2019;23(4):1427–1436.
   PubMed Web of Science ®Google Scholar
• Staal JJ, Abramoff MD, Niemeijer M, et al. Ridge based vessel segmentation in color images of the retina. IEEE Trans Med Imaging. 2004;23(4):501–509.
   PubMed Web of Science ®Google Scholar
• Hoover A, Kouznetsova V, Goldbaum M. Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imaging. 2000;19(3):203–210.
   PubMed Web of Science ®Google Scholar