Less-supervised learning with knowledge distillation for sperm morphology analysis

References

• Abbasi A, Miahi E, Mirroshandel SA. 2021. Effect of deep transfer and multi-task learning on sperm abnormality detection. Comput Biol Med. 128:104121. doi: 10.1016/j.compbiomed.2020.104121.
   PubMed Web of Science ®Google Scholar
• Andrews J, Tanay T, Morton EJ, Griffin LD, 2016. Transfer representation-learning for anomaly detection. JMLR.
   Google Scholar
• Chandra S, Gourisaria MK, Gm H, Konar D, Gao X, Wang T, Xu M. 2022. Prolificacy assessment of spermatozoan via state-of-the-art deep learning frameworks. IEEE Acces. 10:13715–16. doi: 10.1109/ACCESS.2022.3146334.
   PubMed Web of Science ®Google Scholar
• Chang V, Garcia A, Hitschfeld N, Härtel S. 2017. Gold-standard for computer-assisted morphological sperm analysis. Comput Biol Med. 83:143–150. doi: 10.1016/j.compbiomed.2017.03.004.
   PubMed Web of Science ®Google Scholar
• Chen D, Mei JP, Zhang Y, Wang C, Wang Z, Feng Y, Chen C. 2021. Cross-layer distillation with semantic calibration. Proceedings of the AAAI Conference on Artificial Intelligence. p. 7028–7036.
   Google Scholar
• Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L. 2009. Imagenet: a large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern Recognition. p. 248–255. doi: 10.1109/CVPR.2009.5206848.
   Google Scholar
• Ghasemian F, Mirroshandel SA, Monji-Azad S, Azarnia M, Zahiri Z. 2015. An efficient method for automatic morphological abnormality detection from human sperm images. Comput Methods Programs Biomed. 122(3):409–420. doi: 10.1016/j.cmpb.2015.08.013.
   PubMed Web of Science ®Google Scholar
• Glorot X, Bengio Y. 2010. Understanding the difficulty of training deep feedforward neural networks. Proceedings of the thirteenth international conference on artificial intelligence and statistics, JMLR Workshop and Conference Proceedings; Sardina, Italy. p. 249–256.
   Google Scholar
• Goodfellow IJ, Shlens J, Szegedy C. 2014. Explaining and harnessing adversarial examples. 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings. doi: 10.48550/arxiv.1412.6572.
   Google Scholar
• Gou J, Yu B, Maybank SJ, Tao D. 2021. Knowledge distillation: a survey. Int J Comput Vis. 129(6):1789–1819. doi: 10.1007/s11263-021-01453-z.
   Web of Science ®Google Scholar
• Hinton G, Vinyals O, Dean J. 2015. Distilling the knowledge in a neural network. arXivpreprint arXiv:1503.02531 2.
   Google Scholar
• ILHAN H, Serbes G, Aydin N. 2022. Decision and feature level fusion of deep features extracted from public COVID-19 data-sets. Appl Intell. 52(8):8551–8571. doi: 10.17632/6XVDHC9FYB.1.
   PubMed Web of Science ®Google Scholar
• Ilhan HO, Serbes G, Aydin N. 2018a. Dual tree complex wavelet transform based sperm abnormality classification. 2018 41st International Conference on Telecommunications and Signal Processing (TSP); Athens, Greece. IEEE. p. 1–5.
   Google Scholar
• Ilhan HO, Sigirci IO, Serbes G, Aydin N. 2018b. The effect of nonlinear wavelet transform based de-noising in sperm abnormality classification. 2018 3rd International Conference on Computer Science and Engineering (UBMK); Bosnia and Herzegovina. IEEE. p. 658–661.
   Google Scholar
• Ilhan HO, Sigirci IO, Serbes G, Aydin N. 2020. A fully automated hybrid human sperm detection and classification system based on mobile-net and the performance comparison with conventional methods. Med Biol Eng Comput. 58(5):1047–1068. doi: 10.1007/s11517-019-02101-y.
   PubMed Web of Science ®Google Scholar
• Javadi S, Mirroshandel SA. 2019. A novel deep learning method for automatic assessment of human sperm images. Comput Biol Med. 109:182–194. doi: 10.1016/j.compbiomed.2019.04.030.
   PubMed Web of Science ®Google Scholar
• Krizhevsky A, Sutskever I, Hinton GE. 2017. Imagenet classification with deep convolutional neural networks. Commun ACM. 60(6):84–90. doi: 10.1145/3065386.
   Web of Science ®Google Scholar
• Li J, Tseng KK, Dong H, Li Y, Zhao M, Ding M. 2014. Human sperm health diagnosis with principal component analysis and k-nearest neighbor algorithm. 2014 International Conference on Medical Biometrics; Shenzhen, China. IEEE. p. 108–113.
   Google Scholar
• Liu R, Wang M, Wang M, Yin J, Yuan Y, Liu J. 2021. Automatic microscopy analysis with transfer learning for classification of human sperm. Appl Sci. 11(12):5369. doi: 10.3390/app11125369.
   Google Scholar
• Lv Q, Yuan X, Qian J, Li X, Zhang H, Zhan S. 2022. An improved u-net for human sperm head segmentation. Neural Process Lett. 54(1):537–557. doi: 10.1007/s11063-021-10643-2.
   Web of Science ®Google Scholar
• Melendez R, Castañón CB, Medina-Rodrguez R. 2021. Sperm cell segmentation in digital micrographs based on convolutional neural networks using u-net architecture. 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS). IEEE. p. 91–96.
   Google Scholar
• Miahi E, Mirroshandel SA, Nasr A. 2022. Genetic neural architecture search for automatic assessment of human sperm images. Expert Syst Appl. 188:115937. doi: 10.1016/j.eswa.2021.115937.
   Web of Science ®Google Scholar
• Mirroshandel SA, Ghasemian F. 2018. Automated morphology detection from human sperm images Intracytoplasmic Sperm Injection. p. 99–122. https://link.springer.com/chapter/10.1007/978-3-319-70497-5_8.
   Google Scholar
• Mirzadeh SI, Farajtabar M, Li A, Levine N, Matsukawa A, Ghasemzadeh H. 2020. Improved knowledge distillation via teacher assistant. Proceedings of the AAAI conference on artificial intelligence; New york, USA. p. 5191–5198.
   Google Scholar
• Perera P, Nallapati R, Xiang B. 2019. Ocgan: one-class novelty detection using gans with constrained latent representations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Long Beach, USA. p. 2898–2906.
   Google Scholar
• Revollo NV, Sarmiento G, Delrieux C, Herrera M, González-José R. 2022. Supervised machine learning classification of human sperm head based on morphological features. Trends and advancements of image processing and its applications. Springer; p. 177–191.
   Google Scholar
• Riordon J, McCallum C, Sinton D. 2019. Deep learning for the classification of human sperm. Comput Biol Med. 111:103342. doi: 10.1016/j.compbiomed.2019.103342.
   PubMed Web of Science ®Google Scholar
• Romero A, Ballas N, Kahou SE, Chassang A, Gatta C, Bengio Y. 2014. Fitnets: hints for thin deep nets. arXivarXiv preprint arXiv:1412.6550.
   Google Scholar
• Ronneberger O, Fischer P, Brox T. 2015. U-net: convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention; Munich, Germany. Springer. p. 234–241.
   Google Scholar
• Salehi M, Arya A, Pajoum B, Otoofi M, Shaeiri A, Rohban MH, Rabiee HR, 2021. Arae: adversarially robust training of autoencoders improves novelty detection. www.aaai.org.
   Google Scholar
• Salehi M, Sadjadi N, Baselizadeh S, Rohban MH, Rabiee HR. 2021. Multiresolution knowledge distillation for anomaly detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; Nashville, USA. p. 14902–14912.
   Google Scholar
• Schlegl T, Seeböck P, Waldstein SM, Langs G, Schmidt-Erfurth U. 2019. F-anogan: fast unsupervised anomaly detection with generative adversarial networks. Med Image Anal. 54:30–44. doi: 10.1016/j.media.2019.01.010.
   PubMed Web of Science ®Google Scholar
• Shaker F, Monadjemi SA, Alirezaie J, 2017. Classification of human sperm heads using elliptic features and lda. 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA); Shahrekord, Iran. IEEE. p. 151–155.
   Google Scholar
• Shaker F, Monadjemi SA, Alirezaie J, Naghsh-Nilchi AR. 2017. A dictionary learning approach for human sperm heads classification. Comput Biol Med. 91:181–190. doi: 10.1016/j.compbiomed.2017.10.009.
   PubMed Web of Science ®Google Scholar
• Simonyan K, Zisserman A. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.
   Google Scholar
• Skoracka K, Eder P, Łykowska Szuber L, Dobrowolska A, Krela-Kaźmierczak I. 2020. Diet and nutritional factors in male (in)fertility—underestimated factors. JCM. 9(5):1400. doi: 10.3390/JCM9051400.
   Google Scholar
• Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M. 2014. Striving for simplicity: the all convolutional net. arXivarXiv preprint arXiv:1412.6806.
   Google Scholar
• Tseng KK, Li Y, Hsu CY, Huang HN, Zhao M, Ding M. 2013. Computer-assisted system with multiple feature fused support vector machine for sperm morphology diagnosis. BioMed Res Int. 2013:1–13. doi: 10.1155/2013/687607.
   Web of Science ®Google Scholar
• WHO. 2021. WHO laboratory manual for the examination and processing of human semen. Geneva, Switzerland: World Health Organization.
   Google Scholar
• Zhang L, Song J, Gao A, Chen J, Bao C, Ma K, 2019. Be your own teacher: improve the performance of convolutional neural networks via self distillation. Proceedings of the IEEE/CVF International Conference on Computer Vision; Seoul, Korea. p. 3713–3722.
   Google Scholar
• Zhang Y, Xiang T, Hospedales TM, Lu H. 2018. Deep mutual learning. Proceedings of the IEEE conference on computer vision and pattern recognition; Salt Lake City, USA. p. 4320–4328.
   Google Scholar
• Zhang Y, Zhang J, Zha X, Zhou Y, Cao Y, Chen D. 2022. Improving human sperm head morphology classification with unsupervised anatomical feature distillation. 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI); Kolkata, India. IEEE. p. 1–5.
   Google Scholar