Anomaly Detection Using Siamese Network with Attention Mechanism for Few-Shot Learning

References

• Akçay, S., A. Atapour-Abarghouei, and T. P. Breckon. 2018. GANomaly semi-supervised anomaly detection via adversarial training. Proc. of Asian Conference of Computer Vision, pp. 622–637, Perth, Australia, 2018. arXiv:1805.06725 622–2946—.
   Google Scholar
• Akçay, S., A. Atapour-Abarghouei, and T. P. Breckon. 2019. Skip-GANomaly: skip connected and adversarially trained encoder-decoder anomaly detection. Proc. of International Joint Conference on Neural Networks, pp. 1–8, Budapest, Hungary, 2019, arXiv:1901.08954 1–8.
   Google Scholar
• Andrews, J. T. A., T. Tanay, E. J. Morton, and L. D. Griffin 2016. “Transfer representation-learning for anomaly detection”, Proc. of The 33rd International Conference on Machine Learning, New York, USA.
   Google Scholar
• Bergmann, P., M. Fauser, D. Sattleegger, and C. Steger 2019. “MVTec AD: a comprehensive real-world dataset for unsupervised anomaly detection”, Proc. of The IEEE Computer Society Conference on Computer Vision and Pattern Recognition, California, USA, 9592–600.
   Google Scholar
• Bromley, J., I. Guyon, Y. Lecun, E. Sackinger, and R. Shah. 1993. Signature verification using a ”Siamese” time delay neural network. Proc. of the 6th International Conference on Neural Information Processing Systems:737–44, Colorado, USA.
   Google Scholar
• Bromley, J., I. Guyon, Y. Lecun, E. Sackinger, and R. Shah. 1994. Signature verification using a ”Siamese” time delay neural network. Advance Neural Information Processing Systems 6:737–44.
   Google Scholar
• Cha, Y. J., W. Choi, and O. Buyukzturk. 2017. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering 32 (5):361–78. doi:10.1111/mice.12263.
   Web of Science ®Google Scholar
• Chopra, S., R. Hadsell, and Y. LeCun 2005. “Learning a similarity metric discriminatively, with application to face verification”, Proc. of The IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, 539–46.
   Google Scholar
• Eisenbach, M., R. Stricker, K. Debes, and H. M. Gross. 2017. Crack detection with an interactive and adaptive video inspection system. Arbeitsgruppentagung Infrastrukturmanagement 94:94–103.
   Google Scholar
• Fukui, H., T. Hirakawa, T. Yamashita, and H. Fujiyoshi 2019. “Attention branch network: learning of attention mechanism for visual explanation”, Proc. of The IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 10705–14
   Google Scholar
• Gong, D., L. Liu, V. Le, B. Saha, M. R. Mansour, S. Venkatesh, and A. V. D. Hengel 2019. “Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection”, Proc. of The IEEE International Conference on Computer Vision, Seoul, South Korea, 1705–14.
   Google Scholar
• Goodfellow, I. J., J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. 2014. Generative adversarial nets. Proceeding of Advances in Neural Information Processing Systems 27:2672–80.
   Google Scholar
• Haselmann, M., D. P. Gruber, and P. Tabatabai 2018. “Anomaly detection using deep learning based image completion”, Proc. of 17th IEEE International Conference on Machine Learning and Applications, Orlando, Florida, USA, 1237–42.
   Google Scholar
• Haselmann, M., and D. P. Gruber. 2019. Pixel-wise defect detection by CNNs without manually labeled training data. Applied Artificial Intelligence 33 (6):548–66. doi:10.1080/08839514.2019.1583862.
   Web of Science ®Google Scholar
• Hinton, G. E., and R. R. Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science 313 (5786):504–07. doi:10.1126/science.1127647.
   PubMed Web of Science ®Google Scholar
• Jadon, S. 2020. An overview of deep learning architectures in few-shot learning domain. arXiv, arXiv:2008.06365.
   Google Scholar
• Jetley, S., N. A. Lord, N. Lee, and P. Torr 2018. “Learn to pay attention”, Proc. of International Conference on Learning Representations, Vancouver CANADA.
   Google Scholar
• Katafuchi, R., and T. Tokunaga. 2021. LEA-Net: layer-wise external attention network for efficient color anomaly detection. arXiv, arXiv:2109.05493.
   Google Scholar
• Krizhevsky, A., I. Sutskever, and G. E. Hinton 2012. “ImageNet classification with deep convolutional neural networks”, Proc, of The 25th International Conference on Neural Information Processing Systems, NY, USA, pp. 1106–14.
   Google Scholar
• Lecun, Y., L. Bottou, Y. Bengio, and P. Haffner. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86 (11):2278–324. doi:10.1109/5.726791.
   Web of Science ®Google Scholar
• Ma, L., W. Xie, and Y. Zhang. 2019. Blister defect detection based on convolutional neural network for polymer lithium-ion battery. Applied Sciences 9 (6):1085–99. doi:10.3390/app9061085.
   Google Scholar
• Masci, J., U. Meier, D. Ciresan, J. Schmidhuber, and G. Fricout 2012. “Steel defect classification with max-pooling convolutional neural networks”, Proc. of The IEEE International Joint Conference on Neural Networks, Brisbane, Australia, 1–6.
   Google Scholar
• Mei, S., H. Yang, and Z. Yin. 2018. An unsupervised-learning-based approach for automated defect inspection on textured surfaces. IEEE Transactions on Instrumentation and Measurement 67 (6):1266–77. doi:10.1109/TIM.2018.2795178.
   Web of Science ®Google Scholar
• Mumtaz, R., A. B. Mansoor, and H. Masood. 2012. Computer aided visual inspection of aircraft surfaces. Proceeding of International Journal of Image Processing 6:38–53.
   Google Scholar
• Ren, R., T. Hung, and K. C. Tan. 2017. A generic deep-learning-based approach for automated surface inspection. IEEE Transactions on Cybernetics 48 (3):929–40. doi:10.1109/TCYB.2017.2668395.
   PubMed Web of Science ®Google Scholar
• Sakurada, M., and T. Yairi 2014. “Anomaly detection using autoencoders with nonlinear dimensionality reduction”, Proc. of the Machine Learning for Sensory Data Analysis, New York, USA, 4–11.
   Google Scholar
• Schlegl, T., P. Seeböck, S. M. Waldstein, U. Schmidt-Erfurth, and G. Langs. 2017. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. Proc. of 25th International Conference on Information Processing in Medical Imaging, pp.146–157, North Carolina, USA, 2017, arXiv:1703.05921.146–157.
   Google Scholar
• Simonyan, K., and A. Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. Proc. of 3rd International Conference on Learning Representations, ICLR 2015, pp.1-14, San Diego, CA, USA, 2015, arXiv:1409.1556.
   Google Scholar
• Soukup, D., and R. Huber-Mork 2014. Convolutional neural networks for steel surface defect detection from photometric stereo images, Proc. of International Symposium on Visual Computing, Las Vegas, NV, USA, 668–77.
   Google Scholar
• Tang, T.-W., W.-H. Kuo, J.-H. Lan, C.-F. Ding, H. Hsu, and H.-T. Young. 2020. Anomaly detection neural network with dual auto-encoders gan and its industrial inspection applications. Sensors 20 (12):3336. doi:10.3390/s20123336.
   PubMed Web of Science ®Google Scholar
• Tao, X., D.-P. Zhang, W. Ma, Z. Hou, Z. Lu, and C. Adak 2022. “Unsupervised anomaly detection for surface defects with dual-siamese network”, IEEE Trans. on Industrial Informatics, DOI: 10.1109/TII.2022.3142326
   Google Scholar
• Weimer, D., B. Scholz-Reiter, and M. Shpitalni. 2016. Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection. Cirp Annals-manufacturing Technology 65 (1):417–20. doi:10.1016/j.cirp.2016.04.072.
   Web of Science ®Google Scholar
• Zenati, H., C. S. Foo, B. Lecouat, G. Manek, and V. R. Chandrasekhar. 2018. Efficient GAN-based anomaly detection. arXiv, arXiv:1802.06222.
   Google Scholar