A Multi-level spatial feature fusion-based transformer for intelligent defect recognition with small samples toward smart manufacturing system

References

• Cheon, S., H. Lee, C. Ouk Kim, and S. Hyung Lee. 2019. “Convolutional Neural Network for Wafer Surface Defect Classification and the Detection of Unknown Defect Class.” IEEE Transactions on Semiconductor Manufacturing 32 (2): 163–170. https://doi.org/10.1109/TSM.2019.2902657.
   Web of Science ®Google Scholar
• Chollet, F. 2017. “Xception: Deep Learning with Depthwise Separable Convolutions.” In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1800–1807. IEEE. https://doi.org/10.1109/CVPR.2017.195.
   Google Scholar
• Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, and M. Dehghani, Minderer, M., Heigold, G., Gelly, S. et al. 2021. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” ArXiv:2010.11929 [Cs], June. http://arxiv.org/abs/2010.11929.
   Google Scholar
• Fu, G., P. Sun, W. Zhu, J. Yang, Y. Cao, M. Ying Yang, and Y. Cao. 2019. “A Deep-Learning-Based Approach for Fast and Robust Steel Surface Defects Classification.” Optics and Lasers in Engineering 121:397–405. https://doi.org/10.1016/j.optlaseng.2019.05.005.
   Web of Science ®Google Scholar
• Gan, Y. S., S.-T. Liong, S.-Y. Wang, and C. Tiong Cheng. 2022. “An Improved Automatic Defect Identification System on Natural Leather via Generative Adversarial Network.” International Journal of Computer Integrated Manufacturing 35 (12): 1378–1394. https://doi.org/10.1080/0951192X.2022.2048421.
   Web of Science ®Google Scholar
• Gao, Y., L. Gao, and L. Xinyu. 2021. “A Generative Adversarial Network Based Deep Learning Method for Low-Quality Defect Image Reconstruction and Recognition.” IEEE Transactions on Industrial Informatics 17 (5): 3231–3240. https://doi.org/10.1109/TII.2020.3008703.
   Web of Science ®Google Scholar
• Gao, Y., L. Gao, and L. Xinyu. 2023. “A Hierarchical Training-Convolutional Neural Network with Feature Alignment for Steel Surface Defect Recognition.” Robotics and Computer-Integrated Manufacturing 81:102507. https://doi.org/10.1016/j.rcim.2022.102507.
   Web of Science ®Google Scholar
• Gao, Y., L. Gao, L. Xinyu, and X. Wang. 2020. “A Multilevel Information Fusion-Based Deep Learning Method for Vision-Based Defect Recognition.” IEEE Transactions on Instrumentation and Measurement 69 (7): 3980–3991. https://doi.org/10.1109/TIM.2019.2947800.
   Web of Science ®Google Scholar
• Gao, Y., L. Gao, L. Xinyu, and X. Yan. 2020. “A Semi-Supervised Convolutional Neural Network-Based Method for Steel Surface Defect Recognition.” Robotics and Computer-Integrated Manufacturing 61:101825. https://doi.org/10.1016/j.rcim.2019.101825.
   Web of Science ®Google Scholar
• Hao, R., L. Bingyu, Y. Cheng, L. Xiu, and B. Huang. 2021. “A Steel Surface Defect Inspection Approach Towards Smart Industrial Monitoring.” Journal of Intelligent Manufacturing 32 (7): 1833–1843. https://doi.org/10.1007/s10845-020-01670-2.
   Web of Science ®Google Scholar
• He, Y., K. Song, Q. Meng, and Y. Yan. 2020. “An End-To-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features.” IEEE Transactions on Instrumentation and Measurement 69 (4): 1493–1504. https://doi.org/10.1109/TIM.2019.2915404.
   Web of Science ®Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Nevada, 770–778. IEEE. https://doi.org/10.1109/CVPR.2016.90.
   Google Scholar
• Hu, C., and Y. Wang. 2020. “An Efficient Convolutional Neural Network Model Based on Object-Level Attention Mechanism for Casting Defect Detection on Radiography Images.” IEEE Transactions on Industrial Electronics 67 (12): 10922–10930. https://doi.org/10.1109/TIE.2019.2962437.
   Web of Science ®Google Scholar
• Jeon, M., S. Yoo, and S.-W. Kim. 2022. “A Contactless PCBA Defect Detection Method: Convolutional Neural Networks with Thermographic Images.” IEEE Transactions on Components, Packaging and Manufacturing Technology 12 (3): 489–501. https://doi.org/10.1109/TCPMT.2022.3147319.
   Web of Science ®Google Scholar
• Jing, J., Z. Wang, M. Rätsch, and H. Zhang. 2022. “Mobile-Unet: An Efficient Convolutional Neural Network for Fabric Defect Detection.” Textile Research Journal 92 (1–2): 30–42. https://doi.org/10.1177/0040517520928604.
   Web of Science ®Google Scholar
• Kyeong, K., and H. Kim. 2018. “Classification of Mixed-Type Defect Patterns in Wafer Bin Maps Using Convolutional Neural Networks.” IEEE Transactions on Semiconductor Manufacturing 31 (3): 395–402. https://doi.org/10.1109/TSM.2018.2841416.
   Web of Science ®Google Scholar
• Lin, T.-Y., P. Dollar, R. Girshick, H. Kaiming, B. Hariharan, and S. Belongie. 2017. “Feature Pyramid Networks for Object Detection.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Hawaii, 2117–2125.
   Google Scholar
• Liu, T., J. Bao, J. Wang, and Y. Zhang. 2018. “A Hybrid CNN–LSTM Algorithm for Online Defect Recognition of CO2 Welding.” Sensors 18 (12): 4369. (Switzerland). https://doi.org/10.3390/S18124369.
   PubMed Web of Science ®Google Scholar
• Liu, Y., Y. Yuan, C. Balta, and J. Liu. 2020. “A Light-Weight Deep-Learning Model with Multi-Scale Features for Steel Surface Defect Classification.” Materials 13 (20): 4629. https://doi.org/10.3390/ma13204629.
   PubMed Web of Science ®Google Scholar
• Lu, Y., X. Xu, and L. Wang. 2020. “Smart Manufacturing Process and System Automation – a Critical Review of the Standards and Envisioned Scenarios.” Journal of Manufacturing Systems 56 (July): 312–325. https://doi.org/10.1016/j.jmsy.2020.06.010.
   Google Scholar
• Mo, J. P. T., and R. C. Beckett. 2022. “Transdisciplinary System of Systems Development in the Trend to X4.0 for Intelligent Manufacturing.” International Journal of Computer Integrated Manufacturing 35 (1): 21–35. https://doi.org/10.1080/0951192X.2021.1992663.
   Web of Science ®Google Scholar
• Nath, V., and C. Chattopadhyay. 2021. “S2D2Net: An Improved Approach for Robust Steel Surface Defects Diagnosis with Small Sample Learning.” In 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, Alaska, 1199–1203. https://doi.org/10.1109/ICIP42928.2021.9506405.
   Google Scholar
• Raghu, M., T. Unterthiner, S. Kornblith, C. Zhang, and A. Dosovitskiy. 2021. “Do Vision Transformers See Like Convolutional Neural Networks?“ Advances in Neural Information Processing Systems, Virtual 34: 12116–12128.
   Google Scholar
• Silven, O., M. Niskanen, and H. Kauppinen. 2003. “Wood Inspection with Non-Supervised Clustering.” Machine Vision and Applications 13 (5): 275–285. https://doi.org/10.1007/s00138-002-0084-z.
   Web of Science ®Google Scholar
• Sindagi, V. A., and S. Srivastava. 2017. “Domain Adaptation for Automatic OLED Panel Defect Detection Using Adaptive Support Vector Data Description.” International Journal of Computer Vision 122 (2): 193–211. https://doi.org/10.1007/s11263-016-0953-y.
   Web of Science ®Google Scholar
• Song, K., and Y. Yan. 2013. “A Noise Robust Method Based on Completed Local Binary Patterns for Hot-Rolled Steel Strip Surface Defects.” Applied Surface Science 285:858–864. https://doi.org/10.1016/j.apsusc.2013.09.002.
   Web of Science ®Google Scholar
• Stephen, O., U. Joseph Maduh, and M. Sain. 2022. “A Machine Learning Method for Detection of Surface Defects on Ceramic Tiles Using Convolutional Neural Networks.” Electronics 11 (1): 55. https://doi.org/10.3390/electronics11010055.
   Web of Science ®Google Scholar
• Sun, J., Z. Tian, F. Yelin, J. Geng, and C. Liu. 2021. “Digital Twins in Human Understanding: A Deep Learning-Based Method to Recognize Personality Traits.” International Journal of Computer Integrated Manufacturing 34 (7–8): 860–873. https://doi.org/10.1080/0951192X.2020.1757155.
   Web of Science ®Google Scholar
• Tian, R., and M. Jia. 2022. “DCC-Centernet: A Rapid Detection Method for Steel Surface Defects.” Measurement 187 (January): 110211. https://doi.org/10.1016/j.measurement.2021.110211.
   Google Scholar
• Wang, Y., L. Xinyu, Y. Gao, L. Wang, and L. Gao. 2021. “A New Feature-Fusion Method Based on Training Dataset Prototype for Surface Defect Recognition.” Advanced Engineering Informatics 50:101392. https://doi.org/10.1016/j.aei.2021.101392.
   Web of Science ®Google Scholar
• Zhang, H., L. Jiang, and L. Chaoqun. 2021. “CS-Resnet: Cost-Sensitive Residual Convolutional Neural Network for PCB Cosmetic Defect Detection.” Expert Systems with Applications 185:115673. https://doi.org/10.1016/j.eswa.2021.115673.
   Web of Science ®Google Scholar
• Zhang, J., L. Shihao, Y. Yan, N. Zhonghua, and N. Hongjun. 2022. “Surface Defect Classification of Steel Strip with Few Samples Based on Dual‐Stream Neural Network.” Steel Research International 93 (5): 2100554. https://doi.org/10.1002/srin.202100554.
   Web of Science ®Google Scholar
• Zhang, Z., Z. Yang, W. Ren, and G. Wen. 2019. “Random Forest-Based Real-Time Defect Detection of Al Alloy in Robotic Arc Welding Using Optical Spectrum.” Journal of Manufacturing Processes 42:51–59. https://doi.org/10.1016/j.jmapro.2019.04.023.
   Web of Science ®Google Scholar
• Zhou, Y., M. Zhuxi, X. Shi, and K. Zhang. 2019. “An Adaptive Clustering Method Detecting the Surface Defects on Linear Guide Rails.” International Journal of Computer Integrated Manufacturing 32 (8): 798–808. https://doi.org/10.1080/0951192X.2019.1636409.
   Web of Science ®Google Scholar