Few-shot learning for defect detection in manufacturing

References

• Abd Al Rahman, M., and Alireza Mousavi. 2020. “A Review and Analysis of Automatic Optical Inspection and Quality Monitoring Methods in Electronics Industry.” IEEE Access 8:183192–183271. https://doi.org/10.1109/Access.6287639.
   Web of Science ®Google Scholar
• Aggour, Kareem S., Vipul K. Gupta, Daniel Ruscitto, Leonardo Ajdelsztajn, Xiao Bian, Kristen H. Brosnan, Natarajan Chennimalai Kumar, and Rajkumar K. 2019. “Artificial Intelligence/machine Learning in Manufacturing and Inspection: A GE Perspective.” MRS Bulletin 44 (7): 545–558. https://doi.org/10.1557/mrs.2019.157.
   Web of Science ®Google Scholar
• Beltrán-González, Carlos, Matteo Bustreo, and Alessio Del Bue. 2020. “External and Internal Quality Inspection of Aerospace Components.” In 2020 IEEE 7th International Workshop on Metrology for AeroSpace (MetroAeroSpace), 351–355. IEEE.
   Google Scholar
• Benbarrad, Tajeddine, Marouane Salhaoui, Soukaina Bakhat Kenitar, and Mounir Arioua. 2021. “Intelligent Machine Vision Model for Defective Product Inspection Based on Machine Learning.” Journal of Sensor and Actuator Networks 10 (1): 7. https://doi.org/10.3390/jsan10010007.
   Web of Science ®Google Scholar
• Bergmann, Paul, Michael Fauser, David Sattlegger, and Carsten Steger. 2019. “MVTec AD–A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9592–9600.
   Google Scholar
• Bradley, Andrew P. 1997. “The Use of the Area Under the ROC Curve in the Evaluation of Machine Learning Algorithms.” Pattern Recognition 30 (7): 1145–1159. https://doi.org/10.1016/S0031-3203(96)00142-2.
   Web of Science ®Google Scholar
• Cai, Qi, Yingwei Pan, Ting Yao, Chenggang Yan, and Tao Mei. 2018. “Memory Matching Networks for One-Shot Image Recognition.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4080–4088.
   Google Scholar
• Caron, Mathilde, Hugo Touvron, Ishan Misra, Herv'e J'egou, Julien Mairal, Piotr Bojanowski, and Armand Joulin. 2021. “Emerging Properties in Self-Supervised Vision Transformers.” In 2021 IEEE/CVF International Conference on Computer Vision (ICCV) 9630–9640.
   Google Scholar
• Chin, Roland T., and Charles A. Harlow. 1982. “Automated Visual Inspection: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence6): 557–573. https://doi.org/10.1109/TPAMI.1982.4767309.
   PubMed Web of Science ®Google Scholar
• Chouchene, Amal, Adriana Carvalho, Tânia M. Lima, Fernando Charrua-Santos, Gerardo J. Osório, and Walid Barhoumi. 2020. “Artificial Intelligence for Product Quality Inspection Toward Smart Industries: Quality Control of Vehicle Non-Conformities.” In 2020 9th International Conference on Industrial Technology and Management (ICITM), 127–131. IEEE.
   Google Scholar
• Ciravegna, Gabriele, Frédéric Precioso, Alessandro Betti, Kevin Mottin, and Marco Gori. 2023. “Knowledge-Driven Active Learning.” In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 38–54. Springer.
   Google Scholar
• Cullinane, Sarah-Jane, Janine Bosak, Patrick C Flood, and Evangelia Demerouti. 2013. “Job Design Under Lean Manufacturing and Its Impact on Employee Outcomes.” Organizational Psychology Review 3 (1): 41–61. https://doi.org/10.1177/2041386612456412.
   Web of Science ®Google Scholar
• Czimmermann, Tamás, Gastone Ciuti, Mario Milazzo, Marcello Chiurazzi, Stefano Roccella, Calogero Maria Oddo, and Paolo Dario. 2020. “Visual-based Defect Detection and Classification Approaches for Industrial Applications—A Survey.” Sensors 20 (5): 1459. https://doi.org/10.3390/s20051459.
   PubMed Web of Science ®Google Scholar
• Dosovitskiy, Alexey, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, et al. 2021. “An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale.” In International Conference on Learning Representations, https://openreview.net/forum?id=YicbFdNTTy.
   Google Scholar
• Duan, Guifang, Hongcui Wang, Zhenyu Liu, and Yen-Wei Chen. 2012. “A Machine Learning-based Framework for Automatic Visual Inspection of Microdrill Bits in PCB Production.” IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 42 (6): 1679–1689. https://doi.org/10.1109/TSMCC.2012.2216260.
   Web of Science ®Google Scholar
• EC2. n.d. “European Commission, Enabling Technologies for Industry 5.0, Results of a Workshop with Europe's Technology Leaders.” https://op.europa.eu/en/publication-detail/-/publication/8e5de100-2a1c-11eb-9d7e-01aa75ed71a1/language-en. September 2020.
   Google Scholar
• Ghai, Bhavya, Q. Vera Liao, Yunfeng Zhang, Rachel Bellamy, and Klaus Mueller. 2021. “Explainable Active Learning (xal) Toward Ai Explanations As Interfaces for Machine Teachers.” Proceedings of the ACM on Human-Computer Interaction 4 (CSCW3): 1–28. https://doi.org/10.1145/3432934.
   Google Scholar
• Gobert, Christian, Edward W. Reutzel, Jan Petrich, Abdalla R. Nassar, and Shashi Phoha. 2018. “Application of Supervised Machine Learning for Defect Detection During Metallic Powder Bed Fusion Additive Manufacturing Using High Resolution Imaging.” Additive Manufacturing 21:517–528. https://doi.org/10.1016/j.addma.2018.04.005.
   Web of Science ®Google Scholar
• He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. “Deep Residual Learning for Image Recognition.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770–778.
   Google Scholar
• Hu, Shell Xu, Da Li, Jan Stühmer, Minyoung Kim, and Timothy M. Hospedales. 2022a. “Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Difference.” In CVPR.
   Google Scholar
• Hu, Shell Xu, Da Li, Jan Stühmer, Minyoung Kim, and Timothy M. Hospedales. 2022b. “Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Difference.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9068–9077.
   Google Scholar
• Huang, Yiming, Di Wu, Zhifen Zhang, Huabin Chen, and Shanben Chen. 2017. “EMD-based Pulsed TIG Welding Process Porosity Defect Detection and Defect Diagnosis Using GA-SVM.” Journal of Materials Processing Technology 239:92–102. https://doi.org/10.1016/j.jmatprotec.2016.07.015.
   Web of Science ®Google Scholar
• Jia, Hongbin, Yi Lu Murphey, Jinajun Shi, and Tzyy-Shuh Chang. 2004. “An Intelligent Real-Time Vision System for Surface Defect Detection.” In Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., Vol. 3, 239–242. IEEE.
   Google Scholar
• Konstantinidis, Fotios K., Nikolaos Myrillas, Konstantinos A. Tsintotas, Spyridon G. Mouroutsos, and Antonios Gasteratos. 2023. “A Technology Maturity Assessment Framework for Industry 5.0 Machine Vision Systems Based on Systematic Literature Review in Automotive Manufacturing.” International Journal of Production Research 1–37. https://doi.org/10.1080/00207543.2023.2270588.
   Web of Science ®Google Scholar
• Križnar, Karel, Jože M. Rožanec, Blaž Fortuna, and Dunja Mladenić. 2023. “Explainable Artificial Intelligence Meets Active Learning: A Novel GradCAM-Based Active Learning Strategy.” Submitted.
   Google Scholar
• Kujawińska, Agnieszka, Katarzyna Vogt, and Adam Hamrol. 2016. “The Role of Human Motivation in Quality Inspection of Production Processes.” In Advances in Ergonomics of Manufacturing: Managing the Enterprise of the Future, 569–579. Springer.
   Google Scholar
• Lenka, Sambit, Vinit Parida, and Joakim Wincent. 2017. “Digitalization Capabilities As Enablers of Value Co-creation in Servitizing Firms.” Psychology and Marketing 34 (1): 92–100. https://doi.org/10.1002/mar.2016.34.issue-1.
   Web of Science ®Google Scholar
• Lied, Lars Harald, Maria Flavia Mogos, and Daryl John Powell. 2020. “Organizational Enablers for Digitalization in Norwegian Industry.” In IFIP International Conference on Advances in Production Management Systems, 83–90. Springer.
   Google Scholar
• Lim, Kendrik Yan Hong, Pai Zheng, and Chun-Hsien Chen. 2020. “A State-of-the-art Survey of Digital Twin: Techniques, Engineering Product Lifecycle Management and Business Innovation Perspectives.” Journal of Intelligent Manufacturing 31 (6): 1313–1337. https://doi.org/10.1007/s10845-019-01512-w.
   Web of Science ®Google Scholar
• Liqun, Wang, Wu Jiansheng, and Wu Dingjin. 2020. “Research on Vehicle Parts Defect Detection Based on Deep Learning.” In Journal of Physics: Conference Series, Vol. 1437, 012004. IOP Publishing.
   Google Scholar
• Lv, Qianwen, and Yonghong Song. 2019. “Few-shot Learning Combine Attention Mechanism-based Defect Detection in Bar Surface.” ISIJ International 59 (6): 1089–1097. https://doi.org/10.2355/isijinternational.ISIJINT-2018-722.
   Web of Science ®Google Scholar
• Mishra, Nikhil, Mostafa Rohaninejad, Xi Chen, and Pieter Abbeel. 2017. “A Simple Neural Attentive Meta-Learner.” arXiv preprint arXiv:1707.03141.
   Google Scholar
• Munkhdalai, Tsendsuren, and Hong Yu. 2017. “Meta Networks.” In International Conference on Machine Learning, 2554–2563. PMLR.
   Google Scholar
• Nahavandi, Saeid.. 2019. “Industry 5.0–A Human-centric Solution.” Sustainability 11 (16): 4371. https://doi.org/10.3390/su11164371.
   Web of Science ®Google Scholar
• Ochal, Mateusz, Massimiliano Patacchiola, Amos Storkey, Jose Vazquez, and Sen Wang. 2021. “Few-Shot Learning with Class Imbalance.” arXiv preprint arXiv:2101.02523.
   Google Scholar
• O'Mahony, Niall, Sean Campbell, Anderson Carvalho, Suman Harapanahalli, Gustavo Velasco Hernandez, Lenka Krpalkova, Daniel Riordan, and Joseph Walsh. 2020. “Deep Learning vs. Traditional Computer Vision.” In Advances in Computer Vision: Proceedings of the 2019 Computer Vision Conference (CVC), Volume 1 1, 128–144. Springer.
   Google Scholar
• Parnami, Archit, and Minwoo Lee. 2022. “Learning from Few Examples: A Summary of Approaches to Few-Shot Learning.” arXiv preprint arXiv:2203.04291.
   Google Scholar
• Pouyanfar, Samira, Saad Sadiq, Yilin Yan, Haiman Tian, Yudong Tao, Maria Presa Reyes, Mei-Ling Shyu, Shu-Ching Chen, and Sundaraja S. Iyengar. 2018. “A Survey on Deep Learning: Algorithms, Techniques, and Applications.” ACM Computing Surveys (CSUR) 51 (5): 1–36. https://doi.org/10.1145/3234150.
   Web of Science ®Google Scholar
• Ren, Zhonghe, Fengzhou Fang, Ning Yan, and You Wu. 2022. “State of the Art in Defect Detection Based on Machine Vision.” International Journal of Precision Engineering and Manufacturing-Green Technology 9 (2): 661–691. https://doi.org/10.1007/s40684-021-00343-6.
   Web of Science ®Google Scholar
• Rožanec, Jože M., Patrik Zajec, Spyros Theodoropoulos, Erik Koehorst, Blaž Fortuna, and Dunja Mladenić. 2022. “Robust Anomaly Map Assisted Multiple Defect Detection with Supervised Classification Techniques.” arXiv preprint arXiv:2212.09352.
   Google Scholar
• Rožanec, Jože M., Patrik Zajec, Elena Trajkova, Beno Šircelj, Bor Brecelj, Inna Novalija, Paulien Dam, Blaž Fortuna, and Dunja Mladenić. 2022. “Towards a Comprehensive Visual Quality Inspection for Industry 4.0.” IFAC-PapersOnLine 55 (10): 690–695. https://doi.org/10.1016/j.ifacol.2022.09.486.
   Google Scholar
• Russakovsky, Olga, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang. 2015. “Imagenet Large Scale Visual Recognition Challenge.” International Journal of Computer Vision 115 (3): 211–252. https://doi.org/10.1007/s11263-015-0816-y.
   Web of Science ®Google Scholar
• See, Judi E. 2012. “Visual Inspection: A Review of the Literature.”.
   Google Scholar
• Settles, Burr. 2009. “Active Learning Literature Survey.”.
   Google Scholar
• Shahin, Mohammad, F. Frank Chen, Ali Hosseinzadeh, Hamed Bouzary, and Awni Shahin. 2023. “Waste Reduction Via Image Classification Algorithms: Beyond the Human Eye with An AI-based Vision.” International Journal of Production Research 1–19. https://doi.org/10.1080/00207543.2023.2225652.
   Web of Science ®Google Scholar
• Singh, Prerna. 2023. “Systematic Review of Data-centric Approaches in Artificial Intelligence and Machine Learning.” Data Science and Management 6 (3): 144–157. https://doi.org/10.1016/j.dsm.2023.06.001.
   Google Scholar
• Snell, Jake, Kevin Swersky, and Richard S. Zemel. 2017. “Prototypical Networks for Few-Shot Learning.” ArXiv abs/1703.05175.
   Google Scholar
• Takimoto, Hironori, Junya Seki, Sulfayanti F. Situju, and Akihiro Kanagawa. 2022. “Anomaly Detection Using Siamese Network with Attention Mechanism for Few-shot Learning.” Applied Artificial Intelligence 36 (1): 2094885. https://doi.org/10.1080/08839514.2022.2094885.
   Web of Science ®Google Scholar
• Tortorella, Guilherme Luz, Michel J. Anzanello, Flavio S. Fogliatto, Jiju Antony, and Daniel Nascimento. 2023. “Effect of Industry 4.0 Technologies Adoption on the Learning Process of Workers in a Quality Inspection Operation.” International Journal of Production Research 61 (22): 7592–7607. https://doi.org/10.1080/00207543.2022.2153943.
   Web of Science ®Google Scholar
• Triantafillou, Eleni, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin, Utku Evci, Kelvin Xu, Ross Goroshin, et al. 2019. “Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples.” arXiv preprint arXiv:1903.03096.
   Google Scholar
• Villalba-Diez, Javier, Daniel Schmidt, Roman Gevers, Joaquín Ordieres-Meré, Martin Buchwitz, and Wanja Wellbrock. 2019. “Deep Learning for Industrial Computer Vision Quality Control in the Printing Industry 4.0.” Sensors 19 (18): 3987. https://doi.org/10.3390/s19183987.
   PubMed Web of Science ®Google Scholar
• Wang, Haohan, Zhuoling Li, and Haoqian Wang. 2021. “Few-shot Steel Surface Defect Detection.” IEEE Transactions on Instrumentation and Measurement 71:1–12.
   Web of Science ®Google Scholar
• Wang, Yisen, Weiyang Liu, Xingjun Ma, James Bailey, Hongyuan Zha, Le Song, and Shu-Tao Xia. 2018. “Iterative Learning with Open-Set Noisy Labels.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 8688–8696.
   Google Scholar
• Wang, Yaqing, Quanming Yao, James T. Kwok, and Lionel M. Ni. 2020. “Generalizing From a Few Examples: A Survey on Few-shot Learning.” ACM Computing Surveys (CSUR) 53 (3): 1–34. https://doi.org/10.1145/3386252.
   Web of Science ®Google Scholar
• Wu, Ke, Jie Tan, Jingwei Li, and Chengbao Liu. 2021. “Few-Shot Learning Approach for 3D Defect Detection in Lithium Battery.” In Journal of Physics: Conference Series, Vol. 1884, 012024. IOP Publishing.
   Google Scholar
• Xu, Jiancheng, and Jialei Ma. 2022. “Auto Parts Defect Detection Based on Few-Shot Learning.” In 2022 3rd International Conference on Computer Vision, Image and Deep Learning & International Conference on Computer Engineering and Applications (CVIDL & ICCEA), 943–946. IEEE.
   Google Scholar
• Yang, Jing, Shaobo Li, Zheng Wang, Hao Dong, Jun Wang, and Shihao Tang. 2020. “Using Deep Learning to Detect Defects in Manufacturing: a Comprehensive Survey and Current Challenges.” Materials 13 (24): 5755. https://doi.org/10.3390/ma13245755.
   PubMed Web of Science ®Google Scholar
• Yu, Jianbo, Yanshu Wang, Qingfeng Li, Hao Li, Mingyan Ma, and Peilun Liu. 2023. “Cascaded Adaptive Global Localisation Network for Steel Defect Detection.” International Journal of Production Research 1–18. https://doi.org/10.1080/00207543.2023.2281664.
   Web of Science ®Google Scholar
• Zavrtanik, Vitjan, Matej Kristan, and Danijel Skočaj. 2021. “DRAEM-A Discriminatively Trained Reconstruction Embedding for Surface Anomaly Detection.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 8330–8339.
   Google Scholar
• Zhan, Zhu, Jinfeng Zhou, and Bugao Xu. 2022. “Fabric Defect Classification Using Prototypical Network of Few-shot Learning Algorithm.” Computers in Industry 138:103628. https://doi.org/10.1016/j.compind.2022.103628.
   Web of Science ®Google Scholar
• Zhang, Shen, Fei Ye, Bingnan Wang, and Thomas G. Habetler. 2020. “Few-Shot Bearing Anomaly Detection via Model-Agnostic Meta-Learning.” In 2020 23rd International Conference on Electrical Machines and Systems (ICEMS), 1341–1346. IEEE.
   Google Scholar
• Zhao, Zetian, Bingtao Hu, Yixiong Feng, Bin Zhao, Chen Yang, Zhaoxi Hong, and Jianrong Tan. 2023. “Multi-surface Defect Detection for Universal Joint Bearings Via Multimodal Feature and Deep Transfer Learning.” International Journal of Production Research 61 (13): 4402–4418. https://doi.org/10.1080/00207543.2022.2138613.
   Web of Science ®Google Scholar