A novel self-training semi-supervised deep learning approach for machinery fault diagnosis

References

• Agrawala, A. K. 1970. “Learning with a Probabilistic Teacher.” IEEE Transactions on Information Theory 16: 373–379.
   Web of Science ®Google Scholar
• Artigao, E., A. Honrubia-Escribano, and E. Gomez-Lazaro. 2020. “In-Service Wind Turbine DFIG Diagnosis Using Current Signature Analysis.” IEEE Transactions on Industrial Electronics 67: 2262–2271.
   Web of Science ®Google Scholar
• Belkin, M., P. Niyogi, and V. Sindhwani. 2006. “Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples.” Journal of Machine Learning Research 7: 2399–2434.
   Web of Science ®Google Scholar
• Bennett, K. P., and A. Demiriz. 1999. “Semi-supervised Support Vector Machines.” Proceedings of the Neural Information Processing Systems, 368–374.
   Google Scholar
• Berthelot, D., N. Carlini, I. Goodfellow, N. Papernot, A. Oliver, and C. Raffel . 2019. MixMatch: A holistic approach to semi-supervised learning: arXiv:1905.02249.
   Google Scholar
• Blum, A., and T. M. Mitchell. 1998. “Combining Labeled and Unlabeled Data with co-Training.” Proceedings of the Eleventh Annual Conference on Computational Learning Theory, 92–100.
   Google Scholar
• Case Western Reserve University. n.d. Bearing Data Center. https://csegroups.case.edu/bearingdatacenter/home.
   Google Scholar
• Dong, X., D. Meng, F. Ma, and Y. Yang. 2017. “A Dual-Network Progressive Approach to Weakly Supervised Object Detection.” Proceedings of the ACM International Conference on Multimedia, 279–287.
   Google Scholar
• Fan, H., X. Chang, D. Cheng, Y. Yang, D. Xu, and A. G. Hauptmann. 2017. “Complex Event Detection by Identifying Reliable Shots from Untrimmed Videos.” Proceedings of the IEEE International Conference on Computer Vision, 736–744.
   Google Scholar
• Fan, H., L. Zheng, C. Yan, and Y. Yang . 2018. “Unsupervised Person re-Identification: Clustering and Fine-Tuning.” Acm Transactions on Multimedia Computing Communications and Applications 83: 1–18.
   Web of Science ®Google Scholar
• Gao, Z., C. Cecati, and S. X. Ding. 2015a. “A Survey of Fault Diagnosis and Fault-Tolerant Techniques-Part i: Fault Diagnosis with Model-Based and Signal-Based Approaches.” IEEE Transactions on Industrial Electronics 62: 3757–3767.
   Web of Science ®Google Scholar
• Gao, Z., C. Cecati, and S. X. Ding. 2015b. “A Survey of Fault Diagnosis and Fault-Tolerant Techniques-Part ii: Fault Diagnosis with Knowledge-Based and Hybrid/Active Approaches.” IEEE Transactions on Industrial Electronics 62: 3768–3774.
   Web of Science ®Google Scholar
• Hanachi, H., J. Liu, I. Y. Kim, and C. K. Mechefske. 2019. “Hybrid Sequential Fault Estimation for Multi-Mode Diagnosis of gas Turbine Engines.” Mechanical Systems and Signal Processing 115: 255–268.
   Web of Science ®Google Scholar
• Hu, Y., P. Baraldi, F. Di Maio, and E. Zio. 2017. “A Systematic Semi-Supervised Self-Adaptable Fault Diagnostics Approach in an Evolving Environment.” Mechanical Systems and Signal Processing 88: 413–427.
   Web of Science ®Google Scholar
• Jeong, I. J., V. J. Leon, and J. R. Villalobos. 2007. “Integrated Decision-Support System for Diagnosis, Maintenance Planning, and Scheduling of Manufacturing Systems.” International Journal of Production Research 45: 267–285.
   Web of Science ®Google Scholar
• Lee, J., B. Park, and C. Lee. 2020. “Fault Diagnosis Based on the Quantification of the Fault Features in a Rotary Machine.” Applied Soft Computing 97: 106726.
   Web of Science ®Google Scholar
• Lei, Y., B. Yang, X. Jiang, F. Jia, N. Li, and A. K. Nandi. 2020. “Applications of Machine Learning to Machine Fault Diagnosis: A Review and Roadmap.” Mechanical Systems and Signal Processing 138: 106587.
   Web of Science ®Google Scholar
• Li, W., C. Foo, and H. Bilen . 2020. Learning to impute: a general framework for semi-supervised learning: arXiv:1912.10364.
   Google Scholar
• Long, J., J. Mou, L. Zhang, S. Zhang, and C. Li. 2021. “Attitude Data-Based Deep Hybrid Learning Architecture for Intelligent Fault Diagnosis of Multi-Joint Industrial Robots.” Journal of Manufacturing Systems 61: 736–745.
   Web of Science ®Google Scholar
• Long, J. Y., Z. Z. Sun, C. Li, Y. Hong, Y. Bai, and S. H. Zhang. 2020a. “A Novel Sparse Echo Autoencoder Network for Data-Driven Fault Diagnosis of Delta 3-D Printers.” IEEE Transactions on Instrumentation and Measurement 69: 683–692.
   Web of Science ®Google Scholar
• Long, J. Y., S. H. Zhang, and C. Li. 2020b. “Evolving Deep Echo State Networks for Intelligent Fault Diagnosis.” IEEE Transactions on Industrial Informatics 16: 4928–4937.
   Web of Science ®Google Scholar
• Majdouline, I., S. Dellagi, L. Mifdal, E. M. Kibbou, and A. Moufki. 2021. “Integrated Production-Maintenance Strategy Considering Quality Constraints in dry Machining.” International Journal of Production Research,. Early Access.
   PubMed Web of Science ®Google Scholar
• Nigam, K., A. McCallum, S. Thrun, and T. M. Mitchell. 2000. “Text Classification from Labeled and Unlabeled Documents Using EM.” Machine Learning 39: 103–134.
   Web of Science ®Google Scholar
• Potocnik, P., and E. Govekar. 2017. “Semi-supervised Vibration-Based Classification and Condition Monitoring of Compressors.” Mechanical Systems and Signal Processing 93: 51–65.
   Web of Science ®Google Scholar
• Razavi-Far, R., E. Hallaji, M. Farajzadeh-Zanjani, M. Saif, S. H. Kia, H. Henao, and G.-A. Capolino. 2019. “Information Fusion and Semi-Supervised Deep Learning Scheme for Diagnosing Gear Faults in Induction Machine Systems.” IEEE Transactions on Industrial Electronics 66: 6331–6342.
   Web of Science ®Google Scholar
• Rosenberg, C., M. Hebert, and H. Schneiderman. 2005. Semi-supervised self-training of object detection models, the 7th IEEE Workshop on Applications of Computer Vision: 29-36.
   Google Scholar
• Rumelhart, D. E., G. E. Hinton, and R. J. Williams. 1986. “Learning Representations by Back-Propagating Errors.” Nature 323: 533–536.
   Web of Science ®Google Scholar
• Shao, H. D., H. K. Jiang, Y. Lin, and X. Q. Li. 2018. “A Novel Method for Intelligent Fault Diagnosis of Rolling Bearings Using Ensemble Deep Auto-Encoders.” Mechanical Systems and Signal Processing 102: 278–297.
   Web of Science ®Google Scholar
• Shao, H. D., J. Lin, L. W. Zhang, D. Galar, and U. Kumar. 2021a. “A Novel Approach of Multisensory Fusion to Collaborative Fault Diagnosis in Maintenance.” Information Fusion 74: 65–76.
   Web of Science ®Google Scholar
• Shao, H., M. Xia, G. Han, Y. Zhang, and J. Wan. 2021b. “Intelligent Fault Diagnosis of Rotor-Bearing System Under Varying Working Conditions with Modified Transfer Convolutional Neural Network and Thermal Images.” IEEE Transactions on Industrial Informatics 17: 3488–3496.
   Web of Science ®Google Scholar
• Tarvainen, A., and H. Valpola. 2017. “Mean Teachers are Better Role Models: Weight-Averaged Consistency Targets Improve Semi-Supervised Deep Learning Results.” Proceedings of the Neural Information Processing Systems, 1195–1204.
   Google Scholar
• Wang, Z., Q. Liu, H. Chen, and X. Chu. 2021. “A Deformable CNN-DLSTM Based Transfer Learning Method for Fault Diagnosis of Rolling Bearing Under Multiple Working Conditions.” International Journal of Production Research 59: 4811–4825.
   Web of Science ®Google Scholar
• Yang, W., L. Chen, and S. Dauzere-Peres. 2021a. “A Dynamic Optimisation Approach for a Single Machine Scheduling Problem with Machine Conditions and Maintenance Decisions.” International Journal of Production Research,. Early Access.
   PubMed Web of Science ®Google Scholar
• Yang, X., Z. Song, I. King, and Z. Xu. 2021b. A survey on deep semi-supervised learning: arXiv:2103.00550.
   Google Scholar
• Ye, M., A. J. Ma, L. Zheng, J. Li, and P. C. Yuen. 2017. “Dynamic Label Graph Matching for Unsupervised Video re-Identification.” Proceedings of the IEEE International Conference on Computer Vision, 5152–5160.
   Google Scholar
• Zhang, Y. Y., X. Y. Li, L. Gao, W. Chen, and P. G. Li. 2020. “Ensemble Deep Contractive Auto-Encoders for Intelligent Fault Diagnosis of Machines Under Noisy Environment.” Knowledge-Based Systems 196: 105764.
   Web of Science ®Google Scholar
• Zhang, C., J. Yu, and S. Wang. 2021. “Fault Detection and Recognition of Multivariate Process Based on Feature Learning of one-Dimensional Convolutional Neural Network and Stacked Denoised Autoencoder.” International Journal of Production Research 59: 2426–2449.
   Web of Science ®Google Scholar
• Zhao, X., M. Jia, J. Bin, T. Wang, and Z. Liu. 2020a. “Multiple-Order Graphical Deep Extreme Learning Machine for Unsupervised Fault Diagnosis of Rolling Bearing.” IEEE Transactions on Instrumentation and Measurement 70: 3506012.
   Web of Science ®Google Scholar
• Zhao, X., M. Jia, and Z. Liu. 2021a. “Semisupervised Graph Convolution Deep Belief Network for Fault Diagnosis of Electormechanical System with Limited Labeled Data.” IEEE Transactions on Industrial Informatics 17: 5450–5460.
   Web of Science ®Google Scholar
• Zhao, B., X. Zhang, Z. Zhan, and Q. Wu. 2021b. “Deep Multi-Scale Adversarial Network with Attention: A Novel Domain Adaptation Method for Intelligent Fault Diagnosis.” Journal of Manufacturing Systems 59: 565–576.
   Web of Science ®Google Scholar
• Zhao, M., S. Zhong, X. Fu, B. Tang, and M. Pecht. 2020b. “Deep Residual Shrinkage Networks for Fault Diagnosis.” IEEE Transactions on Industrial Informatics 16: 4681–4690.
   Web of Science ®Google Scholar
• Zheng, J., H. Wang, Z. Song, and Z. Ge. 2019. “Ensemble Semi-Supervised Fisher Discriminant Analysis Model for Fault Classification in Industrial Processes.” ISA Transactions 92: 109–117.
   PubMed Web of Science ®Google Scholar