Dynamic convolutional gated recurrent unit attention auto-encoder for feature learning and fault detection in dynamic industrial processes

References

• Amini, N., and Q. Zhu. 2022. “Fault Detection and Diagnosis with a Novel Source-Aware Autoencoder and Deep Residual Neural Network.” Neurocomputing 488: 618–633.
   Web of Science ®Google Scholar
• Chen, M. C., C. Hsu, B. Malhotra, and M. K. Tiwari. 2016. “An Efficient ICA-DW-SVDD Fault Detection and Diagnosis Method for Non-Gaussian Processes.” International Journal of Production Research 54 (17): 5208–5218.
   Web of Science ®Google Scholar
• Chen, Y., C. Tong, Y. Ge, and L. Ting. 2021. “Fault Detection Based on Auto-Regressive Extreme Learning Machine for Nonlinear Dynamic Processes.” Applied Soft Computing 106: 107319.
   Web of Science ®Google Scholar
• Cho, K., M. Van, C. Gulcehre, D. Bahdanau, F. Bougraes, H. Schwenk, and Y. Bengio. 2014. “Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation.” In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1724–1734. Doha, Qatar: Association for Computational Linguistics.
   Google Scholar
• Das, A., J. Maiti, and R. N. Banerjee. 2010. “A Hierarchical Process Monitoring Strategy for a Serial Multi-stage Manufacturing System.” International Journal of Production Research 48 (7–8): 2459–2479.
   Web of Science ®Google Scholar
• Ding, S., Z. Wang, W. Kong, H. Yang, and G. Song. 2019. “Electrode Regulating System Modeling in Electrical Smelting Furnace Using Recurrent Neural Network with Attention Mechanism.” Neurocomputing 359: 32–40.
   Web of Science ®Google Scholar
• Fezai, R., M. Mansouri, K. Abodayeh, H. Nounou, and M. Nounou. 2019. “Online Reduced Gaussian Process Regression Based Generalized Likelihood Ratio Test for Fault Detection.” Journal of Process Control 85: 30–40.
   Web of Science ®Google Scholar
• Glaeser, A., V. Selvaraj, S. Lee, Y. Hwang, K. Lee, N. Lee, S. Lee, and S. Min. 2021. “Applications of Deep Learning for Fault Detection in Industrial Cold Forging.” International Journal of Production Research 59 (16): 4826–4835.
   Web of Science ®Google Scholar
• Hochreiter, S., and J. Schmidhuber. 1997. “Long Short-term Memory.” Neural Computation 9 (8): 1735–1780.
   PubMed Web of Science ®Google Scholar
• Huang, J., and X. Yan. 2016. “Related and Independent Variable Fault Detection Based on KPCA and SVDD.” Journal of Process Control 39: 88–99.
   Web of Science ®Google Scholar
• Huang, J., X. Yang, and K. Peng. 2021. “Double-Layer Distributed Monitoring Based on Sequential Correlation Information for Large-Scale Industrial Processes in Dynamic and Static States.” IEEE Transactions on Industrial Informatics 17 (9): 6419–6428.
   Web of Science ®Google Scholar
• Jiang, Q., and X. Yan. 2019. “Learning Deep Correlated Representations for Nonlinear Process Monitoring.” IEEE Transactions on Industrial Informatics 15 (12): 6200–6209.
   Web of Science ®Google Scholar
• Jiang, Q., X. Yan, Z. Lv, and M. Guo. 2014. “Independent Component Analysis-based Non-Gaussian Process Monitoring with Preselecting Optimal Components and Support Vector Data Description.” International Journal of Production Research 52 (11): 3273–3286.
   Web of Science ®Google Scholar
• Jung, M., H. Lee, and J. Tani. 2018. “Adaptive Detrending to Accelerate Convolutional Gated Recurrent Unit Training for Contextual Video Recognition.” Neural Networks 105: 356–370.
   PubMed Web of Science ®Google Scholar
• Ko, J. M., and C. O. Kim. 2012. “A Multivariate Parameter Trace Analysis for Online Fault Detection in a Semiconductor Etch Tool.” International Journal of Production Research 50 (23): 6639–6654.
   Web of Science ®Google Scholar
• Ku, W., R. H. Storer, and C. Georgakis. 1995. “Disturbance Detection and Isolation by Dynamic Principal Component Analysis.” Chemometrics and Intelligent Laboratory Systems 30 (1): 179–196.
   Web of Science ®Google Scholar
• Lee, J. M., C. K. Yoo, and I. B. Lee. 2004. “Statistical Monitoring of Dynamic Processes Based on Dynamic Independent Component Analysis.” Chemical Engineering Science 59 (14): 2995–3006.
   Web of Science ®Google Scholar
• Lindsay, G. 2015. “Feature-based Attention in Convolutional Neural Networks.” Computer Vision and Pattern Recognition 32: 41–45. doi:10.1016/0020-0190(89)90067-7.
   Web of Science ®Google Scholar
• Liu, D., J. Shang, and M. Chen. 2021. “Principal Component Analysis-based Ensemble Detector for Incipient Faults in Dynamic Processes.” IEEE Transactions on Industrial Informatics 17 (8): 5391–5401.
   Web of Science ®Google Scholar
• Liu, D., M. Wang, and M. Chen. 2022. “Feature Ensemble Net: A Deep Framework for Detecting Incipient Faults in Dynamical Processes.” IEEE Transactions on Industrial Informatics 18: 8618–8628. doi:10.1109/TII.2022.3150805.
   Web of Science ®Google Scholar
• Liu, X., and J. Yu. 2021. “Attention Convolutional GRU-based Autoencoder and Its Application in Industrial Process Monitoring.” Journal of Zhejiang University-Science A (Applied Physics & Engineering) 55 (9): 1643–1651.
   Google Scholar
• Liu, X., J. Yu, and L. Ye. 2021. “Residual Attention Convolutional Autoencoder for Feature Learning and Fault Detection in Nonlinear Industrial Processes.” Neural Computing and Applications 33: 12737–12753.
   Web of Science ®Google Scholar
• Ma, Y., and H. Li. 2020. “GRU-Auto-Encoder Neural Network-based Methods for Diagnosing Abnormal Operating Conditions of Steam Drums in Coal Gasification Plants.” Computers & Chemical Engineering 143: 107097.
   Web of Science ®Google Scholar
• Malhi, A., R. Yan, and R. X. Gao. 2011. “Prognosis of Defect Propagation Based on Recurrent Neural Networks.” IEEE Transactions on Instrumentation and Measurement 60 (3): 703–711.
   Web of Science ®Google Scholar
• McAvoy, T. J., and N. Ye. 1994. “Base Control for the Tennessee Eastman Problem.” Computers & Chemical Engineering 18 (5): 383–413.
   Web of Science ®Google Scholar
• Michael, C., S. Ashish, and D. Seborg. 2002. “Pattern Matching in Historical Data.” AICHE Journal 48 (9): 2022–2038.
   Web of Science ®Google Scholar
• Mnih, V., N. Heess, A. Graves, and K. Kavukcuoglu. 2014. “Recurrent Models of Visual Attention.” Advances in Neural Information Processing Systems 2: 2204–2212.
   Google Scholar
• Nogueira, I., C. Fontes, I. Sartori, K. Pontes, and M. Embirucu. 2017. “A Model-based Approach to Quality Monitoring of a Polymerization Process without Online Measurement of Product Specifications.” Computers & Industrial Engineering 106 (5): 123–136.
   Web of Science ®Google Scholar
• Rai, R., M. J. Tiwari, D. Ivanov, and A. Dolgui. 2021. “Machine Learning in Manufacturing and Industry 4.0 Applications.” International Journal of Production Research 59 (16): 4773–4778.
   Web of Science ®Google Scholar
• Rashidi, B., and Q. Zhao. 2022. “Output-related Fault Detection in Non-stationary Processes Using Constructive Correlative-SAE and Demoting Correlative-DNN.” Applied Soft Computing 123: 108898.
   Web of Science ®Google Scholar
• Ren, J., and D. Ni. 2020. “A Batch-wise LSTM-encoder Decoder Network for Batch Process Monitoring.” Chemical Engineering Research and Design 164 (1): 102–112.
   Web of Science ®Google Scholar
• Ruiz-Cárcel, C., Y. Cao, D. Mba, L. Lao, and R. Samuel. 2015. “Statistical Process Monitoring of a Multiphase Flow Facility.” Control Engineering Practice 42: 74–88.
   Web of Science ®Google Scholar
• Shen, X., and S. Agrawal. 2006. “Kernel Density Estimation for an Anomaly Based Intrusion Detection System.” MLMTA:161–167.
   Google Scholar
• Sheriff, M. Z., M. Mansouri, M. N. Karim, H. Nounou, and M. Nounou. 2017. “Fault Detection Using Multiscale PCA-based Moving Window GLRT.” Journal of Process Control 54: 47–64.
   Web of Science ®Google Scholar
• Shi, X., Z. Gao, L. Lausen, H. Wang, D. Yeung, W. Wong, and W. Woo. 2017. “Deep Learning for Precipitation Nowcasting: A Benchmark and a New Model.” doi:10.48550/arXiv.1706.03458.
   Google Scholar
• Tao, Y., H. Shi, B. Song, and S. Tan. 2020. “A Novel Dynamic Weight Principal Component Analysis Method and Hierarchical Monitoring Strategy for Process Fault Detection and Diagnosis.” IEEE Transactions on Industrial Electronics 67 (9): 7994–8004.
   Web of Science ®Google Scholar
• Tong, C., and X. Shi. 2016. “Decentralized Monitoring of Dynamic Processes Based on Dynamic Feature Selection and Informative Fault Pattern Dissimilarity.” IEEE Transactions on Industrial Electronics 63 (6): 3804–3814.
   Web of Science ®Google Scholar
• Yan, S., and X. Yan. 2019. “Design Teacher and Supervised Dual Stacked Auto-encoders for Quality-relevant Fault Detection in Industrial Process.” Applied Soft Computing 81: 105526.
   Web of Science ®Google Scholar
• Yu, J. 2010. “Hidden Markov Models Combining Local and Global Information for Nonlinear and Multimodal Process Monitoring.” Journal of Process Control 20 (3): 344–359.
   Web of Science ®Google Scholar
• Yu, J., and X. Liu. 2020. “A Fault Detection Method based on Convolutional Gated Recurrent Unit Auto-encoder for Tennessee Eastman Process.” In 2020 Chinese Automation Congress (CAC), 1234–1238. Shanghai, China: Institute of Electrical and Electronics Engineers.
   Google Scholar
• Yu, J., and X. Liu. 2022. “One-dimensional Residual Convolutional Auto-encoder for Fault Detection in Complex Industrial Processes.” International Journal of Production Research 60: 5655–5674.
   Web of Science ®Google Scholar
• Yu, J., X. Zheng, and S. Wang. 2018. “Stacked Denoising Autoencoder-based Feature Learning for Out-of-control Source Recognition in Multivariate Manufacturing Process.” Quality and Reliability Engineering 35 (3): 204–223.
   Google Scholar
• Zhang, S., and T. Qiu. 2022. “A Dynamic-inner Convolutional Autoencoder for Process Monitoring.” Computers & Chemical Engineering 158: 107654.
   Web of Science ®Google Scholar
• Zhang, C., J. Yu, and S. Wang. 2021. “Fault Detection and Recognition of Multivariate Process based on Feature Learning of One-dimensional Convolutional Neural Network and Stacked Denoised Autoencoder.” International Journal of Production Research 59: 2426–2449.
   Web of Science ®Google Scholar
• Zhang, C., J. Yu, and L. Ye. 2021. “Sparsity and Manifold Regularized Convolutional Auto-encoders-based Feature Learning for Fault Detection of Multivariate Processes.” Control Engineering Practice 111 (7): 104811.
   Web of Science ®Google Scholar
• Zheng, J., and C. Zhao. 2020. “Enhanced Canonical Variate Analysis with Slow Feature for Dynamic Process Status Analytics.” Journal of Process Control 95: 10–31.
   Web of Science ®Google Scholar
• Zhong, M., Y. Song, T. Xue, R. Yang, and W. Li. 2018. “Parity Space-Based Fault Detection by Minimum Error Minimax Probability Machine.” IFAC-PapersOnLine 51 (24): 1292–1297.
   Google Scholar
• Zhong, B., J. Wang, J. Zhou, and H. Wu. 2016. “Quality-related Statistical Process Monitoring Method Based on Global and Local Partial Least-Squares Projection.” Industrial & Engineering Chemistry Research 55 (6): 1609–1622.
   Web of Science ®Google Scholar
• Zhu, J., H. Shi, B. Song, S. Tan, and Y. Tao. 2020. “Deep Neural Network Based Recursive Feature Learning for Nonlinear Dynamic Process Monitoring.” The Canadian Journal of Chemical Engineering 98 (4): 919–933.
   Web of Science ®Google Scholar