Hybrid deep learning controller for nonlinear systems based on adaptive learning rates

References

• Aftab, M. S., Shafiq, M., & Yousef, H. (2015 March). Lyapunov stability criterion based neural inverse tracking for unknown dynamic plants. In 2015 IEEE international conference on industrial technology (ICIT) (pp. 321–325). IEEE.
   Google Scholar
• Akpan, V. A., & Hassapis, G. D. (2011). Nonlinear model identification and adaptive model predictive control using neural networks. ISA Transactions, 50(2), 177–194. https://doi.org/10.1016/j.isatra.2010.12.007
   PubMed Web of Science ®Google Scholar
• Almi'ani, M., Ghazleh, A. A., Al-Rahayfeh, A., & Razaque, A. (2018 April). Intelligent intrusion detection system using clustered self organized map. In 2018 fifth international conference on software defined systems (SDS) (pp. 138–144). IEEE.
   Google Scholar
• Alpaydin, E. (2021). Neural networks and deep learning. In Machine learning (pp. 389–411). MIT Press.
   Google Scholar
• Blundell, C., Cornebise, J., Kavukcuoglu, K., & Wierstra, D. (2015, June). Weight uncertainty in neural network. In International conference on machine learning (pp. 1613–1622). Proceedings of Machine Learning Research.
   Google Scholar
• Chakraverty, S., Sahoo, D. M., & Mahato, N. R. (2019). Concepts of soft computing: Fuzzy and ANN with programming. Springer Singapore.
   Google Scholar
• Chen, C., Zhu, S., & Wei, Y. (2019). Closed-loop control of nonlinear neural networks: The estimate of control time and energy cost. Neural Networks, 117, 145–151. https://doi.org/10.1016/j.neunet.2019.05.016
   PubMed Web of Science ®Google Scholar
• Chen, J., Zeng, G. Q., Zhou, W., Du, W., & Lu, K. D. (2018). Wind speed forecasting using nonlinear-learning ensemble of deep learning time series prediction and extremal optimization. Energy Conversion and Management, 165, 681–695. https://doi.org/10.1016/j.enconman.2018.03.098
   Web of Science ®Google Scholar
• da Silva Ribeiro, V. D. J., de Moraes Oliveira, G. F., Cristian, M., Martins, A. L., Fernandes, L. D., & Vega, M. P. (2019). Neural network based controllers for the oil well drilling process. Journal of Petroleum Science and Engineering, 176, 573–583. https://doi.org/10.1016/j.petrol.2019.01.078
   Web of Science ®Google Scholar
• Deepa, S. N., & Baranilingesan, I. (2018). Optimized deep learning neural network predictive controller for continuous stirred tank reactor. Computers & Electrical Engineering, 71, 782–797. https://doi.org/10.1016/j.compeleceng.2017.07.004
   Web of Science ®Google Scholar
• Detorakis, G., Bartley, T., & Neftci, E. (2019). Contrastive Hebbian learning with random feedback weights. Neural Networks, 114, 1–14. https://doi.org/10.1016/j.neunet.2019.01.008
   PubMed Web of Science ®Google Scholar
• El-Nagar, A. M. (2016). Embedded intelligent adaptive PI controller for an electromechanical system. ISA Transactions, 64, 314–327. https://doi.org/10.1016/j.isatra.2016.06.006
   PubMed Web of Science ®Google Scholar
• Feng, J., & Lu, S. (2019). Performance analysis of various activation functions in artificial neural networks. Journal of Physics: Conference Series, 1237(2), 022030. https://doi.org/10.1088/1742-6596/1237/2/022030
   Google Scholar
• Fourati, F., & Chtourou, M. (2007). A greenhouse control with feed-forward and recurrent neural networks. Simulation Modelling Practice and Theory, 15(8), 1016–1028. https://doi.org/10.1016/j.simpat.2007.06.001
   Web of Science ®Google Scholar
• Gerstner, W., & Kistler, W. M. (2002). Mathematical formulations of Hebbian learning. Biological Cybernetics, 87(5), 404–415. https://doi.org/10.1007/s00422-002-0353-y
   PubMed Web of Science ®Google Scholar
• Guo, X., Yan, W., & Cui, R. (2019). Neural network-based nonlinear sliding-mode control for an AUV without velocity measurements. International Journal of Control, 92(3), 677–692. https://doi.org/10.1080/00207179.2017.1366669
   Web of Science ®Google Scholar
• Hua, C., Yu, C., & Guan, X. (2014). Neural network observer-based networked control for a class of nonlinear systems. Neurocomputing, 133, 103–110. https://doi.org/10.1016/j.neucom.2013.11.026
   Web of Science ®Google Scholar
• Jin, X., Shao, J., Zhang, X., An, W., & Malekian, R. (2016). Modeling of nonlinear system based on deep learning framework. Nonlinear Dynamics, 84(3), 1327–1340. https://doi.org/10.1007/s11071-015-2571-6
   Web of Science ®Google Scholar
• Khalifa, T. R., El-Nagar, A. M., El-Brawany, M. A., El-Araby, E. A., & El-Bardini, M. (2020). A novel fuzzy Wiener-based nonlinear modelling for engineering applications. ISA Transactions, 97, 130–142. https://doi.org/10.1016/j.isatra.2019.07.017
   PubMed Web of Science ®Google Scholar
• Khater, A. A., El-Nagar, A. M., El-Bardini, M., & El-Rabaie, N. (2020a). A novel structure of actor-critic learning based on an interval type-2 TSK fuzzy neural network. IEEE Transactions on Fuzzy Systems, 28(11), 3047–3061. https://doi.org/10.1109/TFUZZ.2019.2949554
   Web of Science ®Google Scholar
• Khater, A. A., El-Nagar, A. M., El-Bardini, M., & El-Rabaie, N. M. (2018). Adaptive T–S fuzzy controller using reinforcement learning based on Lyapunov stability. Journal of the Franklin Institute, 355(14), 6390–6415. https://doi.org/10.1016/j.jfranklin.2018.06.031
   Web of Science ®Google Scholar
• Khater, A. A., El-Nagar, A. M., El-Bardini, M., & El-Rabaie, N. M. (2020b). Improving the performance of a class of adaptive fuzzy controller based on stable and fast on-line learning algorithm. European Journal of Control, 51, 39–52. https://doi.org/10.1016/j.ejcon.2019.07.001
   Web of Science ®Google Scholar
• Khater, A. A., El-Nagar, A. M., El-Bardini, M., & El-Rabaie, N. M. (2020c). Online learning based on adaptive learning rate for a class of recurrent fuzzy neural network. Neural Computing and Applications, 32(12), 8691–8710. https://doi.org/10.1007/s00521-019-04372-w
   Web of Science ®Google Scholar
• Kim, J. H., & Oh, S. J. (2000). A fuzzy PID controller for nonlinear and uncertain systems. Soft Computing, 4(2), 123–129. . https://doi.org/10.1007/s005000000039
   Google Scholar
• Kitani, E. C., Del-Moral-Hernandez, E., & Silva, L. A. (2012, September). SOMM–self-organized manifold mapping. In International conference on artificial neural networks (pp. 355–362). Springer.
   Google Scholar
• Kohonen, T. (1990). The self-organizing map. Proceedings of the IEEE, 78(9), 1464–1480. https://doi.org/10.1109/5.58325
   Web of Science ®Google Scholar
• Kumar, R., Srivastava, S., & Gupta, J. R. P. (2017). Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion. ISA Transactions, 67, 407–427. https://doi.org/10.1016/j.isatra.2017.01.022
   PubMed Web of Science ®Google Scholar
• Kumar, S. K. (2017). On weight initialization in deep neural networks. arXiv preprint arXiv:1704.08863.
   Google Scholar
• Li, X., Fu, X. M., Xiong, F. R., & Bai, X. M. (2020). Deep learning-based unsupervised representation clustering methodology for automatic nuclear reactor operating transient identification. Knowledge-Based Systems, 204, 106178. https://doi.org/10.1016/j.knosys.2020.106178
   Web of Science ®Google Scholar
• Lucia, S., & Karg, B. (2018). A deep learning-based approach to robust nonlinear model predictive control. IFAC-PapersOnLine, 51(20), 511–516. https://doi.org/10.1016/j.ifacol.2018.11.038
   Google Scholar
• Min, H.-F., & Duan, N. (2014). Neural network-based adaptive state-feedback control for high-order stochastic nonlinear systems. Acta Automatica Sinica, 40(12), 2968–2972. https://doi.org/10.1016/S1874-1029(15)60002-7
   Google Scholar
• Mohammadi, A., & Ryu, J. C. (2020). Neural network-based PID compensation for nonlinear systems: Ball-on-plate example. International Journal of Dynamics and Control, 8(1), 178–188. https://doi.org/10.1007/s40435-018-0480-5
   Google Scholar
• Murat, F., Yildirim, O., Talo, M., Baloglu, U. B., Demir, Y., & Acharya, U. R. (2020). Application of deep learning techniques for heartbeats detection using ECG signals-analysis and review. Computers in Biology and Medicine, 120, 103726. https://doi.org/10.1016/j.compbiomed.2020.103726
   PubMed Web of Science ®Google Scholar
• Nasr, M. B., & Chtourou, M. (2014). Neural network control of nonlinear dynamic systems using hybrid algorithm. Applied Soft Computing, 24, 423–431. https://doi.org/10.1016/j.asoc.2014.07.023
   Web of Science ®Google Scholar
• Nitisanon, S., & Hoonchareon, N. (2017, July). Solar power forecast with weather classification using self-organized map. In 2017 IEEE power & energy society general meeting (pp. 1–5). IEEE.
   Google Scholar
• Patan, K., Patan, M., & Kowalów, D. (2017). Neural networks in design of iterative learning control for nonlinear systems. IFAC-PapersOnLine, 50(1), 13402–13407. https://doi.org/10.1016/j.ifacol.2017.08.2277
   Google Scholar
• Pathak, Y., Shukla, P. K., Tiwari, A., Stalin, S., & Singh, S. (2020). Deep transfer learning based classification model for COVID-19 disease. IRBM, 1, 1–6. https://doi.org/10.1016/j.irbm.2020.05.003
   Google Scholar
• Qiao, J., Wang, G., Li, X., & Li, W. (2018). A self-organizing deep belief network for nonlinear system modeling. Applied Soft Computing, 65, 170–183. https://doi.org/10.1016/j.asoc.2018.01.019
   Web of Science ®Google Scholar
• Qiu, X., Zhang, L., Ren, Y., Suganthan, P. N., & Amaratunga, G. (2014, December). Ensemble deep learning for regression and time series forecasting. In 2014 IEEE symposium on computational intelligence in ensemble learning (CIEL) (pp. 1–6). IEEE.
   Google Scholar
• Rahmani, B., & Belkheiri, M. (2019). Adaptive neural network output feedback control for flexible multi-link robotic manipulators. International Journal of Control, 92(10), 2324–2338. https://doi.org/10.1080/00207179.2018.1436774
   Web of Science ®Google Scholar
• Sarabakha, A., & Kayacan, E. (2019). Online deep fuzzy learning for control of nonlinear systems using expert knowledge. IEEE Transactions on Fuzzy Systems, 28(7), 1492–1503. https://doi.org/10.1109/TFUZZ.2019.2936787
   Web of Science ®Google Scholar
• Shaheen, O., El-Nagar, A. M., El-Bardini, M., & El-Rabaie, N. M. (2020). Stable adaptive probabilistic Takagi–Sugeno–Kang fuzzy controller for dynamic systems with uncertainties. ISA Transactions, 98, 271–283. https://doi.org/10.1016/j.isatra.2019.08.035
   PubMed Web of Science ®Google Scholar
• Shakeel, P. M., Tobely, T. E. E., Al-Feel, H., Manogaran, G., & Baskar, S. (2019). Neural network based brain tumor detection using wireless infrared imaging sensor. IEEE Access, 7, 5577–5588. https://doi.org/10.1109/ACCESS.2018.2883957
   Web of Science ®Google Scholar
• Sutar, M. K., Pattnaik, S., & Rana, J. (2015). Neural based controller for smart detection of crack in cracked cantilever beam. Materials Today: Proceedings, 2(4-5), 2648–2653. https://doi.org/10.1016/j.matpr.2015.07.225
   Google Scholar
• Takahashi, K., Kurokawa, M., & Hashimoto, M. (2014). Multi-layer quantum neural network controller trained by real-coded genetic algorithm. Neurocomputing, 134, 159–164. https://doi.org/10.1016/j.neucom.2012.12.073
   Web of Science ®Google Scholar
• Tan, H. H., & Lim, K. H. (2019, June). Vanishing gradient mitigation with deep learning neural network optimization. In 2019 7th international conference on smart computing & communications (ICSCC) (pp. 1–4). IEEE.
   Google Scholar
• Tran, H. D., Guan, Z. H., Dang, X. K., Cheng, X. M., & Yuan, F. S. (2013). A normalized PID controller in networked control systems with varying time delays. ISA Transactions, 52(5), 592–599. https://doi.org/10.1016/j.isatra.2013.05.005
   PubMed Web of Science ®Google Scholar
• Xu, B., Yang, C., & Shi, Z. (2014). Reinforcement learning output feedback NN control using deterministic learning technique. IEEE Transactions on Neural Networks and Learning Systems, 25(3), 635–641. https://doi.org/10.1109/TNNLS.2013.2292704
   PubMed Web of Science ®Google Scholar
• Yu, W., & De la Rosa, E. (2019). Deep Boltzmann machine for nonlinear system modelling. International Journal of Machine Learning and Cybernetics, 10(7), 1705–1716. https://doi.org/10.1007/s13042-018-0847-0
   Web of Science ®Google Scholar
• Zhang, L., Dong, D., Zhang, W., Hao, X., Fang, M., Wang, S., Li, W., Liu, Z., Wang, R., Zhou, J., & Tian, J. (2020). A deep learning risk prediction model for overall survival in patients with gastric cancer: A multicenter study. Radiotherapy and Oncology, 150, 73–80. . https://doi.org/10.1016/j.radonc.2020.06.010
   PubMed Web of Science ®Google Scholar
• Zhang, Z. (2006, August). Adaptive controller based on wavelets neural network for a class of nonlinear systems. In International conference on intelligent computing (pp. 305–310). Springer.
   Google Scholar