A brief survey on nonlinear control using adaptive dynamic programming under engineering-oriented complexities

References

• Abu-Khalaf, M., Lewis, F. L., & Huang, J. (2006, December). Policy iterations on the Hamilton-Jacobi-Isaacs equation for H∞ state feedback control with input saturation. IEEE Transaction Automatic Control, 51(12), 1989–1995. https://doi.org/10.1109/TAC.2006.884959
   Web of Science ®Google Scholar
• Al-Tamimi, A., Abu-Khalaf, M., & Lewis, F. L. (2007, February). Adaptive critic designs for discrete-time zero-sum games with application to H∞ control. IEEE Transactions on System, Man, and Cybernetics: Cybernetics, 37(1), 240–247. https://doi.org/10.1109/TSMCB.2006.880135
   PubMed Web of Science ®Google Scholar
• Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2008, August). Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Transactions on System, Man, and Cybernetics: Cybernetics, 38(4), 943–949. https://doi.org/10.1109/TSMCB.2008.926614
   PubMed Web of Science ®Google Scholar
• Balakrishnan, S. N., & Biega, V. (1996, July). Adaptive-critic-based neural networks for aircraft optimal control. Journal of Guidance Control and Dynamics, 19(4), 893–898. https://doi.org/10.2514/3.21715
   Web of Science ®Google Scholar
• Bao, G., Ma, L., & Yi, X. (2022, December). Recent advances on cooperative control of heterogeneous multi-agent systems subject to constraints: A survey. Systems Science & Control Engineering, 10(1), 539–551. https://doi.org/10.1080/21642583.2022.2074169
   Web of Science ®Google Scholar
• Beard, R. W., & Saridis, G. N. (1998, March). Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation. Journal of Optimization Theory and Applications, 96(3), 589–626. https://doi.org/10.1023/A:1022664528457
   Web of Science ®Google Scholar
• Chen, H., Tian, E., & Wang, L. (2022, May). State-of-charge estimation of lithium-ion batteries subject to random sensor data unavailability: a recursive filtering approach. IEEE Transactions on Industrial Electronics, 69(5), 5175–5184. https://doi.org/10.1109/TIE.2021.3078376
   Web of Science ®Google Scholar
• Chen, L., Chen, Y., & Zhang, N. (2021, October). Synchronization control for chaotic neural networks with mixed delays under input saturations. Neural Process Letters, 53(5), 3735–3755. https://doi.org/10.1007/s11063-021-10577-9
   Web of Science ®Google Scholar
• Chen, N., Li, B., Luo, B., Gui, W., & Yang, C. (2021). Event-triggered optimal control for temperature field of roller kiln based on adaptive dynamic programming. IEEE Transactions on Cybernetics, 53(5), 2805–2817. https://doi.org/10.1109/TCYB.2021.3121409
   Web of Science ®Google Scholar
• Chen, Y., Fu, Z., Fei, S., & Song, S. (2020, May). Delayed anti-windup strategy for input-delay systems with actuator saturations. Journal of the Franklin Institute, 357(8), 4680–4696. https://doi.org/10.1016/j.jfranklin.2020.02.008
   Web of Science ®Google Scholar
• Chen, Y., & Wang, Z. (2021, March). Local stabilization for discrete-time systems with distributed state delay and fast-varying input delay under actuator saturations. IEEE Transactions on Automatic Control, 66(3), 1337–1344. https://doi.org/10.1109/TAC.9
   Web of Science ®Google Scholar
• Cheng, P., Liu, S., Chen, B., & Yu, L. (2022, May). Multi-agent reinforcement learning for decentralized resilient secondary control of energy storage systems against doS attacks. IEEE Transactions on Smart Grid, 13(3), 1739–1750. https://doi.org/10.1109/TSG.2022.3142087
   Web of Science ®Google Scholar
• Cheng, T., Lewis, F. L., & Abu-Khalaf, M. (2007, March). A neural network solution for fixed final time optimal control of nonlinear systems. Automatica, 43(3), 482–490. https://doi.org/10.1016/j.automatica.2006.09.021
   Web of Science ®Google Scholar
• Cui, Y., Liu, Y., Zhang, W., & Alsaadi, F. E. (2021, January). Sampled-based consensus for nonlinear multiagent systems with deception attacks: the decoupled method. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51(1), 561–573. https://doi.org/10.1109/TSMC.6221021
   Web of Science ®Google Scholar
• Cui, Y., Yu, L., Liu, Y., Zhang, W., & Alsaadi, F. E. (2021, December). Dynamic event-based non-fragile state estimation for complex networks via partial nodes information. Journal of the Franklin Institute, 358(18), 10193–10212. https://doi.org/10.1016/j.jfranklin.2021.10.038
   Web of Science ®Google Scholar
• Deb, A. K., Jayadeva, K., Gopal, M., & Chandra, S. (2007, July). SVM-based tree-type neural networks as a critic in adaptive critic designs for control. IEEE Transactions on Neural Networks, 18(4), 1016–1030. https://doi.org/10.1109/TNN.2007.899255
   PubMed Web of Science ®Google Scholar
• Deng, Y., Gong, M., & Ni, T. (2022). Double-channel event-triggered adaptive optimal control of active suspension systems. Nonlinear Dynamics, 108, 3435–3448. https://doi.org/10.1007/s11071-022-07360-3
   Web of Science ®Google Scholar
• Ding, D., Wang, Z., & Han, Q. (2019, August). Neural-network-based output-feedback control with stochastic communication protocols. Automatica, 106, 221–229. https://doi.org/10.1016/j.automatica.2019.04.025
   Web of Science ®Google Scholar
• Ding, D., Wang, Z., & Han, Q.-L. (2020, August). Neural-network-based consensus control for multiagent systems with input constraints: the event-triggered case. IEEE Transactions on Cybernetics, 50(8), 3719–3730. https://doi.org/10.1109/TCYB.6221036
   PubMed Web of Science ®Google Scholar
• Ding, D., Wang, Z., Han, Q.-L., & Wei, G. (2019, June). Neural-network-based output-feedback control under Round-Robin scheduling protocols. IEEE Transactions on Cybernetics, 59(6), 2372–2384. https://doi.org/10.1109/TCYB.2018.2827037
   Web of Science ®Google Scholar
• Dong, D., Chen, C., Tarn, T. J., Pechen, A., & Rabitz, H. (2008, August). Incoherent control of quantum systems with wavefunction-controllable subspaces via quantum reinforcement learning. IEEE Transactions on System, Man, and Cybernetics: Cybernetics, 38(4), 957–962. https://doi.org/10.1109/TSMCB.2008.926603
   PubMed Web of Science ®Google Scholar
• Dong, Y., Song, Y., & Wei, G. (2022, January). Efficient model-predictive control for nonlinear systems in interval type-2 T-S fuzzy form under round-robin protocol. IEEE Transactions on Fuzzy Systems, 30(1), 63–74. https://doi.org/10.1109/TFUZZ.2020.3031394
   Web of Science ®Google Scholar
• Enns, R., & Si, J. (2003, July). Helicopter trimming and tracking control using direct neural dynamic programming. IEEE Transactions on Neural Networks, 14(4), 929–939. https://doi.org/10.1109/TNN.2003.813839
   PubMed Web of Science ®Google Scholar
• Ferrari, S., Steck, J. E., & Chandramohan, R. (2008, August). Adaptive feedback control by constrained approximate dynamic programming. IEEE Transactions on System, Man, and Cybernetics: Cybernetics, 38(4), 982–987. https://doi.org/10.1109/TSMCB.2008.924140
   PubMed Web of Science ®Google Scholar
• Gao, C., Wang, Z., He, X., & Yue, D. (2021, November). Sampled-data-based fault-tolerant consensus control for multi-agent systems: A data privacy preserving scheme. Automatica, 133, 109847. https://doi.org/10.1016/j.auto-matica.2021.109847
   Web of Science ®Google Scholar
• Gao, H., Dong, H., Wang, Z., & Han, F. (2022). Recursive minimum-variance filter design for state-saturated complex networks with uncertain coupling strengths subject to deception attacks. IEEE Transactions on Cybernetics, 52(10), 11121–11132. https://doi.org/10.1109/TCYB.2021.3067822
   PubMed Web of Science ®Google Scholar
• Gu, Z., Shi, P., Yue, D., & Ding, Z. (2018). Decentralized adaptive event-triggered H∞ filtering for a class of networked nonlinear interconnected systems. IEEE Transactions on Cybernetics, 49(5), 1570–1579. https://doi.org/10.1109/TCYB.6221036
   PubMed Web of Science ®Google Scholar
• Han, F., Wang, Z., Dong, H., & Liu, H. (2021). Partial-nodes-based scalable H∞-consensus filtering with censored measurements over sensor networks. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51(3), 1892–1903. http://doi.org/10.1109/TSMC.2019.2907649.
   Web of Science ®Google Scholar
• Han, X., Qi, H., Wang, Z., Xu, N., Zhao, X., & Zhao, J. (2021, July). An event-triggered integer-mixed adaptive dynamic programming for switched nonlinear systems with bounded inputs. International Journal of Robust and Nonlinear Control, 31(15), 7280–7297. https://doi.org/10.1002/rnc.v31.15
   Web of Science ®Google Scholar
• Havira, R., & Lewis, J. (1972). Computation of quantized controls using differential dynamic programming. IEEE Transactions Automatatic Control, 17(2), 191–196. https://doi.org/10.1109/TAC.1972.1099943
   Web of Science ®Google Scholar
• He, P., & Jagannathan, S. (2005, February). Reinforcement learning-based output feedback control of nonlinear systems with input constraints. IEEE Transactions on System, Man, and Cybernetics: Cybernetics, 35(1), 150–154. https://doi.org/10.1109/TSMCB.2004.840124
   PubMed Web of Science ®Google Scholar
• He, W., Mo, Z., Han, Q.-L., & Qian, F. (2020, September). Secure impulsive synchronization in lipschitz-type multi-agent systems subject to deception attacks. IEEE/CAA Journal of Automatica Sinica, 7(5), 1326–1334. https://doi.org/10.1109/JAS.2020.1003297.
   Google Scholar
• Hou, N., Li, J., Liu, H., Ge, Y., & Dong, H. (2022). Finite-horizon resilient state estimation for complex networks with integral measurements from partial nodes. Science China-Information Sciences, 65, 132205. https://doi.org/10.1007/s11432-020-3243-7
   Web of Science ®Google Scholar
• Hu, C., Zhao, L., & Qu, G. (2021). Event-triggered model predictive adaptive dynamic programming for road intersection path planning of unmanned ground vehicle. IEEE Transactions on Vehicular Technology, 70(11), 11228–11243. https://doi.org/10.1109/TVT.2021.3111692
   Web of Science ®Google Scholar
• Huang, X., & Dong, G. (2021, December). ADP-based robust resilient control of partially unknown nonlinear systems via cooperative interaction design. IEEE Transactions on Systems Man Cybernetics: Systems, 51(12), 7466–7474. https://doi.org/10.1109/TSMC.2020.2970040
   Web of Science ®Google Scholar
• Jiang, B., Dong, H., Shen, Y., & Mu, S. (2022, June). Encoding-decoding-based recursive filtering for fractional-order systems. IEEE/CAA Journal of Automatica Sinica, 9(6), 1103–1106. https://doi.org/10.1109/JAS.2022.105644
   Google Scholar
• Jiang, B., Gao, H., Han, F., & Dong, H. (2021). Recursive filtering for nonlinear systems subject to measurement outliers. Science China-Information Sciences, 64, 172206. https://doi.org/10.1007/s11432-020-3135-y
   Web of Science ®Google Scholar
• Khankalantary, S., Izadi, I., & Sheikholeslam, F. (2020, December). Robust ADP-based solution of a class of nonlinear multi-agent systems with input saturation and collision avoidance constraints. ISA Transactions, 107, 52–62. https://doi.org/10.1016/j.isatra.2020.07.029
   PubMed Web of Science ®Google Scholar
• Kim, Y. J., & Lim, M. T. (2008, July). Parallel optimal control for weakly coupled nonlinear systems using successive Galerkin approximation. IEEE Transactions on Automatic Control, 53(6), 1542–1547. https://doi.org/10.1109/TAC.2008.921047
   Web of Science ®Google Scholar
• Lewis, F. L., & Vrabie, D. (2009). Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Circuits and Systems Magazine, 9(3), 40–58. https://doi.org/10.1109/MCAS.7384
   Web of Science ®Google Scholar
• Li, J., Dong, H., Shen, Y., & Hou, N. (2022, August). Encoding-decoding strategy based resilient state estimation for bias-corrupted stochastic nonlinear systems. ISA Transactions, 127, 80–87. https://doi.org/10.1016/j.isatra.2022.04.048
   PubMed Web of Science ®Google Scholar
• Li, J., Tian, X., & Wei, G. (2022, November). Protocol-based control for nonlinear systems with environment-dependent energy harvesting sensors: an average dwell-time method. Nonlinear Analysis: Hybrid Systems, 46, 101241. https://doi.org/10.1016/j.nahs.2022.101241.
   Web of Science ®Google Scholar
• Li, Z., Hu, J., & Li, J. (2021, January). Distributed filtering for delayed nonlinear system with random sensor saturation: A dynamic event-triggered approach. Systems Science & Control Engineering, 9(1), 440–454. https://doi.org/10.1080/21642583.2021.1919935
   Web of Science ®Google Scholar
• Lian, B., Xue, W., Lewis, F. L., & Chai, T. (2021, September). Online inverse reinforcement learning for nonlinear systems with adversarial attacks. International Journal of Robust and Nonlinear Control, 31(14), 6646–6667. https://doi.org/10.1002/rnc.v31.14
   Web of Science ®Google Scholar
• Liang, M., Wang, D., & Liu, D. (2020, November). Neuro-optimal control for discrete stochastic processes via a novel policy iteration algorithm. IEEE Transactions on System, Man, and Cybernetics: Systems, 50(11), 3972–3985. https://doi.org/10.1109/TSMC.6221021
   Web of Science ®Google Scholar
• Liu, D., Zhang, Y., & Zhang, H. (2005, September). A self-learning call admission control scheme for CDMA cellular networks. IEEE Transactions on Neural Networks, 16(5), 1219–1228. https://doi.org/10.1109/TNN.2005.853408
   PubMed Web of Science ®Google Scholar
• Liu, F., Jiang, C., & Xiao, W. (2021, April). Multistep prediction-based adaptive dynamic programming sensor scheduling approach for collaborative target tracking in energy harvesting wireless sensor networks. IEEE Transactions on Automation Science and Engineering, 18(2), 693–704. https://doi.org/10.1109/TASE.2020.3019567
   Web of Science ®Google Scholar
• Liu, H., Wang, Z., Fei, W., & Li, J. (2022, May). Resilient H∞ state estimation for discrete-time stochastic delayed memristive neural networks: a dynamic event-triggered mechanism. IEEE Transactions on Cybernetics, 52(5), 3333–3341. https://doi.org/10.1109/TCYB.2020.3021556
   PubMed Web of Science ®Google Scholar
• Liu, P., Zhang, H., Ren, H., & Liu, C. (2021, October). Online event-triggered adaptive critic design for multi-player zero-sum games of partially unknown nonlinear systems with input constraints. Neurocomputing, 462, 309–319. https://doi.org/10.1016/j.neucom.2021.07.058
   Web of Science ®Google Scholar
• Liu, S., Wang, Z., Wang, L., & Wei, G. (2022, August). H∞ pinning control of complex dynamical networks under dynamic quantization effects: a coupled backward Riccati equation approach. IEEE Transactions on Cybernetics, 52(8), 7377–7387. https://doi.org/10.1109/TCYB.2020.3021982
   PubMed Web of Science ®Google Scholar
• Liu, S., Zhao, X., Tian, E., & Wei, G. (2022, August). Distributed recursive filtering under random access protocols: a multirate strategy. International Journal of Robust and Nonlinear Control, 32(12), 7132–7148. https://doi.org/10.1002/rnc.v32.12
   Web of Science ®Google Scholar
• Liu, Y., Shen, B., & Sun, J. (2022, November). Stubborn state estimation for complex-valued neural networks with mixed time delays: the discrete time case. Neural Computing and Applications, 34(7), 5449–5464. https://doi.org/10.1007/s00521-021-06707-y
   Web of Science ®Google Scholar
• Liu, Y., Shen, B., & Zhang, P. (2022, June). Synchronization and state estimation for discrete-time coupled delayed complex-valued neural networks with random system parameters. Neural Networks, 150, 181–193. https://doi.org/10.1016/j.neunet.2022.02.028
   PubMed Web of Science ®Google Scholar
• Ma, L., Wang, Z., Cai, C., & Alsaadi, F. E. (2021, November). A dynamic event-triggered approach to H∞ control for discrete-time singularly perturbed systems with time-delays and sensor saturations. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51(11), 6614–6625. https://doi.org/10.1109/TSMC.2019.2958529
   Web of Science ®Google Scholar
• Ma, L., Wang, Z., Hu, J., & Han, Q.-L. (2021, July). Probability-guaranteed envelope-constrained filtering for nonlinear systems subject to measurement outliers. IEEE Transactions on Automatic Control, 66(7), 3274–3281. https://doi.org/10.1109/TAC.2020.3016767
   Web of Science ®Google Scholar
• Ma, L., Wang, Z., Liu, H., & Alsaadi, F. E. (2022, June). Neural-network-based filtering for a general class of nonlinear systems under dynamically bounded innovations over sensor networks. IEEE Transactions on Network Science and Engineering, 9(3), 1395–1408. https://doi.org/10.1109/TNSE.2022.3144484
   Web of Science ®Google Scholar
• Ming, Z., Zhang, H., Luo, Y., & Wang, W. (2022). Dynamic event-based control for stochastic optimal regulation of nonlinear networked control systems. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2022.3140478
   PubMed Web of Science ®Google Scholar
• Mishra, A., & Ghosh, S. (2022). Simultaneous identification and optimal tracking control of unknown continuous-time systems with actuator constraints. International Journal of Control, 95(8), 2005–2023. https://doi.org/10.1080/00207179.2021.1890824
   Web of Science ®Google Scholar
• Mohahegi, S., Venayagamoorth, G. K., & Harley, R. H. (2006, November). Adaptive critic design based neuro-fuzzy controller for a static compensator in a multimachine power system. IEEE Transactions on Power Systems, 21(4), 1744–1754. https://doi.org/10.1109/TPWRS.2006.882467
   Web of Science ®Google Scholar
• Mu, C., Wang, K., & Ni, Z.. Adaptive learning and sampled-control for nonlinear game systems using dynamic event-triggering strategy. IEEE Transactions on Neural Networks and Learning Systems, 33(9), 4437–4450. https://doi.org/10.1109/TNNLS.2021.3057438
   PubMed Web of Science ®Google Scholar
• Ni, Z., He, H., Zhong, X., & Prokhorov, D. V. (2015, August). Model-free dual heuristic dynamic programming. IEEE Transactions on Neural Networks and Learning Systems, 26(8), 1834–1839. https://doi.org/10.1109/TNNLS.2015.2424971
   PubMed Web of Science ®Google Scholar
• Ning, B., Han, Q.-L., & Ding, L. (2021, August). Distributed finite-time secondary frequency and voltage control for islanded microgrids with communication delays and switching topologies. IEEE Transactions on Cybernetics, 51(8), 3988–3999. https://doi.org/10.1109/TCYB.2020.3003690
   PubMed Web of Science ®Google Scholar
• Niu, H., Bhowmick, C., & Jagannathan, S. (2020, January). Attack detection and approximation in nonlinear networked control systems using neural networks. IEEE Transactions on Neural Networks and Learning Systems, 31(1), 235–245. https://doi.org/10.1109/TNNLS.5962385
   PubMed Web of Science ®Google Scholar
• Padhi, R., Unnikrishnan, N., Wang, X., & Balakrishnan, S. N. (2006, December). A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems. Neural Networks, 19(10), 1648–1660. https://doi.org/10.1016/j.neunet.2006.08.010
   PubMed Web of Science ®Google Scholar
• Pang, K., Ma, L., Bai, H., & Xue, S. (2021). Finite-time containment control for nonlinear second-order multiagent system under directed topology. IEEE Systems Journal, 16(4), 6175–6184. https://doi.org/10.1109/JSYST.2021.3130611
   Web of Science ®Google Scholar
• Pinto, E. R., Nepomuceno, E. G., & Campanharo, A. S. L. O. (2022, December). Individual-based modelling of animal brucellosis spread with the use of complex networks. International Journal of Network Dynamics and Intelligence, 1(1), 120–129. https://doi.org/10.53941/ijndi0101011
   Google Scholar
• Prokhorov, D. V., Santiago, R., & Wunsch, D. C. (1995). Adaptive critic designs: a case study for neurocontrol. Neural Networks, 8(9), 1367–1372. https://doi.org/10.1016/0893-6080(95)00042-9
   Web of Science ®Google Scholar
• Qian, W., Gao, Y., & Yang, Y. (2019, October). Global consensus of multiagent systems with internal delays and communication delays. IEEE Transactions on Systems,Man,and Cybernetics: Systems, 49(10), 1961–1970. https://doi.org/10.1109/TSMC.6221021
   Web of Science ®Google Scholar
• Qian, W., Li, Y., Zhao, Y., & Chen, Y. (2020, November). New optimal method for L2- L∞ state estimation of delayed neural networks. IEEE Transactions on Neural Networks and Learning Systems, 415, 258–265. https://doi.org/10.1016/j.neucom.2020.06.118.
   Web of Science ®Google Scholar
• Qian, W., Xing, W., & Fei, S. (2021, September). H∞ state estimation for neural networks with general activation function and mixed time-varying delays. IEEE Transactions on Neural Networks and Learning Systems, 32(9), 3909–3918. https://doi.org/10.1109/TNNLS.2020.3016120
   PubMed Web of Science ®Google Scholar
• Qu, B., Wang, Z., Shen, B., & Dong, H. (2021). Distributed state estimation for renewable energy microgrids with sensor saturations. Automatica, 131, 109730. https://doi.org/10.1016/j.automatica.2021.109730
   Web of Science ®Google Scholar
• Ren, H., Zhang, H., Mu, Y., & Duan, J. (2020, February). Off-policy synchronous iteration IRL method for multi-player zero-sum games with input constraints. Neurocomputing, 378, 413–421. https://doi.org/10.1016/j.neucom.2019.10.075
   Web of Science ®Google Scholar
• Rizvi, S. A. A., & Lin, Z. (2022, February). Adaptive dynamic programming for model-free global stabilization of control constrained continuous-time systems. IEEE Transactions on Cybernetics, 52(2), 1048–1060. https://doi.org/10.1109/TCYB.2020.2989419
   PubMed Web of Science ®Google Scholar
• Shen, B., Wang, Z., Tan, H., & Chen, H. (2021). Robust fusion filtering over multisensor systems with energy harvesting constraints. Automatica, 131, 109782. https://doi.org/10.1016/j.automatica.2021.109782
   Web of Science ®Google Scholar
• Shen, Y., Wang, Z., Shen, B., & Han, Q.-L. (2022). Recursive state estimation for networked multi-rate multi-sensor systems with distributed time-delays under the Round-Robin protocol. IEEE Transactions on Cybernetics, 52(6), 4136–4146. https://doi.org/10.1109/TCYB.2020.3021350
   PubMed Web of Science ®Google Scholar
• Shervais, S., Shannon, T. T., & Lendaris, G. G. (2003, March). Intelligent supply chain management using adaptive critic learning. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 33(2), 235–244. https://doi.org/10.1109/TSMCA.2003.809214
   Web of Science ®Google Scholar
• Shi, H., Wang, M., & Wang, C. (2022, September). Model-based event-triggered neural learning control for discrete-time strict-feedback systems. International Journal of Robust and Nonlinear Control, 32(13), 7611–7630. https://doi.org/10.1002/rnc.v32.13
   Web of Science ®Google Scholar
• Shi, J., Yue, D., & Xie, X. (2020, July). Adaptive optimal tracking control for nonlinear continuous-time systems with time delay using value iteration algorithm. Neurocomputing, 396, 172–178. https://doi.org/10.1016/j.neucom.2018.07.098
   Web of Science ®Google Scholar
• Song, B., Miao, H., & Xu, L. (2021, January). Path planning for coal mine robot via improved ant colony optimization algorithm. Systems Science & Control Engineering, 9(1), 283–289. https://doi.org/10.1080/21642583.2021.1901158
   Web of Science ®Google Scholar
• Song, R., & Liu, L. (2020, September). Event-triggered constrained robust control for partly-unknown nonlinear systems via ADP. Neurocomputing, 404, 294–303. https://doi.org/10.1016/j.neucom.2020.05.012
   Web of Science ®Google Scholar
• Song, R., Xiao, W., & Wei, Q. (2013, November). Multi-objective optimal control for a class of nonlinear time-delay systems via adaptive dynamic programming. Soft Computing, 17(11), 2109–2115. https://doi.org/10.1007/s00500-013-1111-x
   Web of Science ®Google Scholar
• Su, H., Zhang, H., Jiang, H., & Wen, Y. (2020, October). Decentralized event-triggered adaptive control of discrete-time nonzero-sum games over wireless sensor-actuator networks with input constraints. IEEE Transactions on Neural Networks and Learning Systems, 31(10), 4254–4266. https://doi.org/10.1109/TNNLS.5962385
   PubMed Web of Science ®Google Scholar
• Sun, B., & van Kampen, E.-J. (2021, May). Intelligent adaptive optimal control using incremental model-based global dual heuristic programming subject to partial observability. Applied Soft Computing, 103, 107153. https://doi.org/10.1016/j.asoc.2021.107153.
   Web of Science ®Google Scholar
• Sun, J., Shen, B., & Liu, Y. (2022). A resilient outlier-resistant recursive filtering approach to time-delayed spatial–temporal systems with energy harvesting sensors. ISA Transactions, 127, 41–49. https://doi.org/10.1016/j.isatra.2021.12.040
   PubMed Web of Science ®Google Scholar
• Tan, H., Shen, B., & Li, Q. (2022, March). Fusion estimation for stochastic uncertain systems with time-correlated Rician fading channels. Journal of the Franklin Institute, 359(5), 2340–2358. https://doi.org/10.1016/j.jfranklin.2022.01.033
   Web of Science ®Google Scholar
• Tan, L. N. (2018, July). Distributed optimal control for nonholonomic systems with input constraints and uncertain interconnections. Nonlinear Dynamics, 93(2), 801–817. https://doi.org/10.1007/s11071-018-4228-8
   Web of Science ®Google Scholar
• Tao, H., Tan, H., Chen, Q., Liu, H., & Hu, J. (2022, December). H∞ state estimation for memristive neural networks with randomly occurring doS attacks. Systems Science & Control Engineering, 10(1), 154–165. https://doi.org/10.1080/21642583.2022.2048322
   Web of Science ®Google Scholar
• Tesauro, G. (1992, May). Practical issues in temporal difference learning. Machine Learning, 8(3-4), 257–277. https://doi.org/10.1007/BF00992697
   Web of Science ®Google Scholar
• Tian, E., Yue, D., & Peng, C. (2010). Reliable control for networked control systems with probabilistic actuator fault and random delays. Journal of the Franklin Institute, 347(10), 1907–1926. https://doi.org/10.1016/j.jfranklin.2010.10.010
   Web of Science ®Google Scholar
• Vamvodakis, K. G., & Lewis, F. L. (2010, May). Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica, 46(5), 878–888. https://doi.org/10.1016/j.automatica.2010.02.018
   Web of Science ®Google Scholar
• Wang, D., Hu, L., Zhao, M., & Qiao, J. (2021). Adaptive critic for event-triggered unknown nonlinear optimal tracking design with wastewater treatment applications. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2021.3135405.
   Web of Science ®Google Scholar
• Wang, F.-Y., Zhang, H., & Liu, D. (2009). Adaptive dynamic programming: an introduction. IEEE Computational Intelligence Magazine, 4(2), 39–47. https://doi.org/10.1109/MCI.2009.932261
   Web of Science ®Google Scholar
• Wang, L., Tian, E., Wang, C., & Liu, S. (2022, July). Secure estimation against malicious attacks for lithium-ion batteries under cloud environments. IEEE Transactions on Circuits and Systems I: Regular Papers, 52(6), 4136–4146. https://doi.org/10.1109/TCSI.2022.3187725.
   Web of Science ®Google Scholar
• Wang, M., & Wang, L. (2022, April). Finite-time performance guaranteed event-triggered adaptive control for nonlinear systems with unknown control direction. Journal of the Franklin Institute, 359(6), 2463–2486. https://doi.org/10.1016/j.jfranklin.2022.02.003
   Web of Science ®Google Scholar
• Wang, M., Zou, Y., & Yang, C. (2022, March). System transformation-based neural control for full-state-constrained pure-feedback systems via disturbance observer. IEEE Transactions on Cybernetics, 52(3), 1479–1489. https://doi.org/10.1109/TCYB.2020.2988897
   PubMed Web of Science ®Google Scholar
• Wang, X., Ding, D., Dong, H., & Yi, X. (2022a). PI-based security control against joint sensor and controller attacks and applications in load frequency control. IEEE Transactions on System, Man, and Cybernetics: Systems, 53(2), 970–980. https://doi.org/10.1109/TSMC.2022.3190005
   Web of Science ®Google Scholar
• Wang, X., Ding, D., Dong, H., & Yi, X. (2022b). Supplementary control for quantized discrete-time nonlinear systems under goal representation heuristic dynamic programming. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2022.3201521.
   Web of Science ®Google Scholar
• Wang, X., Ding, D., Dong, H., & Zhang, X.-M. (2021, April). Neural-network-based control for discrete-time nonlinear systems with input saturation under stochastic communication protocol. IEEE/CAA Journal of Automatica Sinica, 8(4), 766–778. https://doi.org/10.1109/JAS.6570654
   Google Scholar
• Wang, X., Ding, D., Ge, X., & Han, Q.-L. (2022, March). Neural-network-based control for discrete-time nonlinear systems with denial-of-service attack: the adaptive event-triggered case. International Journal of Robust and Nonlinear Control, 32(5), 2760–2779. https://doi.org/10.1002/rnc.v32.5
   Web of Science ®Google Scholar
• Wang, X., Sun, Y., & Ding, D. (2022, December). Adaptive dynamic programming for networked control systems under communication constraints: a survey of trends and techniques. International Journal of Network Dynamics and Intelligence, 1(1), 85–98. https://doi.org/10.53941/ijndi0101008
   Google Scholar
• Wei, Q., Lu, J., Zhou, T., Cheng, X., & Wang, F.-Y. (2022, June). Event-triggered near-optimal control of discrete-time constrained nonlinear systems with application to a boiler-turbine system. IEEE Transactions on Industrial Informatics, 18(6), 3926–3935. https://doi.org/10.1109/TII.2021.3116084
   Web of Science ®Google Scholar
• Wei, Q., Wang, D., & Zhang, D. (2013, December). Dual iterative adaptive dynamic programming for a class of discrete-time nonlinear systems with time-delays. Neural Computing and Applications, 23(7-8), 1851–1863. https://doi.org/10.1007/s00521-012-1188-7
   Web of Science ®Google Scholar
• Wu, X., & Wang, C. (2021, May). Event-driven adaptive near-optimal tracking control of the robot in aircraft skin inspection. International Journal of Robust and Nonlinear Control, 31(7), 2593–2613. https://doi.org/10.1002/rnc.v31.7
   Web of Science ®Google Scholar
• Xiao, S., Ge, X., Han, Q.-L., & Zhang, Y. (2021). Secure distributed adaptive platooning control of automated vehicles over vehicular Ad-Hoc networks under denial-of-service attacks. IEEE Transactions on Cybernetics, 52(11), 12003–12015. https://doi.org/10.1109/TCYB.2021.3074318
   Web of Science ®Google Scholar
• Xie, X., Zhou, Q., Yue, D., & Li, H. (2017). Relaxed control design of discrete-time Takagi-Sugeno fuzzy systems: an event-triggered real-time scheduling approach. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 48(12), 2251–2262. https://doi.org/10.1109/TSMC.2017.2737542
   Web of Science ®Google Scholar
• Xu, D., Wang, Q., & Li, Y. (2020, May). Optimal guaranteed cost tracking of uncertain nonlinear systems using adaptive dynamic programming with concurrent learning. International Journal of Control, Automation and Systems, 18(5), 1116–1127. https://doi.org/10.1007/s12555-019-0165-7
   Web of Science ®Google Scholar
• Xu, H., Jagannathan, S., & Lewis, F. L. (2014, September). Stochastic optimal design for unknown linear discrete-time system zero-sum games in input-output form under communication constraints. Asian Journal of Control, 16(5), 1263–1276. https://doi.org/10.1002/asjc.v16.5
   Web of Science ®Google Scholar
• Xu, H., Zhao, Q., & Jagannathan, S. (2015, August). Finite-horizon near-optimal output feedback neural network control of quantized nonlinear discrete-time systems with input constraint. IEEE Transactions on Neural Networks and Learning Systems, 26(8), 1776–1788. https://doi.org/10.1109/TNNLS.2015.2409301
   PubMed Web of Science ®Google Scholar
• Xu, J., Sheng, L., & Gao, M. (2021, May). Fault estimation for nonlinear systems with sensor gain degradation and stochastic protocol based on strong tracking filtering. Systems Science & Control Engineering, 9(S2), 60–70. https://doi.org/10.1080/21642583.2020.1833789
   Web of Science ®Google Scholar
• Xu, J., Wang, J., Rao, J., Zhong, Y., & Wang, H. (2022, April). Adaptive dynamic programming for optimal control of discrete-time nonlinear system with state constraints based on control barrier function. International Journal of Robust and Nonlinear Control, 32(6), 3408–3424. https://doi.org/10.1002/rnc.v32.6
   Web of Science ®Google Scholar
• Xu, Y., Lv, W., Lin, W., Lu, R., & Quevedo, D. E. (2022). On extended state estimation for nonlinear uncertain systems with round-robin protocol. Automatica, 138, 110154. https://doi.org/10.1016/j.automatica.2021.110154
   Web of Science ®Google Scholar
• Xu, Y., Yao, Z., Lu, R., & Ghosh, B. K. (2022). A novel fixed-time protocol for first-order consensus tracking with disturbance rejection. IEEE Transactions on Automatic Control, 67(11), 6180–6186. https://doi.org/10.1109/TAC.2021.3131549
   Web of Science ®Google Scholar
• Xue, S., Luo, B., Liu, D., & Yang, Y. (2022, January). Constrained event-triggered H∞ control based on adaptive dynamic programming with concurrent learning. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 52(1), 357–369. https://doi.org/10.1109/TSMC.2020.2997559
   Web of Science ®Google Scholar
• Yadav, V., Padhi, R., & Balakrishnan, S. N. (2007, July). Robust/optimal temperature profile control of a high-speed aerospace vehicle using neural networks. IEEE Transactions on Neural Networks, 18(4), 1115–1128. https://doi.org/10.1109/TNN.2007.899229
   PubMed Web of Science ®Google Scholar
• Yang, H., Li, Y., Yuan, H., & Liu, Z. (2018, September). Adaptive dynamic programming for security of networked control systems with actuator saturation. Information Sciences, 460, 51–64. https://doi.org/10.1016/j.ins.2018.05.039
   Web of Science ®Google Scholar
• Yang, X., & Wei, Q. (2021, January). Adaptive critic learning for constrained optimal event-triggered control with discounted cost. IEEE Transactions on Neural Networks and Learning Systems, 32(1), 91–104. https://doi.org/10.1109/TNNLS.5962385
   PubMed Web of Science ®Google Scholar
• Yang, X., Zhou, Y., Dong, N., & Wei, Q. (2021). Adaptive critics for decentralized stabilization of constrained-input nonlinear interconnected systems. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 52(7), 4187–4199. https://doi.org/10.1109/TSMC.2021.3089944
   Web of Science ®Google Scholar
• Yao, M., Wei, G., Ding, D., & Li, W. (2022, September). Output-feedback control for stochastic impulsive systems under Round-Robin protocol. Automatica, 143, 110394. https://doi.org/10.1016/j.automatica.2022.110394
   Web of Science ®Google Scholar
• Yuan, Y., Wang, Z., Yu, Y., Guo, L., & Yang, H. (2019). Active disturbance rejection control for a pneumatic motion platform subject to actuator saturation: an extended state observer approach. Automatica, 107, 353–361. https://doi.org/10.1016/j.automatica.2019.05.056
   Web of Science ®Google Scholar
• Yuan, Y., Yuan, H., Ho, D. W. C., & Guo, L. (2020, January). Resilient control of wireless networked control system under denial-of-service attacks: A cross-layer design approach. IEEE Transactions on Cybernetics, 50(1), 48–60. https://doi.org/10.1109/TCYB.6221036
   PubMed Web of Science ®Google Scholar
• Zhang, B., & Song, Y. (2022, September). Model-predictive control for Markovian jump systems under asynchronous scenario: an optimizing prediction dynamics approach. Transactions on Automatic Control, 67(9), 4900–4907. https://doi.org/10.1109/TAC.2022.3164832
   Web of Science ®Google Scholar
• Zhang, B., Song, Y., & Cai, H. (2022, May). An efficient model predictive control for Markovian jump systems with all unstable modes. Nonlinear Analysis: Hybrid Systems, 44, 101117. https://doi.org/10.1016/j.nahs.2021.101117
   Web of Science ®Google Scholar
• Zhang, H., Song, R., Wei, Q., & Zhang, T. (2011, December). Optimal tracking control for a class of nonlinear discrete-time systems with time delays based on heuristic dynamic programming. IEEE Transactions on Neural Networks, 22(12), 1851–1862. https://doi.org/10.1109/TNN.2011.2172628
   PubMed Web of Science ®Google Scholar
• Zhang, H., Wei, Q., & Luo, Y. (2008, August). A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Transactions on Systems, Man, and Cybernetics: Cybernetics, 38(4), 937–942. https://doi.org/10.1109/TSMCB.2008.920269
   PubMed Web of Science ®Google Scholar
• Zhang, H., Yue, D., Zhao, W., Hu, S., & Dou, C. (2018, July). Distributed optimal consensus control for multiagent systems with input delay. IEEE Transactions on Cybernetics, 48(6), 1747–1759. https://doi.org/10.1109/TCYB.2017.2714173
   PubMed Web of Science ®Google Scholar
• Zhang, Q., & Zhou, Y. (2022, December). Recent advances in non-Gaussian stochastic systems control theory and its applications. International Journal of Network Dynamics and Intelligence, 1(1), 111–119. https://doi.org/10.53941/ijndi0101010
   Google Scholar
• Zhang, S., Ma, L., & Yi, X. (2022, June). Model-free adaptive control for nonlinear multi-agent systems with encoding-decoding mechanism. IEEE Transactions on Signal and Information Processing Over Networks, 8, 489–498. https://doi.org/10.1109/TSIPN.2022.3174966
   Web of Science ®Google Scholar
• Zhang, S., Zhao, B., & Zhang, Y. (2021, July). Event-triggered control for input constrained non-affine nonlinear systems based on neuro-dynamic programming. Neurocomputing, 440, 175–184. https://doi.org/10.1016/j.neucom.2021.01.116
   Web of Science ®Google Scholar
• Zhang, W., Sheng, L., & Gao, M. (2021, May). Finite-horizon H∞ state estimation for time-varying complex networks based on the outputs of partial nodes. Systems Science & Control Engineering, 9(S2), 48–59. https://doi.org/10.1080/21642583.2020.1837691
   Web of Science ®Google Scholar
• Zhang, W., Tang, Y., Zheng, W., & Liu, Y. (2021, November). Stability of time-varying systems with delayed impulsive effects. International Journal of Robust and Nonlinear Control, 31(16), 7825–7843. https://doi.org/10.1002/rnc.v31.16
   Web of Science ®Google Scholar
• Zhang, W., & Yi, W. (2021, November). Composite adaptive dynamic programming for missile interception systems with multiple constraints and less sensor requirement. ISA Transactions, 117, 40–53. https://doi.org/10.1016/j.isatra.2021.01.040
   PubMed Web of Science ®Google Scholar
• Zhang, X., Zhao, B., Liu, D., & Zhang, S. (2022, January). Event-triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs. International Journal of Robust and Nonlinear Control, 32(1), 29–51. https://doi.org/10.1002/rnc.v32.1
   Web of Science ®Google Scholar
• Zhang, X.-M., Han, Q.-L., & Ge, X. (2021). Sufficient conditions for a class of matrix-valued polynomial inequalities on closed intervals and application to H∞ filtering for linear systems with time-varying delays. Automatica, 125, 109390. https://doi.org/10.1016/j.automatica.2020.109390
   Web of Science ®Google Scholar
• Zhao, B., Jia, L., Xia, H., & Li, Y. (2018, September). Adaptive dynamic programming-based stabilization of nonlinear systems with unknown actuator saturation. Nonlinear Dynamics, 93(4), 2089–2103. https://doi.org/10.1007/s11071-018-4309-8
   Web of Science ®Google Scholar
• Zhao, D., Wang, Z., Han, Q.-L., & Wei, G. (2022, August). Proportional-integral observer design for uncertain time-delay systems subject to deception attacks: an outlier-resistant approach. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 52(8), 5152–5164. https://doi.org/10.1109/TSMC.2021.3117742
   Web of Science ®Google Scholar
• Zhao, Q., Xu, H., & Jagannathan, S. (2015, March). Optimal control of uncertain quantized linear discrete-time systems. International Journal of Adaptive Control and Signal Processing, 29(3), 325–345. https://doi.org/10.1002/acs.v29.3
   Web of Science ®Google Scholar
• Zhao, T., Liu, Y., Li, Z., Su, C.-Y., & Feng, Y. (2019, October). Adaptive control and optimization of mobile manipulation subject to input saturation and switching constraints. IEEE Transactions on Automation Science and Engineering, 16(4), 1543–1555. https://doi.org/10.1109/TASE.8856
   Web of Science ®Google Scholar
• Zhao, Y., Dai, X., Gong, D., Lv, X., & Liu, Y. (2022). Event-triggered adaptive dynamic programming consensus tracking control for discrete-time multiagent systems. Complexity. 6028054, 1–14. https://doi.org/10.1155/2022/6028054
   Web of Science ®Google Scholar
• Zhu, J., Zhang, P., & Hou, Y. (2021, October). Adaptive dynamic programming-based optimal regulation on input-constrained nonlinear time-delay systems. Neural Computing and Applications, 33(19), 13039–13047. https://doi.org/10.1007/s00521-021-06000-y
   Web of Science ®Google Scholar
• Zhu, K., Wang, Z., Wei, G., & Liu, X. (2022). Adaptive set-membership state estimation for nonlinear systems under bit rate allocation mechanism: A neural-network-based approach. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2022.3149540.
   Web of Science ®Google Scholar
• Zhu, M., & Martinez, S. (2014, March). On the performance analysis of resilient networked control systems under replay attacks. IEEE Transactions on Automatic Control, 59(3), 804–808. https://doi.org/10.1109/TAC.2013.2279896
   Web of Science ®Google Scholar
• Zhu, S., Tian, E., Xu, D., & Liu, J. (2022, April). An adaptive torus-event-based controller design for networked T-S fuzzy systems under deception attacks. International Journal of Robust and Nonlinear Control, 32(6), 3425–3441. https://doi.org/10.1002/rnc.v32.6
   Web of Science ®Google Scholar
• Zhu, Y., Zhao, D., He, H., & Ji, J. (2017, May). Event-triggered optimal control for partially unknown constrained-input systems via adaptive dynamic programming. IEEE Transactions on Industrial Electronics, 64(5), 4101–4109. https://doi.org/10.1109/TIE.2016.2597763
   Web of Science ®Google Scholar
• Zhu, Z., Zeng, F., Qi, G., Li, Y., Hou, J., & Mazur, N. (2021). Power system structure optimization based on reinforcement learning and sparse constraints under doS attacks in cloud environments. Simulation Modelling Practice and Theory, 110, 102272. https://doi.org/10.1016/j.simpat.2021.102272
   Web of Science ®Google Scholar