Finite horizon optimal control of non-linear discrete-time switched systems using adaptive dynamic programming with ε-error bound

References

• Al-Tamimi, A., Lewis, F.L., and Abu-Khalaf, M. (2008), ‘Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof’, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 38, 943–949.
   PubMed Web of Science ®Google Scholar
• Bertsekas, D.P., and Tsitsiklis, J.N. (1996), Neuro-Dynamic Programming, Belmont, MA: Athena Scientific.
   Google Scholar
• Baotić, M., Christophersen, F., and Morari, M. (2003), ‘Infinite Time Optimal Control of Hybrid Systems With a Linear Performance Index’, in Proceedings of the 42nd IEEE Conference on Decision and Control, Maui, Hawaii, USA, December, pp. 3191–3196.
   Google Scholar
• Bengea, S.C., and DeCarlo, R.A. (2003), ‘Conditions for the Existence of a Solution to a Two-Switched/Hybrid Optimal Control Problem’, in IFAC Conference on Analysis and Design of Hybrid Systems, Saint Malo, France, June, pp. 419–424.
   Google Scholar
• Borrelli, F., Baotić, M., Bemporad, A., and Morari, M. (2005), ‘Dynamic Programming for Constrained Optimal Control of Discrete-Time Linear Hybrid Systems’, Automatica, 41, 1709–1721.
   Web of Science ®Google Scholar
• Blackmore, L., Rajamanoharan, S., and Williams, B.C. (2008), ‘Active Estimation for Jump Markov Linear Systems’, IEEE Transactions on Automatic Control, 53, 2223–2236.
   Web of Science ®Google Scholar
• Costa, O.L.V., and Tuesta, E.F. (2003), ‘Finite Horizon Quadratic Optimal Control and a Separation Principle for Markovian Jump Linear Systems’, IEEE Transactions on Automatic Control, 48, 1836–1842.
   Web of Science ®Google Scholar
• Chai, T., Geng, Z., Yue, H., Wang, H., and Su, C. (2009), ‘A Hybrid Intelligent Optimal Control Method for Complex Flotation Process’, International Journal of Systems Science, 40, 945–960.
   Web of Science ®Google Scholar
• Cao, N., Zhang, H., Luo, Y, and Feng, D. (2012), ‘Infinite Horizon Optimal Control of Affine Nonlinear Discrete Switched Systems Using Two-Stage Approximate Dynamic Programming’, International Journal of Systems Science, 43, 1673–1682.
   Web of Science ®Google Scholar
• Du, D., Jiang, B., Shi, P., and Zhou, S. (2007), ‘H∞ Filtering of Discrete-Time Switched Systems With State Delays via Switched Lyapunov Function Approach’, IEEE Transactions on Automatic Control, 52, 1520–1525.
   Web of Science ®Google Scholar
• Gao, H., Lam, J., and Wang, C. (2006), ‘Model Simplification for Switched Hybrid Systems’, Systems and Control Letters, 55, 1015–1021.
   Web of Science ®Google Scholar
• Jagannathan, S. (2006), Neural Network Control of Nonlinear Discrete-Time Systems, Boca Raton: CRC Press.
   Google Scholar
• Jiang, B., Yang, H., and Shi, P. (2010), ‘Switching Fault Tolerant Control Design via Global Dissipativity’, International Journal of Systems Science, 41, 1003–1012.
   Web of Science ®Google Scholar
• Liberzon, D. (2003), Switching in Systems and Control, Boston, MA: Birkhauser.
   Google Scholar
• Lincoln, B., and Rantzer, A. (2006), ‘Relaxing Dynamic Programming’, IEEE Transactions on Automatic Control, 51, 1249–1260.
   Web of Science ®Google Scholar
• Lewis, F.L., and Vrabie, D. (2009), ‘Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control’, IEEE Circuits and Systems Magazine, 9, 32–50.
   Web of Science ®Google Scholar
• Lian, J., Zhao, J., and Dimirovski, G. (2009), ‘Robust H∞ Sliding Mode Control for a Class of Uncertain Switched Delay Systems’, International Journal of Systems Science, 40, 855–866.
   Web of Science ®Google Scholar
• Loxton, R.-C., Teo, K.-L., and Rehbock, V. (2009), ‘Computational Method for a Class of Switched System Optimal Control Problems’, IEEE Transactions on Automatic Control, 54, 2455–2460.
   Web of Science ®Google Scholar
• Murray, J.J., Cox, C.J., Lendaris, G.G., and Saeks, R. (2002), ‘Adaptive Dynamic Programming’, IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews, 32, 140–153.
   Web of Science ®Google Scholar
• Ni, W., and Cheng, D. (2010), ‘Control of Switched Linear Systems With Input Saturation’, International Journal of Systems Science, 41, 1057–1065.
   Web of Science ®Google Scholar
• Niu, B., and Zhao, J. (2012), ‘Tracking Control for Output-Constrained Nonlinear Switched Systems With a Barrier Lyapunov Function’, International Journal of Systems Science, DOI:10.1080/00207721.2011.652222.
   Web of Science ®Google Scholar
• Prokhorov, D.V., and Wunsch, D.C. (1997), ‘Adaptive Critic Designs’, IEEE Transactions on Neural Networks, 8, 997–1007.
   PubMed Web of Science ®Google Scholar
• Rantzer, A. (2005), ‘On Approximate Dynamic Programming in Switching Systems’, in Proceeding of the IEEE Conference on Decision and Control and the European Control Conference, Seville, Spain, pp. 1391–1396.
   Google Scholar
• Sutton, R.S., and Barto, A.G. (1998), Reinforcement Learning: An Introduction, Cambridge, MA: MIT Press.
   Google Scholar
• Si, J., and Wang, Y.T. (2001), ‘On-Line Learning Control by Association and Reinforcement’, IEEE Transactions on Neural Networks, 12, 264–276.
   PubMed Web of Science ®Google Scholar
• Si, J., Barto, A.G., Powell, W.B., and Wunsch, D.C. (eds.) (2004), Handbook of Learning and Approximate Dynamic Programming, NewYork: Wiley-IEEE Press.
   Google Scholar
• Seatzu, C., Corona, D., Giua, A., and Bempoard, A. (2006), ‘Optimal Control of Continuous Time Switched Affine Systems’, IEEE Transactions on Automatic Control, 51, 726–741.
   Web of Science ®Google Scholar
• Tong, Y., Zhang, L., Shi, P., and Wang, C. (2012), ‘A Common Linear Copositive Lyapunov Function for Switched Positive Linear Systems With Commutable Subsystems’, International Journal of Systems Science, DOI:10.1080/00207721.2012.683830.
   Web of Science ®Google Scholar
• Werbos, P.J. (1992), ‘Approximate Dynamic Programming for Real-Time Control and Neural Modeling’, in Handbook of Intelligent Control, eds. D.A. White and D.A. Sofge, New York: Van Nostrand Reinhold, pp. 493–525.
   Google Scholar
• Wang, F.Y., Zhang, H., and Liu, D. (2009), ‘Adaptive Dynamic Programming: An Introduction’, IEEE Computational Intelligence Magazine, 43, 9–47.
   Google Scholar
• Wang, M., Zhao, J., and Dimirovski, G. (2010), ‘Output Tracking Control of Nonlinear Switched Cascade Systems Using a Variable Structure Control Method’, International Journal of Control, 83, 394–403.
   Web of Science ®Google Scholar
• Wang, M., Zhao, J., and Dimirovski, G. (2009), ‘Stabilisation and L2-gain Analysis for a Class of Uncertain Switched Nonlinear Systems’, International Journal of Systems Science, 40, 1077–1085.
   Web of Science ®Google Scholar
• Wang, F., Jin, N., Liu, D., and Wei, Q. (2011), ‘Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems With ε-Error Bound’, IEEE Transactions on Neural Networks, 22, 24–36.
   PubMed Web of Science ®Google Scholar
• Xu, X.-P., and Antsaklis, P.-J. (2000), ‘Optimal Control of Switched Systems: New Results and Open Problems’, in Proceeding of the American Control Conference, Chicago, Illinois, pp. 2683–2687.
   Google Scholar
• Xu, X.-P., and Antsaklis, P.-J. (2003), ‘Results and Perspectives on Computational Methods for Optimal Control of Switched Systems’, in Hybrid Systems: Computation and Control (HSCC), Berlin: Springer, pp. 540–555.
   Google Scholar
• Xie, G., and Wang, L. (2003), ‘Controllability and Stabilizability of Switched Linear-Systems’, Systems and Control Letters, 48, 135–155.
   Web of Science ®Google Scholar
• Xiang, W., and Xiao, J. (2013), ‘Finite-Time Stability and Stabilisation for Switched Linear Systems’, International Journal of Systems Science, 44, 384–400.
   Web of Science ®Google Scholar
• Yue, D., and Han, Q. (2005), ‘Delay-Dependent Exponential Stability of Stochastic Systems With Time-Varying Delay, Nonlinearity, and Markovian Switching’, IEEE Transactions on Automatic Control, 50, 217–222.
   Web of Science ®Google Scholar
• Zhang, H., Wei, Q., and Luo, Y. (2008), ‘A Novel Infinite-Time Optimal Tracking Control Scheme for a Class of Discrete-Time Nonlinear System Based on Greedy HDP Iteration Algorithm’, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 38, 937–942.
   PubMed Web of Science ®Google Scholar
• Zhang, H., Luo, Y., and Liu, D. (2009), ‘Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems With Control Constraints’, IEEE Transactions on Neural Networks, 20, 1490–1503.
   PubMed Web of Science ®Google Scholar
• Zhang, L., and Gao, H. (2010), ‘Asynchronously Switched Control of Switched Linear Systems With Average Dwell Time’, Automatica, 46, 953–958.
   Web of Science ®Google Scholar
• Zhang, H., Cui, L., Zhang, X., and Luo, Y. (2011), ‘Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method’, IEEE Transactions on Neural Networks, 22, 2226–2236.
   PubMed Web of Science ®Google Scholar