An algebraic approach to dynamic optimisation of nonlinear systems: a survey and some new results

References

• Anstreicher, K. M., & Wright, M. H. (2000). A note on the augmented Hessian when the reduced Hessian is semidefinite. SIAM Journal on Optimization, 11, 243–253. doi: 10.1137/S1052623499351791
   Web of Science ®Google Scholar
• Basar, T. (1976). On the uniqueness of the Nash solution in linear-quadratic differential games. International Journal of Game Theory, 5(2–3), 65–90. doi: 10.1007/BF01753310
   Google Scholar
• Basar, T., & Olsder, G. J. (1999). Dynamic noncooperative game theory (Vol. 23). New York: Siam.
   Google Scholar
• Bertsekas, D. P. (2005). Dynamic programming and optimal control (Vol. 1). MA: Athena Scientific Belmont.
   Google Scholar
• Botkin, N. D., Hoffmann, K.-H., & Turova, V. L. (2011). Stable numerical schemes for solving Hamilton–Jacobi–Bellman–Isaacs equations. SIAM Journal on Scientific Computing, 33(2), 992–1007. doi: 10.1137/100801068
   Web of Science ®Google Scholar
• Bryson, A. E., & Ho, Y. C. (1975). Applied optimal control: Optimization, estimation, and control. New York: Taylor & Francis Group.
   Google Scholar
• Çimen, T. (2008). State-dependent Riccati equation (SDRE) control: A survey. IFAC Proceedings Volumes, 41(2), 3761–3775. doi: 10.3182/20080706-5-KR-1001.00635
   Google Scholar
• Çimen, T. (2010). Systematic and effective design of nonlinear feedback controllers via the state-dependent Riccati equation (SDRE) method. Annual Reviews in Control, 34(1), 32–51. doi: 10.1016/j.arcontrol.2010.03.001
   Web of Science ®Google Scholar
• Chesi, G. (2007). Estimating the domain of attraction via union of continuous families of Lyapunov estimates. Systems & Control Letters, 56(4), 326–333. doi: 10.1016/j.sysconle.2006.10.012
   Web of Science ®Google Scholar
• Chesi, G. (2013). Rational Lyapunov functions for estimating and controlling the robust domain of attraction. Automatica, 49(4), 1051–1057. doi: 10.1016/j.automatica.2013.01.032
   Web of Science ®Google Scholar
• Clarke, F., & Vinter, R. (1987). The relationship between the maximum principle and dynamic programming. SIAM Journal on Control and Optimization, 25(5), 1291–1311. doi: 10.1137/0325071
   Web of Science ®Google Scholar
• Doyle, J. C., Glover, K., Khargonekar, P. P., & Francis, B. A. (1989). State-space solutions to standard and control problems. IEEE Transactions on Automatic Control, 34(8), 831–847. doi: 10.1109/9.29425
   Web of Science ®Google Scholar
• Elloumi, S., Sansa, I., & Braiek, N. B. (2012). On the stability of optimal controlled systems with SDRE approach. In Proceedings of the 9th international multi-conference on systems, signals and devices, Chemnitz, Germany (pp. 1–5).
   Google Scholar
• Engwerda, J. C. (2005). LQ dynamic optimization and differential games. Chichester: John Wiley & Sons.
   Google Scholar
• Engwerda, J. C. (2017). A numerical algorithm to calculate the unique feedback Nash equilibrium in a large scalar LQ differential game. Dynamic Games and Applications, 7(4), 635–656. doi: 10.1007/s13235-016-0201-7
   Web of Science ®Google Scholar
• Freiling, G., Jank, G., & Abou-Kandil, H. (1996). On global existence of solutions to coupled matrix Riccati equations in closed-loop Nash games. IEEE Transactions on Automatic Control, 41(2), 264–269. doi: 10.1109/9.481532
   Web of Science ®Google Scholar
• Huang, Y., & Lu, W.-M. (1996). Nonlinear optimal control: Alternatives to Hamilton-Jacobi equation. In Proceedings of the 35th IEEE conference on decision and control, Kobe, Japan (Vol. 4, pp. 3942–3947).
   Google Scholar
• Karagiannis, D., Sassano, M., & Astolfi, A. (2009). Dynamic scaling and observer design with application to adaptive control. Automatica, 45(12), 2883–2889. doi: 10.1016/j.automatica.2009.09.013
   Web of Science ®Google Scholar
• Kawano, Y., & Ohtsuka, T. (2017). Nonlinear eigenvalue approach to differential Riccati equations for contraction analysis. IEEE Transactions on Automatic Control, 62(12), 6497–6504. doi: 10.1109/TAC.2017.2655443
   Web of Science ®Google Scholar
• Khalil, H. K. (1996). Nonlinear systems. New Jersey: Prentice-Hall.
   Google Scholar
• Limebeer, D., Anderson, B., & Hendel, B. (1994). A Nash game approach to mixed control. IEEE Transactions on Automatic Control, 39(1), 69–82. doi: 10.1109/9.273340
   Web of Science ®Google Scholar
• Lin, W. (1996). Mixed control via state feedback for nonlinear systems. International Journal of Control, 64(5), 899–922. doi: 10.1080/00207179608921664
   Web of Science ®Google Scholar
• Mylvaganam, T., & Astolfi, A. (2012). Approximate optimal monitoring: preliminary results. In American control conference, Montreal, QC, Canada (pp. 4745–4750).
   Google Scholar
• Mylvaganam, T., & Astolfi, A. (2014a). Approximate optimal monitoring. In Proceedings of the 14th European control conference, Strasbourg, France (pp. 1199–1204).
   Google Scholar
• Mylvaganam, T., & Astolfi, A. (2014b). Approximate solutions to a class of nonlinear Stackelberg differential games. In Proceedings of the 53rd IEEE conference on decision and control, Los Angeles, CA, USA (pp. 420–425).
   Google Scholar
• Mylvaganam, T., & Astolfi, A. (2015a). Control of microgrids using a differential game theoretic framework. In Proceedings of the 54th IEEE conference on decision and control, Osaka, Japan.
   Google Scholar
• Mylvaganam, T., & Astolfi, A. (2015b). A differential game approach to formation control for a team of agents with one leader. In American control conference, Chicago, IL, USA (pp. 1469–1474).
   Google Scholar
• Mylvaganam, T., & Astolfi, A. (2016). Dynamic algorithms for solving coupled algebraic Riccati equations arising in mixed control for scalar linear systems. In Proceedings of the 55th IEEE conference on decision and control, Las Vegas, NV, USA (pp. 652–657).
   Google Scholar
• Mylvaganam, T., & Sassano, M. (2017). Approximate optimal control via measurement feedback for a class of nonlinear systems. Proceedings of the 20th IFAC World Congress, 50(1), 15391–15396.
   Google Scholar
• Mylvaganam, T., & Sassano, M. (2018). Autonomous collision avoidance for wheeled mobile robots using a differential game approach. European Journal of Control, 40, 53–61. doi: 10.1016/j.ejcon.2017.11.005
   Web of Science ®Google Scholar
• Mylvaganam, T., Sassano, M., & Astolfi, A. (2015). Constructive ε-Nash equilibria for nonzero-sum differential games. IEEE Transactions on Automatic Control, 60(4), 950–965. doi: 10.1109/TAC.2014.2362334
   Web of Science ®Google Scholar
• Mylvaganam, T., Sassano, M., & Astolfi, A. (2017). A differential game approach to multi-agent collision avoidance. IEEE Transactions on Automatic Control, 62(8), 4229–4235. doi: 10.1109/TAC.2017.2680602
   Web of Science ®Google Scholar
• Nestruev, J. (2002). Smooth manifolds and observables. Berlin: Springer.
   Google Scholar
• Nunna, K., Sassano, M., & Astolfi, A. (2015). Constructive interconnection and damping assignment for port-controlled Hamiltonian systems. IEEE Transactions on Automatic Control, 60(9), 2350–2361. doi: 10.1109/TAC.2015.2400663
   Web of Science ®Google Scholar
• Papavassilopoulos, G., Medanic, J., & Cruz, J. J. (1979). On the existence of Nash strategies and solutions to coupled Riccati equations in linear-quadratic games. Journal of Optimization Theory and Applications, 28, 49–76. doi: 10.1007/BF00933600
   Web of Science ®Google Scholar
• Passenbrunner, T. E., Sassano, M., & del Re, L. (2011). Approximate optimal control of internal combustion engine test benches. In Proceedings of the 50th IEEE conference on decision and control and European control conference, Orlando, FL, USA (pp. 8050–8055).
   Google Scholar
• Possieri, C., & Sassano, M. (2015). An algebraic geometry approach for the computation of all linear feedback Nash equilibria in LQ differential games. In Proceedings of the 54th IEEE conference on decision and control, Osaka, Japan (pp. 5197–5202).
   Google Scholar
• Possieri, C., & Sassano, M. (2016). On polynomial feedback Nash equilibria for two-player scalar differential games. Automatica, 74, 23–29. doi: 10.1016/j.automatica.2016.08.006
   Web of Science ®Google Scholar
• Sakamoto, N., & van der Schaft, A. J. (2008). Analytical approximation methods for the stabilizing solution of the Hamilton–Jacobi equation. IEEE Transactions on Automatic Control, 53(10), 2335–2350. doi: 10.1109/TAC.2008.2006113
   Web of Science ®Google Scholar
• Sassano, M., & Astolfi, A. (2011). Dynamic disturbance attenuation and approximate optimal control for fully actuated mechanical systems. In American control conference, San Francisco, CA, USA (pp. 894–899).
   Google Scholar
• Sassano, M., & Astolfi, A. (2012). Dynamic approximate solutions of the HJ inequality and of the HJB equation for input-affine nonlinear systems. IEEE Transactions on Automatic Control, 57, 2490–2503. doi: 10.1109/TAC.2012.2186716
   Web of Science ®Google Scholar
• Sassano, M., & Astolfi, A. (2013a). Approximate finite-horizon optimal control without PDEs. Systems and Control Letters, 62(2), 97–103. doi: 10.1016/j.sysconle.2012.08.015
   Web of Science ®Google Scholar
• Sassano, M., & Astolfi, A. (2013b). Dynamic Lyapunov functions. Automatica, 49(4), 1058–1067. doi: 10.1016/j.automatica.2013.01.027
   Web of Science ®Google Scholar
• Scarciotti, G., & Astolfi, A. (2014). Approximate finite-horizon optimal control for input-affine nonlinear systems with input constraints. Journal of Control and Decision, 1(2), 149–165. doi: 10.1080/23307706.2014.899110
   Google Scholar
• Scarciotti, G., & Mylvaganam, T. (2018a). Approximate infinite-horizon optimal control for stochastic systems. In Proceedings of the 57th IEEE conference on decision and control, Miami Beach, FL, USA (Accepted).
   Google Scholar
• Scarciotti, G., & Mylvaganam, T. (2018b). Constructive approximate solutions to classes of control problems for stochastic nonlinear systems. IEEE Transactions on Automatic Control (under review).
   Google Scholar
• Sepulchre, R., Jankovic, M., & Kokotovic, P. V. (2012). Constructive nonlinear control. London: Springer Science & Business Media.
   Google Scholar
• Simaan, M., & Cruz, J. B. (1973a). Additional aspects of the Stackelberg strategy in nonzero-sum games. Journal of Optimization Theory and Applications, 11(6), 613–626. doi: 10.1007/BF00935561
   Web of Science ®Google Scholar
• Simaan, M., & Cruz, J. B. (1973b). On the Stackelberg strategy in nonzero-sum games. Journal of Optimization Theory and Applications, 11(5), 533–555. doi: 10.1007/BF00935665
   Web of Science ®Google Scholar
• Starr, A. W., & Ho, Y. C. (1969a). Further properties of nonzero-sum differential games. Journal of Optimization Theory and Applications, 3(4), 207–219.
   Google Scholar
• Starr, A. W., & Ho, Y. C. (1969b). Nonzero-sum differential games. Journal of Optimization Theory and Applications, 3(3), 184–206. doi: 10.1007/BF00929443
   Google Scholar
• van der Schaft, A. J. (1992). -gain analysis of nonlinear systems and nonlinear state-feedback control. IEEE Transactions on Automatic Control, 37(6), 770–784. doi: 10.1109/9.256331
   Web of Science ®Google Scholar
• van der Schaft, A. J. (2000). -gain and passivity techniques in nonlinear control (Vol. 2). London: Springer.
   Google Scholar
• van der Schaft, A. J. (2015). A geometric approach to differential Hamiltonian systems and differential Riccati equations. In Proceedings of the 54th IEEE conference on decision and control, Osaka, Japan (pp. 7151–7156).
   Google Scholar
• Vannelli, A., & Vidyasagar, M. (1985). Maximal Lyapunov functions and domains of attraction for autonomous nonlinear systems. Automatica, 21(1), 69–80. doi: 10.1016/0005-1098(85)90099-8
   Web of Science ®Google Scholar
• Vinter, R. (2000). Optimal control. Boston: Birkhäuser.
   Google Scholar
• Zhou, K., Doyle, J., & Glover, K. (1996). Robust and optimal control (1 ed.). Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Zhou, K., Doyle, J., Glover, K., & Bodenheimer, B. (1990). Mixed and control. In American control conference, San Diego, CA, USA (pp. 2502–2507).
   Google Scholar