Optimal control of probability density functions of stochastic processesFootnote*

Supported in part by the Austrian Science Fund FWF project F3205‐N18 “Fast Multigrid Methods for Inverse Problems”.

References

• Bertsekas , D. 2007 . Dynamic Programming and Optimal Control , Vols. I and II , Athena Scientific .
   Google Scholar
• Borkar , V.S. 2005 . Controlled diffusion processes . Probab. Surv. , 2 : 213 – 244 . (electronic) ISSN 1549–5787. doi:10.1214/154957805100000131.
   Google Scholar
• Falcone , M. 2008 . “ Appendix to the book optimal control and viscosity solutions of Hamilton‐Jacobi‐Bellman equations ” . In Numerical Solution of Dynamic Programming Equations , Edited by: Bardi , M. and Dolcetta , I. Capuzzo . Boston : Birkhauser .
   Google Scholar
• Fleming , W. H. and Rishel , R. W. 1975 . “ Applications of Mathematics ” . In Deterministic and Stochastic Optimal Control , Berlin : Springer‐Verlag .
   Google Scholar
• Forbes , M. G. , Guay , M. and Forbes , J. F. 2004 . Control design for first‐order processes: shaping the probability density of the process state . Journal of process control , 14 : 399 – 410 . doi:10.1016/j.jprocont.2003.07.002.
   Web of Science ®Google Scholar
• Friedman , A. 2008 . Partial Differential Equations of Parabolic Type , Dover Publications .
   Google Scholar
• Gihman , I. I. and Skorohod , A.V. 1972 . Stochastic differential equations , New York : Springer‐Verlag . Translated from the Russian by Kenneth Wickwire, Ergebnisse der Mathematik und ihrer Grenzgebiete, Band 72
   Google Scholar
• Grüne , L. and Rantzer , A. 2008 . On the infinite horizon performance of receding horizon controllers . IEEE Trans. Aut. Control , 53 : 2100 – 2111 . doi:10.1109/TAC.2008.927799.
   Web of Science ®Google Scholar
• Hackbusch , W. 1962 . Elliptic Differential Equations , New‐York : Springer‐Verlag .
   Google Scholar
• Ito , K. and Kunisch , K. 1990 . Receding horizon optimal control for infinite dimensional systems . ESAIM , 35 : 814 – 24 .
   Google Scholar
• Jordan , R. , Kinderlehrer , D. and Otto , F. 1998 . Variational formulation of the Fokker‐Planck equation . SIAM J. Math. Anal. , 29 : 1 – 17 . doi:10.1137/S0036141096303359.
   Web of Science ®Google Scholar
• Jumarie , G. 1992 . Tracking control of nonlinear stochastic systems by using path crossentropy and Fokker‐Planck equation . Internat. J. Systems Sci. , 23 (7) : 1101 – 1114 . ISSN 0020–7721. doi:10.1080/00207729208949368.
   Web of Science ®Google Scholar
• Kárný , M. 1996 . Towards fully probabilistic control design . Automatica , 32 (12) : 1719 – 1722 . doi:10.1016/S0005–1098 (96)80009–4.
   Web of Science ®Google Scholar
• Krasovskiy , A.A. 1968 . The Fokker‐Planck‐Kolmogorov equation and the synthesis of linear control systems. II . Engrg. Cybernetics , 1968 (2) : 1 – 6 . ISSN 0013–788x
   Google Scholar
• Krasovskiy , A.A. 1968 . The Fokker‐Planck‐Kolmogorov equation and the synthesis of relay control systems . Engrg. Cybernetics , 1967 (5) : 45 – 53 . ISSN 0013–788x
   Google Scholar
• Krawczyk , J. A Markovian approximated solution to a portfolio management problem . ITEM. Inf. Technol. Econ. Manag. , 1 (1) 33 pp. Paper 2 (electronic), 2001. ISSN 1643–8949
   Google Scholar
• Krawczyk , J. 2008 . On loss‐avoiding payoff distribution in a dynamic portfolio management problem . The Journal of Risk Finance , 9 (2) : 151 – 172 . doi:10.1108/15265940810853913.
   Google Scholar
• Kullback , S. 1959 . Information theory and statistics , New York : John Wiley and Sons, Inc. .
   Google Scholar
• Kumar , M. , Chakravorty , S. and Junkins , J.L. Computational nonlinear stochastic control based on the Fokker‐Planck‐Kolmogorov equation . AIAA Guidance, Navigation and Control Conference and Exhibit . Aug. 18–21 2008 , Honolulu, Hawaii. pp. AIAA‐2008 – 6477 .
   Google Scholar
• Kushner , H.J. 1990 . Numerical methods for stochastic control problems in continuous time . SIAM J. Control Optim. , 28 (5) : 999 – 1048 . ISSN 0363–0129. doi:10.1137/0328056
   Web of Science ®Google Scholar
• Lions , J. L. 1971 . Optimal Control of Systems Governed by Partial Differential Equations , Berlin : Springer .
   Google Scholar
• Magni , L. , Raimondo , D.M. and Allgöwer , F. 2009 . Nonlinear Model Predictive Control , Berlin : Springer . doi:10.1007/978–3–642–01094–1.
   Google Scholar
• Mayne , D. Q. and Michalska , H. 1990 . Receding horizon control for nonlinear systems . IEEE Trans. Aut. Control , 35 : 814 – 824 . doi:10.1109/9.57020.
   Web of Science ®Google Scholar
• Nocedal , J. and Wright , S.J. 2006 . Numerical Optimization , Springer‐Verlag .
   Google Scholar
• Peskir , G. 2006 . “ On the fundamental solution of the Kolmogorov–Shiryaev equation ” . In From Stochastic Calculus to Mathematical Finance , Edited by: Kabanov , Yu. , Liptser , R. and Stoyanov , J. 535 – 546 . Berlin : Springer . doi:10.1007/978–3–540–30788–4–26.
   Google Scholar
• Primak , S. , Kontorovich , V. and Lyandres , V. 2004 . Stochastic Methods and Their Applications to Communications , Chichester : John Wiley & Sons . Doi:10.1002/0470021187
   Google Scholar
• Risken , R. 1996 . The Fokker‐–Planck Equation: Methods of Solution and Applications , Berlin : Springer .
   Google Scholar
• Shiryaev , A. N. 1961 . The problem of the most rapid detection of a disturbance in a stationaty process . Soviet Mathematics , 2 (2) : 795 – 799 .
   Google Scholar
• Shiryaev , A. N. Quickest detection problems in the technical analysis of the financial data . Math. Finance Bachelier Congress . 2000 , Paris. Edited by: Geman , H. , Madan , D. , Pliska , S.R. and Vorst , T. pp. 487 – 521 . Springer .
   Google Scholar
• Shu , Ch.W. 1998 . “ Essentially non‐oscillatory and weighted essentially non‐oscillatory schemes for hyperbolic conservation laws ” . In Advanced Numerical Approximation of Nonlinear Hyperbolic Equations. Lecture Notes in Mathematics , Edited by: Quarteroni , A. volume 1697 , 325 – 432 . Springer .
   Google Scholar
• Wang , H. 1999 . Robust Control of the Output Probability Density Functions for Multivariable Stochastic Systems with Guaranteed Stability . IEEE Trans. On Automatic Control , 44 (11) : 2103 – 2107 . doi:10.1109/9.802925.
   Web of Science ®Google Scholar
• Wang , L. and Bai , F. 2010 . The state equations methods for stochastic control problems . Numer. Math. Theor. Meth. Appl. , 1 (3) : 79 – 96 .
   Google Scholar
• Supported in part by the Austrian Science Fund FWF project F3205‐N18 “Fast Multigrid Methods for Inverse Problems”.
   Google Scholar