Optimal ergodic control of Markov diffusion processes with minimum variance

References

• Adachi , T. and Morimoto , H. 2000 . On consumption/investment problems with long-term time-average utilities . Stoch. Stoch. Rep. , 68 : 255 – 271 .
   Google Scholar
• Akella , R. and Kumar , P.R. 1986 . Optimal control of production rate in a failure prone manufacturing system . IEEE Trans. Automat. Control , : 116 – 126 . AC-31
   Web of Science ®Google Scholar
• Arapostathis , A. and Borkar , V.S. 2010 . Uniform recurrence properties of controlled diffusions and applications to optimal control . SIAM J. Control Optim. , 48 : 4181 – 4223 .
   Web of Science ®Google Scholar
• Arapostathis , A. , Ghosh , M.K. and Borkar , V.S. 2011 . Ergodic Control of Diffusion Processes , Cambridge, UK : Cambridge University Press .
   Google Scholar
• Bhattacharya , R.N. 1982 . On the functional central limit theorem and the law of the iterated logarithm for Markov processes . Z. Wahrsch. Verw. Gebiete , 60 : 185 – 201 .
   Web of Science ®Google Scholar
• Billingsley , P. 1979 . Probability and Measure , New York, NY : John Wiley & Sons .
   Google Scholar
• Breiman , L. 1968 . Probability , Reading, MA : Addison-Wesley .
   Google Scholar
• Fort , G. and Roberts , G.O. 2005 . Subgeometric ergodicity of strong Markov processes . Ann. Appl. Probab. , 15 : 1565 – 1589 .
   Web of Science ®Google Scholar
• Ghosh , M.K. and Marcus , S.I. 1991 . Infinite horizon controlled diffusion problems with nonstandard criteria . J. Math. Syst. Estimation Control , 1 : 44 – 69 .
   Google Scholar
• Has'minskii , R.Z. 1980 . Stochastic stability of differential equations , Alphen aan der Rijn, The Netherlands : Sijthoff & Noordhoff .
   Google Scholar
• Hernández-Lerma , O. , Vega-Amaya , O. and Carrasco , G. 1999 . Sample-path and variance minimization of average cost Markov control processes . SIAM J. Control Optim. , 38 : 79 – 93 .
   Web of Science ®Google Scholar
• Jasso-Fuentes , H. and Hernández-Lerma , O. 2008 . Characterizations of overtaking optimality for controlled diffusion processes . Appl. Math. Optim. , 57 : 349 – 369 .
   Web of Science ®Google Scholar
• Jasso-Fuentes , H. and Hernández-Lerma , O. 2009 . Ergodic control, bias, and sensitive discount optimality for Markov diffusion processes . Stoch. Anal. Appl. , 27 : 363 – 385 .
   Web of Science ®Google Scholar
• Kawaguchi , K. and Morimoto , H. 2007 . Long-run average welfare in a pollution accumulation model . J. Econ. Dyn. Control , 31 : 703 – 720 .
   Web of Science ®Google Scholar
• Kurano , M. 1987 . Markov decision processes with a minimum variance criterion . J. Math. Anal. Appl. , 123 : 572 – 583 .
   Web of Science ®Google Scholar
• Leizarowitz , A. 1988 . Controlled diffusion process on infinite horizon with the overtaking criterion . Appl. Math. Optim. , 17 : 61 – 78 .
   Web of Science ®Google Scholar
• Leizarowitz , A. 1990 . Optimal controls for diffusion in R d – Min-max max-min formula for the minimal cost growth rate . J. Math. Anal. Appl. , 149 : 180 – 209 .
   Web of Science ®Google Scholar
• Mandl , P. 1971 . On the variance in controlled Markov chains . Kybernetika (Prague) , 7 : 1 – 12 .
   Google Scholar
• Mandl , P. 1972 . An application of Ito's formula to stochastic contol systems . Lect. Notes Math. , 294 : 8 – 13 .
   Google Scholar
• Mandl , P. 1973 . A connection between controlled Markov chains and martingales . Kybernetika (Prague) , 9 : 237 – 241 .
   Google Scholar
• Mandl , P. 1974 . Estimation and control in Markov chains . Adv. Appl. Probab. , 6 : 40 – 60 .
   Google Scholar
• Meyn , S.P. and Tweedie , R.L. 1993 . Stability of Markovian processes III: Foster-Lyapunov criteria for continuous-time processes . Adv. Appl. Probab. , 25 : 518 – 548 .
   Web of Science ®Google Scholar
• Morimoto , H. and Fujita , Y. 2000 . Ergodic control in stochastic manufacturing systems with constant demand . J. Math. Anal. Appl. , 243 : 228 – 248 .
   Web of Science ®Google Scholar
• Prieto-Rumeau , T. and Hernández-Lerma , O. 2009 . Variance minimization and the overtaking optimality approach to continuous-time controlled Markov chains . Math. Methods Oper. Res. , 70 : 527 – 540 .
   Web of Science ®Google Scholar
• Puterman , M.L. 1994 . Markov Decision Processes , New York : Wiley .
   Google Scholar
• Zhu , Q. and Guo , X.P. 2005 . Markov decision processes with variance minimization: A new condition and approach . Stoch. Anal. Appl. , 25 : 577 – 592 .
   Web of Science ®Google Scholar