A Fixed Point Approach to Solve the Average Cost Optimality Equation for Semi-Markov Decision Processes with Feller Transition Probabilities

References

• Feinberg , E. A. ( 1994 ). Constrained semi-Markov decision processes with average rewards . Math. Meth. Oper. Res. 39 : 257 – 288 .
   Google Scholar
• González-Trejo , J. I. , Hernández-Lerma , O. , Hoyos-Reyes , L. F. ( 2003 ). Minimax control of discrete-time stochastic systems . SIAM J. Control Optim. 41 : 1626 – 1659 .
   Web of Science ®Google Scholar
• Hernández-Lerma , O. , Lasserre , J. B. (1999). Further Topics on Discrete-Time Markov Control Process . New York : Springer-Verlag.
   Google Scholar
• Hernández-Lerma , O. , Luque-Vásquez , F. ( 1999 ). Semi-Markov control models with average costs . Appl. Math. 26 : 315 – 331 .
   Google Scholar
• Jaśkiewicz , A. ( 2001 ). An approximation approach to ergodic semi-Markov control processes . Math. Meth. Oper. Res. 54 : 1 – 19 .
   Web of Science ®Google Scholar
• Jaśkiewicz , A. ( 2004 ). On the equivalence of two expected average cost criteria for semi-Markov control processes . Math. Oper. Res. 29 : 326 – 338 .
   Web of Science ®Google Scholar
• Jaśkiewicz , A. , Nowak , A. S. ( 2006a ). On the optimality equation for average cost Markov control processes with Feller transition probabilities . J. Math. Anal. Appl. 316 : 495 – 509 .
   Google Scholar
• Jaśkiewicz , A. , Nowak , A. S. ( 2006b ). Optimality in Feller semi-Markov control processes . Oper. Res. Lett. 34 : 713 – 718 .
   Google Scholar
• Küenle , H.-U. ( 2007 ). On Markov games with average reward criterion and weakly continuous transition probabilities . SIAM J. Control Optim. 45 : 2156 – 2168 .
   Google Scholar
• Meyn , S. P. , Tweedie , R. L. ( 1993 ). Markov Chains and Stochastic Stability . New York : Springer-Verlag .
   Google Scholar
• Meyn , S. P. , Tweedie , R. L. ( 1994 ). Computable bounds for geometric convergence rates of Markov chains . Ann. Appl. Probab. 4 : 981 – 1011 .
   Web of Science ®Google Scholar
• Neveu , J. ( 1965 ). Mathematical Foundations of the Calculus of Probability . San Francisco : Holden-Day .
   Google Scholar
• Ross , S. M. ( 1970 ). Applied Probability Models with Optimization Applications . San Francisco : Holden-Day .
   Google Scholar
• Schäl , M. ( 1993 ). Average optimality in dynamic programming with general state space . Math. Oper. Res. 18 : 163 – 172 .
   Web of Science ®Google Scholar
• Sennott , L. I. ( 1989 ). Average cost semi-Markov decision processes and the control of queueing systems . Prob. Eng. Inform. Sci. 3 : 247 – 272 .
   Google Scholar
• Vega-Amaya , O. ( 2003 ). The average cost optimality equation: a fixed point approach . Bol. Soc. Mat. Mexicana 9 : 185 – 195 .
   Google Scholar
• Yushkevich , A. ( 1981 ). On semi-Markov controlled models with an average reward criterion . Theor. Probab. Appl. 26 : 796 – 803 .
   Web of Science ®Google Scholar