Publication Cover
Optimization
A Journal of Mathematical Programming and Operations Research
Volume 53, 2004 - Issue 4
38
Views
1
CrossRef citations to date
0
Altmetric
Original Articles

Approximation solution and suboptimality for discounted semi-markov decision problems with countable state space

Pages 339-353 | Received 09 Jan 2003, Accepted 26 Mar 2004, Published online: 22 Aug 2006

References

References

  • Dekker R 1985 In: J.H. Drukkerij and B.V. Pasmans (Eds.) Denumerable Markov Decision Chains
  • Dekker , R and Hordijk , A . 1988 . Average, sensitive and blackwell optimal policies in denumerable Markov decision chains with unbounded rewards. . J. Math. Oper. Res. , 13 ( 3 ) : 395 – 420 .
  • Denardo , EV . 1967 . Contraction mappings in the theory underlying dynamic programming. . SIAM Rev. , 9 : 165 – 177 .
  • Derman , C . 1966 . Denumerable state Markovian decision processes. . AMS , 37 : 1545 – 1554 .
  • Feinberg EA Shwartz A 2002 Handbook of Markov Decision Processes Methods and Applications, Kluwer Academic Publishers Boston
  • Fox , BL . 1971 . Finite-state approximations to denumerable-state dynamic programs. . J. Math. Anal. Appl. , 34 : 665 – 670 .
  • Hastings NAJ van Nunen JAEE 1976 The Action Elimination Algorithm for Markov Decision Processes Memorandum Cosor 76–20. Eindhoven
  • Heyman DP Sobel MJ (Eds.) 1990 Stochastic Models North-Holland, Amsterdam
  • Kushner , HJ . 1997 . Domain decomposition methods for large Markov chain control problems and non-linear elliptic-type equations. . SIAM J. SCI. Comput. , 18 ( 5 ) : 1494 – 1516 .
  • Müller PH Nollau V (Hsg.) 1984 Steuerung Stochastischer Prozesse, Akademie-Verlag Berlin
  • Nollau V 1980 Semi-Markovsche Prozesse, Akademie-Verlag Berlin
  • Nollau , V and Ewers , Th. 1977 . Zur Steuerung halb-Markovscher Prozesse und ihre Anwendung bei der Ermittlung optimaler Bedienungsstrategien in einem Mehrmaschinensystem (III). . Wiss. Z. TU Dresden , 26 : 109 – 114 .
  • Nollau , V and Hahnewald-Busch , A . 1981 . A method of clustering for discounted Markovian decision problems. . Math. Operationsforsch. Statist. Ser. Optimization , 12 : 137 – 147 .
  • Nollau , V and Hudak , D . 2000 . A modified Gauss-Seidel-Algorithm with exclusion of suboptimal actions for a class of Semi–markovian decision problems. . Optimization , 48 : 429 – 451 .
  • Puterman ML 1994 Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley New York
  • White , DJ . 1980 . Finite-state approximations for denumerable-state infinite-horizon discounted Markov decision processes. . J. Math. Anal. Appl. , 74 ( 1 ) : 292 – 295 .

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.