30
Views
18
CrossRef citations to date
0
Altmetric
Original Articles

Finite state markovian decision processes with weak and strong interactions

Pages 283-304 | Published online: 04 Apr 2007

References

  • Abbad , M. , Bielecki , T. and Filar , J. 1992 . Algorithms for singular perturbated limiting average control problems . IEEE Trans, on Automatic Control , AC-37 : 1421 – 1425 .
  • Anthony , R. N. 1965 . “ Planning and Control of Systems: A Framework for Analysis ” . Cambridge, MA : Harvard University Press .
  • Davis , M. H. A. 1993 . “ Markov Models and Optimization ” . New York : Chapman & Hall .
  • Delebecque , F. and Quadrat , J. 1981 . Optimal control for Markov chains admitting strong and weak interactions . Automatica , 17 : 281 – 296 .
  • Derman , C. 1970 . “ Finite State Markovian Decision Processes ” . New York : Academic Press .
  • Gaitsgori , V. G. and Pervozvanskii , A. A. 1975 . Aggregation of states in a Markov chain with weak interactions . Kybernetika , May-June : 91 – 98 .
  • Hillier , F. S. and Lieberman , G. J. 1989 . “ Introduction to Operations Research ” . New York : McGraw-Hill .
  • Jiang , J. and Sethi , S. P. 1991 . A state aggregation approach to manufacturing systems having machines states with weak and strong interactions . Operations Research , 39 ( 6 ) : 970 – 978 .
  • Khasminskii , R. Z. , Yin , G. and Zhang , Q. 1996 . “ Constructing asymptotic series for Markov chains with weak and strong interactions ” . In Quarterly of Applied Mathematics to appear
  • Kushner , H. J. and Dupuis , P. G. 1992 . “ Numerical Methods for Stochastic Control Problems in Continuous Time ” . New York : Springer-Verlag .
  • Phillips , R. G. and Kokotovic , P. V. 1981 . A singular perturbation approach to modeling and control of Markov chains . IEEE Trans. on Automatic Control , AC-20 : 1087 – 1094 .
  • Ross , S. 1983 . “ Introduction to Stochastic Dynamic Programming ” . New York : Academic Press .
  • Sethi , S. P. and Zhang , Q. 1994 . “ Hierarchical Decision Making in Stochastic Manufacturing Systems ” . Boston : Birkhäuser .
  • Simon , H. A. and Ando , A. 1961 . Aggregation of variables in dynamic systems . Econometrica , 29 : 111 – 138 .
  • White , D. J. 1992 . “ Markov Decision Processes ” . New York : Wiley .
  • Zhang , Q. 1995 . Risk sensitive production planning of stochastic manufacturing systems: A singular perturbation approach . SIAM Journal on Control and Optimization , 33 : 498 – 527 .

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.