Stationary Distributions of Discrete-Time Markov Chains in Random Environment: Exact Computations and Bounds

References

• Bertsimas , D. 1990 . An analytic approach to a general class of G/G/s queueing systems . Oper. Res. , 38 : 139 – 155 .
   Web of Science ®Google Scholar
• Boucherie , R. 1993 . Aggregation of Markov chains . Stoch. Proc. Appl. , 45 : 95 – 114 . [CROSSREF]
   Web of Science ®Google Scholar
• Bourgin , R.D. and Cogburn , R. 1981 . On determining absorption probabilities for Markov chains in random environments . Adv. Appl. Prob. , 13 : 369 – 387 .
   Web of Science ®Google Scholar
• Brémaud , P. 1999 . Markov Chains: Gibbs Fields, Monte Carlo Simulation and Queues Springer .
   Google Scholar
• Chang , C.-S. and Nelson , R. 1993 . Perturbation analysis of the M/M/1 queue in a Markovian environment via the matrix-geometric method . Commun. Statist. Stoch. Models , 9 : 233 – 246 .
   Google Scholar
• Chao , X. , Pinedo , M. and Miyazawa , M. 1999 . Queueing Networks: Negative Customers, Signals and Product Form New York : Wiley .
   Google Scholar
• Cinlar , E. 1975 . Introduction to Stochastic Processes Englewood Cliffs, NJ : Prentice-Hall .
   Google Scholar
• Economou , A. Generalized product-form stationary distributions for Markov chains in random environment. Technical Report; University of Athens, Department of Mathematics, No: 2002/12/04/1
   Google Scholar
• Falin , G. 1996 . A heterogeneous blocking system in a random environment . J. Appl. Prob. , 33 : 211 – 216 .
   Web of Science ®Google Scholar
• Gaver , D.P. , Jacobs , P.A. and Latouche , G. 1984 . Finite birth-and-death models in randomly changing environments . Adv. Appl. Prob. , 16 : 715 – 731 .
   Web of Science ®Google Scholar
• Gelenbe , E. and Pujolle , G. 1998 . Introduction to Queueing Networks , 2 Chichester : Wiley .
   Google Scholar
• Grassmann , W.K. and Drekic , S. 2000 . An analytical solution for a tandem queue with blocking . Queueing Systems , 36 : 221 – 235 . [CROSSREF]
   Web of Science ®Google Scholar
• Gupta , P.L. and Gupta , R.D. 1990 . A bivariate random environmental stress model . Adv. Appl. Prob. , 22 : 501 – 503 .
   Web of Science ®Google Scholar
• Hambly , B. 1992 . On the limiting distribution of a supercritical branching process in a random environment . J. Appl. Prob. , 29 : 499 – 518 .
   Web of Science ®Google Scholar
• Helm , W.E. and Waldmann , K.-H. 1984 . Optimal control of arrivals to multiserver queues in a random environment . J. Appl. Prob. , 21 : 602 – 615 . [CSA]
   Web of Science ®Google Scholar
• Henderson , W. , Pearce , C.E.M. , Pollett , P.K. and Taylor , P.G. 1992 . Connecting internally balanced quasi-reversible Markov processes . Adv. Appl. Prob. , 24 : 934 – 959 .
   Web of Science ®Google Scholar
• Karlin , S. and McGregor , J.L. 1959 . Random walks . Illinois J. Math. , 8 : 87 – 118 .
   Google Scholar
• Karlin , S. and Taylor , H.M. 1981 . A Second Course in Stochastic Processes New York : Academic Press .
   Google Scholar
• Kulkarni , V.G. and Tedijanto , T.E. 1998 . Optimal admission control of a Markov-modulated batch arrivals to a finite-capacity buffer . Commun. Statist. Stochastic Models , 14 : 95 – 122 .
   Google Scholar
• Lefevre , C. and Milhaud , X. 1990 . On the association of the lifelengths of components subjected to a stochastic environment . Adv. Appl. Prob. , 22 : 961 – 964 .
   Web of Science ®Google Scholar
• Lenin , R.B. and Parthasarathy , P.R. 2000 . Transient analysis in discrete time of Markovian queues with quadratic rates . Southwest J. Pure and Appl. Math. , 1 : 1 – 15 .
   Google Scholar
• Mitrani , I. and Chakka , R. 1995 . Spectral expansion solution for a class of Markov models: Application and comparison with the matrix-geometric method . Perf. Eval. , 23 : 241 – 260 . [CROSSREF]
   Web of Science ®Google Scholar
• Neuts , M.F. 1981 . Matrix-Geometric Solutions in Stochastic Models. An Algorithmic Approach Baltimore : The Johns Hopkins University Press .
   Google Scholar
• Norris , J.R. 1997 . Markov Chains Cambridge, , UK : Cambridge University Press .
   Google Scholar
• O'Cinneide , C.A. and Purdue , P. 1986 . The M/M/∞queue in random environment . J. Appl. Prob. , 23 : 175 – 184 . [CSA]
   Web of Science ®Google Scholar
• Pollett , P.K. 1986 . Connecting reversible Markov processes . Adv. Appl. Prob. , 18 : 880 – 900 .
   Web of Science ®Google Scholar
• Serfozo , R. 1999 . Introduction to Stochastic Networks New York : Springer .
   Google Scholar
• Walrand , J. and Varaiya , P. 1980 . Interconnection of Markov chains and quasi-reversible queueing networks . Stoch. Proc. Appl. , 10 : 209 – 219 . [CROSSREF]
   Google Scholar
• Wang , H.-X. and Fang , D. 1999 . Asymptotic behaviour of population-size-dependent branching processes in Markovian random environments . J. Appl. Prob. , 36 : 611 – 619 . [CROSSREF]
   Web of Science ®Google Scholar
• Yamazaki , G. and Miyazawa , M. 1995 . Decomposability in queues with background states . Queueing Systems , 20 : 453 – 469 .
   Web of Science ®Google Scholar