Markov Systems in a General State Space

References

• Barbu , V. , Boussement , M. , Limnios , N. ( 2004 ). Discrete-time semi Markov model for reliability and survival analysis . Commun. Stat 1st Theor. Meth. 33 : 2833 – 2886 .
   Web of Science ®Google Scholar
• Bartholomew , D. J. (1963). A multistage renewal process. J. Roy. Stat. 1st Soc., B, 25:150–168.
   Web of Science ®Google Scholar
• Chung , K. L. ( 1967 ). Markov Chains with Stationary Transition Probabilities. ed. , 2nd Berlin : Springer-Verlag .
   Google Scholar
• Crooks , G. E. ( 2000 ). Path ensemble averages in system driven far from equilibrium . Phys. Rev. E. 61 ( 3 ): 2361 – 2366 .
   Web of Science ®Google Scholar
• De Freyter , T. ( 2006 ). Modelling heterogeneity in manpower planning: dividing the personel system in more homogeneous subgroups. Appl. Stoch. Model. Bus. Ind. 22 ( 4 ): 321 – 334 .
   Web of Science ®Google Scholar
• De Freyter , T. , Guerry , M. ( 2011 ). Markov manpower models: a review . Handbook of Optimization Theory: Decision Analysis and Applications. In: Varela , J. , Acuidja , S. 2 Eds. Nova Science Publishers . pp. 67 – 88
   Google Scholar
• Dobrushin , R. ( 1956 ) Central limit theorem for non-stationary Markov chains, I, II. Theor. Probab. Applic. 1 : 65 – 80 , 329 – 383 . (English translation).
   Google Scholar
• Doeblin , W. ( 1937 ). Sur les proprietes asymptotiques de mouvement regis par cerain types de chaines simples. Bull. Math. Soc. Roum. Sci. 39 ( 1 ): 57 – 115 ; 39 ( 2 ): 3 – 61 .
   Google Scholar
• Doeblin , W. ( 1940 ). Elements d'une theorie general des chaines simple constantes de Markov. Ann. Sci. Ec. Norm. Sup. 57 : 61 – 111 .
   Google Scholar
• Doob , J. ( 1953 ). Stochastic Processes. John Wiley , New York .
   Google Scholar
• Down , D. , Meyn , S. , Tweedie , R. L. ( 1995 ). Exponential and uniform ergodicity of Markov processes. Ann. Probab. 23 ( 4 ): 1671 – 1691 .
   Web of Science ®Google Scholar
• Faddy , M. J. , McClean , S. I. ( 2005 ). Markov chain for geriatric patient care. Meth. Inform. Med. 44 ( 3 ): 369 – 373 .
   PubMed Web of Science ®Google Scholar
• Feller , W. ( 1968 ). An Introduction to Probability Theory and its Applications I. ed. , 2nd New York ; John Wiley and Sons .
   Google Scholar
• Foucher , Y. , Mathew , E. , Saint Pierre P. , Durant , J-F , Daures , J. P. ( 2005 ). A semi-Markov model based on generalized Weibull distribution with an illustration for HIV disease. Biom. J. 47 ( 6 ): 1 – 9 . 13 .
   Web of Science ®Google Scholar
• Gournescu , F. , McClean , S. I. , Millard , P. H. ( 2002 ). A queueing model for bed-occupancy management and planning of hospitals. J. Operat. Rese. Soc. 53 : 19 – 24 .
   Web of Science ®Google Scholar
• Gournescu , F. , McClean , S. I. , Millard , P. H. ( 2002a ). Using a queueing model to help plan bed allocation in a department of geriatric medicine. Health Care Manage. Sci. 5 ( 4 ): 307 – 212 .
   PubMedGoogle Scholar
• Hajnal J. ( 1956 ) The ergodic properties of non-homogeneous finite Markov chains. Proc. Cambridge Philosoph. Soc. 52 : 67 – 77 .
   Google Scholar
• Hajnal , J. ( 1958 ) Weak ergodicity in non-homogeneous Markov chains. Proce. Cambridge Philosop. Soc. 54 : 233 – 246 .
   Google Scholar
• Hajnal , J . ( 1993 ) Shuffling with two matrices. Contemp. Math. 149 : 271 – 287 .
   Google Scholar
• Harris , T. E. ( 1956 ). The existence of stationary measures for certain Markov processes. Proce. 3rd Berkeley Sympo. Mathemat. Statist Probab. 2 : 113 – 124 . Berkeley, University of California Press .
   Google Scholar
• Howard . ( 1971 ). Dynamic Probabilistic Systems.Vol. I and II. Chichester : Wiley .
   Google Scholar
• Hunter , J. J. ( 1983 ). Mathematical Techniques of Applied Probability. New York : Academic Press .
   Google Scholar
• Kac , M. ( 1947 ). On the notion of recurrence in discrete stochastic processses. Bull. Amer. Math. Soc., 53 : 1002 – 1010 .
   Web of Science ®Google Scholar
• Kolmogorov , A. N. ( 1931 ). Uber die analytischen methoden in der wahrscheinlichkeitsrechnung. Math. Ann. 104 : 415 – 458 .
   Google Scholar
• Limnios , N. , Oprisan , G. ( 2003 ). An introduction to semi-Markov processes with application to reliability . In: Shanbhag , D.N , Rao , C.R. eds. Handbook of Statistics, 21. Amsterdam : Elsevier .
   Google Scholar
• Lindvall , T. ( 1992 ). Lectures on the Coupling Method. New York ; John Wiley .
   Google Scholar
• Marshall , A. H. , McClean , S. I. ( 2004 ). Using Coxian phase-type distributions to identify patient characteristics for duration of stay in hospital . Health Care Manage. Sci . 7 ( 4 ): 285 – 289 .
   PubMedGoogle Scholar
• Mathew , E. , Foucher , Y. , Dellamonika , P. Daures , J-P . (2006). Parametric and non-homogeneous semi-Markov process for HIV control . Working paper. Archer Hospital , Nice.
   Google Scholar
• McClean , S. I. , Scotney , B. , Robinson , S. ( 2003 ). Conceptual clustering of heterogeneous gene expression sequences . Artif. Intell. Rev. 20 : 53 – 73 .
   Web of Science ®Google Scholar
• McClean , S. I. , Millard , P. ( 2007 ). Where to treat the older patient? Can Markov models help us better understand the relationship between hospital and community care . J. Operati. Rese. Soc . 58 : 255 – 261 .
   Web of Science ®Google Scholar
• Meyn , S. , Tweedie , R. L. ( 1992 ). Stability of Markovian processes I: discrete time chains . Adv. Appl. Probab . 24 : 542 – 574 .
   Web of Science ®Google Scholar
• Meyn , S. , Tweedie , R. L. ( 2009 ). Markov Chains and Stochastic Stability . Cambridge : Cambridge University Press .
   Google Scholar
• Nilakantan , K. , Raghavendra , B. G. ( 2005 ). Control aspects in proportionality Markov manpower systems . Appl. Stoch. Models Data Anal . 7 : 327 – 341 .
   Google Scholar
• Nummelin , E. ( 1984 ). General Irreducible Markov Chains and Nonnegative Operators . Cambridge : Cambridge University Press .
   Google Scholar
• Ocana-Riola , R. ( 2005 ). Non-homogeneous Markov process for biomedical data analysis . Biom. J . 47 ( 3 ): 369 – 376 .
   PubMed Web of Science ®Google Scholar
• Orey , S. ( 1959 ). Recurrent Markov chains . Pacific J. Math . 9 : 805 – 827 .
   Google Scholar
• Orey , S. ( 1971 ). Limit Theorems for Markov Chain Transition Probabilities . London : Van Nostrand Reinhold .
   Google Scholar
• Patoucheas , P. D. , Stamou , G. ( 1993 ). Non-homogeneous Markovian models in ecological modelling: a study of the zoobenthos dynamics in Thermaikos Gulf , Greece. Ecol. Model . 66 : 197 – 215 .
   Web of Science ®Google Scholar
• Perez-Ocon , R. , Castro J. E. R. ( 2004 ). A semi-Markov model in biomedical studies . Commun. Stat. 1st Theory Meth . 33 ( 3 ): 437 – 455 .
   Web of Science ®Google Scholar
• Seneta , E . ( 1973 ) On the historical development of the theory of finite inhomogeneous Markov chains . Proce. Cambridge Philosoph. Soc . 74 : 507 – 513 .
   Google Scholar
• Seneta , E. ( 2006 ). Non-Negative Matrices and Markov Chains. ed , 2nd . New York . Springer , (Revised printing as paperback of the 1981 2nd ed., with Corrigenda and Additional Bibliography) .
   Google Scholar
• Saint Pierre , P. ( 2005 ). Modelles multi-etas de type Markovien et application a la astme . Ph.d thesis , University of Monpellier I .
   Google Scholar
• Sen Gupta , A. Ugwuogo , F. L. ( 2006 ). Modelling multi-stage processes through multivariate distributions . J. Appl. Stat. 1st 33 ( 2 ): 175 – 187 .
   Web of Science ®Google Scholar
• Tuominen . P. ( 1976 ). Notes on l-recurrent Markov chains . Z. Warhrscleinlichkeitstheorie und Verw. Geb . 36 : 111 – 118 .
   Web of Science ®Google Scholar
• Tweedie , R. L. ( 1974a ). R-theory for Markov chains on a general state space I: solidarity properties and R-recurrent chains . Adv. Appl. Probab. , 2 : 840 – 864 .
   Google Scholar
• Tweedie , R. L. ( 1974b ). R-theory for Markov chains on a general state space II: R-subinvariant measures for R-transient chains . Adv. Appl. Probab. , 2 : 865 – 878 .
   Google Scholar
• Tweedie , R. L. ( 1975 ). Sufficient conditions for ergodicity and recurrence of Markov chains on a general state space . Stoch. Proc. Appln. 3 : 385 – 403 .
   Google Scholar
• Papadopoulou , A. A. and Vassiliou , P.-C. G ( 1994 ). Asymptotic behaviour of non-homogeneous Markov systems . Lin. Algeb. Appl. 210 : 153 – 198 .
   Web of Science ®Google Scholar
• Vassiliou , P.-C. G. ( 1976 ). A markov model for wastage in manpower systems . Operat. Res. Quart. 27 : 57 – 70 .
   Google Scholar
• Vassiliou , P.-C. G. ( 1978 ). A high order non-linear Markovian model for promotion in manpower systems. J.Roy, Statist. Soc. A 141 ( 1 ): 86 – 94 .
   Web of Science ®Google Scholar
• Vassiliou , P.-C. G. ( 1981 ). On the limiting behaviour of a nonhomogeneous Markov chain model in manpower systems . Biometrika 68 ( 2 ): 557 – 61 .
   Web of Science ®Google Scholar
• Vassiliou , P.-C. G. ( 1982 ). Asymptotic behaviour of Markov systems . J. Appl. Probab. box 19 : 851 – 857 .
   Web of Science ®Google Scholar
• Vassiliou , P.-C. G. (1997). The evolution of the theory of non-homogeneous Markov systems. Appl. Stoc. Mod. Data Anal. 13(3-4):159–534.
   Google Scholar
• Vassiliou , P.-C. G. , Papadopoulou , A. A. ( 1992 ). Nonhomogeneous semi-Markov systems and maintainability of the state sizes . J. Appl. Probab. 29 ( 3 ): 519 – 534 .
   Web of Science ®Google Scholar
• Ugwuogo , F. I. , McClean , S. I. ( 2000 ). Modelling heterogeneity in manpower systems: a review . Appl. Stoch. Models Bus. Ind. 2 : 99 – 110 .
   Web of Science ®Google Scholar
• Yadavalli , V. S. S. , Natarajan , R. , Udayabhaskaram , S. ( 2002 ). Optimal training policy for promotion-stochastic models of manpower systems . Electro Publ , 13 ( 1 ): 13 – 23 .
   Google Scholar
• Young , A. , Almond , G. ( 1961 ). Predicting distributions of staff . Comput. J. 3 : 246 – 250 .
   Web of Science ®Google Scholar
• Young , A. , Vassiliou , P.-C. G. ( 1974 ). A non-linear model on the promotion of staff . J.Roy. Statist. Soc. A 138 ( 4 ): 584 – 595 .
   Web of Science ®Google Scholar