A zero-one law for Markov chains

References

• D. Andrica and T. Andreescu, Number Theory: Structures, Examples, and Problems, Birkhäuser, Boston, 2009.
   Google Scholar
• P. Billingsley, Probability and Measure, 3rd ed., Wiley, New York, 1995.
   Google Scholar
• D. Blackwell, Finite non-homogeneous chains, Ann. Math. 46 (1945), pp. 594–599.
   Web of Science ®Google Scholar
• D. Blackwell and D. Freedman, The tail σ-field of a Markov chain and a theorem of Orey, Ann. Math. Stat. 35 (1964), pp. 1291–1295.
   Google Scholar
• S. Bolouki and R.P. Malhamé, Consensus algorithms and the decomposition-separation theorem, IEEE Trans. Automat. Control 61 (2016), pp. 2357–2369.
   Web of Science ®Google Scholar
• K. Chatterjee and M. Tracol, Decidable problems for probabilistic automata on infinite words, in 27th Annual IEEE Symposium on Logic in Computer Science, Dubrovnik, 2012, pp. 185–194.
   Google Scholar
• H. Cohn, On the tail σ-algebra of the finite inhomogeneous Markov chains, Ann. Math. Stat. 41 (1970), pp. 2175–2176.
   Google Scholar
• H. Cohn, A ratio limit theorem for the finite nonhomogeneous Markov chains, Isr. J. Math. 19 (1974), pp. 329–334.
   Web of Science ®Google Scholar
• H. Cohn and M. Fielding, Simulated annealing: Searching for an optimal temperature schedule, SIAM J. Optim. 9 (1999), pp. 779–802.
   Web of Science ®Google Scholar
• E.B. Dynkin, Boundary theory of Markov processes (the discrete case), Russian Math. Surv. 24 (1969), pp. 1–42.
   Google Scholar
• S.R. Etesami, A simple framework for stability analysis of state-dependent networks of heterogeneous agents, SIAM J. Control Optim. 57 (2019), pp. 1757–1782.
   Web of Science ®Google Scholar
• G.B. Folland, Real Analysis, 2nd ed., John Wiley & Sons, Hoboken, NJ, 1999.
   Google Scholar
• G.A. Hunt, Markoff chains and Martin boundaries, Illinois J. Math. 4 (1960), pp. 313–340.
   Google Scholar
• M. Iosifescu, The tail structure of nonhomogeneous finite state Markov chains: Survey, Banach Cent. Publ. 5 (1979), pp. 125–132.
   Google Scholar
• M. Iosifescu, Finite Markov Processes and their Applications, Dover Publications, Inc., Mineola, NY, 1980.
   Google Scholar
• J.G. Kemeny, J.L. Snell, and A.W. Knapp, Denumerable Markov Chains, 2nd ed., Springer, New York, 1976.
   Google Scholar
• A. Kolmogoroff, Zur theorie der Markoffschen ketten. Math. Ann. 112 (1936), pp. 155–160 (English translation in Selected Works of A. N. Kolmogorov 2 (1992), pp. 182–187).
   Google Scholar
• J.R. Munkres, Topology, 2nd ed., Prentice Hall, Upper Saddle River, NJ, 2000.
   Google Scholar
• H. Robbins, A remark on Stirling's formula, Am. Math. Mon. 62 (1955), pp. 26–29.
   Google Scholar
• I.M. Sonin, Theorem on separation of jets and some properties of random sequences, Stochastics 21 (1987), pp. 231–249.
   Google Scholar
• I.M. Sonin, An arbitrary nonhomogeneous Markov chain with bounded number of states may be decomposed into asymptotically noncommunicating components having the mixing property, Theory Probab. Appl., 36 (1991), pp. 74–85.
   Web of Science ®Google Scholar
• I.M. Sonin, On an extremal property of Markov chains and sufficiency of Markov strategies in Markov decision processes with the Dubins-Savage criterion, Ann. Oper. Res., 29 (1991), pp. 417–426.
   Google Scholar
• I.M. Sonin, The asymptotic behaviour of a general finite nonhomogeneous Markov chain (the decomposition-separation theorem). In Statistics, Probability and Game Theory: Papers in Honor of David Blackwell, T.S. Ferguson, L.S. Shapley, and J.B. MacQueen, eds., Institute of Mathematical Statistics, 1996, pp. 337–346.
   Google Scholar
• I.M. Sonin, The decomposition-separation theorem for finite nonhomogeneous Markov chains and related problems. In Markov Processes and Related Topics: A Festschrift for Thomas G. Kurtz, S. Ethier, J. Feng and R.H. Stockbridge, eds., Institute of Mathematical Statistics, 2008, pp. 1–15.
   Google Scholar
• D.W. Stroock, Probability Theory: An Analytic View, 2nd ed., Cambridge University Press, Cambridge, 2011.
   Google Scholar
• F. Treves, Topological Vector Spaces, Distributions and Kernels, Academic Press, New York, 1967.
   Google Scholar
• D. Williams, Probability With Martingales, Cambridge University Press, Cambridge, 1991.
   Google Scholar