The Stationary Distribution of a Markov Jump Process Glued Together from Two State Spaces at Two Vertices

Abstract

We compute the stationary distribution of a continuous-time Markov chain that is constructed by gluing together two finite, irreducible Markov chains by identifying a pair of states of one chain with a pair of states of the other and keeping all transition rates from either chain. The result expresses the stationary distribution of the glued chain in terms of quantities of the two original chains. Special emphasis is given to the cases when the stationary distribution of the glued chain is a multiple of the equilibria of the original chains, and when not, for which bounds are derived.

Keywords:

• Continuous-time Markov chain
• Ergodic theorem for regenerative processes
• Gluing
• Stationary distribution

Mathematics Subject Classification:

• 60J27
• 60K15