Publication Cover
Stochastics
An International Journal of Probability and Stochastic Processes
Volume 86, 2014 - Issue 3
147
Views
4
CrossRef citations to date
0
Altmetric
Original Articles

Moderate deviations for time-varying dynamic systems driven by non-homogeneous Markov chains with Two-time Scales

&
Pages 527-550 | Received 12 Feb 2013, Accepted 04 Sep 2013, Published online: 25 Oct 2013

References

  • P.Billingsley, Convergence of Probability Measures, John Wiley, New York, 1968.
  • A.de Acosta, Moderate deviations for empirical measure of Markov chains: Lower bound, Ann. Probab. 25 (1997), pp. 259–284.
  • H.Djellout, Moderate deviations for martingale differences and applications to φ-mixing sequences, Stoch. Stoch. Rep.73 (2002), pp. 37–63.
  • H.Djellout and A.Guillin, Moderate deviations for Markov chains with atom, Stoch. Process. Appl.95(2) (2001), pp. 203–217.
  • M.I.Freidlin and A.D.Wentzell, Random Perturbations of Dynamical Systems, Springer-Verlag, New York, 1984.
  • A.Guillin, Moderate deviations of inhomogeneous functionsals of Markov process and application to averaging, Stoch. Process. Appl.92 (2001), pp. 287–313.
  • Q.He, G.Yin, and Q.Zhang, Large deviations for two-time-scale systems driven by nonhomogeneous Markov chains and LQ control problems, SIAM J. Control Optim.49 (2011), pp. 1737–1765.
  • R.Z.Khasminskii, On stochastic processes defined by differential equations with a small parameter, Theory Probab. Appl.11 (1966), pp. 211–228.
  • R.Z.Khasminskii, G.Yin, and Q.Zhang, Asymptotic expansions of singularly perturbed systems involving rapidly fluctuating Markov chains, SIAM J. Appl. Math.56 (1996), pp. 277–293.
  • R.Z.Khasminskii, G.Yin, and Q.Zhang, Constructing asymptotic series for probability distribution of Markov chains with weak and strong interactions, Quart. Appl. Math.LV (1997), pp. 177–200.
  • H.J.Kushner, Approximation and Weak Convergence Methods for Random Processes, with Applications to Stochastic Systems Theory, MIT Press, Cambridge, MA, 1984.
  • H.J.Kushner and G.Yin, Stochastic Approximation and Recursive Algorithms and Applications, 2nd ed., Springer-Verlag, New York, NY, 2003.
  • R.Liptser and V.Spokoiny, Modrate deviations type evaluation for integral functional of diffusion processes, Electron. J. Probab.4 (1999), pp. 1–25.
  • W.Massey, Asymptotic analysis of the time dependent M/M/1 queue, Math. Oper. Res.10 (1985), pp. 305–327.
  • W.A.Massey and W.Whitt, Uniform acceleration expansions for Markov chains with time-varying rates, Ann. Appl. Probab.8 (1998), pp. 1130–1155.
  • S.P.Sethi and Q.Zhang, Hierarchical Decision Making in Stochastic Manufacturing Systems, Birkhäuser, Boston, MA, 1994.
  • H.A.Simon and A.Ando, Aggregation of variables in dynamic systems, Econometrica.29 (1961), pp. 111–138.
  • L.Y.Wang, P.P.Khargonekar, and A.Beydoun, Robust control of hybrid systems: Performance guided strategies, in Hybrid Systems V, P.Antsaklis, W.Kohn, M.Lemmon, A.Nerode, and S.Sastry, eds., Lecuture Notes in Computer Science, Vol. 1567, Springer, Berlin, 1999, pp. 356–389.
  • L.Wu, Moderate deviations of dependent random variables related to CLT, Ann. Probab.23 (1995), pp. 420–445.
  • L.Wu, Large and moderate deviations and exponential convergence for stochastic damping hamiltonian systems, Stoch. Process. Appl.91 (2001), pp. 205–238.
  • G.Yin and Q.Zhang, Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach, 2nd ed., Springer-Verlag, New York, 2013.
  • G.Yin, Q.Zhang, and G.Badowski, Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states, Ann. Appl. Probab.10 (2000), pp. 549–572.
  • G.Yin, G.Zhao, and F.Wu, Regularization and stabilization of randomly switching dynamic systems, SIAM J. Appl. Math.72 (2012), pp. 1361–1382.
  • Q.Zhang and G.Yin, On nearly optimal controls of hybrid LQG problems, IEEE Trans. Automat. Control44 (1999), pp. 2271–2282.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.