Almost sure convergence of stochastic approximation algorithms with non-additive noise

References

• Albert , A. E. and Gardner , L. A. Jr , 1967 , Stochastic Approximation and Nonlinear Regression ( Cambridge, Mass : MIT Press ).
   Google Scholar
• Chen , H. F. and Guo , L. 1987 . J. System Sci. Math Sci. , 7 ( 2 ) : 117
   Google Scholar
• Chen , H. F. , and Zhu , Y. M. 1986 , Scientia sin., Series A , XXIX , 914 .
   Google Scholar
• Derman , C. and Sacks , J. 1959 . Ann. math. Statist. , 30 : 601
   Google Scholar
• Englund , J. , Holst , U. , and Ruppert , D. 1986 , Recursive M-estimators of location and scale for dependent sequences . Tech. Report, 1986-9, Lund Institute of Technology, Lund, Sweden .
   Google Scholar
• Eweda and Macchi , 1983 , Ann. Inst. Henri Poincaré , B, 14 , 235 .
   Google Scholar
• Kushner , H. J. 1980 , I.E.E.E. Trans. autom. Control , 25 , 836 ; 1981 , J. math. Analysis Applic . 82 , 527 .
   Google Scholar
• Kushner , H. J. and Clark , D. S. 1978 . Stochastic Approximation for Constrained and Unconstrained Systems , Berlin : Springer-Verlag .
   Google Scholar
• Kushner , H. J. and Huang , H. 1979 , SIAM J. Control Optim. , 17 , 607 .
   Google Scholar
• Kushner , H. J. and Kumar , R. 1982 , I.E.E.E. Trans. autom. Control , 27 , 775 .
   Google Scholar
• LaSalle , J. R . 1976 . The Stability of Dynamic Systems , Philadelphia, Pa : Society for Industrial and Applied Mathematics .
   Google Scholar
• Ljung , L. 1977 , I.E.E.E. Trans. autom. Control , 22 , 551 .
   Web of Science ®Google Scholar
• Makowski , A. M. and Schwartz , A. 1986 , Implementation issues for Markov decision processes . Proc. Workshop on Stochastic Differential Systems , W. Fleming and P. L. Lions . Lecture Notes in Control and Information Sciences ( Berlin : Springer-Verlag ).
   Google Scholar
• Nevelson , M. B. and Khasminskii , R. Z. 1973 , Trans. Math. Monogr. , 47 , AMS .
   Google Scholar
• Ruppert , D. 1983 , Lecture Notes Statist ., 20 , 182 .
   Google Scholar
• Zhu , Y. M. and Yin , G. 1988 , System Control Letters , 10 , 271 .
   Google Scholar