Non-Parametric Sequential Estimation of a Regression Function Based on Dependent Observations

REFERENCES

• Bai , E.-W. and Liu , Y. ( 2007 ). Recursive Direct Weight Optimization in Nonlinear System Identification: A Minimal Probability Approach , IEEE Transactions on Automatic Control 52 : 1218 – 1231 .
   Web of Science ®Google Scholar
• Borisov , V. Z. and Konev , V. V. ( 1977 ). On Sequential Estimation of Parameters in Discrete-Time Processes , Automation and Remote Control 10 : 58 – 64 (in Russian) .
   Google Scholar
• Carroll , R. J. ( 1976 ). On Sequential Density Estimation , Zeitschrift für Warscheinlich- skeitstheorie und Verwandte Gebiete 36 : 58 – 64 .
   Google Scholar
• Davies , H. I. and Wegman , E. J. ( 1975 ). Sequential Nonparametric Density Estimation , IEEE Transactions in Information Theory 21 : 619 – 628 .
   Web of Science ®Google Scholar
• Dedecker , J. and Doukhan , P. ( 1990 ). A New Covariance Inequality and Applications , Stochastic Processes and Their Applications 10 : 63 – 80 .
   Google Scholar
• Dharmasena , S. , Zeephongsekul , P. , and De Silva , B. ( 2008 ). Two Stage Sequential Procedure for Nonparametric Regression Estimation , Australian and New Zealand Industrial and Applied Mathematics Journal 49 : 681 – 698 .
   Google Scholar
• Dobrovidov , A. V. , Koshkin , G. M. , and Vasiliev , V. A. ( 2012 ). Non-Parametric State Space Models , Heber City , UT : Kendrick Press . (Orig. Pub. Moscow, Russia: Nauka, 2004.)
   Google Scholar
• Efroimovich , S. ( 1999 ). Nonparametric Curve Estimation. Methods, Theory and Applications , Berlin : Springer-Verlag .
   Google Scholar
• Efroimovich , S. ( 2007 ). Sequential Design and Estimation in Heteroscedastic Nonparametric Regression , Sequential Analysis: Design Methods and Applications 26 : 3 – 25 .
   Google Scholar
• Fourdrinier , D. , Konev , V. , and Pergamenshchikov , S. ( 2009 ). Truncated Sequential Estimation of the Parameter of a First Order Autoregressive Process with Dependent Noises , Mathematical Methods of Statistics 18 : 43 – 58 .
   Google Scholar
• Györfi , L. , Kohler , M. , Krzyżak , A. , and Walk , H. ( 2002 ). A Distribution-Free Theory of Nonparametric Regression , Berlin : Springer-Verlag .
   Google Scholar
• Honda , T. ( 1998 ). Sequential Estimation of the Hgarginal Density Function for a Strongly Mixing Process , Sequential Analysis 17 : 239 – 251 .
   Google Scholar
• Konev , V. V. (1985). Sequential Parameter Estimation of Stochastic Dynamical Systems , Tomsk , Russia : Tomsk University Press (in Russian).
   Google Scholar
• Konev , V. V. and Pergamenshchikov , S. M. ( 1990a ). On Truncated Sequential Estimation of the Drifting Parameter Mean in the First Order Autoregressive Model , Sequential Analysis 9 : 193 – 216 .
   Google Scholar
• Konev , V. V. and Pergamenshchikov , S. M. ( 1990b ). Truncated Sequential Estimation of the Parameters in Random Regression , Sequential Analysis 9 : 19 – 41 .
   Google Scholar
• Konev , V. V. and Pergamenshchikov , S. M. ( 1992 ). On Truncated Sequential Estimation of the Parameters of Diffusion Processes , in Methods of Economical Analysis , pp. 3 – 31 , Moscow , Russia : Central Economical and Mathematical Institute of Russian Academy of Science .
   Google Scholar
• Küchler , U. and Vasiliev , V. ( 2010 ). On Guaranteed Parameter Estimation of a Multiparameter Linear Regression Process , Automatica 46 : 637 – 646 .
   Web of Science ®Google Scholar
• Leonov , S. L. ( 1999 ). Remarks on Extremal Problems in Nonparametric Curve Estimation , Statistics and Probability Letters 43 : 169 – 178 .
   Web of Science ®Google Scholar
• Liptser , R. Sh. and Shiryaev , A. N. ( 1977 ). Statistics of Random Processes. I: General Theory , New York : Springer-Verlag .
   Google Scholar
• Liptser , R. Sh. and Shiryaev , A. N. ( 1978 ). Statistics of Random Processes. II: Applications , New York : Springer-Verlag .
   Google Scholar
• Liptser , R. and Shiryaev , A. ( 1988 ). Theory of Martingales , Berlin : Springer Verlag .
   Google Scholar
• Liski , E. P. , Mandal , N. K. , Shah , K. R. , and Sinha , B. K. ( 2002 ). Topics in Optimal Design , New York : Springer-Verlag .
   Google Scholar
• Loeve , M. ( 1963 ). Probability Theory, , third edition , New York : Van Nostrand .
   Google Scholar
• Martinsek , A. T. ( 1992 ). Using Stopping Rules to Bound the Mean Integrated Squared Error in Density Estimation , Annals of Statistics 20 : 797 – 806 .
   Web of Science ®Google Scholar
• McMurry , T. and Politis , D. N. ( 2004 ). Nonparametric Regression with Infinite Order Flat-top Kernels , Journal of Nonparametric Statististics 16 : 549 – 562 .
   Web of Science ®Google Scholar
• Mukhopadhyay , N. and Solanky , T. K. S. ( 1994 ). Multistage Selection and Ranking Procedures , New York : Marcel Dekker .
   Google Scholar
• Nazin , A. V. and Ljung , L. ( 2002 ). Asymptotically Optimal Smoothing of Averaged LMS for Regression, Paper presented at 15th IFAC World Congress, Barcelona, Spain, July 21–26, 15: 436.
   Google Scholar
• Novikov , A. A. ( 1971 ). Sequential Estimation of the Parameters of the Diffusion Processes , Theory of Probability and Its Applications 16 : 394 – 396 (in Russian) .
   Google Scholar
• Politis , D. N. ( 2001 ). On Nonparametric Function Estimation with Infinite-Order Flat-top Kernels , in Probability and Statistical Models with Applications , et al. , eds., pp. 469 – 483 , Boca Raton : Chapman and Hall/CRC .
   Google Scholar
• Politis , D. N. and Romano , J. P. ( 1993 ). On a Family of Smoothing Kernels of Infinite Order, in Proceedings of 25th Symposium on the Interface, San Diego, California, April 14–17, M. Tarter and M. Lock, eds., pp. 141–145, The Interface Foundation of North America.
   Google Scholar
• Politis , D. N. and Romano , J. P. ( 1999 ). Multivariate Density Estimation with General Flat-Top Kernels of Infinite Order , Journal of Multivariate Analysis 68 : 1 – 25 .
   Web of Science ®Google Scholar
• Politis , D. , Romano , J. , and Wolf , M. ( 1999 ). Subsumpling , Berlin : Springer Verlag .
   Google Scholar
• Politis , D. N. and Vasiliev , V. A. ( 2012 ). Sequential Kernel Estimation of a Multivariate Regression Function, in Proceedings of IX International Conference ‘System Identification and Control Problems’, SICPRO’12, Moscow, 30 January–2 February, 2012. S. N. Vassiliev et al. eds., pp. 996–1009, Moscow: V. A. Tapeznikov Institute of Control Sciences.
   Google Scholar
• Prakasa Rao , B. L. S. ( 1983 ). Nonparametric Functional Estimation , New York : Academic Press .
   Google Scholar
• Roll , J. , Nazin , A. , and Ljung , L. ( 2002 ). A Non-Asymptotic Approach to Local Modelling, the 41st IEEE CDC, Las Vegas, NV, December 10–13. Available at http://www.control.isy.liu.se/research/reports/2003/2482.pdf
   Google Scholar
• Roll , J. , Nazin , A. , and Ljung , L. (2005). Non-Linear System Identification Via Direct Weight Optimization, Automatica , 41: 475–490.
   Web of Science ®Google Scholar
• Rosenblatt , M. ( 1991 ). Stochastic Curve Estimation, Vol. 3, NSF-CBMS Regional Conference Series , Hayward , CA : Institute of Mathematical Statistics .
   Google Scholar
• Scott , D. W. ( 1992 ). Multivariate Density Estimation: Theory, Practice and Visualization , New York : Wiley .
   Google Scholar
• Stute , W. ( 1983 ). Sequential Fixed-Width Confidence Intervals for a Nonparametric Density Function , Zeitschrift für Warscheinlichskeitstheorie und Verwandte Gebiete 62 : 113 – 123 .
   Web of Science ®Google Scholar
• Vasiliev , V. A. ( 1997 ). On Identification of Dynamic Systems of Autoregressive Type , Automation and Remote Control 58 : 106 – 118 .
   Google Scholar
• Vasiliev , V. A. ( 2011 ). On Adaptive Control Problems of Discrete-Time Stochastic Systems , Preprints of 18th IFAC World Congress , Milano (Italy) August 28–September 2, 2011 , et al. , eds., pp. 12439–12444, Milano, Italy: Università Cattolica del Sacro Cuore .
   Google Scholar
• Vasiliev , V. A. and Konev , V. V. ( 1997 ). On Optimal Adaptive Control of a Linear Stochastic Process, Proceedings of 15th IMACS World Congress on Scientific Computation, Modelling and Applied Mathematics, August 24–29, Berlin, Germany 5: 87–91.
   Google Scholar
• Vasiliev , V. A. and Koshkin , G. M. ( 1998 ). Nonparametric Identification of Autoregression , Probability Theory and Its Applications 43 : 577 – 588 .
   Google Scholar
• Wald , A. ( 1947 ). Sequential Analysis , New York : Wiley .
   Google Scholar
• Wald , A. ( 1950 ). Statistical Decision Functions , New York : Wiley .
   Google Scholar
• Xu , Y. and Martinsek , A. T. ( 1995 ). Sequential Confidence Bands for Densities , Annals of Statistics 23 : 2218 – 2240 .
   Web of Science ®Google Scholar
• Recommended by Sangyed Lee
   Google Scholar