Statistical estimation of quadratic Rényi entropy for a stationary m-dependent sequence

References

• Anderson, T.W. (1971), The Statistical Analysis of Time Series, New York: John Wiley and Sons.
   Google Scholar
• Barbour, A.D., Holst, L., and Janson, S. (1992), Poisson Approximation, Oxford: Oxford University Press.
   Google Scholar
• Baryshnikov, Y., Penrose, M.D., and Yukich, J.E. (2009), ‘Gaussian Limits for Generalized Spacings’, Annals of Applied Probability, 19, 158–185. doi: 10.1214/08-AAP537
   Web of Science ®Google Scholar
• Berkes, I., Horváth, L., Kokoszka, P., and Shao, Q.M. (2005), ‘Almost Sure Convergence of the Bartlett Estimator’, Periodica Mathematica Hungarica, 51, 11–25. doi: 10.1007/s10998-005-0017-5
   Google Scholar
• Bickel, P.J., and Ritov, Y. (1988), ‘Estimating Integrated Squared Density Derivatives: Sharp Best Order of Convergence Estimates’, Sankhyā: The Indian Journal of Statistics, Series A, 50, 381–393.
   Google Scholar
• Billlingsley, P. (1995), Probability and Measure, New York: Wiley.
   Google Scholar
• Escolano, F., Suau, P., and Bonev, B. (2009), Information Theory in Computer Vision and Pattern Recognition, New York: Springer.
   Google Scholar
• Giné, E., and Nickl, R. (2008), ‘A Simple Adaptive Estimator for the Integrated Square of a Density’, Bernoulli, 14, 47–61. doi: 10.3150/07-BEJ110
   Web of Science ®Google Scholar
• Goria, M.N., Leonenko, N.N., Mergel, V.V., and Inverardi, P.L.N. (2005), ‘A New Class of Random Vector Entropy Estimators and Its Applications in Testing Statistical Hypotheses’, Journal of Nonparametric Statistics, 17, 277–297. doi: 10.1080/104852504200026815
   Web of Science ®Google Scholar
• Gregorio, A., and Iacus, S.M. (2009), ‘On Rényi Information for Ergodic Diffusion Processes’, Information Sciences, 179, 279–291. doi: 10.1016/j.ins.2008.09.016
   Web of Science ®Google Scholar
• Harrelson, D., and Houdré, C. (2003), ‘A Characterization of m-Dependent Stationary Infinitely Divisible Sequences with Applications to Weak Convergence’, Annals of Probability, 31, 849–881. doi: 10.1214/aop/1048516538
   Google Scholar
• Jammalamadaka, S.R., and Janson, S. (1986), ‘Limit Theorems for a Triangular Scheme of U-Statistics with Applications to Inter-Point Distances’, Annals of Probability, 14, 1347–1358. doi: 10.1214/aop/1176992375
   Web of Science ®Google Scholar
• Joe, H. (1997), Multivariate Models and Dependence Concepts, London: Chapman and Hall.
   Google Scholar
• Johnson, O., and Vignat, C. (2007), ‘Some Results Concerning Maximum Rényi Entropy Distributions’, Annales de Institut Henri Poincaré Probability and Statistics, 43, 339–351. doi: 10.1016/j.anihpb.2006.05.001
   Web of Science ®Google Scholar
• Källberg, D., and Seleznjev, O. (2014), ‘Estimation of Entropy-Type Integral Functionals’, Communications in Statistics - Theory and Methods, preprint arXiv:1209.2544.
   Google Scholar
• Källberg, D., Leonenko, N., and Seleznjev, O. (2012), ‘Statistical Inference for Rényi Entropy Functionals’, Lecture Notes in Computer Science, 7260, 36–51. doi: 10.1007/978-3-642-28279-9_5
   Google Scholar
• Kapur, J.N. (1989), Maximum-Entropy Models in Science and Engineering, New York: Wiley.
   Google Scholar
• Kapur, J.N., and Kesavan, H.K. (1992), Entropy Optimization Principles with Applications, New York: Academic Press.
   Google Scholar
• Kim, T.Y., Luo, Z.M., and Kim, C. (2011), ‘The Central Limit Theorem for Degenerate Variable U-Statistics Under Dependence’, Journal of Nonparametric Statistics, 23, 683–699. doi: 10.1080/10485252.2011.556193
   Web of Science ®Google Scholar
• Koroljuk, V.S., and Borovskich, Y.V. (1994), Theory of U-Statistics, Dordrecht: Kluwer.
   Google Scholar
• Kotz, S., Balakrishnan, N., and Johnson, N.L. (2000), Continuous Multivariate Distributions: Models and Applications, New York: Wiley.
   Google Scholar
• Last, Y., Klein, M., and Kandel, A. (2001), ‘Knowledge Discovery in Time Series Databases’, IEEE Transactions on Systems, Man, and Cybernetics – Part B, 31, 160–169. doi: 10.1109/3477.907576
   PubMed Web of Science ®Google Scholar
• Laurent, B. (1996), ‘Efficient Estimation of Integral Functionals of a Density’, Annals of Statistics, 24, 659–681. doi: 10.1214/aos/1032894458
   Web of Science ®Google Scholar
• Laurent, B. (1997), ‘Estimation of Integral Functionals of a Density and Its Derivatives’, Bernoulli, 3, 181–211. doi: 10.2307/3318586
   Web of Science ®Google Scholar
• Lee, A.J. (1990), U-Statistics: Theory and Practice, New York: Marcel Dekker.
   Google Scholar
• Leonenko, N., and Seleznjev, O. (2010), ‘Statistical Inference for the ε-Entropy and the Quadratic Rényi Entropy’, Journal of Multivariate Analysis, 101, 1981–1994. doi: 10.1016/j.jmva.2010.05.009
   Web of Science ®Google Scholar
• Leonenko, N., Pronzato, L., and Savani, V. (2008), ‘A Class of Rényi Information Estimators for Multidimensional Densities’, Annals of Statistics, 36, 2153–2182 (corrections (2010), Annals of Statistics, 38, 3837–3838). doi: 10.1214/07-AOS539
   Web of Science ®Google Scholar
• Neemuchwala, H., Hero, A., and Carson, P. (2005), ‘Image Matching Using Alpha-Entropy Measures and Entropic Graphs’, Signal Processing, 85, 277–296. doi: 10.1016/j.sigpro.2004.10.002
   Web of Science ®Google Scholar
• Pardo, L. (2006), Statistical Inference Based on Divergence Measures, Boca Raton, FL: Chapman & Hall.
   Google Scholar
• Penrose, M., and Yukich, J.E. (2011), ‘Limit Theory for Point Processes in Manifolds’, Annals of Applied Probability, 23, 2161–2211. doi: 10.1214/12-AAP897
   Web of Science ®Google Scholar
• Principe, J.C. (2010), Information Theoretic Learning, New York: Springer.
   Google Scholar
• Rényi, A. (1970), Probability Theory, Amsterdam: North-Holland.
   Google Scholar
• Seleznjev, O., and Thalheim, B. (2003), ‘Average Case Analysis in Database Problems’, Methodology and Computing in Applied Probability, 5, 395–418. doi: 10.1023/A:1026258911996
   Web of Science ®Google Scholar
• Seleznjev, O., and Thalheim, B. (2010), ‘Random Databases with Approximate Record Matching’, Methodology and Computing in Applied Probability, 12, 63–89. doi: 10.1007/s11009-008-9092-4
   Web of Science ®Google Scholar
• Serfling, R.J. (2002), Approximation Theorems of Mathematical Statistics, New York: Wiley.
   Google Scholar
• Shannon, C.E. (1948), ‘A Mathematical Theory of Communication’, Bell System Technical Journal, 27, 379–423, 623–656. doi: 10.1002/j.1538-7305.1948.tb01338.x
   Web of Science ®Google Scholar
• Thalheim, B. (2000), Entity-Relationship Modeling. Foundations of Database Technology, Berlin: Springer-Verlag.
   Google Scholar
• Tsallis, C. (1988), ‘Possible Generalization of Boltzmann–Gibbs Statistics’, Journal of Statistical Physics, 52, 479–487. doi: 10.1007/BF01016429
   Web of Science ®Google Scholar
• Tsybakov, A.B. (2009), Introduction to Nonparametric Estimation. New York: Springer-Verlag.
   Google Scholar
• Ullah, A. (1996), ‘Entropy, Divergence and Distance Measures with Econometric Applications’. Journal of Statistical Planning and Inference, 49, 137–162. doi: 10.1016/0378-3758(95)00034-8
   Web of Science ®Google Scholar
• Vatutin, V.A., and Mikhailov, V.G. (1995), ‘Statistical Estimation of the Entropy of Discrete Random Variables with a Large Number of Outcomes’, Russian Mathematical Surveys, 50, 963–976. doi: 10.1070/RM1995v050n05ABEH002601
   Web of Science ®Google Scholar
• Wang, Q. (1999), ‘On Berry–Esseen Rates for m-Dependent U-Statistics’, Statistics and Probability Letters, 41, 123–130. doi: 10.1016/S0167-7152(98)00128-X
   Google Scholar