A new estimator of Kullback–Leibler information and its application in goodness of fit testsFootnote^*

* This work is dedicated to Professor Naser Reza Arghami, who was one of the pioneers in goodness of fit tests based on some measures in information theory. He died in 26 July 2017 at the age of 68.

References

• Shannon CE. A mathematical theory of communications. Bell Syst Tech J. 1948;27:379–423; 623–656. doi: 10.1002/j.1538-7305.1948.tb01338.x
   Web of Science ®Google Scholar
• Vasicek O. A test for normality based on sample entropy. J Roy Stat Soc Ser B. 1976;38:54–59.
   Google Scholar
• Hall P, Morton SC. On the estimation of entropy. Ann Inst Stat Math. 1993;45:69–88. doi: 10.1007/BF00773669
   Web of Science ®Google Scholar
• van Es B. Estimating functionals related to a density by class of statistics based on spacings. Scand J Stat. 1992;19:61–72.
   Web of Science ®Google Scholar
• Ebrahimi N, Pflughoeft K, Soofi E. Two measures of sample entropy. Stat Probab Lett. 1994;20:225–234. doi: 10.1016/0167-7152(94)90046-9
   Web of Science ®Google Scholar
• Correa JC. A new estimator of entropy. Commun Stat Theory Meth. 1995;24:2439–2449. doi: 10.1080/03610929508831626
   Web of Science ®Google Scholar
• Wieczorkowski R, Grzegorzewsky P. Entropy estimators improvements and comparisons. Commun Stat Simul Comput. 1999;28:541–567. doi: 10.1080/03610919908813564
   Web of Science ®Google Scholar
• Alizadeh Noughabi H. A new estimator of entropy and its application in testing normality. J Stat Comput Simul. 2010;80:1151–1162. doi: 10.1080/00949650903005656
   Web of Science ®Google Scholar
• Dudewicz EJ, Van der Meulen EC. Entropy-based tests of uniformity. J Am Stat Assoc. 1981;76:967–974. doi: 10.1080/01621459.1981.10477750
   Web of Science ®Google Scholar
• Gokhale DV. On entropy-based goodness-of-fit test. Comput Stat Data Anal. 1983;1:157–165. doi: 10.1016/0167-9473(83)90087-7
   Web of Science ®Google Scholar
• Arizono I, Ohta H. A test for normality based on Kullback–Leibler information. Am Stat. 1989;43:20–22.
   Web of Science ®Google Scholar
• Ebrahimi N, Habibullah M, Soofi E. Testing exponentiality based on Kullback–Leibler information. J Roy Stat Soc Ser B. 1992;54:739–748.
   Google Scholar
• Alizadeh Noughabi H, Arghami NR. General treatment of goodness of fit tests based on Kullback–Leibler information. J Stat Comput Simul. 2013;83:1556–1569. doi: 10.1080/00949655.2012.667100
   Web of Science ®Google Scholar
• Mudholkar GS, Tian L. An entropy characterization of the inverse Gaussian distribution and related goodness-of-fit test. J Stat Plan Infer. 2002;102:211–221. doi: 10.1016/S0378-3758(01)00099-4
   Web of Science ®Google Scholar
• Choi B, Kim K. Testing goodness-of-fit for Laplace distribution based on maximum entropy. Statistics (Ber). 2006;40:517–531. doi: 10.1080/02331880600822473
   Web of Science ®Google Scholar
• Song KS. Limit theorems for nonparametric sample entropy estimators. Stat Probab Lett. 2000;49:9–18. doi: 10.1016/S0167-7152(00)00025-0
   Web of Science ®Google Scholar
• D’Agostino RB, Stephens MA. Goodness-of-fit Techniques. New York: Marcel Dekker; 1986.
   Google Scholar
• Lemeshko BY, Gorbunova AA. Application of nonparametric Kuiper and Watson tests of goodness-of-fit for composite hypotheses. Meas Tech. 2013;56:965–973. doi: 10.1007/s11018-013-0314-y
   Web of Science ®Google Scholar
• Lemeshko BY, Lemeshko SB. Distribution models for nonparametric tests for fit in verifying complicated hypotheses and maximum-likelihood estimators. Part 1. Meas Tech. 2009a;52:555–565. doi: 10.1007/s11018-009-9330-3
   Web of Science ®Google Scholar
• Lemeshko BY, Lemeshko SB. Models for statistical distributions in nonparametric fitting tests on composite hypotheses based on maximum-likelihood estimators, Part II. Meas Tech. 2009b;52:799–812. doi: 10.1007/s11018-009-9353-9
   Web of Science ®Google Scholar
• Lemeshko BY, Lemeshko SB, Postovalov SN. Statistic distribution models for some nonparametric goodness-of-fit tests in testing composite hypotheses. Commun Stat Theory Meth. 2010;39:460–471. doi: 10.1080/03610920903140148
   Web of Science ®Google Scholar
• Lemeshko BY, Lemeshko SB. Construction of statistic distribution models for nonparametric goodness-of-fit tests in testing composite hypotheses: The computer approach. Qual Technol Quant Manag. 2011;8:359–373. doi: 10.1080/16843703.2011.11673263
   Web of Science ®Google Scholar
• Esteban MD, Castellanos ME, Morales D, et al. Monte Carlo comparison of four normality tests using different entropy estimates. Commun Stat Simul Comput. 2001;30:261–285. doi: 10.1081/SAC-100107780
   Web of Science ®Google Scholar
• Alizadeh Noughabi H, Arghami NR. Monte Carlo comparison of seven normality tests. J Stat Comput Simul. 2011a;81:965–972. doi: 10.1080/00949650903580047
   Web of Science ®Google Scholar
• Alizadeh Noughabi H, Arghami NR. Testing normality using transformed data. Commun Stat Theory Meth. 2011b;42:2365–2375.
   Web of Science ®Google Scholar
• Alizadeh Noughabi H, Arghami NR. Monte Carlo comparison of five exponentiality tests using different entropy estimates. J Stat Comput Simul. 2011c;81:1579–1592. doi: 10.1080/00949655.2010.496368
   Web of Science ®Google Scholar
• Duncan AJ. Quality Control and Industrial statistics. Homewood (IL): Irwin; 1974.
   Google Scholar
• Puig P, Stephens MA. Tests of fit for the Laplace distribution with applications. Technometrics. 2000;42:417–424. doi: 10.1080/00401706.2000.10485715
   Web of Science ®Google Scholar
• Bain LJ, Englehardt M. Interval estimation for the two parameter double exponential distribution. Technometrics. 1973;15:875–887. doi: 10.1080/00401706.1973.10489120
   Web of Science ®Google Scholar
• von Alven WH. Reliability Engineering by ARINC. New Jersey: Prentice-Hall; 1964.
   Google Scholar
• Chhikara RS, Folks JL. The inverse Gaussian distribution as a lifetime model. Technometrics. 1977;19:461–468. doi: 10.1080/00401706.1977.10489586
   Web of Science ®Google Scholar
• Mudholkar GS, Natarajan R, Chaubey YP. A goodness-of-fit test for the inverse Gaussian distribution using its independence characterization. Sankhya, Ser. B. 2001;63:362–374.
   Google Scholar
• Lee S, Vonta L, Karagrigoriou A. A maximum entropy type test of fit. Comput Stat Data Anal. 2011;55:2635–2643. doi: 10.1016/j.csda.2011.03.012
   Web of Science ®Google Scholar
• Folks JL, Chhikara RS. The inverse Gaussian distribution and its statistical application-a review. J Roy Stat Soc Ser B. 1978;40:263–289.
   Google Scholar
• O’Reilly FJ, Rueda R. Goodness of fit for the inverse Gaussian distribution. Can J Stat. 1992;20:387–397. doi: 10.2307/3315609
   Web of Science ®Google Scholar
• Pavur R, Edgeman R, Scott R. Quadratic statistics for the goodness-of-fit test of the inverse Gaussian distribution. IEEE Trans Reliab. 1992;41:118–123. doi: 10.1109/24.126682
   Web of Science ®Google Scholar
• Gunes H, Dietz DC, Auclair PF, et al. Modified goodness-of-fit tests for the inverse Gaussian distribution. Comput Stat Data Anal. 1997;24:63–77. doi: 10.1016/S0167-9473(96)00056-4
   Web of Science ®Google Scholar
• Henze N, Klar B. Goodness-of-fit tests for the inverse Gaussian distribution based on the empirical Laplace transform. Ann Inst Stat Math. 2002;54:425–444. doi: 10.1023/A:1022442506681
   Web of Science ®Google Scholar
• Grubbs FE. Fiducial bounds on reliability for the two parameter negative exponential distribution. Technometrics. 1971;13:873–876. doi: 10.1080/00401706.1971.10488858
   Web of Science ®Google Scholar
• Grane A, Fortiana J. A location- and scale-free goodness-of-fit statistic for the exponential distribution based on maximum correlations. Statistics (Ber). 2009;43:1–12. doi: 10.1080/02331880802187667
   Web of Science ®Google Scholar
• Lawless JF. Statistical models and methods for life-Time data. New York: Wiley; 1982.
   Google Scholar
• Baratpour S, Habibi Rad A. Testing goodness-of-fit for exponential distribution based on cumulative residual entropy. Commun Stat Theory Meth. 2012;41:1387–1396. doi: 10.1080/03610926.2010.542857
   Web of Science ®Google Scholar
• Balakrishnan N, Ng HKT, Kannan N. Goodness-of-fit tests based on spacings for progressively Type-II censored data from a general location-scale distribution. IEEE Trans Reliab. 2004;53:349–356. doi: 10.1109/TR.2004.833317
   Web of Science ®Google Scholar
• Balakrishnan N, Habibi Rad A, Arghami NR. Testing exponentiality based on Kullback–leibler information with progressively Type-II censored data. IEEE Trans Reliab. 2007;56:301–307. doi: 10.1109/TR.2007.895308
   Web of Science ®Google Scholar
• Habibi Rad A, Yousefzadeh F, Balakrishnan N. Goodness-of-fit test based on Kullback–leibler information for progressively Type-II censored data. IEEE Trans Reliab. 2011;60:570–579. doi: 10.1109/TR.2011.2162470
   Web of Science ®Google Scholar
• Pakyari R, Balakrishnan N. A general purpose approximate goodness-of-fit test for progressively Type-II censored data. IEEE Trans Reliab. 2012;61:238–244. doi: 10.1109/TR.2012.2182811
   Web of Science ®Google Scholar
• Lin C-T, Huang Y-L, Balakrishnan N. A new method for goodness-of-fit testing based on Type-II right censored samples. IEEE Trans Reliab. 2008;57:633–642. doi: 10.1109/TR.2008.2005860
   Web of Science ®Google Scholar
• Pakyari R, Balakrishnan N. Goodness-of-fit tests for progressively Type-II censored data from location-scale distributions. J Stat Comput Simul. 2013;83:167–178. doi: 10.1080/00949655.2011.625424
   Web of Science ®Google Scholar
• Alizadeh Noughabi H, Balakrishnan N. Goodness of fit using a new estimate of Kullback–Leibler information based on Type II censored data. IEEE Trans Reliab. 2015;64:627–635. doi: 10.1109/TR.2014.2366763
   Web of Science ®Google Scholar
• Pardo L. Statistical inference based on divergence measures. New York (FL): Chapman & Hall/CRC Press; 2006.
   Google Scholar