Variable selection via penalized minimum φ-divergence estimation in logistic regression

REFERENCES

• A. Agresti, Categorical Data Analysis, John Wiley and Sons, New York, 1990.
   Google Scholar
• S.M. Ali and S.D. Silvey, A general class of coefficients of divergence of one distribution from another, J. R. Stat. Soc. Ser. B 26 (1966), pp. 131–142.
   Google Scholar
• E.B. Andersen, Introduction to the Statistical Analysis of Categorical Data I, Springer-Verlag, Heidelberg, 1997.
   Google Scholar
• J. Anderson and V. Blair, Penalized maximum likelihood estimation in logistic regression and discrimination, Biometrika 69 (1982), pp. 123–136. doi: 10.1093/biomet/69.1.123
   Web of Science ®Google Scholar
• N. Cressie and L. Pardo, Minimum φ -divergence estimator and hierarchical testing in loglinear models, Stat. Sin. 10 (2000), pp. 867–884.
   Web of Science ®Google Scholar
• N. Cressie, L. Pardo, and M.C. Pardo, Size and power considerations for testing Loglinear models using φ -divergence test statistics, Stat. Sin. 13 (2003), pp. 555–570.
   Web of Science ®Google Scholar
• N. Cressie and T.R.C. Read, Multinomial goodness of fit tests, J. R. Stat. Soc. Ser. B 46 (1984), pp. 440–464.
   Google Scholar
• I. Csiszár, Eine Informationtheorestiche Ungleichung und ihre Anwendung anf den Beweis der Ergodizität Markoffshen Ketten, Publ. Math. Inst. Hung. Acad. Sci. Ser. A 8 (1963), pp. 84–108.
   Google Scholar
• A.R. De Pierro, A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography, IEEE Trans. Med. Imaging 14(1) (1995), pp. 132–137. doi: 10.1109/42.370409
   PubMed Web of Science ®Google Scholar
• D.L. Donoho and I.M. Johnstone, Ideal spatial adaptation by wavelet shrinkage, Biometrika 81 (1994), pp. 425–455. doi: 10.1093/biomet/81.3.425
   Web of Science ®Google Scholar
• J. Fan and R. Li, Variable selection via nonconcave penalized likelihood and its oracle properties, J. Am. Stat. Assoc. 96 (2001), 1348–1360. doi: 10.1198/016214501753382273
   Web of Science ®Google Scholar
• J. Fan and H. Peng, Nonconcave penalized likelihood with a diverging number of parameters, Ann. Stat. 32 (2004), 928–961. doi: 10.1214/009053604000000256
   Web of Science ®Google Scholar
• I.E. Frank and J.H. Friedman, A statistical view of some chemometrics regression tools, Technometrics 35 (1993), 109–148. doi: 10.1080/00401706.1993.10485033
   Web of Science ®Google Scholar
• A. Genkin, D.D. Lewis, and D. Madigan, Large-scale Bayesian logistic regression for text categorization, Technometrics 49 (2007), pp. 291–304. doi: 10.1198/004017007000000245
   Web of Science ®Google Scholar
• P.J. Green, On use of the EM for penalized likelihood estimation, J. R. Stat. Soc. Ser. B (Methodol.) 52(3) (1990), pp. 443–452.
   Web of Science ®Google Scholar
• A.K. Gupta, D. Kasturiratna, T. Nguyen, and L. Pardo, A new family of BAN estimators for polytomous logistic regression models based on ϕ-divergence measures, Stat. Methods Appl. 15 (2006), 159–176. doi: 10.1007/s10260-006-0008-6
   Google Scholar
• D.W. Hosmer and S. Lemeshow, Applied Logistic Regression, John Wiley, New York, 1989.
   Google Scholar
• Y. Kim, H. Choi, and H. Oh, Smoothly clipped absolute deviation on high dimensions, J. Am. Stat. Assoc. 103 (2008), pp. 1665–1673. doi: 10.1198/016214508000001066
   Web of Science ®Google Scholar
• S. Kullback, Kullback information, in Encyclopedia of Statistical Sciences, Vol. 4, S. Kotz and N.L. Johnson, eds., John Wiley, New York, 1985, pp. 421–425.
   Google Scholar
• J.A. Pardo, L. Pardo, and M.C. Pardo, Minimum φ -divergence estimator in logistic regression models, Stat. Pap. 47 (2005), pp. 91–108. doi: 10.1007/s00362-005-0274-7
   Web of Science ®Google Scholar
• J.A. Pardo and M.C. Pardo, Minimum φ -divergence estimator and φ -divergence statistics in generalized linear models with binary data, Methodol. Comput. Appl. Probab. 10 (2008), pp. 357–379. doi: 10.1007/s11009-007-9054-2
   Web of Science ®Google Scholar
• L. Pardo, Statistical Inference Based on Divergence Measures, Chapman and Hall/CRC, Taylor and Francis Group, Boca Raton, FL, 2006.
   Google Scholar
• L. Pardo and M.C. Pardo, Minimum power-divergence in three-way contingency tables, J. Stat. Comput. Simul. 73(11) (2003), pp. 819–831. doi: 10.1080/0094965031000097782
   Web of Science ®Google Scholar
• W.C. Parr, Minimum distance estimation: a bibliography, Commun. Stat. Theory Methods 10 (1981), pp. 1205–1224. doi: 10.1080/03610928108828104
   Web of Science ®Google Scholar
• T.R.C. Read and N. Cressie, Goodness of Fit Statistics for Discrete Multivariate Data, Springer, New York, 1988.
   Google Scholar
• V. Roth, The generalized LASSO, IEEE Trans. Neural Networks 15 (2004), pp. 16–28. doi: 10.1109/TNN.2003.809398
   PubMed Web of Science ®Google Scholar
• S. Shevade and S. Keerthi, A simple and efficient algorithm for gene selection using sparse logistic regression, Bioinformatics 19 (2003), pp. 2246–2253. doi: 10.1093/bioinformatics/btg308
   PubMed Web of Science ®Google Scholar
• R.J. Tibshirani, Regression shrinkage and selection via LASSO, J. R. Stat. Soc. B 58 (1996), pp. 267–288.
   Google Scholar
• I. Vajda, Theory of Statistical Inference and Information, Kluwer, Boston, MA, 1989.
   Google Scholar
• H. Wang, R. Li, and C.L. Tsai, On the consistency of SCAD tuning parameter selector, Biometrika 94 (2007), pp. 553–568. doi: 10.1093/biomet/asm053
   PubMed Web of Science ®Google Scholar
• H. Xie and J. Huang, SCAD-penalized regression in high-dimensional partially linear models, Ann. Stat. 37 (2009), pp. 673–696. doi: 10.1214/07-AOS580
   Web of Science ®Google Scholar
• H. Zang, J. Ahn, X. Lin, and C. Park, Gene selection using support vector machines with non-convex penalty, Bioinformatics 22 (2006), 88–95. doi: 10.1093/bioinformatics/bti736
   PubMed Web of Science ®Google Scholar