Automatic Feature Selection via Weighted Kernels and Regularization

References

• Alon , U. , Barkai , N. , Notterman , D. A. , Gish , K. , Ybarra , S. , Mack , D. and Levine , A. J. 1999 . “Broad Patterns of Gene Expression Revealed by Clustering Analysis of Tumor and Normal Colon Tissues Probed by Oligonucleotide Arrays,” . Proceedings of the National Academy of Sciences , 96 : 6745 – 6750 .
   PubMed Web of Science ®Google Scholar
• Argyriou , A. , Hauser , R. , Micchelli , C. A. and Pontil , M. 2006 . “A DC-Programming Algorithm for Kernel Selection,” . In ICML '06: Proceedings of the 23rd International Conference on Machine Learning 41 – 48 .
   Google Scholar
• Bach , F. R. , Lanckriet , G. R. G. and Jordan , M. I. “Multiple Kernel Learning, Conic Duality, and the SMO Algorithm,” . ICML '04: Proceedings of the Twenty-First International Conference on Machine Learning . pp. 41 – 48 .
   Google Scholar
• Bertin , K. and Lecué , G. 2008 . “Selection of Variables and Dimension Reduction in High-Dimensional Non-Parametric Regression,” . Electronic Journal of Statistics , 2 : 1224 – 1241 .
   Web of Science ®Google Scholar
• Breiman , L. 1995 . “Better Subset Regression Using the Nonnegative Garrote,” . Technometrics , 37 : 373 – 384 .
   Web of Science ®Google Scholar
• Breiman , L. and Friedman , J. 1985 . “Estimating Optimal Transformations for Multiple Regression and Correlation,” . Journal of the American Statistical Association , 80 : 580 – 598 .
   Web of Science ®Google Scholar
• Candes , E. and Plan , Y. 2009 . “Near-Ideal Model Selection by ℓ1 Minimization,” . The Annals of Statistics , 37 : 2145 – 2177 .
   Web of Science ®Google Scholar
• Cao , B. , Shen , D. , Sun , J. , Yang , Q. and Chen , Z. 2007 . “Feature Selection in a Kernel Space,” . In ICML '07: Proceedings of the 24th International Conference on Machine Learning 121 – 128 .
   Google Scholar
• Efron , B. , Hastie , T. , Johnstone , I. and Tibshirani , R. 2004 . “Least Angle Regression,” . The Annals of Statistics , 32 : 407 – 499 .
   Web of Science ®Google Scholar
• Fan , J. and Lv , J. 2008 . “Sure Independence Screening for Ultrahigh Dimensional Feature Space,” . Journal of the Royal Statistical Society,Series B , 70 : 849 – 911 .
   PubMed Web of Science ®Google Scholar
• Friedman , J. , Hastie , T. and Tibshirani , R. 2010 . “Regularization Paths for Generalized Linear Models via Coordinate Descent,” . Journal of Statistical Software , 33 : 1 – 22 .
   PubMed Web of Science ®Google Scholar
• Grandvalet , Y. and Canu , S. 2002 . “Adaptive Scaling for Feature Selection in SVMs,” . In Advances in Neural Information Processing Systems 15 553 – 560 .
   Google Scholar
• Guyon , I. , Bitter , H. M. and Ahmed , Z. “Multivariate Nonlinear Feature Selection With Kernel Multiplicative Updates and Gram-Schmidt Relief,” . Proceedings of the BISC FLINT-CIBI 2003 Workshop, Berkeley, CA.
   Google Scholar
• Guyon , I. , Weston , J. , Barnhill , S. and Vapnik , V. 2002 . “Gene Selection for Cancer Classification Using Support Vector Machines,” . Machine Learning , 46 : 389 – 422 .
   Web of Science ®Google Scholar
• Hastie , T. , Rosset , S. , Tibshirani , R. and Zhu , J. 2004 . “The Entire Regularization Path for the Support Vector Machine,” . The Journal of Machine Learning Research , 5 : 1391 – 1415 .
   Web of Science ®Google Scholar
• Hastie , T. , Tibshirani , R. and Friedman , J. 2009 . Elements of Statistical Learning (2nd ed.) , New York : Springer .
   Google Scholar
• Lafferty , J. and Wasserman , L. 2008 . “Rodeo: Sparse, Greedy Nonparametric Regression,” . The Annals of Statistics , 36 : 28 – 63 .
   Web of Science ®Google Scholar
• Lanckriet , G. , Cristianini , N. , Bartlett , P. and Ghaoui , L. E. 2004 . “Learning the Kernel Matrix With Semidefinite Programming,” . Journal of Machine Learning Research , 5 : 27 – 72 .
   Web of Science ®Google Scholar
• Li , F. , Yang , Y. and Xing , E. 2006 . “From Lasso Regression to Feature Vector Machine,” . In Advances in Neural Information Processing Systems 18 779 – 786 .
   Google Scholar
• Lin , Y. and Zhang , H. H. 2007 . “Component Selection and Smoothing in Multivariate Nonparametric Regression,” . The Annals of Statistics , 34 : 2272 – 2297 .
   Google Scholar
• Navot , A. and Tishby , N. 2004 . “Margin Based Feature Selection—Theory and Algorithms,” . In Proceedings of the International Conference on Machine Learning (ICML) 43 – 50 .
   Google Scholar
• Neumann , J. , Schnörr , C. and Steidl , G. 2005 . “Combined SVM-Based Feature Selection and Classification,” . Machine Learning , 61 : 129 – 150 .
   Web of Science ®Google Scholar
• Osborne , M. , Presnell , B. and Turlach , B. 2000 . “A New Approach to Variable Selection in Least Squares Problems,” . IMA Journal of Numerical Analysis , 20 : 389 – 403 .
   Web of Science ®Google Scholar
• Tibshirani , R. 1996 . “Regression Shrinkage and Selection via the Lasso,” . Journal of the Royal Statistical Society,Series B , 58 : 267 – 288 .
   Google Scholar
• Wahba , G. , Lin , Y. and Zhang , H. 1999 . “Generalized Approximate Cross Validation for Support Vector Machines, or, Another Way to Look at Margin-Like Quantities,” . Technical Report, University of Wisconsin
   Google Scholar
• Wang , L. 2008 . “Feature Selection With Kernel Class Separability,” . IEEE Transactions on Pattern Analysis and Machine Intelligence , 30 : 1534 – 1546 .
   Google Scholar
• Weston , J. , Mukherjee , S. , Chapelle , O. , Pontil , M. , Poggio , T. and Vapnik , V. 2000 . “Feature Selection for SVMs,” . In Advances in Neural Information Processing Systems 13 668 – 674 .
   Google Scholar
• Xu , Z. , Jin , R. , Ye , J. , Lyu , M. R. and King , I. 2009 . “Non-Monotonic Feature Selection,” . In ICML '09: Proceedings of the 26th Annual International Conference on Machine Learning 1145 – 1152 .
   Google Scholar
• Zhang , H. H. and Lin , C.-Y. 2010 . COSSO (R package version 1.0-1) , Raleigh , NC : North Carolina State University .
   Google Scholar
• Zhu , J. , Rosset , S. , Hastie , T. and Tibshirani , R. 2003 . “1-Norm Support Vector Machines,” . In Advances in Neural Information Processing Systems 1 – 16 .
   Google Scholar
• Zou , H. 2006 . “The Adaptive Lasso and Its Oracle Properties,” . Journal of the American Statistical Association , 101 : 1418 – 1429 .
   Web of Science ®Google Scholar
• Zou , H. and Hastie , T. 2005 . “Regularization and Variable Selection via the Elastic Net,” . Journal of the Royal Statistical Society,Series B , 67 : 301 – 320 .
   Google Scholar