Penalized Maximum Likelihood Principle for Choosing Ridge Parameter

References

• Akaike , H. ( 1973 ). Information Theory and an Extension of the Maximum Likelihood Principle . Proc. 2nd International Symposium on Information Theory . Budapest : Akademiai Kaidó , pp. 267 – 281 .
   Google Scholar
• Alkhamisi , M. , Khalaf , G. , Shukur , G. ( 2006 ). Some modifications for choosing ridge parameters . Communications in Statistics—Theory and Methods 35 : 2005 – 2020 .
   Web of Science ®Google Scholar
• Alkhamisi , M. , Shukur , G. ( 2007 ). A Monte Carlo study of recent ridge parameters . Communications in Statistics—Simulation and Computation 36 : 535 – 547 .
   Web of Science ®Google Scholar
• Allen , D. ( 1974 ). The relationship between variable selection and data augmentation and a method for prediction . Technometrics 16 : 125 – 127 .
   Web of Science ®Google Scholar
• Belsley , D. A. , Kuh , E. , Welsch , R. E. ( 1980 ). Regression Diagnostics, Identifying Influential Data and Sources of Collinearity . New York : John Wiley .
   Google Scholar
• Craven , P. , Wahba , G. ( 1979 ). Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the methods of generalized cross-validation . Numerische Mathematik 31 : 377 – 403 .
   Web of Science ®Google Scholar
• Delaney , N. J. , Chatterjee , S. ( 1986 ). Use of the bootstrap and cross-validation in ridge regression . Journal of Business and Economics Statsitics 4 ( 2 ): 225 – 262 .
   Google Scholar
• Draper , N. R. , Smith , H. ( 1981 ). Applied Regression Analysis . New York : John Wiley .
   Google Scholar
• Geisser , S. ( 1975 ). The predictive sample reuse method with applications . Journal of the American Statistical Association 70 : 329 – 328 .
   Google Scholar
• Golub , G. H. , Heath , M. , Wahba , G. ( 1979 ). Generalized cross-validation as a method for choosing a good ridge parameter . Technometrics ( 21 ): 215 – 223 .
   Google Scholar
• Hastie , T. , Tibshirani , R. , Friedman , J. H. ( 2001 ). The Elements of Statistical Learning . New York : Springer .
   Google Scholar
• Hoerl , A. E. , Kennard , R. W. ( 1970 ). Ridge regression: biased estimation for nonorthogonal problems . Technometrics 12 ( 1 ): 55 – 67 .
   Web of Science ®Google Scholar
• Hoerl , A. E. , Kennard , R. W. , Baldwin , K. F. (1975). Ridge regression: some simulations. Communications in Statistics (4):105–123.
   Google Scholar
• Hutter , M. ( 2007 ). The Loss Rank Principle for Model Selection . Proc. 20th Annual Conference on Learning Theory (COLT'07), Vol. 4539 of LNAI, San Diego . Berlin : Springer , pp. 589 – 603 .
   Google Scholar
• Hutter , M. , Tran , M. N. ( 2008 ). The loss rank principle for model selection . Submitted.
   Google Scholar
• Khalaf , G. , Shukur , G. ( 2005 ). Choosing ridge parameter for regression problems . Communications in Statistics—Theory and Methods 34 : 1177 – 1182 .
   Web of Science ®Google Scholar
• Rice , J. A. ( 1995 ). Mathematical Statistics and Data Analysis . California : Duxbury Press .
   Google Scholar
• Stamey , T. , Kabalin , J. , McNeal , J. , Johnstone , I. , Freiha , F. , Redwine , E. , Yang , N. ( 1989 ). Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate II. Radical prostatectomy treated patients . Journal of Urology ( 16 ): 1076 – 1083 .
   PubMed Web of Science ®Google Scholar
• Stone , M. ( 1974 ). Cross-validatory choice and assessment of statistical predictions (with discussion) . Journal of the Royal Statistical Society Series B 36 : 111 – 147 .
   Google Scholar
• Tran , M. N. ( 2009 ). The loss rank criteria for variable selection . Submitted.
   Google Scholar
• Vinod , H. D. ( 1978 ). A survey of ridge regression and related techniques for improvements over ordinary least squares . The Review of Economics and Statistics 60 ( 1 ): 121 – 131 .
   Web of Science ®Google Scholar
• Wang , H. , Li , R. , Tsai , C. L. ( 2007 ). Tuning parameter selectors for the smoothly clipped absolute deviation method . Biometrika 3 ( 94 ): 553 – 568 .
   Web of Science ®Google Scholar