The Variable Selection Problem

References

• Akaike , H. 1973 . “Information Theory and an Extension of the Maximum Likelihood Principle,” . In 2nd International Symposium on Information Theory , Edited by: Petrov , B. N. and Csaki , F. 267 – 281 . Budapest : Akademia Kiado .
   Google Scholar
• Benjamini , Y. and Hochberg , Y. 1995 . “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing” . Journal of the Royal Statistical Society , 57 : 289 – 300 . Ser. B
   Google Scholar
• Berger , J. O. and Pericchi , L. R. 1996a . “The Intrinsic Bayes Factor for Model Selection and Prediction” . Journal of the American Statistical Association , 91 : 109 – 122 .
   Web of Science ®Google Scholar
• Berger , J. O. and Pericchi , L. R. 1996b . “The Intrinsic Bayes Factor for Linear Models,” . In Bayesian Statistics 5 , Edited by: Bernardo , J. M. , Berger , J. O. , Dawid , A. P. and Smith , A. F. M. 25 – 44 . London : Oxford University Press .
   Google Scholar
• Brieman , L. 1992 . “The Little Bootstrap and Other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error” . Journal of the American Statistical Association , 87 : 738 – 754 .
   Web of Science ®Google Scholar
• Brieman , L. 1995 . “Better Subset Selection Using the Nonnegative Garrote” . Technometrics , 37 : 373 – 384 .
   Web of Science ®Google Scholar
• Clyde , M. 1999 . “Bayesian Model Averaging and Model Search Strategies,” . In Bayesian Statistics 6 , Edited by: Bernardo , J. M. , Berger , J. O. , Dawid , A. P. and Smith , A. F. M. London : Oxford University Press .
   Google Scholar
• Clyde , M. and George , E. I. 1999 . “Empirical Bayes Estimation in Wavelet Nonparametric Regression,” . In Bayesian Inference in Wavelet-Based Models , Edited by: Muller , P. and Vidakovic , B. 309 – 322 . New York : Springer-Verlag .
   Google Scholar
• Clyde , M. and George , E. I. 2000 . “Flexible Empirical Bayes Estimation for Wavelets” . Journal of the Royal Statistical Society , : 681 – 698 . Ser. B
   Google Scholar
• Clyde , M. , Parmigiani , G. and Vidakovic , B. 1998 . “Multiple Shrinkage and Subset Selection in Wavelets” . Biometrika , 85 : 391 – 402 .
   Web of Science ®Google Scholar
• Dash , M. and Liu , H. 1997 . “Feature Selection for Classification” . Intelligent Data Analysis , 1 : 131 – 156 .
   Google Scholar
• Donoho , D. L. and Johnstone , I. M. 1994 . “Ideal Spatial Adaptation by Wavelet Shrinkage” . Biometrika , 81 : 425 – 256 .
   Web of Science ®Google Scholar
• Donoho , D. L. and Johnstone , I. M. 1995 . “Adapting to Unknown Smoothness via Wavelet Shrinkage” . Journal of the Royal Statistical Society , 90 : 1200 – 1224 . Ser. B
   Google Scholar
• Draper , D. 1995 . “Assessment and Propagation of Model Uncertainty” . Journal of the Royal Statistical Society , 57 : 45 – 97 . (with discussion), Ser. B
   Google Scholar
• Efron , B. 1983 . “Estimating the Error Rate of a Predictive Rule: Improvement Over Cross-Validation” . Journal of the American Statistical Association , 78 : 316 – 331 .
   Web of Science ®Google Scholar
• Efroymson , M. A. 1960 . “Multiple Regression Analysis,” . In Mathematical Methods for Digital Computers , Edited by: Ralston , A. and Wilf , H. S. 191 – 203 . New York : Wiley .
   Google Scholar
• Foster , D. P. and George , E. I. 1994 . “The Risk Inflation Criterion for Multiple Regression” . The Annals of Statistics , 22 : 1947 – 1975 .
   Web of Science ®Google Scholar
• Furnival , G. M. and Wilson , R. W. 1974 . “Regression by Leaps and Bounds” . Technometrics , 16 : 499 – 511 .
   Web of Science ®Google Scholar
• Garthwaite , P. H. and Dickey , J. M. 1996 . “Quantifying and Using Expert Opinion for Variable-Selection Problems in Regression” . Chemometrics and Intelligent Laboratory Systems , 35 : 1 – 34 . (with discussion)
   Web of Science ®Google Scholar
• Geisser , S. and Eddy , W. F. 1979 . “A Predictive Approach to Model Selection” . Journal of the American Statistical Association , 74 : 153 – 160 .
   Web of Science ®Google Scholar
• George , E. I. 1999 . “Bayesian Model Selection,” . In Encyclopedia of Statistical Sciences, Update Vol. 3 , Edited by: Kotz , S. , Read , C. and Banks , D. 39 – 46 . New York : Wiley .
   Google Scholar
• George , E. I. and Foster , D. P. 2000 . “Calibration and Empirical Bayes Variable Selection” . Biometrika , 87 (forthcoming)
   Web of Science ®Google Scholar
• George , E. I. and McCulloch , R. E. 1993 . “Variable Selection via Gibbs Sampling” . Journal of the American Statistical Association , 88 : 881 – 889 .
   Web of Science ®Google Scholar
• George , E. I. and McCulloch , R. E. 1997 . “Approaches for Bayesian Variable Selection” . Statistica Sinica , 7 ( 2 ) : 339 – 373 .
   Web of Science ®Google Scholar
• Gong , G. 1986 . “Cross-Validation, the Jackknife, and the Bootstrap: Excess Error Estimation in Forward Logistic Regression” . Journal of the American Statistical Association , 393 : 108 – 113 .
   Google Scholar
• Green , P. 1995 . “Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination” . Biometrika , 82 : 711 – 732 .
   Web of Science ®Google Scholar
• Haughton , D. 1988 . “On the Choice of a Model to Fit Data From an Exponential Family” . The Annals of Statistics , 16 : 342 – 355 .
   Web of Science ®Google Scholar
• Hocking . 1976 . “The Analysis and Selection of Variables in Linear Regression” . Biometrics , 32 : 1 – 49 .
   Web of Science ®Google Scholar
• Hoeting , J. A. , Madigan , D. , Raftery , A. E. and Volinsky , C. T. 1999 . “Bayesian Model Averaging: A Tutorial” . Statistical Science , 14 : 382 – 417 . (with discussion)
   Web of Science ®Google Scholar
• Hurvich , C. M. and Tsai , C. L. 1989 . “Regression and Time Series Model Selection in Small Samples” . Biometrika , 76 : 297 – 307 .
   Web of Science ®Google Scholar
• Hurvich , C. M. and Tsai , C. L. 1998 . “A Cross-Validatory AIC for Hard Wavelet Thresholding in Spatially Adaptive Function Estimation” . Biometrika , 85 : 701 – 710 .
   Web of Science ®Google Scholar
• Johnstone , I. M. and Silverman , B. W. 1998 . “Empirical Bayes Approaches to Mixture Problems and Wavelet Regression,” , University of Bristol . technical report
   Google Scholar
• Kass , R. E. and Wasserman , L. 1995 . “A Reference Bayesian Test for Nested Hypotheses and Its Relationship to the Schwarz Criterion” . Journal of the American Statistical Association , 90 : 928 – 934 .
   Web of Science ®Google Scholar
• Laud , P. W. and Ibrahim , J. G. 1995 . “Predictive Model Selection” . Journal of the Royal Statistical Society , 57 : 247 – 262 . Ser. B
   Google Scholar
• Lindley , D. V. 1968 . “The Choice of Variables in Multiple Regression” . Journal of the Royal Statistical Society , 30 : 31 – 66 . (with discussion), Ser. B
   Google Scholar
• Mallows , C. L. 1973 . “Some Comments on Cp” . Technometrics , 15 : 661 – 676 .
   Web of Science ®Google Scholar
• Mallows , C. L. 1995 . “More Comments on Cp” . Technometrics , 37 : 362 – 372 .
   Web of Science ®Google Scholar
• Miller , A. 1990 . Subset Selection in Regression , London : Chapman and Hall .
   Google Scholar
• O'Hagan , A. 1995 . “Fractional Bayes Factors for Model Comparison” . Journal of the Royal Statistical Society , 57 : 99 – 138 . (with discussion), Ser. B
   Google Scholar
• Pauler , D. 1998 . “The Schwarz Criterion and Related Methods for the Normal Linear Model” . Biometrika , 85 : 13 – 27 .
   Web of Science ®Google Scholar
• Raftery , A. E. 1996 . “Approximate Bayes Factors and Accounting for Model Uncertainty in Generalized Linear Models” . Biometrika , 83 : 251 – 266 .
   Web of Science ®Google Scholar
• Rao , C. R. and Wu , Y. 1989 . “A Strongly Consistent Procedure for Model Selection in a Regression Problem” . Biometrika , 76 : 369 – 374 .
   Web of Science ®Google Scholar
• Rissanen , J. 1978 . “Modeling by Shortest Data Description” . Automatica , 14 : 465 – 471 .
   Web of Science ®Google Scholar
• Martini , A. San and Spezzaferri , F. 1984 . “A Predictive Model Selection Criterion” . Journal of the Royal Statistical Society , 46 : 296 – 303 . Ser. B
   Google Scholar
• Schwarz , G. 1978 . “Estimating the Dimension of a Model” . The Annals of Statistics , 6 : 461 – 464 .
   Web of Science ®Google Scholar
• Shao , J. 1997 . “An Asymptotic Theory for Linear Model Selection” . Statistica Sinica , 7 ( 2 ) : 221 – 264 .
   Web of Science ®Google Scholar
• Shao , J. 1993 . “Linear Model Selection by Cross-Validation” . Journal of the American Statistical Association , 88 : 486 – 494 .
   Web of Science ®Google Scholar
• Shibata , R. 1981 . “An Optimal Selection of Regression Variables” . Biometrika , 68 : 45 – 54 .
   Web of Science ®Google Scholar
• Stone , M. 1977 . “An Asymptotic Equivalence of Choice of Model by Cross-Validation and Akaike's Criterion” . Journal of the Royal Statistical Society , 39 : 44 – 47 . Ser. B
   Google Scholar
• Stone , M. 1979 . “Comments on Model Selection Criteria of Akaike and Schwarz” . Journal of the Royal Statistical Society , 41 : 276 – 278 . Ser. B
   Google Scholar
• Thompson , M. L. 1978 . “Selection of Variables in Multiple Regression: Part I. A Review and Evaluation” . International Statistical Review , 46 : 1 – 19 .
   Web of Science ®Google Scholar
• Tibshirani , R. 1996 . “Regression Shrinkage and Selection via the Lasso” . Journal of the Royal Statistical Society , 58 : 267 – 288 . Ser. B
   Google Scholar
• Tibshirani , R. and Knight , K. 1999 . “The Covariance Inflation Criterion for Model Selection” . Journal of the Royal Statistical Society , 61 : 529 – 546 . Ser. B
   Google Scholar
• Wei , C. Z. 1992 . “On Predictive Least Squares Principles” . The Annals of Statistics , 29 : 1 – 42 .
   Google Scholar
• Ye , J. 1998 . “On Measuring and Correcting the Effects of Data Mining and Model Selection” . Journal of the American Statistical Association , 93 : 120 – 131 .
   Web of Science ®Google Scholar
• Zhang , P. 1992 . “Inference After Variable Selection in Linear Regression Models” . Biometrika , 79 : 741 – 746 .
   Web of Science ®Google Scholar
• Zhang , P. 1993 . “Model Selection via Multifold Cross-Validation” . The Annals of Statistics , 21 : 299 – 313 .
   Web of Science ®Google Scholar
• Zheng , X. and Loh , W. Y. 1997 . “A Consistent Variable Selection Criterion for Linear Models for Linear Models With High-Dimensional Covariates” . Statistica Sinica , 7 ( 2 ) : 311 – 325 .
   Web of Science ®Google Scholar