A Criterion for Optimal Predictive Model Selection

References

• Akaike , H. H. ( 1973 ). Information theory and an extension of the maximum likelihood principle . Proc. 2nd Int. Sym. Inform. Theor. Budapest : Akademiai Kaidó , pp. 267 – 281 .
   Google Scholar
• Bailey , C. ( 1994 ). Smart Exercise: Burning Fat, Getting Fit . Boston : Houghton-Mifflin .
   Google Scholar
• Barbieri , M. M. , Berger , J. O. ( 2004 ). Optimal predictive model selection . Ann. Statist. 32 ( 3 ): 870 – 897 .
   Web of Science ®Google Scholar
• Barron , A. R. , Clarke , B. S. , Haussler , D. (1993). Information bounds for the risk of bayesian predictions and the redundancy of universal code. Proc. IEEE Int. Symp. Inform. Theor. (ISIT), pp 54–54.
   Google Scholar
• Berger , J. O. ( 1985 ). Statistical Decision Theory and Bayesian Inference . New York : Springer-Verlag .
   Google Scholar
• Burnham , K. P. , Anderson , D. ( 2002 ). Model Selection and Multimodel Inference: a Practical Information-Theoretic Approach . New York : Springer .
   Google Scholar
• Clyde , M. , George , E. I. ( 2004 ). Model uncertainty . Statist. Sci. 19 ( 1 ): 81 – 94 .
   Web of Science ®Google Scholar
• Draper , D. ( 1995 ). Assessment and propagation of model uncertainty (with discussion) . J. Roy. Statist. Soc. B 57 ( 1 ): 45 – 97 .
   Google Scholar
• Draper , N. R. , Smith , H. ( 1981 ). Applied Regression Analysis . New York : John Wiley .
   Google Scholar
• Ehrlich , I. ( 1973 ). Participation in illegitimate activities: a theoretical and empirical investigation . J. Polit. Econ. 81 : 521 – 565 .
   Web of Science ®Google Scholar
• Geisser , S. ( 1980 ). Discussion of “sampling and bayes' inference in scientific modelling and robustness” by g.e.p. box . J. Roy. Statist. Soc. A 143 : 416 – 417 .
   Web of Science ®Google Scholar
• Gilks , W. R. , Spiegelhalter , D. J. , Richardson , S. ( 1996 ). Markov Chain Monte Carlo in Practice . London : Chapman & Hall .
   Google Scholar
• Good , I. J. ( 1952 ). Rational decisions . J. Roy. Statist. Soc. B 14 : 107 – 114 .
   Google Scholar
• Hoerl , A. E. , Kennard , R. W. ( 1970 ). Ridge regression: biased estimation for nonorthogonal problems . Technometrics 12 ( 1 ): 55 – 67 .
   Web of Science ®Google Scholar
• Hoeting , J. A. , Madigan , D. , Raftery , A. E. , Volinsky , C. T. ( 1999 ). Bayesian model averaging: a tutorial . Statist. Sci. 14 ( 4 ): 382 – 417 .
   Web of Science ®Google Scholar
• Hutter , M. ( 2005 ). Universal Artificial Intelligence: Sequential Decisions based on Algorithm Probability . Berlin : Springer .
   Google Scholar
• Hutter , M. ( 2008 ). Predictive hypothesis identification. arXiv:0809.1270v1 [cs.LG].
   Google Scholar
• Johnson , R. W. ( 1996 ). Fitting percentage of body fat to simple body measurements . J. Statist. Educat. 4 .
   Google Scholar
• Kass , R. E. , Vaidyanathan , S. ( 1992 ). Approximate bayes factors and orthogonal parameters, with application to testing equality of two binomial proportions . J. Roy Statist. Soc. B 54 : 129 – 144 .
   Google Scholar
• Leamer , E. E. ( 1978 ). Specification Searches . New York : Wiley .
   Google Scholar
• Madigan , D. , Raftery , A. E. ( 1994 ). Model selection and accounting for model uncertainty in graphical models using occam's window . J. Amer. Statist. Assoc. 89 .
   PubMedGoogle Scholar
• Madigan , D. , York , J. ( 1995 ). Bayesian graphical models for discrete data . Int. Statist. Rev. 63 : 215 – 232 .
   Web of Science ®Google Scholar
• Mallows , C. L. ( 1973 ). Some comments on C p . Technometrics 15 : 661 – 675 .
   Web of Science ®Google Scholar
• Miller , A. ( 2002 ). Subset Selection in Regression . London : Chapman & Hall/CRC .
   Google Scholar
• Nishii , R. ( 1984 ). Asymptotic properties of criteria for selection of variables in multiple regression . Ann. Statist. 12 : 758 – 765 .
   Web of Science ®Google Scholar
• Raftery , A. E. ( 1996 ). Approximate bayes factors and accounting for model uncertainty in generalised linear models . Biometrika 830 ( 2 ): 251 – 266 .
   Google Scholar
• Raftery , A. E. , Madigan , D. , Hoeting , J. A. ( 1997 ). Bayesian model averaging for linear regression models . J. Amer. Statist. Assoc. 920 ( 437 ): 179 – 191 .
   Google Scholar
• Rao , C. R. , Wu , Y. ( 1989 ). A strongly consistent procedure for model selection in a regression problem . Biometrika 76 : 369 – 374 .
   Web of Science ®Google Scholar
• Rissanen , J. J. ( 1978 ). Modeling by shortest data description . Automatica 14 ( 5 ): 465 – 471 .
   Web of Science ®Google Scholar
• Schwarz , G. ( 1978 ). Estimating the dimension of a model . Ann. Statist. 6 ( 2 ): 461 – 464 .
   Web of Science ®Google Scholar
• Shao , J. ( 1997 ). An asymptotic theory for linear model selection . Statistica Sinica 7 : 221 – 264 .
   Web of Science ®Google Scholar
• Shibata , R. ( 1983 ). Asymptotic mean efficiency of a selection of regression variables . Ann. Instit. Statist. Math. 35 : 415 – 423 .
   Web of Science ®Google Scholar
• Shibata , R. ( 1984 ). Approximate efficiency of a selection procedure for the number of regression variables . Biometrika 71 : 43 – 49 .
   Web of Science ®Google Scholar
• Smith , A. F. M. , Roberts , G. O. (1993). Bayesian computation via gibbs sampler and related Markov chain Monte Carlo methods. J. Roy. Statist. Soc. B 55:3–24.
   Google Scholar
• Taplin , R. H. ( 1993 ). Robust likelihood calculation for time series . J. Roy. Statist. Soc. Ser. B 55 : 829 – 836 .
   Google Scholar
• Tibshirani , R. ( 1996 ). Regression shrinkage and selection via the lasso . J. Roy. Statist. Soc. B 58 ( 1 ): 267 – 288 .
   Google Scholar
• Tierney , L. , Kadane , J. B. ( 1986 ). Accurate approximations for posterior moments and marginal densities . J. Amer. Statist. Assoc. 81 : 82 – 86 .
   Web of Science ®Google Scholar