In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?

References

• Amato , J. D. and Swanson , N. R. 2001 . The real-time predictive content of money for output . J. Monetary Econ. , 48 : 3 – 24 .
   Web of Science ®Google Scholar
• Anderson , T. W. 1994 . The Statistical Analysis of Time Series New York : Wiley .
   Google Scholar
• Ashley , R. , Granger , C. W. J. and Schmalensee , R. 1980 . Advertising and aggregate consumption: An analysis of causality . Econometrica , 48 : 1149 – 1167 .
   Web of Science ®Google Scholar
• Berkowitz , J. and Giorgianni , L. 2001 . Long-horizon exchange rate predictability? . Rev. Econ. Statist. , 83 : 81 – 91 .
   Web of Science ®Google Scholar
• Campbell , J. Y. and Shiller , R. J. 1988a . The dividend-price ratio and expectations of future dividends and discount factors . Rev. Financial Stud. , 1 : 195 – 228 .
   Web of Science ®Google Scholar
• Campbell , J. Y. and Shiller , R. J. 1988b . Stock prices, earnings, and expected dividends . J. Financ. , 43 : 661 – 676 .
   Web of Science ®Google Scholar
• Chao , J. C. , Corradi , V. and Swanson , N. R. 2001 . An out-of-sample test for granger causality . Macroecon. Dyn. , 5 : 598 – 620 .
   Web of Science ®Google Scholar
• Chinn , M. D. and Meese , R. A. 1995 . Banking on currency forecasts: How predictable is change in money? . J. Int. Econ. , 38 : 161 – 178 .
   Web of Science ®Google Scholar
• Clarida , R. H. and Taylor , M. P. 1997 . The term structure of forward exchange premiums and the forecastability of spot exchange rates: Correcting the errors . Rev. Econ. Statist. , 89 : 353 – 361 .
   Google Scholar
• Clarida , R. H. , Sarno , L. , Taylor , M. P. and Valente , G. 2003 . The out-of sample success of term structure models as exchange rate predictors: A step beyond . J. Int. Econ. , 60 : 61 – 83 .
   Web of Science ®Google Scholar
• Clark , T. E. 2004 . Can out-of-sample forecast comparisons help prevent overfitting? Forthcoming . J. Forecast , 23 : 115 – 139 .
   Web of Science ®Google Scholar
• Clark , T. E. and McCracken , M. W. 2000 . Not-for-Publication Appendix to Tests of Equal Forecast Accuracy and Encompassing for Nested Models. Manuscript. Federal Reserve Bank of Kansas City and Louisiana State University
   Google Scholar
• Clark , T. E. and McCracken , M. W. 2001 . Tests of equal forecast accuracy and encompassing for nested models . J. Econometrics. , 105 : 85 – 110 .
   Web of Science ®Google Scholar
• Clark , T. E. and McCracken , M. W. 2003 . The power of tests of predictive ability in the presence of structural breaks. Forthcoming . J. Econometrics ,
   Google Scholar
• Clark , T. E. and McCracken , M. W. 2004 . Evaluating long-horizon forecasts. Manuscript. Department of Economics, University of Missouri at Columbia
   Google Scholar
• Corradi , V. and Swanson , N. R. 2002 . A consistent test for nonlinear out of sample predictive accuracy . J. Econometrics. , 110 : 353 – 381 .
   Web of Science ®Google Scholar
• Corradi , V. , Swanson , N. R. and Olivetti , C. 2001 . Predictive ability with cointegrated variables . J. Econometrics , 104 : 315 – 358 .
   Google Scholar
• Dasgupta , N. and Spurrier , J. D. 1997 . A class of multivariate chi-square distributions with applications to comparisons with a control . Commun. Statist. Theory Method , 26 : 1559 – 1573 .
   Web of Science ®Google Scholar
• Denton , F. T. 1985 . Data mining as an industry . Rev. Econ. Statist. , 67 : 124 – 127 .
   Web of Science ®Google Scholar
• Diebold , F. X. and Mariano , R. S. 1995 . Comparing predictive accuracy . J. Business Econ. Statist. , 13 : 253 – 263 .
   Web of Science ®Google Scholar
• Fama , E. F. and French , K. R. 1988 . Dividend yields and expected stock returns . J. Financial Econ. , 22 : 3 – 25 .
   Web of Science ®Google Scholar
• Faust , J. , Rogers , J. and Wright , J. 2003 . Exchange rate forecasting: The errors we've really made . J. Int. Econ. , 60 : 35 – 59 .
   Web of Science ®Google Scholar
• Gilbert , S. 2001 . Sampling Schemes and Tests of Regression Models. Manuscript. Department of Economics, Southern Illinois University at Carbondale
   Google Scholar
• Goetzmann , W. N. and Jorion , P. 1993 . Testing the predictive power of dividend yields . J. Finance , 48 : 663 – 679 .
   Web of Science ®Google Scholar
• Goetzmann , W. N. and Jorion , P. 1995 . A longer look at dividend yields . J. Business , 68 : 483 – 508 .
   Web of Science ®Google Scholar
• Granger , C. W. J. 1990 . Modeling Economic Time Series: Readings in Econometric Methodology Oxford, UK : Oxford University Press .
   Google Scholar
• Hansen , B. E. 1992 . Convergence to stochastic integrals for dependent and heterogeneous processes . Econometric Theory , 8 : 489 – 500 .
   Web of Science ®Google Scholar
• Hansen , P. R. 2000 . The Distribution of the Maximal R 2. Manuscript. Department of Economics, University of California at San Diego
   Google Scholar
• Hansen , P. R. 2001 . The Reality Check for Data Snooping: A Comment on White. Manuscript. Department of Economics, Brown University
   Google Scholar
• Harvey , D. I. , Leybourne , S. J. and Newbold , P. 1998 . Tests for forecast encompassing . J. Business Econ. Statist. , 16 : 254 – 259 .
   Web of Science ®Google Scholar
• Inoue , A. and Kilian , L. 2003 . On the Selection of Forecasting Models. Working Paper No. 214. European Central Bank
   Google Scholar
• Kilian , L. 1999 . Exchange rates and monetary fundamentals: What do we learn from long-horizon regressions? . J. Appl. Econometrics , 14 : 491 – 510 .
   Web of Science ®Google Scholar
• Kilian , L. and Taylor , M. P. 2003 . Why is it so difficult to beat the random walk forecast of exchange rates? . J. Int. Econ. , 6 : 85 – 107 .
   Google Scholar
• Magnus , J. R. and Neudecker , H. 1999 . Matrix Differential Calculus with Applications in Statistics and Econometrics , Revised edition Chichester, UK : Wiley .
   Google Scholar
• Mark , N. C. 1995 . Exchange rates and fundamentals: Evidence on long-horizon predictability . Amer. Econ. Rev. , 85 : 201 – 218 .
   Web of Science ®Google Scholar
• Mark , N. C. and Choi , D. 1997 . Real exchange rate prediction over long horizons . J. Int. Econ. , 43 : 29 – 60 .
   Google Scholar
• McCracken , M. W. 1999 . Asymptotics for Out of Sample Tests of Causality. Manuscript. Department of Economics, Louisiana State University
   Google Scholar
• McCracken , M. W. 2001 . Data Mining and Out-of-Sample Inference. Manuscript. Department of Economics, Louisiana State University
   Google Scholar
• Meese , R. A. and Rogoff , K. 1983 . Empirical exchange rate models of the seventies: Do they fit out-of-sample? . J. Int. Econ. , 14 : 3 – 24 .
   Web of Science ®Google Scholar
• Meese , R. A. and Rogoff , K. 1988 . Was it real? The exchange rate-interest differential relation over the modern floating-rate period . J. Finance , 43 : 933 – 948 .
   Web of Science ®Google Scholar
• Meese , R. A. and Rose , A. K. 1991 . An empirical assessment of non-linearities in models of exchange rate determination . Rev. Econ. Stud. , 58 : 603 – 619 .
   Web of Science ®Google Scholar
• Rapach , D. E. and Wohar , M. E. 2002 . In-Sample vs. Out-of-Sample Tests of Stock Return Predictability in the Context of Data Mining. Manuscript. University of Nebraska
   Google Scholar
• Rapach , D. E. and Wohar , M. E. 2003 . Valuation ratios and long-horizon stock price predictability. Forthcoming . J. Appl. Econometrics ,
   Google Scholar
• Rossi , B. 2003 . Testing long-horizon predictive ability with high persistence and the Meese-Rogoff puzzle. Forthcoming: International Economic Review
   Google Scholar
• Royen , T. 1984 . Multivariate comparisons of polynomial distributions . Biometrical J. , 26 : 319 – 332 .
   Web of Science ®Google Scholar
• Royen , T. 1997 . “ Multivariate gamma distributions (Update) ” . In Encyclopedia of Statistical Sciences Edited by: Kotz , S. Vol. 1 , 419 – 425 . New York : Wiley .
   Google Scholar
• Stock , J. H. and Watson , M. W. 1999 . Forecasting inflation . J. Monetary Econ. , 44 : 293 – 335 .
   Web of Science ®Google Scholar
• Stock , J. H. and Watson , M. W. 2003 . Forecasting output and inflation: The role of asset prices . J. Econ. Literature , 41 : 788 – 829 .
   Web of Science ®Google Scholar
• Sullivan , R. , Timmermann , A. and White , H. 2001 . Dangers of data mining: The case of calendar effects in stock returns . J. Econometrics , 105 : 249 – 286 .
   Web of Science ®Google Scholar
• West , K. D. 1996 . Asymptotic inference about predictive ability . Econometrica , 64 : 1067 – 1084 .
   Web of Science ®Google Scholar
• West , K. D. 2001 . Forecasts depend on estimated regression parameters . J. Business Econ. Statist. , 19 : 29 – 33 .
   Web of Science ®Google Scholar
• White , H. 2000 . A reality check for data snooping . Econometrica , 68 : 1097 – 1126 .
   Web of Science ®Google Scholar