Abstract
This paper evaluates accuracy and rationality of real GDP forecasts made by 38 Japanese private institutions over the past 22 years. It finds that about 80% of current-year forecasts and year-ahead forecasts made by them pass various tests for rationality. Moreover, the encompassing test reveals the following results: (a) All of these forecasts outperform the naïve forecasts; (b) About half of their current-year forecasts are inferior to the corresponding forecast of VAR, VECM, or the Japanese government; (c) Almost all of their year-ahead forecasts are significantly superior to the corresponding forecast of VAR or the Japanese government, but one-third of them are significantly inferior to VECM forecast; (d) The consensus forecast outperforms typical institution's forecast.
Notes
See Keane and Runkle (Citation1990) and Stark and Croushore (Citation2002). We obtain the same results by using the revised data of gt
released in June of year t + 2.
Average forecast error of typical forecaster is about 0.5 percentage points for current-year forecast (
) and 1.3 percentage points for year-ahead forecast (
). See Ashiya (
Citation2002d) for the details.
Ashiya (Citation2002d) finds that the consensus (i.e. mean) forecasts (
and
) are not biased.
Ashiya (Citation2002d) finds that the consensus forecasts (
and
) use available information efficiently.
When δ < 0 (δ > 1), f
1(f
2) is so inaccurate that the minimum squared error composite requires ‘short selling’ of it (Cooper and Nelson, Citation1975, p. 8).
The generalized encompassing test
was also conducted, and similar results obtained. See Ashiya (
Citation2002d) for the details.
Ashiya (Citation2002d) finds that the consensus forecast for the current year (
) encompasses all of naïve forecasts, VAR forecast, VECM forecast, and the government forecast.
Ashiya (Citation2002d) finds that the consensus forecast for the next year (
) encompasses naïve forecasts, VAR forecast, and the government forecast, but that it does not encompass VECM forecast.
Batchelor
,
R
and
Dua
,
P
.
1991
.
Blue chip rationality tests
.
Journal of Money, Credit, and Banking
,
23
:
692
–
705
.
Jansen
,
DW
and
Kishan
,
RP
.
1996
.
An evaluation of Federal Reserve forecasting
.
Journal of Macroeconomics
,
18
:
89
–
109
.
Joutz
,
F
and
Stekler
,
HO
.
2000
.
An evaluation of the predictions of the Federal Reserve
.
International Journal of Forecasting
,
16
:
17
–
38
.
Ashiya
M
2002c
Forecast accuracy of the Japanese government: its year-ahead GDP forecast is too optimistic
Discussion Paper Series No. 323
Faculty of Economics, Nagoya City University
Zarnowitz
,
V
.
1985
.
Rational expectations and macroeconomic forecasts
.
Journal of Business and Economic Statistics
,
3
:
293
–
311
.
Artis
MJ
1996
How accurate are the IMF's short-term forecasts? Another examination of the world economic outlook
International Monetary Fund Working Paper
WP/96/89
Pons
,
J
.
1999
.
Evaluating the OECD's forecasts for economic growth
.
Applied Economics
,
31
:
893
–
902
.
Pons
,
J
.
2000
.
The accuracy of IMF and OECD forecasts for G7 countries
.
Journal of Forecasting
,
19
:
53
–
63
.
Oller
,
L-E
and
Barot
,
B
.
2000
.
The accuracy of European growth and inflation forecasts
.
International Journal of Forecasting
,
16
:
293
–
315
.
Kreinin
,
ME
.
2000
.
Accuracy of OECD and IMF projection
.
Journal of Policy Modeling
,
22
:
61
–
79
.
Fildes
,
R
and
Stekler
,
H
.
2002
.
The state of macroeconomic forecasting
.
Journal of Macroeconomics
,
24
:
435
–
68
.
Ashiya
,
M
.
2002a
.
Accuracy and rationality of Japanese institutional forecasters
.
Japan and the World Economy
,
14
:
203
–
13
.
Ashiya
M
2002b
Are 16-months-ahead forecasts useful?: a directional analysis of Japanese GDP forecasts
Discussion Paper Series No. 310, Faculty of Economics, Nagoya City University
Ashiya
,
M
.
2003
.
Testing the rationality of Japanese GDP forecasts: the sign of forecast revision matters
.
Journal of Economic Behavior and Organization
,
50
:
263
–
9
.
Keane
,
MP
and
Runkle
,
DE
.
1990
.
Testing the rationality of price forecasts: new evidence from panel data
.
American Economic Review
,
80
:
714
–
35
.
Stark
,
T
and
Croushore
,
D
.
2002
.
Forecasting with a real-time data set for macroeconomists
.
Journal of Macroeconomics
,
24
:
507
–
31
.
Ashiya
M
2002c
Forecast accuracy of the Japanese government: its year-ahead GDP forecast is too optimistic
Discussion Paper Series No. 323
Faculty of Economics, Nagoya City University
Ashiya
M
2002d
Twenty-two years of the Japanese institutional forecasts
Discussion Paper Series No. 330
Faculty of Economics, Nagoya City University
Ashiya
M
2002d
Twenty-two years of the Japanese institutional forecasts
Discussion Paper Series No. 330
Faculty of Economics, Nagoya City University
Ashiya
M
2002d
Twenty-two years of the Japanese institutional forecasts
Discussion Paper Series No. 330
Faculty of Economics, Nagoya City University
Chong
,
YY
and
Hendry
,
DF
.
1986
.
Econometric evaluation of linear macro-economic models
.
Review of Economic Studies
,
53
:
671
–
90
.
Mizon
,
GE
and
Richard
,
J-F
.
1986
.
The encompassing principle and its application to testing non-nested hypotheses
.
Econometrica
,
54
:
657
–
78
.
Ericsson
,
NR
.
1992
.
Parameter constancy, mean square forecast errors, and measuring forecast performance: an exposition, extensions, and illustration
.
Journal of Policy Modeling
,
14
:
465
–
95
.
Jansen
,
DW
and
Kishan
,
RP
.
1996
.
An evaluation of Federal Reserve forecasting
.
Journal of Macroeconomics
,
18
:
89
–
109
.
Cooper
,
JP
and
Nelson
,
CR
.
1975
.
The ex ante prediction performance of the St. Louis and FRB-MIT-PENN econometric models and some results on composite predictors
.
Journal of Money, Credit, and Banking
,
7
:
1
–
32
.
Ashiya
M
2002d
Twenty-two years of the Japanese institutional forecasts
Discussion Paper Series No. 330
Faculty of Economics, Nagoya City University
Ashiya
M
2002d
Twenty-two years of the Japanese institutional forecasts
Discussion Paper Series No. 330
Faculty of Economics, Nagoya City University
Ashiya
M
2002d
Twenty-two years of the Japanese institutional forecasts
Discussion Paper Series No. 330
Faculty of Economics, Nagoya City University