I Got More Data, My Model is More Refined, but My Estimator is Getting Worse! Am I Just Dumb?

REFERENCES

• Abel , P. S. , Singpurwalla , N. D. ( 1994 ). To survive or to fail: That is the question . The American Statistician 48 : 18 – 21 .
   Web of Science ®Google Scholar
• Anderson , T. W. ( 1959 ). On asymptotic distributions of estimates of parameters of stochastic difference equations . The Annals of Mathematical Statistics 30 : 676 – 687 .
   Google Scholar
• Berger , J. O. , Yang , R.-Y. ( 1994 ). Noninformative priors and Bayesian testing for AR(1) model . Econometric Theory 10 : 461 – 482 .
   Web of Science ®Google Scholar
• Bollerslev , T. ( 1986 ). Generalized autoregressive conditional heteroskedasticity . Journal of Econometrics 31 : 307 – 327 .
   Web of Science ®Google Scholar
• Chan , N. G. ( 1988 ). The parameter inference for nearly nonstationary time series . Journal of the American Statistical Association 83 : 857 – 862 .
   Web of Science ®Google Scholar
• Chan , N. G. ( 2006 ). Inference for time series and stochastic process . Statistica Sinica 16 : 683 – 696 .
   Web of Science ®Google Scholar
• Chan , N. H. , Ing , C. K. ( 2011 ). Uniform moment bounds of Fisher's information with applications to time series . The Annals of Statistics 39 : 1526 – 1550 .
   Web of Science ®Google Scholar
• Ebrahimi , N. , Soofi , E. S. , Soyer , R. ( 2008 ). Multivariate maximum entropy identification, transformation, and dependence . Journal of Multivariate Analysis 99 : 1271 – 1231 .
   Google Scholar
• Ebrahimi , N. , Soofi , E. S. , Soyer , R. ( 2010 ). On the sample information about parameter and prediction . Statistical Science 25 : 348 – 367 .
   Web of Science ®Google Scholar
• Ebrahimi , N. , Soofi , E. S. , Soyer , R. ( 2013 ). When are observed failures more informative than observed survivals? Naval Research Logistics 60 : 102 – 110 .
   Web of Science ®Google Scholar
• Efron , B. , Hinkley , D. V. ( 1978 ). Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information . Biometrika 65 : 457 – 487 .
   Web of Science ®Google Scholar
• Engle , R. F. ( 1982 ). Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation . Econometrica 50 : 987 – 1007 .
   Web of Science ®Google Scholar
• Ferguson , T. G. ( 1996 ). A Course in Large Sample Theory . London : Chapman & Hall .
   Google Scholar
• Gelman , A. , Shirley , K. ( 2011 ). Inference from simulations and monitoring convergence. In Handbook of Markov Chain Monte Carlo (Eds: Brooks, Gelman, Jones, and Meng). Boca Raton: CRC Press .
   Google Scholar
• Gelman , A. , Jakulin , A. , Pittau , M. G. , Su , Y.-S. ( 2008 ). A weakly informative default prior distribution for logistic and other regression models . Annals of Applied Statistics 2 : 1360 – 1383 .
   Web of Science ®Google Scholar
• Godambe , V. P. ( 1960 ). An optimum property of regular maximum likelihood estimation . The Annals of Mathematical Statistics 31 : 1208 – 1211 .
   Google Scholar
• Godambe , V. P. ( 1976 ). Conditional likelihood and unconditional optimum estimating equations . Biometrika 63 : 277 – 84 .
   Web of Science ®Google Scholar
• Jeffreys , H. ( 1983 ). Theory of Probability. Oxford: Oxford University Press .
   Google Scholar
• Kass , R. E. , Wasserman , L. ( 1996 ). The selection of prior distributions by formal rules. Journal of the American Statistical Association 91:1343–1370 .
   Google Scholar
• Meng , X.-L. ( 1994 ). Multiple-imputation inferences with uncongenial sources of input (with discussions) . Statistical Science 9 : 538 – 573 .
   Web of Science ®Google Scholar
• Meng , X.-L. ( 2005 ). From unit root to Stein's estimator to Fisher's k statistics: If you have a moment, I can tell you more . Statistical Science 20 : 141 – 162 .
   Web of Science ®Google Scholar
• Meng , X.-L. ( 2009 ). Decoding the H-likelihood . Statistical Science 24 : 280 – 293 .
   Web of Science ®Google Scholar
• Meng , X.-L. ( 2011 ). What's the H in H-likelihood: A Holy Grail or an Achilles’ Heel? (with discussions). In: Bernardo, Bayarri, Berger, Dawid, Heckerman, Smith and West, eds. Bayesian Statistics 9. Oxford University Press, p. 473–500 .
   Google Scholar
• Meng , X.-L. , Zaslavsky , A. M. ( 2002 ). Single observation unbiased priors . Annals of Statistics 30 : 1345 – 1375 .
   Web of Science ®Google Scholar
• Mukerjee , R. ( 2008 ). Data-dependent probability matching priors for empirical and related likelihoods . In: Clarke and Ghosal, eds. Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh . Beachwood , Ohio : Institute of Mathematical Statistics , pp. 60 – 70 .
   Google Scholar
• Nyquist , H. ( 1928 ). Certain topics in telegraph transmission theory. Trans. AIEE (Reprint as classic paper in: Proc. IEEE, 90(2), Feb 2002.) 47:617–644 .
   Google Scholar
• Pantula , S. G. ( 1988 ). Estimation of autoregressive models with ARCH errors . Sankhya 50 : 119 – 138 .
   Google Scholar
• Phillips , P. C. B. (1987). Testing for a unit root in time series regression. Econometrica 55:277–301.
   Web of Science ®Google Scholar
• Phillips , P. C. B ( 1991 ). To criticise the critics: An objective Bayesian analysis of stochastic trends . Journal of Applied Econometrics 6 : 333 – 364 .
   Web of Science ®Google Scholar
• Phillips , P. C. B. , Perron , P. ( 1988 ). Testing for a unit root in time series regression . Biometrika 75 : 335 – 346 .
   Web of Science ®Google Scholar
• Rubin , D. B. ( 1987 ). Multiple imputation for non-response in Surveys . New York : Wiley .
   Google Scholar
• Tanaka , K. ( 1996 ). Time Series Analysis–Nonstationary and Noninvertible Distribution Theory . New York : Wiley .
   Google Scholar
• Tanner , M. A. , Wong , W. H. ( 1987 ). The calculation of posterior distributions by data augmentation . Journal of the American Statistical Association 82 : 528 – 540 .
   Web of Science ®Google Scholar
• Tanner , M. A. , Wong , W. H. ( 2010 ). From EM to data augmentation: the emergence of MCMC Bayesian computation in the 1980s . Statistical Science 25 : 506 – 516 .
   Web of Science ®Google Scholar
• Tsay , R. S. ( 2001 ). Nonlinear time series models: testing and applications . In: Pena, Tiao and Tsay, eds. A Course in Time Series Analysis . New York : Wiley , pp. 267 – 285 .
   Google Scholar
• Tsay , R. S. , Tiao , G. C. ( 1990 ). Asymptotic properties of multivariate nonstationary processes with applications to autoregressions . The Annals of Statistics 18 : 220 – 250 .
   Web of Science ®Google Scholar
• Uhlig , H. ( 1994a ). What macroeconomists should know about unit roots: A Bayesian perspective . Econometric Theory 10 : 645 – 671 .
   Web of Science ®Google Scholar
• Uhlig , H. ( 1994b ). On Jeffreys prior when using the exact likelihood function . Econometric Theory 10 : 633 – 644 .
   Web of Science ®Google Scholar
• Unser , M. ( 2000 ). Sampling—50 years after Shannon . Proceedings of the IEEE 88 : 569 – 587 .
   Web of Science ®Google Scholar
• van Dyk , D. A. , Meng , X.-L. ( 2001 ). The art of data augmentation (with discussion) . Journal of Computational and Graphical Statistics 10 : 1 – 111 .
   Web of Science ®Google Scholar
• van Dyk , D. A. , Meng , X.-L. ( 2010 ). Cross-fertilizing strategies for better EM mountain climbing and DA field exploration: A graphical guide book . Statistical Science 25 : 429 – 449 .
   Web of Science ®Google Scholar
• Wasserman , L. ( 2000 ). Asymptotic inference for mixture models using data-dependent priors . Journal of the Royal Statistical Society B 62 : 159 – 180 .
   Google Scholar
• White , J. S. ( 1958 ). The limiting distribution of the serial correlation coefficient in the explosive case . The Annals of Mathematical Statistics 29 : 1188 – 1197 .
   Google Scholar
• Wilson , G. T. ( 2001 ). Model fitting and checking, and the Kalman filter . In: Pena , Tiao , and Tsay, eds. A Course in Time Series Analysis New York : Wiley , pp. 86 – 110 .
   Google Scholar
• Xie , X. , Meng , X.-L. ( 2012 ). Multi-party inferences: What happens when there are three uncongenial models involved? Technical Report, Department of Statistics, Harvard University .
   Google Scholar
• Yu , S-H. , Lin , C.-C. , Cheng , H.-W. ( 2012 ). A note on mean squared prediction error under the unit root model with deterministic trend . Journal of Time Series Analysis 33 : 276 – 286 .
   Web of Science ®Google Scholar