Error, Error in My Model, Who’s the Fairest Error of Them All?

REFERENCES

• Aiken, L. S., Aguinis, H., Appelbaum, M., Boodoo, G. M., Edwards, M. C., Gonzalez, R. D., & Patelis, T., et al. (2009). Report of the task force for increasing the number of quantitative psychologists. New York, NY: American Psychological Association.
   Google Scholar
• Box, G. E. P. (1976). Science and statistics. Journal of the American Statistical Association, 71, 791–799. doi:10.1080/01621459.1976.10480949
   Web of Science ®Google Scholar
• Box, G. E. P. (1979). Some problems of statistics and everyday life. Journal of the American Statistical Asssociation, 74, 1–4. doi:10.1080/01621459.1979.10481600
   Web of Science ®Google Scholar
• Box, G. E. P., & Draper, N. R. (1987). Empirical model building and response surfaces. New York, NY: Wiley.
   Google Scholar
• Card, N. A. (2012). Applied meta-analysis for social science research. New York, NY: Guilford.
   Google Scholar
• Cattell, R. B., & Tsujioka, B. (1964). The importance of factor-trueness and validity, versus homogeneity and orthogonality, in test scales. Educational and Psychological Measurement, 4, 3–30. doi:10.1177/001316446402400101
   Web of Science ®Google Scholar
• Cohen, A. S., & Wollack, J. A. (2006). Test administration, security, scoring, and reporting. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 355–386). Westport, CT: Praeger Publishers.
   Google Scholar
• Dicerbo, K. E., & Behrens, J. T. (2012). Implications of the digital ocean on current and future assessment. In R. W. Lissitz & H. Jiao (Eds.), Computers and their impact on state assessment: Recent history and predictions for the future (pp. 273–306). Charlotte, NC: Information Age Publishing.
   Google Scholar
• DuBois, P. H. (1970). A history of psychological testing. Boston, MA: Allyn & Bacon.
   Google Scholar
• Gelman, A., & Carlin, J. (2014). Beyond power calculations assessing Type S (sign) and Type M (magnitude) errors. Perspectives on Psychological Science, 9, 641–651. doi:10.1177/1745691614551642
   Web of Science ®Google Scholar
• Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013). Bayesian data analysis (3rd ed.). Boca Raton, FL: Chapman and Hall/CRC.
   Google Scholar
• Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. New York, NY: Cambridge University Press.
   Google Scholar
• Gigerenzer, G. (2004). Mindless statistics. Journal of Socio-Economics, 33, 587–606. doi:10.1016/j.socec.2004.09.033
   Google Scholar
• Hancock, G. R., & Mueller, R. O. (Eds.). (2010). The reviewer’s guide to quantitative methods in the social sciences. New York, NY: Routledge.
   Google Scholar
• Harring, J. R., McNeish, D. M., & Hancock, G. R. (in press). Using phantom variables in structural equation modeling to assess model sensitivity to external misspecification. Psychological Methods.
   Web of Science ®Google Scholar
• Hofer, S. M., & Piccinin, A. M. (2009). Integrative data analysis through coordination of measurement and analysis protocol across independent longitudinal studies. Psychological Methods, 14, 150–164. doi:10.1037/a0015566
   PubMed Web of Science ®Google Scholar
• Kenny, D. (2010). DataToText: A consumer-oriented approach to data analysis. Multivariate Behavioral Research, 45, 1000–1019. doi:10.1080/00273171.2010.531232
   PubMed Web of Science ®Google Scholar
• Kimball, A. W. (1957). Errors of the third kind in statistical consulting. Journal of the American Statistical Association, 52, 133–142. doi:10.1080/01621459.1957.10501374
   Web of Science ®Google Scholar
• Lai, K., & Kelley, K. (2012). Accuracy in parameter estimation for ANCOVA and ANOVA contrasts: Sample size planning via narrow confidence intervals. British Journal of Mathematical and Statistical Psychology, 65, 350–370. doi:10.1111/j.2044-8317.2011.02029.x
   PubMed Web of Science ®Google Scholar
• Lang, K. M., & Little, T. D. (2016). Principled missing data treatments. Prevention Science, 17, 1–11.
   PubMed Web of Science ®Google Scholar
• Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 22, 5–55.
   Google Scholar
• Little, T. D. (2015). Methodological practice as matters of justice, justification, and the pursuit of verisimilitude. Research in Human Development, 12, 268–273. doi:10.1080/15427609.2015.1068044
   Web of Science ®Google Scholar
• Little, T. D., & Rhemtulla, M. (2013). Planned missing data designs for developmental researchers. Child Development Perspectives, 7, 199–204. doi:10.1111/cdep.2013.7.issue-4
   Web of Science ®Google Scholar
• MacCallum, R. C. (2003). Working with imperfect models. Multivariate Behavioral Research, 38, 113–139. doi:10.1207/S15327906MBR3801_5
   PubMed Web of Science ®Google Scholar
• MacCallum, R. C., & Austin, J. T. (2000). Applications of structural equation modeling in psychological research. Annual Review of Psychology, 51, 201–226. doi:10.1146/annurev.psych.51.1.201
   PubMed Web of Science ®Google Scholar
• Marascuilo, L. A., & Levin, J. R. (1970). Appropriate post hoc comparisons for interaction and nested hypothesese in analysis of variance designs: The elimination of Type IV errors. American Educational Research Journal, 7, 397–421. doi:10.3102/00028312007003397
   Web of Science ®Google Scholar
• Mauro, R. (1990). Understanding L.O.V.E. (left out variables error): A method for estimating the effects of omitted variables. Psychological Bulletin, 108, 314–329. doi:10.1037/0033-2909.108.2.314
   Web of Science ®Google Scholar
• McArdle, J. J., & Horn, J. L. (2002, October). The benefits and limitations of mega-analysis with illustrations for the WAIS. Paper presented at the International meeting of CODATA, Montreal, Canada.
   Google Scholar
• Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806–834. doi:10.1037/0022-006X.46.4.806
   Web of Science ®Google Scholar
• Mitroff, I. I., & Silvers, A. (2009). Dirty rotten strategies: How we trick ourselves and others into solving the wrong problems precisely. Redwood City, CA: Stanford University Press.
   Google Scholar
• Mosteller, F. (1948). A k-sample slippage test for an extreme population. Annals of Mathematical Statistics, 19, 58–65. doi:10.1214/aoms/1177730290
   Google Scholar
• Mukherjee, S. (2010). The emperor of all maladies. New York, NY: Scribner.
   Google Scholar
• Muthén, B., & Asparouhov, T. (2012). Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17, 313–335. doi:10.1037/a0026802
   PubMed Web of Science ®Google Scholar
• Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2, 13–43. doi:10.1207/S15328031US0201_02
   Google Scholar
• Rhemtulla, M., & Hancock, G. R. (2016). Planned missing data designs in educational psychology research. Educational Psychologist, 51, 305–316. doi:10.1080/00461520.2016.1208094
   Web of Science ®Google Scholar
• Rodgers, J. L. (2010). The epistemology of mathematical and statistical modeling: A quiet methodological revolution. American Psychologist, 65, 1–12. doi:10.1037/a0018326
   PubMed Web of Science ®Google Scholar
• Tukey, J. W. (1962). The future of data analysis. Annals of Mathematical Statistics, 33, 1–67. doi:10.1214/aoms/1177704711
   Google Scholar
• Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison Wesley.
   Google Scholar
• Widaman, K. F., Little, T. D., Preacher, K. J., & Sawalani, G. (2011). On creating and using short forms of scales in secondary research. In K. H. Trzesniewski, M. B. Donnelan, & R. E. Lucas (Eds.), Secondary data analysis: An introduction for psychologists (pp. 39–61). Washington, DC: American Psychological Association.
   Google Scholar