Addressing Item-Level Missing Data: A Comparison of Proration and Full Information Maximum Likelihood Estimation

REFERENCES

• Agresti, A. (2012). Categorical data analysis ( 3rd ed.). Hoboken, NJ: Wiley.
   Google Scholar
• Byars, K., & Simon, S. (2014). Practice patterns and insomnia treatment outcomes from an evidence-based pediatric behavioral sleep medicine clinic. Clinical Practice in Pediatric Psychology, 2 (3), 337–349.
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences ( 2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Collins, L.M., Schafer, J.L., & Kam, C.M. (2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6, 330–351.
   PubMed Web of Science ®Google Scholar
• Culbert, K.M., Breedlove, S.M., Sisk, C.L., Burt, S.A., & Klump, K.L. (2013). The emergence of sex differences in risk for disordered eating attitudes during puberty: A role for prenatal testosterone exposure. Journal of Abnormal Psychology, 122(2), 420–432.
   PubMed Web of Science ®Google Scholar
• Culbert, K.M., Breedlove, S.M., Sisk, C.L., Keel, P.K., Neale, M.C., Boker, S.M., … Klump, K.L. (2015). Age differences in prenatal testosterone's protective effects on disordered eating symptoms: Developmental windows of expression? Behavioral Neuroscience, 129(1), 18–36.
   PubMed Web of Science ®Google Scholar
• Downey, R.G., & King, C.V. (1998). Missing data in Likert ratings: A comparison of replacement methods. Journal of General Psychology, 125(2), 175–191.
   PubMed Web of Science ®Google Scholar
• Eekhout, I., Enders, C.K., Twisk, J.W. R., de Boer, M.R., de Vet, H.C. W., & Heymans, M.W. (2015). Analyzing incomplete item scores in longitudinal data by including item score information as auxiliary variables. Structural Equation Modeling. Advance online publication.
   PubMed Web of Science ®Google Scholar
• Enders, C.K. (2003). Using the expectation maximization algorithm to estimate coefficient alpha for scales with item-level missing data. Psychological Methods, 8(3), 322–337.
   PubMed Web of Science ®Google Scholar
• Enders, C.K. (2010). Applied missing data analysis. New York, NY: Guilford Press.
   Google Scholar
• Forand, N.R., & DeRubeis, R.J. (2013). Pretreatment anxiety predicts patterns of change in cognitive behavioral therapy and medications for depression. Journal of Consulting and Clinical Psychology, 81 (5), 774–782.
   PubMed Web of Science ®Google Scholar
• Forand, N.R., & DeRubeis, R.J. (2014). Extreme response style and symptom return after depression treatment: The role of positive extreme responding. Journal of Consulting and Clinical Psychology, 82(3), 500–509.
   PubMed Web of Science ®Google Scholar
• Gottschall, A.C., West, S.G., & Enders, C.K. (2012). A comparison of item-level and scale-level multiple imputation for questionnaire batteries. Multivariate Behavioral Research, 47, 1–25.
   Web of Science ®Google Scholar
• Graham, J.W. (2003). Adding missing-data-relevant variables to FIML-based structural equation models. Structural Equation Modeling, 10 (1), 80–100.
   Web of Science ®Google Scholar
• Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.
   PubMed Web of Science ®Google Scholar
• Graham, J.W. (2012). Missing data: Analysis and design. New York, NY: Springer.
   Google Scholar
• Graham, J.W., Hofer, S.M., & MacKinnon, D.P. (1996). Maximizing the usefulness of data obtained with planned missing value patterns: An application of maximum likelihood procedures. Multivariate Behavioral Research, 31, 197–218.
   PubMed Web of Science ®Google Scholar
• Graham, J.W., Olchowski, A.E., & Gilreath, T.D. (2007). How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prevention Science, 8(3), 206–213.
   PubMed Web of Science ®Google Scholar
• Graham, J.W., Taylor, B.J., Olchowski, A.E., & Cumsille, P.E. (2006). Planned missing data designs in psychological research. Psychological Methods, 11, 323–343.
   PubMed Web of Science ®Google Scholar
• Hazel, N.A., Oppenheimer, C.W., Technow, J.R., Young, J.F., & Hankin, B.L. (2014). Parent relationship quality buffers against the effect of peer stressors on depressive symptoms from middle childhood to adolescence. Developmental Psychology, 50(8), 2115–2123.
   PubMed Web of Science ®Google Scholar
• Howe, G.W., Hornberger, A.P., Weihs, K., Moreno, F., & Neiderhiser, J.M. (2012). Higher-order structure in the trajectories of depression and anxiety following sudden involuntary unemployment. Journal of Abnormal Psychology, 121 (2), 325–338.
   PubMed Web of Science ®Google Scholar
• Huisman, M. (2000). Imputation of missing item responses: Some simple techniques. Quality and Quantity, 34, 331–351.
   Web of Science ®Google Scholar
• Johnson, V.E., & Albert, J.H. (1999). Ordinal data modeling. New York, NY: Springer.
   Google Scholar
• Keller, B.T., & Enders, C.K. (2014, May). A latent variable chained equations approach for multilevel multiple imputation. . Paper presented at the Modern Modeling Methods Conference, Storrs, CT.
   Google Scholar
• Krabbendam, A.A., Colins, O.F., Doreleijers, T.A. H., van der Molen, E., Beekman, A.T. F., & Vermeiren, R.R. J. M. (2015). Personality disorders in previously detained adolescent females: A prospective study. American Journal of Orthopsychiatry, 85(1), 63–71.
   PubMed Web of Science ®Google Scholar
• Lee, M.R., Bartholow, B.D., McCarthy, D.M., Pederson, S.L., & Sher, K.J. (2014). Two alternative approaches to conventional person-mean imputation scoring of the Self-Rating of the Effects of Alcohol Scale (SRE). Psychology of Addictive Behaviors, 29(1), 231236.
   PubMed Web of Science ®Google Scholar
• McDonald, R.A., Thurston, P.W., & Nelson, M.R. (2000). A Monte Carlo study of missing item methods. Organizational Research Methods, 3(1), 70–91.
   Web of Science ®Google Scholar
• Neugebauer, R., Turner, J.B., Fisher, P.W., Yamabe, S., Zhang, B., Neria, Y., … Mack, R. (2014). Posttraumatic stress reactions among Rwandan youth in the second year after the genocide: Rising trajectory among girls. Psychological Trauma: Theory, Research, Practice, and Policy, 6(3), 269–279.
   Web of Science ®Google Scholar
• Olver, M.E., Nicholaichuk, T.P., Kingston, D.A., & Wong, S.C. P. (2014). A multisite examination of sexual violence risk and therapeutic change. Journal of Consulting and Clinical Psychology, 82(2), 312–324.
   PubMed Web of Science ®Google Scholar
• Rhemtulla, M., Brosseau-Liard, P., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373.
   PubMed Web of Science ®Google Scholar
• Rice, M.E., Harris, G.T., & Lang, C. (2013). Validation of and revision to the VRAG and SORAG: The Violence Risk Appraisal Guide—Revised (VRAG-R). Psychological Assessment, 25(3), 951–965.
   PubMed Web of Science ®Google Scholar
• Rubin, D.B. (1976). Inference and missing data. Biometrika, 63, 581–592.
   Web of Science ®Google Scholar
• Ruehlman, L.S., Karoly, P., & Enders, C.K. (2012). A randomized controlled evaluation of an online chronic pain self-management program. Pain, 153(2), 319–330.
   PubMed Web of Science ®Google Scholar
• Savalei, V., & Bentler, P.M. (2009). A two-stage approach to missing data: Theory and application to auxiliary variables. Structural Equation Modeling, 16(3), 477–497.
   Web of Science ®Google Scholar
• Savalei, V., & Rhemtulla, M. (2014, October). Two-stage estimator for models with composites or parcels when data are missing at the item level. . Paper presented at the Annual Meeting of the Society for Multivariate Experimental Psychology, Nashville, TN.
   Google Scholar
• Schafer, J.L., & Graham, J.W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.
   PubMed Web of Science ®Google Scholar
• Sijtsma, K., & van der Ark, L.A. (2003). Investigation and treatment of missing item scores in test and questionnaire data. Multivariate Behavioral Research, 38 (4), 505–528.
   PubMed Web of Science ®Google Scholar
• Smid, W.J., Kamphuis, J.H., Wever, E.C., & Van Beek, D.J. (2014). A comparison of the predictive properties of nine sex offender risk assessment instruments. Psychological Assessment, 26(3), 691–703.
   PubMed Web of Science ®Google Scholar
• Tonkin, M., Howells, K., Ferguson, E., Clark, A., Newberry, M., & Schalast, N. (2012). Lost in translation? Psychometric properties and construct validity of the English Essen Climate Evaluation Schema (EssenCES) social climate questionnaire. Psychological Assessment, 24(3), 573–580.
   PubMed Web of Science ®Google Scholar
• van Buuren, S. (2010). Item imputation without specifying scale structure. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 6(1), 31–36.
   Web of Science ®Google Scholar