An IRT Mixture Model for Rating Scale Confusion Associated with Negatively Worded Items in Measures of Social-Emotional Learning

References

• Anastasi, A. (1982). Psychological testing (5th ed.). New York, NY: Macmillan.
   Google Scholar
• Barnette, J. J. (2000). Effects of stem and Likert response option reversals on survey internal consistency: If you feel the need, there is a better alternative to using those negatively worded stems. Educational and Psychological Measurement, 60(3), 361–370. doi:10.1177/00131640021970592
   Web of Science ®Google Scholar
• Cohen, A. S., & Bolt, D. M. (2005). A mixture model analysis of differential item functioning. Journal of Educational Measurement, 42(2), 133–148. doi:10.1111/j.1745-3984.2005.00007
   Web of Science ®Google Scholar
• Durlak, J. A., Domitrovich, C. E., Weissberg, R. P., & Gullotta, T. P. (Eds.). (2015). Handbook of social and emotional learning: Research and practice. New York, NY: The Guilford Press.
   Google Scholar
• Dweck, C. S. (2000). Self-theories: Their role in motivation, personality, and development. Philadelphia, PA: Taylor and Francis.
   Google Scholar
• Dweck, C. S. (2006). Mindset: The new psychology of success. New York, NY: Random House.
   Google Scholar
• Gelman, A., & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 11(4), 457–472. doi:10.1214/ss/1177011136
   Google Scholar
• Jin, K.-Y., Chen, H.-F., & Wang, W.-C. (2017). Mixture item response models for inattentive responding behavior. Organizational Research Methods, 21(1), 197–225. doi:10.1177/1094428117725792
   Web of Science ®Google Scholar
• Kam, C. C. S., & Meyer, J. P. (2015). How careless responding and acquiescence response bias can influence construct dimensionality: The case of job satisfaction. Organizational Research Methods, 18(3), 512–541. doi:10.1177/1094428115571894
   Web of Science ®Google Scholar
• Lin, C. Y., Strong, C., Tsai, M. C., & Lee, C. T. (2017). Raters interpret positively and negatively worded items similarly in a quality of life instrument for children: Kid-KINDL. INQUIRY: The Journal of Health Care Organization, Provision, and Financing, 54, 004695801769672. doi:10.1177/0046958017696724
   Web of Science ®Google Scholar
• Magazine, S. L., Williams, L. J., & Williams, M. L. (1996). A confirmatory factor analysis examination of reverse coding effects in Meyer and Allen’s affective and continuance commitment scales. Educational and Psychological Measurement, 56(2), 241–250. doi:10.1177/0013164496056002005
   Web of Science ®Google Scholar
• Marsh, J. A., McKibben, S., Hough, H. J., Hall, M., Allbright, T. N., Matewos, A. M., & Siqueira, C. (2018). Enacting social-emotional learning: Practices and supports employed in CORE districts and schools. Stanford: Policy Analysis for California Education. Retrieved from https://edpolicyinca.org/publications/sel-practices
   Google Scholar
• Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17(3), 437. doi:10.1037/a0028085
   PubMed Web of Science ®Google Scholar
• Meyer, R. H., Wang, Y. C., & Rice, A. B. (2018). Measuring students’ social-emotional learning among California’s CORE districts: An IRT modeling approach. CORE-PACE research partnership working paper, Madison, WI. Retrieved from https://edpolicyinca.org/sites/default/files/Measuring_SEL_May-2018.pdf
   Google Scholar
• Nunnally, J. (1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.
   Google Scholar
• Policy Analysis for California Education. (2018). CORE-PACE research partnership: Social-emotional learning. Retrieved from https://www.edpolicyinca.org/projects/core-pace-research-partnership/sel
   Google Scholar
• Roszkowski, M. J., & Soven, M. (2010). Shifting gears: Consequences of including two negatively worded items in the middle of a positively worded questionnaire. Assessment & Evaluation in Higher Education, 35(1), 113–130. doi:10.1080/02602930802618344
   Web of Science ®Google Scholar
• Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement. New York, NY: Psychometric Society.
   Google Scholar
• Schmitt, N., & Stults, D. M. (1985). Factors defined by negatively coded items: The result of careless respondents?”. Applied Psychological Measurement, 9(4), 367–373. doi:10.1177/014662168500900405
   Web of Science ®Google Scholar
• Schriesheim, C. A., Eisenbach, R. J., & Hill, K. D. (1991). The effect of negation and polar opposite item reversals on questionnaire reliability and validity: An experimental investigation. Educational and Psychological Measurement, 51(1), 67–78. doi:10.1177/0013164491511005
   Web of Science ®Google Scholar
• Snipes, J., & Tran, L. (2017). Growth mindset, performance avoidance, and academic behaviors in Clark County School District. Regional Educational Laboratory at West Ed. REL 2017-226. Washington, DC: U.S. Department of Education, Institute of Education Sciences.
   Google Scholar
• Sonderen, E., Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLoS One, 8(7), e68967. doi:10.1371/journal.pone.0068967
   PubMed Web of Science ®Google Scholar
• Spiegelhalter, D., Thomas, A., & Best, N. (2003). WinBUGS version 1.4 user manual. Cambridge, England: MRC Biostatistics Unit.
   Google Scholar
• Weijters, B., & Baumgartner, H. (2012). Misresponse to reversed and negated items in surveys: A review. Journal of Marketing Research, 49(5), 737–747. doi:10.1509/jmr.11.0368
   Web of Science ®Google Scholar
• Weijters, B., Baumgartner, H., & Schillewaert, N. (2013). Reverse item bias: An integrative model. Psychological Methods, 18(3), 320–334. doi:10.1037/a0032121
   PubMed Web of Science ®Google Scholar
• West, M. R., Buckley, K., Krachman, S. B., & Bookman, N. (2018). Development and implementation of student social-emotional surveys in the CORE districts. Journal of Applied Developmental Psychology, 55, 119–129. doi:10.1016/j.appdev.2017.06.001
   Web of Science ®Google Scholar
• Woods, C. M. (2006). Careless responding to reverse-worded items: Implications for confirmatory factor analysis. Journal of Psychopathology and Behavioral Assessment, 28(3), 186. doi:10.1007/s10862-005-9004-7
   Web of Science ®Google Scholar