Are Test and Academic Disengagement Related? Implications for Measurement and Practice

References

• Ackerman, P. L., & Kanfer, R. (2009). Test length and cognitive fatigue: An empirical examination of effects on performance and test-taker reactions. Journal of Experimental Psychology: Applied, 15(2), 163. doi:10.1037/a0016995
   PubMed Web of Science ®Google Scholar
• Allensworth, E. (2013). The use of ninth-grade early warning indicators to improve chicago schools. Journal of Education for Students Placed at Risk (JESPAR), 18(1), 68–83. doi:10.1080/10824669.2013.745181
   Google Scholar
• Archambault, I., Janosz, M., Fallu, J.-S., & Pagani, L. S. (2009). Student engagement and its relationship with early high school dropout. Journal of Adolescence, 32(3), 651–670. doi:10.1016/j.adolescence.2008.06.007
   PubMed Web of Science ®Google Scholar
• Balfanz, R., Herzog, L., & Mac Iver, D. J. (2007). Preventing student disengagement and keeping students on the graduation path in urban middle-grades schools: Early identification and effective interventions. Educational Psychologist, 42(4), 223–235. doi:10.1080/00461520701621079
   Web of Science ®Google Scholar
• Balfanz, R., & Legters, N. (2004). Locating the dropout crisis. Baltimore, MD: Johns Hopkins University, Center for Social Organization of Schools, Everyone Graduates Center.
   Google Scholar
• Balfanz, R., Wang, A., & Byrnes, V. (2010). Early warning indicator analysis: Tennessee. Baltimore, MD: Johns Hopkins University, Center for Social Organization of Schools, Everyone Graduates Center.
   Google Scholar
• Bandura, A. (1993). Perceived self-efficacy in cognitive development and functioning. Educational Psychologist, 28(2), 117–148. doi:10.1207/s15326985ep2802_3
   Web of Science ®Google Scholar
• Bandura, A. (1997). Self-efficacy: The exercise of control. New York, NY: W. H. Freeman.
   Google Scholar
• Barry, C. L., & Finney, S. J. (2016). Modeling change in effort across a low-stakes testing session: A latent growth curve modeling approach. Applied Measurement in Education, 29(1), 46–64. doi:10.1080/08957347.2015.1102914
   Web of Science ®Google Scholar
• Barry, C. L., Horst, S. J., Finney, S. J., Brown, A. R., & Kopp, J. P. (2010). Do examinees have similar test-taking effort? A high-stakes question for low-stakes testing. International Journal of Testing, 10(4), 342–363. doi:10.1080/15305058.2010.508569
   Google Scholar
• Baumert, J., & Demmrich, A. (2001). Test motivation in the assessment of student skills: The effects of incentives on motivation and performance. European Journal of Psychology of Education, 16(3), 441–462. doi:10.1007/BF03173192
   Web of Science ®Google Scholar
• Belfield, C., Bowden, A. B., Klapp, A., Levin, H., Shand, R., & Zander, S. (2015). The economic value of social and emotional learning. Journal of Benefit-Cost Analysis, 6(3), 508–544. doi:10.1017/bca.2015.55
   Web of Science ®Google Scholar
• Blackwell, L. S, Trzesniewski, K. H, & Dweck, C. S. (2007). Implicit theories of intelligence predict achievement across an adolescent transition: a longitudinal study and an intervention. Child Development, 78(1), 246–263. doi:10.1111/cdev.2007.78.issue-1
   PubMed Web of Science ®Google Scholar
• Briesch, A. M., & Chafouleas, S. M. (2009). Review and analysis of literature on self-management interventions to promote appropriate classroom behaviors (1988–2008). School Psychology Quarterly, 24(2), 106. doi:10.1037/a0016159
   Web of Science ®Google Scholar
• Brown, G. T., & Hirschfeld, G. H. (2007). Students’ conceptions of assessment and mathematics achievement: Evidence for the power of self‐regulation. Australian Journal of Educational and Developmental Psychology, 7, 63–74.
   Google Scholar
• Brown, G. T., & Hirschfeld, G. H. (2008). Students’ conceptions of assessment: Links to outcomes. Assessment in Education: Principles, Policy & Practice, 15(1), 3–17. doi:10.1080/09695940701876003
   Google Scholar
• Davis, M., Herzog, L., & Legters, N. (2013). Organizing schools to address early warning indicators (EWIs): Common practices and challenges. Journal of Education for Students Placed at Risk (JESPAR), 18(1), 84–100. doi:10.1080/10824669.2013.745210
   Google Scholar
• Demars, C. E. (2007). Changes in rapid-guessing behavior over a series of assessments. Educational Assessment, 12(1), 23–45. doi:10.1080/10627190709336946
   Google Scholar
• Duckworth, A. L., & Seligman, M. E. (2005). Self-discipline outdoes IQ in predicting academic performance of adolescents. Psychological Science, 16(12), 939–944. doi:10.1111/j.1467-9280.2005.01641.x
   PubMed Web of Science ®Google Scholar
• Duckworth, A. L., & Yeager, D. S. (2015). Measurement matters: Assessing personal qualities other than cognitive ability for educational purposes. Educational Researcher, 44(4), 237–251. doi:10.3102/0013189X15584327
   PubMed Web of Science ®Google Scholar
• Dweck, C. (2006). Mindset: The new psychology of success. New York, NY: Random House.
   Google Scholar
• Dweck, C. S. (2010). Even geniuses work hard. Educational Leadership, 68(1), 16–20.
   Web of Science ®Google Scholar
• Elliott, E. S., & Dweck, C. S. (1988). Goals: An approach to motivation and achievement. Journal of Personality and Social Psychology, 54(1), 5–12.
   PubMed Web of Science ®Google Scholar
• Fan, X, & Sivo, S. A. (2005). Sensitivity of fit indexes to misspecified structural or measurement model components: rationale of two-index strategy revisited. Structural Equation Modeling: a Multidisciplinary Journal, 12(3), 343–367. doi:10.1207/s15328007sem1203_1
   Web of Science ®Google Scholar
• Farrington, C. A., Roderick, M., Allensworth, E., Nagaoka, J., Keyes, T. S., Johnson, D. W., & Beechum, N. O. (2012). Teaching adolescents to become learners: The role of noncognitive factors in shaping school performance–A critical literature review. Chicago, IL: University of Chicago Consortium on Chicago School Research.
   Google Scholar
• Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. doi:10.3102/00346543074001059
   Web of Science ®Google Scholar
• Guo, H., Rios, J. A., Haberman, S., Liu, O. L., Wang, J., & Paek, I. (2016). A new procedure for detection of students’ rapid guessing responses using response time. Applied Measurement in Education, 29(3), 173–183. doi:10.1080/08957347.2016.1171766
   Web of Science ®Google Scholar
• Heppen, J. B., & Therriault, S. B. (2008). Developing early warning systems to identify potential high school dropouts. Washington, D.C.: American Institutes for Research.
   Google Scholar
• Horn, C. L., & Flores, S. M. (2003). Percent plans in college admissions: A comparative analysis of three states’ experiences. Cambridge, MA: Civil Rights Project, Harvard University.
   Google Scholar
• Hu, L-T, & Bentler, P. M. (1998). Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424. doi:10.1037/1082-989X.3.4.424
   Web of Science ®Google Scholar
• Iacobucci, D. (2010). Structural equations modeling: Fit indices, sample size, and advanced topics. Journal of Consumer Psychology, 20(1), 90–98. doi:10.1016/j.jcps.2009.09.003
   Web of Science ®Google Scholar
• Jensen, N., Rice, A., & Soland, J. (2018). The influence of rapidly guessed item responses on teacher value-added estimates: Implications for policy and practice. Educational Evaluation and Policy Analysis, 40(2), 267–284. doi:10.3102/0162373718759600
   Web of Science ®Google Scholar
• Kennelly, L., & Monrad, M. (2007). Approaches to dropout prevention: Heeding early warning signs with appropriate interventions. Washington, D.C.: American Institutes for Research.
   Google Scholar
• Kong, X. J., Wise, S. L., & Bhola, D. S. (2007). Setting the response time threshold parameter to differentiate solution behavior from rapid-guessing behavior. Educational and Psychological Measurement, 67(4), 606–619. doi:10.1177/0013164406294779
   Web of Science ®Google Scholar
• Levendoski, L. S., & Cartledge, G. (2000). Self-monitoring for elementary school children with serious emotional disturbances: classroom applications for increased academic responding. Behavioral Disorders, 25(3), 211–224. doi:10.1177/019874290002500308
   Web of Science ®Google Scholar
• Mooney, P., Ryan, J. B., Uhing, B. M., Reid, R., & Epstein, M. H. (2005). A review of self-management interventions targeting academic outcomes for students with emotional and behavioral disorders. Journal of Behavioral Education, 14(3), 203–221. doi:10.1007/s10864-005-6298-1
   Google Scholar
• Ogbu, J. U. (2003). Black American students in an affluent suburb: A study of academic disengagement. New York, NY: Routledge.
   Google Scholar
• Rios, J. A., Guo, H., Mao, L., & Liu, O. L. (2016). Evaluating the impact of careless responding on aggregated-scores: To filter unmotivated examinees or not? International Journal of Testing, 17(1), 1–31.
   Web of Science ®Google Scholar
• Rios, J. A., Liu, O. L., & Bridgeman, B. (2014). Identifying low-effort examinees on student learning outcomes assessment: A comparison of two approaches. New Directions for Institutional Research, 2014(161), 69–82. doi:10.1002/ir.v2014.issue-161
   Google Scholar
• Rotter, J. B. (1982). Expectations and actions: Expectancy-value models in psychology. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
   Google Scholar
• Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23–74.
   Google Scholar
• Schnipke, D. L., & Scrams, D. J. (2002). Exploring issues of examinee behavior: Insights gained from response-time analyses. In C. N. Mills, M. T. Potenza, J. J. Fremer, & W. C. Ward (Eds.), Computer-based testing: Building the foundation for future assessments (pp. 237-266). Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Schunk, D. H., & Zimmerman, B. J. (2012). Motivation and self-regulated learning: Theory, research, and applications. New Jersey: Routledge.
   Google Scholar
• Setzer, J. C., Wise, S. L., van den Heuvel, J. R., & Ling, G. (2013). An investigation of examinee test-taking effort on a large-scale assessment. Applied Measurement in Education, 26(1), 34–49. doi:10.1080/08957347.2013.739453
   Web of Science ®Google Scholar
• Soland, J. (2013). Predicting high school graduation and college enrollment: Comparing early warning indicator data and teacher intuition. Journal of Education for Students Placed at Risk (JESPAR), 18(3–4), 233–262. doi:10.1080/10824669.2013.833047
   Google Scholar
• Soland, J. (2018). Are achievement gap estimates biased by differential student test effort? Putting an important policy metric to the test. Teachers College Record, 120, 12.
   Web of Science ®Google Scholar
• Sperling, R. A., Howard, B. C., Staley, R., & DuBois, N. (2004). Metacognition and self-regulated learning constructs. Educational Research and Evaluation, 10(2), 117–139. doi:10.1076/edre.10.2.117.27905
   Google Scholar
• Swerdzewski, P. J., Harmes, J. C., & Finney, S. J. (2009). Skipping the test: Using empirical evidence to inform policy related to students who avoid taking low-stakes assessments in college. The Journal of General Education, 58(1), 167–195. doi:10.1353/jge.0.0043
   Google Scholar
• Swerdzewski, P. J., Harmes, J. C., & Finney, S. J. (2011). Two approaches for identifying low-motivated students in a low-stakes assessment context. Applied Measurement in Education, 24(2), 162–188. doi:10.1080/08957347.2011.555217
   Web of Science ®Google Scholar
• Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004). High self-control predicts good adjustment, less pathology, better grades, and interpersonal success. Journal of Personality, 72(2), 271–324. doi:10.1111/j.0022-3506.2004.00263.x
   PubMed Web of Science ®Google Scholar
• Thum, Y. M., & Hauser, C. H. (2015). NWEA 2015 MAP norms for student and school achievement status and growth. Portland, OR: NWEA.
   Google Scholar
• U.S. Department of Education, National Center for Education Statistics. (2018). The Condition of Education 2018 (NCES 2018-144), Status Dropout Rates.
   Google Scholar
• Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. doi:10.1177/109442810031002
   Web of Science ®Google Scholar
• West, M. R., Buckley, K., Krachman, S. B., & Bookman, N. (2018). Development and implementation of student social-emotional surveys in the CORE districts. Journal of Applied Developmental Psychology, 55, 119–129. doi:10.1016/j.appdev.2017.06.001
   Web of Science ®Google Scholar
• Wise, S. L. (2006). An investigation of the differential effort received by items on a low-stakes computer-based test. Applied Measurement in Education, 19(2), 95–114. doi:10.1207/s15324818ame1902_2
   Web of Science ®Google Scholar
• Wise, S. L. (2015). Effort analysis: Individual score validation of achievement test data. Applied Measurement in Education, 28(3), 237–252. doi:10.1080/08957347.2015.1042155
   Web of Science ®Google Scholar
• Wise, S. L., & Demars, C. E. (2005). Low examinee effort in low-stakes assessment: Problems and potential solutions. Educational Assessment, 10(1), 1–17. doi:10.1207/s15326977ea1001_1
   Google Scholar
• Wise, S. L, & DeMars, C. E. (2010). Examinee noneffort and the validity of program assessment results. Educational Assessment, 15(1), 27–41. doi:10.1080/10627191003673216
   Google Scholar
• Wise, S. L., & Kingsbury, G. G. (2016). Modeling student test‐taking motivation in the context of an adaptive achievement test. Journal of Educational Measurement, 53(1), 86–105. doi:10.1111/jedm.2016.53.issue-1
   Web of Science ®Google Scholar
• Wise, S. L., & Kong, X. (2005). Response time effort: A new measure of examinee motivation in computer-based tests. Applied Measurement in Education, 18(2), 163–183. doi:10.1207/s15324818ame1802_2
   Web of Science ®Google Scholar
• Wise, S. L., & Ma, L. (2012, April). Setting response time thresholds for a CAT item pool: The normative threshold method. In annual meeting of the National Council on Measurement in Education, Vancouver, Canada.
   Google Scholar
• Yeager, D. S., & Dweck, C. S. (2012). Mindsets that promote resilience: When students believe that personal characteristics can be developed. Educational Psychologist, 47(4), 302–314. doi:10.1080/00461520.2012.722805
   Web of Science ®Google Scholar
• Zimmerman, B. J. (2000). Self-efficacy: An essential motive to learn. Contemporary Educational Psychology, 25(1), 82–91. doi:10.1006/ceps.1999.1016
   PubMed Web of Science ®Google Scholar