Uncovering Preservice Teachers’ Conceptions of Achievement and Accountability: Evidence from a Framed Field Experiment

References

• Adams, S. J., Heywood, J. S., & Rothstein, R. (2009). Teachers, performance pay, and accountability: What educators should learn from other sectors. Economic Policy Institute. https://secure.epi.org/files/page/-/pdf/teachers_performance_pay_and_accountability-full_text.pdf
   Google Scholar
• Amrein-Beardsley, A., Pivovarova, M., & Geiger, T. J. (2016). Value-added models: What the experts say. Phi Delta Kappan, 98(2), 35–40. https://doi.org/10.1177/0031721716671904
   Web of Science ®Google Scholar
• Apple Inc. (2015). Xcode (Version 7.1.1) [Computer software]. Cupertino, CA: Author.
   Google Scholar
• Au, W. (2016). Meritocracy 2.0: High-stakes, standardized testing as a racial project of neoliberal multiculturalism. Educational Policy, 30(1), 39–62. https://doi.org/10.1177/0895904815614916
   Web of Science ®Google Scholar
• Bertrand, M., & Marsh, J. A. (2015). Teachers’ sensemaking of data and implications for equity. American Educational Research Journal, 52(5), 861–893. https://doi.org/10.3102/0002831215599251
   Web of Science ®Google Scholar
• Black, P., Harrison, C., Lee, C., Marshall, B., & Wiliam, D. (2003). Assessment for learning: Putting it into practice. Open University Press.
   Google Scholar
• Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5
   Web of Science ®Google Scholar
• Booher-Jennings, J. (2005). Below the bubble: “Educational triage” and the Texas accountability system. American Educational Research Journal, 42(2), 231–268. https://doi.org/10.3102/00028312042002231
   Web of Science ®Google Scholar
• Booher-Jennings, J. (2006). Rationing education in an era of accountability. Phi Delta Kappan, 87(10), 756–761. https://doi.org/10.1177/003172170608701010
   Web of Science ®Google Scholar
• Brown, B. W., & Saks, D. H. (1987). The microeconomics of the allocation of teachers’ time and student learning. Economics of Education Review, 6(4), 319–332. https://doi.org/10.1016/0272-7757(87)90015
   Google Scholar
• Carey, M., Grainger, P., & Christie, M. (2018). Preparing preservice teachers to be data literate: A Queensland case study. Asia-Pacific Journal of Teacher Education, 46(3), 267–278. https://doi.org/10.1080/1359866X.2017.1402860
   Web of Science ®Google Scholar
• Datnow, A., Choi, B., Park, V., & St. John, E. (2018). Teacher talk about student ability and achievement in the era of data-driven decision making. Teachers College Record, 120(4), 1–34. https://doi.org/10.1177/016146811812000408
   Web of Science ®Google Scholar
• Datnow, A., & Hubbard, L. (2016). Teacher capacity for and beliefs about data-driven decision making: A literature review of international research. Journal of Educational Change, 17(1), 7–28. https://doi.org/10.1007/s10833-015-9264-2
   Web of Science ®Google Scholar
• Datnow, A., & Park, V. (2018). Opening or closing doors for students? Equity and data use in schools. Journal of Educational Change, 19(2), 131–152. https://doi.org/10.1007/s10833-018-9323-6
   Web of Science ®Google Scholar
• Diamond, J. B., & Cooper, K. (2007). The uses of testing data in urban elementary schools: Some lessons from Chicago. In P. Moss (Ed.), Evidence and decision making: 106th yearbook of the national society for the study of education (pp. 241–263). Blackwell Publishing.
   Google Scholar
• Dunlap, K., & Piro, J. S. (2016). Diving into data: Developing the capacity for data literacy in teacher education. Cogent Education, 3(1), 1–13. https://doi.org/10.1080/2331186X.2015.1132526
   Google Scholar
• Elmore, R. F. (2005). Accountable leadership. The Educational Forum, 69(2), 134–142. https://doi.org/10.1080/00131720508984677
   Google Scholar
• Farley-Ripple, E. N., Jennings, A. S., & Buttram, J. (2019). Toward a framework for classifying teachers’ use of assessment data. AERA Open, 5(4), 1–18. https://doi.org/10.1177/2332858419883571
   Web of Science ®Google Scholar
• Farley-Ripple, E. N., Jennings, A. S., & Jennings, A. B. (2021). Tools of the trade: A look at educators’ use of assessment systems. School Effectiveness and School Improvement, 32(1), 96–117. https://doi.org/10.1080/09243453.2020.1777171
   Web of Science ®Google Scholar
• Farrell, C. C., & Marsh, J. A. (2016). Metrics matter: How properties and perceptions of data shape teachers’ instructional responses. Educational Administration Quarterly, 52(3), 423–462. https://doi.org/10.1177/0013161X16638429
   Web of Science ®Google Scholar
• Figlio, D., & Loeb, S. (2011). School accountability. In E. A. Hanushek, S. J. Machin, & L. Woessmann (Eds.), Handbook of the economics of education (pp. 383–421). North Holland.
   Google Scholar
• Finnigan, K. S., & Gross, B. (2007). Do accountability policy sanctions influence teacher motivation? Lessons from Chicago’s low-performing schools. American Educational Research Journal, 44(3), 594–629. https://doi.org/10.3102/0002831207306767
   Web of Science ®Google Scholar
• Garner, B., & Horn, I. (2018). Using standardized-test data as a starting point for inquiry: A case of thoughtful compliance. In N. Barnes & H. Fives (Eds.), Cases of teachers’ data use (pp. 96–111). Routledge. https://doi.org/10.4324/9781315165370
   Google Scholar
• Garner, B., Thorne, J. K., & Seidel, I. S. (2017). Teachers interpreting data for instructional decisions: Where does equity come in? Journal of Educational Administration, 55(4), 407–426. https://doi.org/10.1108/JEA-09-2016-0106
   Web of Science ®Google Scholar
• Gillborn, D., & Youdell, D. (2000). Rationing education: Policy, practice, reform, and equity. Open University Press.
   Google Scholar
• Gummer, E. S., Gibbs, N. P., & Dorn, S. (2021). The role of educator preparation programs to teach about the ethical use of data. In E. B. Mandinach & E. S. Gummer (Eds.), The ethical use of data in education: Promoting responsible policies and practices (pp. 144–172). Teachers College Press.
   Google Scholar
• Guo, G., & Zhao, H. (2000). Multilevel modeling for binary data. Annual Review of Sociology, 26(1), 441–462. https://doi.org/10.1146/annurev.soc.26.1.441
   Web of Science ®Google Scholar
• Hamilton, L., Halverson, R., Jackson, S., Mandinach, E., Supovitz, J., & Wayman, J. (2009). Using student achievement data to support instructional decision making (NCEE Report No. 2009-4607). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. https://ies.ed.gov/ncee/wwc/Docs/PracticeGuide/dddm_pg_092909.pdf
   Google Scholar
• Harrison, G. W., & List, J. A. (2004). Field experiments. Journal of Economic Literature, 42(4), 1009–1055. https://doi.org/10.1257/0022051043004577
   Web of Science ®Google Scholar
• Horn, I. S. (2007). Fast kids, slow kids, lazy kids: Framing the mismatch problem in mathematics teachers’ conversations. The Journal of the Learning Sciences, 16(1), 27–79. https://doi.org/10.1080/10508400709336942
   Web of Science ®Google Scholar
• Horn, I. S. (2018). Accountability as a design for teacher learning: Sensemaking about mathematics and equity in the NCLB era. Urban Education, 53(3), 382–408. https://doi.org/10.1177/0042085916646625
   Web of Science ®Google Scholar
• Horn, I. S., Kane, B. D., & Wilson, J. (2015). Making sense of student performance data: Data use logics and mathematics teachers’ learning opportunities. American Educational Research Journal, 52(2), 208–242. https://doi.org/10.3102/0002831215573773
   Web of Science ®Google Scholar
• Ingram, D., Louis, K. S., & Schroeder, R. G. (2004). Accountability policies and teacher decision making: Barriers to the use of data to improve practice. Teachers College Record, 106(6), 1258–1287. https://doi.org/10.1177/016146810410600609
   Web of Science ®Google Scholar
• Jennings, A. S. (in press). Preferences, substitutes, and complements: Mapping the relationship between data sources within teachers’ instructional practice. Educational Assessment.
   Google Scholar
• Jennings, A. S., & Jennings, A. B. (2020). Comprehensive and superficial data users: A convergent mixed methods study of teachers’ practice of interim assessment data use. Teachers College Record, 122(12), 1–46. https://doi.org/10.1177/016146812012201210
   Web of Science ®Google Scholar
• Jennings, J. L., & Pallas, A. M. (2016). How does value-added data affect teachers? Educational Leadership, 73(8). https://www.ascd.org/el/articles/how-does-value-added-data-affect-teachers
   Google Scholar
• Krieg, J. M. (2008). Are students left behind? The distributional effects of the no child left behind act. Education Finance and Policy, 3(2), 250–281. https://doi.org/10.1162/edfp.2008.3.2.250
   Web of Science ®Google Scholar
• Ladd, H. F., & Lauen, D. L. (2010). Status versus growth: The distributional effects of school accountability policies. Journal of Policy Analysis and Management, 29(3), 426–450. https://doi.org/10.1002/pam.20504
   Web of Science ®Google Scholar
• Little, J. W. (2012). Understanding data use practice among teachers: The contribution of micro-process studies. American Journal of Education, 118(2), 143–166. https://doi.org/10.1086/663271
   Web of Science ®Google Scholar
• Madaus, G., Russell, M., & Higgins, J. (2009). The paradoxes of high stakes testing: How they affect students, their parents, teachers, principals, schools, and society. Information Age Publishing, Inc.
   Google Scholar
• Mandinach, E. B., Friedman, J. M., & Gummer, E. S. (2015). How can schools of education help to build educators’ capacity to use data? A systemic view of the issue. Teachers College Record, 117(4), 1–50. https://doi.org/10.1177/016146811511700404
   Google Scholar
• Mandinach, E. B., & Gummer, E. S. (2013). A systematic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30–37. https://doi.org/10.3102/0013189X12459803
   Web of Science ®Google Scholar
• Mandinach, E. B., & Gummer, E. S. (2016a). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366–376. https://doi.org/10.1016/j.tate.2016.07.011
   Web of Science ®Google Scholar
• Mandinach, E. B., & Gummer, E. S. (2016b). Data literacy for educators: Making it count in teacher preparation and practice. Teachers College Press.
   Google Scholar
• Mandinach, E. B., & Gummer, E. S. (2021). The landscape of data ethics in education: What counts as responsible data use. In E. B. Mandinach & E. S. Gummer (Eds.), The ethical use of data in education: Promoting responsible policies and practices (pp. 35–55). Teachers College Press.
   Google Scholar
• Mandinach, E. B., & Jimerson, J. B. (2021). The role of the classroom, school, and district to ensure the ethical use of data. In E. B. Mandinach & E. S. Gummer (Eds.), The ethical use of data in education: Promoting responsible policies and practices (pp. 101–124). Teachers College Press.
   Google Scholar
• Mandinach, E. B., Parton, B. M., Gummer, E. S., & Anderson, R. (2015). Ethical and appropriate data use requires data literacy. Phi Delta Kappan, 96(5), 25–28. https://doi.org/10.1177/0031721715569465
   Web of Science ®Google Scholar
• Mandinach, E. B., & Schildkamp, K. (2021). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation, 69, 1–10. https://doi.org/10.1016/j.stueduc.2020.100842
   Web of Science ®Google Scholar
• Marsh, J. A. (2012). Interventions promoting educators’ use of data: Research insights and gaps. Teachers College Record, 114(11), 1–48. https://doi.org/10.1177/016146811211401106
   PubMed Web of Science ®Google Scholar
• Marsh, J. A., Springer, M. G., McCaffrey, D. F., Yuan, K., Epstein, S., Koppich, J., Kalra, N., DiMartino, C., & Peng, A. (2011). A big apple for educators: New York city’s experiment with schoolwide performance bonuses. RAND Corporation.
   Google Scholar
• Means, B., Padilla, C., DeBarger, A., & Bakia, M. (2009). Implementing data-informed decision making in schools–Teacher access, supports and use. U.S. Department of Education, Office of Planning, Evaluation and Policy Development.
   Google Scholar
• Nabors Oláh, L., Lawrence, N. R., & Riggan, M. (2010). Learning to learn from benchmark assessment data: How teachers analyze results. Peabody Journal of Education, 85(2), 226–245. https://doi.org/10.1080/01619561003688688
   Google Scholar
• Neal, D., & Schanzenbach, D. W. (2010). Left behind by design: Proficiency counts and test-based accountability. The Review of Economics and Statistics, 92(2), 263–283. https://doi.org/10.1162/rest.2010.12318
   Web of Science ®Google Scholar
• Nichols, S. L. (2021). Educational policy contexts and the (un)ethical use of data. In E. B. Mandinach & E. S. Gummer (Eds.), The ethical use of data in education: Promoting responsible policies and practices (pp. 81–97). Teachers College Press.
   Google Scholar
• Nichols, S. L., & Berliner, D. C. (2007). Collateral damage: How high-stakes testing corrupts America’s schools. Harvard Educational Press.
   Google Scholar
• Nichols, S. L., & Harris, L. R. (2016). Accountability assessment’s effects on teachers and schools. In G. T. L. Brown & L. R. Harris (Eds.), Handbook of human and social conditions in assessment (pp. 40–56). Routledge. https://doi.org/10.4324/9781315749136
   Google Scholar
• O’Day, J. A. (2002). Complexity, accountability, and school improvement. Harvard Educational Review, 72(3), 293–329. https://doi.org/10.17763/haer.72.3.021q742t8182h238
   Web of Science ®Google Scholar
• Park, V., & Datnow, A. (2017). Ability grouping and differentiated instruction in an era of data-driven decision making. American Journal of Education, 123(2), 281–306. https://doi.org/10.1086/689930
   Web of Science ®Google Scholar
• Penuel, W. R., & Shepard, L. A. (2016). Assessment and teaching. In D. H. Gitomer & C. A. Bell (Eds.), Handbook of research on teaching (5th ed., pp. 787–850). American Educational Research Association.
   Google Scholar
• Pham, L. D., Nguyen, T. D., & Springer, M. G. (2021). Teacher merit pay: A meta-analysis. American Educational Research Journal, 58(3), 527–566. https://doi.org/10.3102/0002831220905580
   Web of Science ®Google Scholar
• Piro, J. S., & Hutchinson, C. J. (2014). Using a data chat to teach instructional interventions: Student perceptions of data literacy in an assessment course. The New Educator, 10(2), 95–111. https://doi.org/10.1080/1547688X.2014.898479
   Google Scholar
• Podgursky, M. J., & Springer, M. G. (2007). Teacher performance pay: A review. Journal of Policy Analysis and Management, 26(4), 909–949. https://doi.org/10.1002/pam.20292
   Web of Science ®Google Scholar
• Raudenbush, S. W., Bryk, A. S., & Congdon, R. (2019). HLM 8.00 for windows [Computer software]. Scientific Software International, Inc.
   Google Scholar
• Reback, R. (2008). Teaching to the rating: School accountability and the distribution of student achievement. Journal of Public Economics, 92(5), 1394–1415. https://doi.org/10.1016/j.jpubeco.2007.05.003
   Web of Science ®Google Scholar
• Reeves, T. D. (2017). Pre-service teachers’ data use opportunities during student teaching. Teaching and Teacher Education, 63, 263–273. https://doi.org/10.1016/j.tate.2017.01.003
   Web of Science ®Google Scholar
• Reeves, T. D., & Honig, S. L. (2015). A classroom data literacy intervention for pre-service teachers. Teaching and Teacher Education, 50, 90–101. https://doi.org/10.1016/j.tate.2015.05.007
   Web of Science ®Google Scholar
• Richardson, V. (2003). Preservice teachers’ beliefs. In J. Raths & A. C. McAninch (Eds.), Teacher beliefs and classroom performance: The impact of teacher education (pp. 1–22). Information Age Publishing, Inc.
   Google Scholar
• Ross, E., & Worth, C. (2018). Databurst: Strategic teacher compensation. National Council on Teacher Quality. https://www.nctq.org/dmsView/Strategic_Compensation_Databurst
   Google Scholar
• Shields, R. (2012). Strategic design of teacher compensation. Education Resource Strategies. https://www.erstrategies.org/cms/files/3340-strategic-design-of-teacher-compensation-new.pdf
   Google Scholar
• Smarter Balanced Assessment Consortium. (2014). Smarter balanced assessment consortium reporting system: Reporting system overview. https://portal.smarterbalanced.org/library/en/reporting-system-overview.pdf
   Google Scholar
• Supovitz, J. A., & Klein, V. (2003). Mapping a course for improved student learning: How innovative schools systematically use student performance data to guide improvement (CPRE Research Reports). University of Pennsylvania Consortium for Policy Research in Education. https://repository.upenn.edu/cpre_researchreports/39
   Google Scholar
• Thompson, A. G. (1992). Teachers’ beliefs and conceptions: A synthesis of the research. In D. A. Grouws (Ed.), Handbook of research on mathematics teaching and learning: A project of the national council of teachers of mathematics (pp. 127–146). National Council of Teachers of Mathematics.
   Google Scholar
• White, K. W., & Rosenbaum, J. E. (2008). Inside the black box of accountability: How high-stakes accountability alters school culture and the classification and treatment of students and teachers. In A. R. Sadovnik, J. A. O’Day, G. W. Bohrnstedt, & K. M. Borman (Eds.), No child left behind and the reduction of the achievement gap: Sociological perspectives on federal educational policy (pp. 97–114). Routledge. https://doi.org/10.4324/9780203941256
   Google Scholar