Is Teacher Value Added a Matter of Scale? The Practical Consequences of Treating an Ordinal Scale as Interval for Estimation of Teacher Effects

References

• American Institutes for Research. (2012). Value added model for measuring student learning gains: General approach and framework for evaluating candidate models. Retrieved from http://www.fldoe.org/core/fileparse.php/7566/urlt/0075115-sghandout.pdf
   Google Scholar
• Ballou, D. (2009). Test scaling and value-added measurement. Education, 4(4), 351–383.
   Web of Science ®Google Scholar
• Betebenner, D. W. (2008a). A primer on student growth percentiles. Dover, NH: National Center for the Improvement of Educational Assessment. Retrieved from https://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Documents/Aprimeronstudentgrowthpercentiles.pdf.
   Google Scholar
• Betebenner, D. W. (2008b). Toward a normative understanding of student growth. In K. E. Ryan & L. A. Shepard (Eds.), The future of test-based educational accountability (pp. 155–170). New York, NY: Taylor & Francis.
   Google Scholar
• Briggs, D. C. (2013). Measuring growth with vertical scales. Journal of Educational Measurement, 50(2), 204–226. doi:10.1111/jedm.2013.50.issue-2
   Web of Science ®Google Scholar
• Briggs, D. C., & Domingue, B. (2013). The gains from vertical scaling. Journal of Educational and Behavioral Statistics, 38, 551–576.
   Web of Science ®Google Scholar
• Briggs, D. C., & Weeks, J. P. (2009a). The impact of vertical scaling decisions on growth interpretations. Educational Measurement: Issues and Practice, 28(4), 3–14. doi:10.1111/j.1745-3992.2009.00158.x
   Google Scholar
• Briggs, D. C., & Weeks, J. P. (2009b). The sensitivity of value-added modeling to the creation of a vertical scale. Education Finance & Policy, 4(4), 384–414. doi:10.1162/edfp.2009.4.4.384
   Web of Science ®Google Scholar
• Chetty, R., Friedman, J. N., & Rockoff, J. E. (2011). The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood (NBER Working Paper no. 17699). Cambridge, MA: National Bureau of Economic Research.
   Google Scholar
• Dee, T. S., & Wyckoff, J. (2015). Incentives, selection, and teacher performance: Evidence from IMPACT. Journal of Policy Analysis and Management, 34(2), 267–297.
   Web of Science ®Google Scholar
• Doherty, K., & Jacobs, S. (2013). Connect the dots: Using evaluations of teacher effectiveness to inform policy and practice. Retrieved from http://www.nctq.org/dmsStage/StateoftheStates2013UsingTeacherEvaluationsNCTQReport
   Google Scholar
• Gordon, R. J., Kane, T. J., & Staiger, D. (2006). Identifying effective teachers using performance on the job. Washington, DC: Brookings Institution.
   Google Scholar
• Hanushek, E. A. (2011). The economic value of higher teacher quality. Economics of Education Review, 30(3), 466–479. doi:10.1016/j.econedurev.2010.12.006
   Web of Science ®Google Scholar
• Herrmann, M., Walsh, E., Isenberg, E., & Resch, A. (2013). Shrinkage of value-added estimates and characteristics of students with hard-to-predict achievement levels (Policy Report). Princeton, NJ: Mathematica Policy Research.
   Google Scholar
• Ho, A. D. (2007). Discrepancies between score trends from NAEP and state tests: A scale-invariant perspective. Educational Measurement: Issues and Practice, 26(4), 11–20. doi:10.1111/j.1745-3992.2007.00104.x
   Google Scholar
• Ho, A. D., & Reardon, S. F. (2012). Estimating achievement gaps from test scores reported in ordinal “proficiency” categories. Journal of Educational and Behavioral Statistics, 37(4), 489–517. doi:10.3102/1076998611411918
   Web of Science ®Google Scholar
• Koedel, C., Leatherman, R., & Parsons, E. (2012). Test measurement error and inference from value-added models. The BE Journal of Economic Analysis & Policy, 12(1), 1–37. doi:10.1515/1935-1682.3314
   Web of Science ®Google Scholar
• Lockwood, J. R., & McCaffrey, D. F. (2014). Correcting for test score measurement error in ANCOVA models for estimating treatment effects. Journal of Educational and Behavioral Statistics, 39(1), 22–52. doi:10.3102/1076998613509405
   Web of Science ®Google Scholar
• Lockwood, J. R., McCaffrey, D. F., Hamilton, L. S., Stecher, B., Le, V.-N., & Martinez, J. F. (2007). The sensitivity of value‐added teacher effect estimates to different mathematics achievement measures. Journal of Educational Measurement, 44(1), 47–67. doi:10.1111/jedm.2007.44.issue-1
   Web of Science ®Google Scholar
• Loeb, S., Kalogrides, D., & Béteille, T. (2012). Effective schools: Teacher hiring, assignment, development, and retention. Education, 7(3), 269–304.
   Web of Science ®Google Scholar
• Loeb, S., Soland, J., & Fox, L. (2014). Is a good teacher a good teacher for all? Comparing value-added of teachers with their English learners and non-English learners. Educational Evaluation and Policy Analysis, 36(4), 457–475. doi:10.3102/0162373714527788
   Web of Science ®Google Scholar
• McCaffrey, D. F., Lockwood, J. R., Koretz, D., Louis, T. A., & Hamilton, L. (2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29(1), 67–101. doi:10.3102/10769986029001067
   PubMed Web of Science ®Google Scholar
• McCaffrey, D. F., Sass, T. R., Lockwood, J. R., & Mihaly, K. (2009). The intertemporal variability of teacher effect estimates. Education, 4(4), 572–606.
   Web of Science ®Google Scholar
• Mihaly, K., McCaffrey, D. F., Lockwood, J. R., & Sass, T. R. (2010). Centering and reference groups for estimates of fixed effects: Modifications to felsdvreg. Stata Journal, 10(1), 82–103.
   Web of Science ®Google Scholar
• Ng, H. L., & Koretz, D. (2015). Sensitivity of school-performance ratings to scaling decisions. Applied Measurement in Education, 28(4), 330–349. doi:10.1080/08957347.2015.1062764
   Web of Science ®Google Scholar
• Papay, J. P. (2011). Different tests, different answers: The stability of teacher value-added estimates across outcome measures. American Educational Research Journal, 48(1), 163–193. doi:10.3102/0002831210362589
   Web of Science ®Google Scholar
• Pearson, K. (1895). On skew probability curves. Nature, 52, 317.
   Google Scholar
• Rothstein, J. (2009). Student sorting and bias in value-added estimation: Selection on observables and unobservables. Education, 4(4), 537–571.
   Web of Science ®Google Scholar
• Sass, T. R. (2008). The stability of value-added measures of teacher quality and implications for teacher compensation policy. Brief 4. Washington, DC: National Center for Analysis of Longitudinal Data in Education Research.
   Google Scholar
• Spencer, B. D. (1983). On interpreting test scores as social indicators: Statistical considerations. Journal of Educational Measurement, 20(4), 317–333. doi:10.1111/jedm.1983.20.issue-4
   Web of Science ®Google Scholar
• Zwick, R. (1992). Statistical and psychometric issues in the measurement of educational achievement trends: Examples from the National Assessment of Educational Progress. Journal of Educational and Behavioral Statistics, 17(2), 205–218. doi:10.3102/10769986017002205
   Web of Science ®Google Scholar