Measuring Educators' Attitudes and Beliefs About Evaluation: Construct Validity and Reliability of the Teacher Evaluation Experience Scale

References

• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• Arbuckle, J. L. (2010). IBM SPSS Amos 19 User's Guide, 587–590. Crawfordville, FL: Amos Development Corporation.
   Google Scholar
• Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
   Google Scholar
• Bandura, A. (2000). Exercise of human agency through collective efficacy. Current Directions in Psychological Science, 9, 75–78.
   Web of Science ®Google Scholar
• Benson, J. (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 1(7), 10–22.
   Google Scholar
• Berman, P., & McLaughlin, M. W. (1978). Federal programs supporting educational change: Implementing and sustaining innovations. Santa Monica, CA: Rand.
   Google Scholar
• Bowen, N. K., & Guo, S. (2012). Structural equation modeling. New York, NY: Oxford University Press.
   Google Scholar
• Burnham, K. P., & Anderson, D. R. (1998). Model selection and inference: A practical information-theoretic approach. New York, NY: Springer-Verlag.
   Google Scholar
• Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.
   Google Scholar
• Claudet, J. G. (1999). An interpretive analysis of educator change processes in response to program innovation: Implications for personnel evaluation. Journal of Personnel Evaluation in Education, 13, 47–69.
   Google Scholar
• Crandall, D. P., & Loucks, S. F. (1983). A roadmap for school improvement, people, policies, and practices: Examining the chain of school improvement (Vol. 10). Andover, MA: The NETWORK.
   Google Scholar
• Danielson, C., & McGreal, T. L. (2000). Teacher evaluation to enhance professional practice. Alexandria, VA: Association for Supervision and Curriculum Development.
   Google Scholar
• Datnow, A., & Castellano, M. (2000). Teachers' responses to Success for All: How Beliefs, experiences, and adaptations shape implementation. American Educational Research Journal, 37, 775–799.
   Web of Science ®Google Scholar
• Davis, D. R., Pool, J. E., & Mits-Cash, M. (2000). Issues in implementing a new teacher assessment system in a large urban school district: Results of a qualitative field study. Journal of Personnel Evaluation in Education, 14, 285–306.
   Google Scholar
• Delvaux, E., Vanhoof, J., Tuytens, M., Vekeman, E., Devos, G., & Petegem, P. V. (2013). How may teacher evaluation have an impact on professional development? A multilevel analysis. Teaching and Teacher Education, 36, 1–11.
   Web of Science ®Google Scholar
• Ding, L., Velicer, W. F., & Harlow, L. L. (1995). Effects of estimation methods, number of indicators per factor, and improper solutions on SEM fit indices. Structural Equation Modeling, 2, 119–144.
   Web of Science ®Google Scholar
• Duffy, G., & Roehler, L. (1986). Constraints on teacher change. Journal of Teacher Education, 35, 55–58.
   Web of Science ®Google Scholar
• Elementary and Secondary Education Act of 2012, 20 U.S.C. § 6301 et seq. (2012)
   Google Scholar
• Ellett, C. D., & Garland, J. S. (1987). Teacher evaluation practices in our largest school districts: Are they measuring up to “state-of the-art” systems? Journal of Personnel Evaluation in Education, 1, 69–92.
   Web of Science ®Google Scholar
• Finnegan, R. S. (2013). Linking teacher self-efficacy to teacher evaluations. Journal of Cross-Disciplinary Perspectives in Education, 6, 18–25.
   Google Scholar
• Firestone, W. A., Blitz, C. L., Gitomer, D. H., Kirova, D., Shcherbakov, A., & Nordon, T. L. (2013). New Jersey teacher evaluation, RU-GSE external assessment, year 1 report. New Brunswick, NJ: Rutgers University–Graduate School of Education.
   Google Scholar
• Fowler, F. (2004). Policy studies for educational leaders: An introduction. Upper Saddle River, NJ: Pearson Merrill Prentice Hall.
   Google Scholar
• Frase, L., & Streshly, W. (1994). Lack of accuracy, feedback, and commitment in teacher evaluation. Journal of Personnel Evaluation in Education, 8, 47–57.
   Google Scholar
• Fullan, M. (1993). Change forces: Probing the depths of educational reform. London, UK: Falmer Press.
   Google Scholar
• Fullan, M. (2001). Leading in a culture of change. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Gersten, R., Chard, D. J., & Baker, S. (2000). Factors enhancing sustained use of research-based instructional practices. Journal of Learning Disabilities, 33, 445–457.
   PubMed Web of Science ®Google Scholar
• Gibson, S., & Dembo, M. H. (1984). Teacher efficacy: A construct validation. Journal of Educational Psychology, 76, 569–582.
   Web of Science ®Google Scholar
• Goddard, R. D., Hoy, W. K., & Woolfolk-Hoy, A. (2000). Collective teacher efficacy: Its meaning, measure, and impact on student achievement. American Educational Research Journal, 37, 479–507.
   Web of Science ®Google Scholar
• Goe, L., Holdheide, L., & Miller, T. (2011). A practical guide to designing comprehensive teacher evaluation systems. Washington, DC: National Comprehensive Center for Teacher Quality. Retrieved from http://eric.ed.gov/?id = ED520828.
   Google Scholar
• Hayduk, L. A. (1987). Structural equations modeling with lisrel. Baltimore, MD: Johns Hopkins University Press.
   Google Scholar
• Heneman, H. G., & Milanowski, A. T. (2003). Continuing assessment of teacher reactions to a standards-based teacher evaluation system. Journal of Personnel Evaluation in Education, 17, 173–195.
   Google Scholar
• Heneman, H. G., & Milanowski, A. T. (2004). Alignment of human resource practices and teacher performance competency. Peabody Journal of Education, 79, 108–125.
   Google Scholar
• Hennessy, J. (1997, March). Reinventing teacher evaluation: A study of the impact on beginning teachers. Paper presented at the annual conference of the American Educational Research Association, Chicago, IL.
   Google Scholar
• Holland, P. (2005). The case for expanding standards for teacher evaluation to include an instructional supervision perspective. Journal of Personnel Evaluation in Education, 18, 67–77.
   Google Scholar
• Hoy, W. K., & Kupersmith, W. J. (1985). The meaning and measure of faculty trust. Educational and Psychological Research, 5, 1–10.
   Google Scholar
• Hoy, W. K., & Sabo, D. J. (1998). Quality middle schools: Open and healthy. Thousand Oaks, CA: Corwin Press.
   Google Scholar
• Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
   Web of Science ®Google Scholar
• Imig, S., & Smith, R. (2013). Listening to those on the front lines: North Carolina teachers and administrators respond to state legislative changes. Wilmington, NC: University of North Carolina Wilmington.
   Google Scholar
• Isore, M. (2009). Teacher evaluation: Current practices in OECD countries and a literature review (OECD Education Working Papers No. 23). Paris, France: OECD Publishing. Retrieved from http://www.oecd.org/edu/workingpapers.
   Google Scholar
• Jackson, D. L., Gillapsy, J. A., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14, 6–23.
   PubMed Web of Science ®Google Scholar
• Jackson, S. L. (2003). Research methods and statistics: A critical thinking approach. Melbourne, Australia: Thomson/Wadsworth.
   Google Scholar
• Jensen, M. A. (1981). How teachers view teacher evaluation. Education, 102, 30–37.
   Google Scholar
• Jiang, J., Sporte, S., & Luppescu, S. (2015). Teacher perspectives on evaluation reform: Chicago's REACH students. Educational Researcher, 44, 105–116.
   Web of Science ®Google Scholar
• Joint Committee on Standards for Educational Evaluation. (1988). The personnel evaluation standards. Thousand Oaks, CA: Corwin.
   Google Scholar
• Jöreskog, K. G., & Sörbom, D. (1986). LISREL VI: Analysis of linear structural relationships by maximum likelihood, instrumental variables, and least squares methods (4th ed.). Uppsula, Sweden: University of Uppsula Department of Statistics.
   Google Scholar
• Kane, M. (2002). Validating high-stakes testing programs. Educational Measurement: Issues and Practice, 21, 31–41.
   Google Scholar
• Kass, R., & Raferty, A. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795.
   Web of Science ®Google Scholar
• Kerlinger, F. N. (1986). Foundations of behavioral research (3rd ed.). San Diego, CA: Harcourt Brace.
   Google Scholar
• Kilburg, R. (1980). Metaphysics and professional resistance to program evaluation. Evaluation and Program Planning, 3, 185–190.
   Google Scholar
• Kurz, A., Elliott, S., Kettler, R., & Yel, O. (2014). Assessing students' opportunity to learn the intended curriculum using an online teacher log: Initial validity evidence. Educational Assessment, 19, 159–184.
   Google Scholar
• Leithwood, K., & Jantzi, D. (2006). Transformational school leadership for large-scale reform: Effects on students, teachers, and their classroom practices. School Effectiveness and School Improvement, 17, 201–217.
   Web of Science ®Google Scholar
• Luthans, F., & Stajkovic, A. (1998). Self-efficacy and work-related performance. A meta-analysis. Psychological Bulletin, 124, 240–246.
   Web of Science ®Google Scholar
• McLaughlin, M. W. (1987). Learning from experience: Lessons from policy implementation. Educational Evaluation and Policy Analysis, 9, 171–178.
   Google Scholar
• McLaughlin, M. W. (1990). Embracing contraries: Implementing and sustaining teacher evaluation. In J. Millman & Darling-Hammond (Eds.), The new handbook of teacher evaluation (pp. 403–415). Newbury Park, CA: Sage.
   Google Scholar
• Mead, S., Recent state action on teacher Effectiveness: What's in state laws and regulations?. Retrieved from http://bellwetheredecuation.org/sites/default/files/RSA-Teacher-Effectiveness.
   Google Scholar
• Milanowski, A. T., & Heneman, III, H. G. (2001). Assessment of teacher reactions to a standards-based teacher evaluation system: A pilot study. Journal of Personnel Evaluation in Education, 15, 193–212.
   Google Scholar
• Muncey, D., & McQuillan, P. (1996). Reform and resistance in schools and classrooms. New Haven, CT: Yale University Press.
   Google Scholar
• National Council on Teacher Quality. (2013). State of the states 2013 Connect the dots: Using evaluations of teacher effectiveness to inform policy and practice. Washington, DC: Author. Retrieved from http://www.nctq.org/dmsStage/State_of_the_States_2013_Using_Teacher_Evaluations_NCTQ_Report.
   Google Scholar
• National Council on Teacher Quality. (2014). State-by-state evaluation timeline briefs. Washington, DC: Author. Retrieved from http://www.nctq.org/dmsStage/Evaluation_Timeline_Brief_Overview.
   Google Scholar
• Nias, J. (1996). Thinking about feeling: the emotions in teaching. Cambridge Journal of Education, 26, 293–306.
   Google Scholar
• Noell, G. H., Witt, J. C., Gilbertson, D. N., Ranier, D. D., & Freeland, J. T. (1997). Increasing teacher intervention implementation in general education settings through consultation and performance feedback. School Psychology Quarterly, 12, 77–88.
   Web of Science ®Google Scholar
• Nye, B., Konstantopoulos, S., & Hedges, L. V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26, 237–257.
   Web of Science ®Google Scholar
• Odden, A. (2008). How new teacher pay structures can support education reform. Madison: University of Wisconsin, Wisconsin Center for Education Research, Consortium for Policy Research in Education.
   Google Scholar
• Organization for Economic Co-Operation and Development. (2009). Teacher evaluation: A conceptual framework and examples of country practices. Paris, France: Author.
   Google Scholar
• Reddy, L. A., & Dudek, C. (2014). Teacher progress monitoring of instructional and behavioral management practices: An evidence-based approach to improving classroom practices. International Journal of School and Educational Psychology, 2, 71–84.
   Google Scholar
• Reddy, L. A., Dudek, C. M., Fabiano, G., & Peters, S. (2015). Measuring teacher self-report on classroom practices: Construct validity and reliability of the CSS-Teacher Form. School Psychology Quarterly, 30, 513–533.
   PubMed Web of Science ®Google Scholar
• Reddy, L. A., Fabiano, G., Dudek, C., & Hsu, L. (2013). Development and construct validation of the Classroom Strategies Scale–Observer Form. School Psychology Quarterly, 28, 317–341.
   PubMed Web of Science ®Google Scholar
• Reddy, L. A., Kettler, R. J., & Kurz, A. (2015). School-wide educator evaluation for improving school capacity and student achievement in high poverty schools: Year 1 of the school system improvement project. Journal of Educational and Psychological Consultation, 2, 71–84.
   Google Scholar
• Reynolds, C. R., & Carson, D. (2005). Methods for assessing cultural bias in tests. In C. L. Frisby & C. R. Reynolds (Eds.), Comprehensive handbook of multicultural school psychology (pp. 795–823). New York, NY: Wiley & Sons.
   Google Scholar
• Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73, 417–458.
   Web of Science ®Google Scholar
• Ross, A. (1994). Trust as a moderator of the effect of performance evaluation style on job-related tension: A research note. Accounting, Organizations and Society, 19, 629–635.
   Web of Science ®Google Scholar
• Ruffini, S., Makkonen, R., Tejwani, J., & Diaz, M. (2014). Principal and teacher perceptions of implementation of a multiple-measure teacher evaluation systems in Arizona (REL 2015-062). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory West. Retrieved from http://ies.ed.gov/ncee/edlabs.
   Google Scholar
• Sanetti, L. M., Luiselli, J. K., & Handler, M. W. (2007). Effects of verbal and graphic performance feedback on behavior support plan implementation in a public elementary school. Behavior Modification, 31, 454–465.
   PubMed Web of Science ®Google Scholar
• Sawyer, L. (2001). Revamping a teacher evaluation system. Educational Leadership, 58(5), 44–47.
   Web of Science ®Google Scholar
• Schmidt, M., & Datnow, A. (2005). Teachers' sense-making about comprehensive school reform: The influence of emotions. Teaching and Teacher Education, 21, 949–965.
   Web of Science ®Google Scholar
• Schwartz, I. S., & Baer, D. M. (1991). Social validity assessments: Is current practice state of the art? Journal of Applied Behavior Analysis, 24, 189–204.
   PubMed Web of Science ®Google Scholar
• Stein, M. K., & Wang, M. C. (1988). Teacher development and school improvement: The process of teacher change. Teaching and Teacher Education, 4, 171–187.
   Web of Science ®Google Scholar
• Stronge, J. H. (Ed.). (2006). Evaluating teaching: A guide to current thinking and best practice (2nd ed.). Thousand Oaks, CA: Corwin Press.
   Google Scholar
• Stronge, J. H., & Tucker, P. D. (1999). The politics of teacher evaluation: a case study of new system design and implementation. Journal of Personnel Evaluation in Education, 13, 339–359.
   Google Scholar
• Teacher Effectiveness and Accountability for the Children of New Jersey Act (TEACHNJ), N.J.S.18A:6-11 amendment S-1455 (2012).
   Google Scholar
• Thoonen, E. E. J., Sleegers, P. J. C., Oort, F. J., Peetsma, T. T. D., & Geijsel, F. P. (2011). How to improve teaching practices: The role of teacher motivation, organizational factors, and leadership practices. Educational Administration Quarterly, 47, 496–536.
   Web of Science ®Google Scholar
• Toch, T., & Rothman, R. (2008). Rush to judgment: Teacher evaluation in public education (Report). Washington, DC: Education Sector.
   Google Scholar
• Tornero, B., & Taut, S. (2010). A mandatory, high-stakes national teacher evaluation system: Perceptions and attributions of teachers who actively refuse to participate. Studies in Educational Evaluation, 36, 132–142.
   Google Scholar
• Tuytens, M., & Devos, G. (2009). Teachers' perception of the new teacher evaluation policy: A validity study of the policy characteristics scale. Teaching and Teacher Education, 25, 924–930.
   Web of Science ®Google Scholar
• van den Berg, R., & Ros, A. (1999). The permanent importance of the subjective reality of teachers during educational innovation: A concerns-based approach. American Educational Research Journal, 36, 879–906.
   Web of Science ®Google Scholar
• Weisberg, D., Sexton, S., Mulhern, J., & Keeling, D. (2009). The Widget Effect: Our national failure to acknowledge and act on differences in teacher effectiveness. New York, NY: The New Teacher Project.
   Google Scholar
• Weisel, A., & Dror, O. (2006). School climate, sense of efficacy, and Israeli teachers' attitudes toward inclusion of students with special needs. Education, Citizenship and Social Justice, 1, 157–174.
   Google Scholar
• Zielinski, A. E., & Hoy, W. K. (1983). Isolation and alienation in elementary schools. Educational Administration Quarterly, 19, 27–45.
   Web of Science ®Google Scholar