Programmatic Effects of the Massachusetts Performance Assessment for Leaders

References

• Abrams, L. M., Pedulla, J. J., & Madaus, G. F. (2003). Views from the classroom: Teachers’ opinions of statewide testing programs. Theory into Practice, 42(1), 18–29. doi:10.1207/s15430421tip4201_4
   Web of Science ®Google Scholar
• Allen, I. E., & Seaman, C. A. (2007). Likert scales and data analyses. Quality Progress, 40(7), 64.
   Google Scholar
• American Educational Research Association, American Psychological Association, National Council on Measurement in Education, & Joint Committee on Standards for Educational Psychological Testing. (2014). Standards for educational and psychological testing. American Educational Research Association.
   Google Scholar
• Aschbacher, P. R. (1991). Performance assessment: State activity, interest, and concerns. Applied Measurement in Education, 4(4), 275–288. doi:10.1207/s15324818ame0404_2
   Google Scholar
• Au, W. (2007). High-stakes testing and curricular control: A qualitative metasynthesis. Educational Researcher, 36(5), 258–267. doi:10.3102/0013189X07306523
   Google Scholar
• Au, W. (2010). Unequal by design: High-stakes testing and the standardization of inequality. New York, NY: Routledge.
   Google Scholar
• Au, W. (2011). Teaching under the new Taylorism: High‐stakes testing and the standardization of the 21st century curriculum. Journal of Curriculum Studies, 43(1), 25–45. doi:10.1080/00220272.2010.521261
   Web of Science ®Google Scholar
• Augustine, C. H., Gonzalez, G., Ikemoto, G. S., Russell, J., & Zellman, G. L. (2009). Improving school leadership: The promise of cohesive leadership systems. Santa Monica, CA: Rand Corporation.
   Google Scholar
• Barnett, B. G., Basom, M. R., Yerkes, D. M., & Norris, C. J. (2000). Cohorts in educational leadership programs: Benefits, difficulties, and the potential for developing school leaders. Educational Administration Quarterly, 36(2), 255–282. doi: http://dx.doi.org/10.1177/0013161X00362005
   Web of Science ®Google Scholar
• Berliner, D. (2011). Rational responses to high stakes testing: The case of curriculum narrowing and the harm that follows. Cambridge Journal of Education, 41(3), 287–302. doi:10.1080/0305764x.2011.607151
   Web of Science ®Google Scholar
• Boone, H. N., Jr, & Boone, D. A. (2012). Analyzing likert data. Journal of Extension, 50(2), n2.
   Google Scholar
• Browne-Ferrigno, T. & Muth, R. (2001, November 2-4). Issues related to the effects of cohorts on learners. Paper presented at the Annual Meeting of the University Council for Educational Administration 15th, Cincinnati, OH.
   Google Scholar
• Buttram, J. L., & Leonard, J. (2014). Preparation programs’ experiences and engagement with the Performance Assessment for Leaders. Paper presented at the Annual Convention of the University Council for Educational Administration, Washington, DC.
   Google Scholar
• California Commission on Teacher Credentialing. (2013). Update on administrator performance assessments. Sacramento, CA: Author. Retrieved from http://www.ctc.ca.gov/commission/agendas/2013-09/2013-09-4e.pdf
   Google Scholar
• California Commission on Teacher Credentialing. (2016). Update on the development of the California administrator performance assessment (CalAPA). Sacramento, CA: Author. Retrieved from http://www.ctc.ca.gov/commission/agendas/2016-10/2016-10-2F.pdf
   Google Scholar
• Carnoy, M., & Loeb, S. (2002). Does external accountability affect student outcomes? A cross-state analysis. Educational Evaluation and Policy Analysis, 24(4), 305–331. doi:10.3102/01623737024004305
   Web of Science ®Google Scholar
• Chatterji, M. (2002). Models and methods for examining standards-based reforms and accountability initiatives: Have the tools of inquiry answered pressing questions on improving schools? Review of Educational Research, 72(3), 345–386. doi:10.3102/00346543072003345
   Web of Science ®Google Scholar
• Cibulka, J. G. (2009). Declining support for higher-education leadership preparation programs: An analysis. Peabody Journal of Education, 84(3), 453–466. doi:10.1080/01619560902973654
   Google Scholar
• Condon, C., & Clifford, M. (2012). Measuring principal performance: How rigorous are commonly used principal performance assessment instruments? Retrieved from Naperville IL http://www.air.org/sites/default/files/downloads/report/Measuring_Principal_Performance_0.pdf
   Google Scholar
• Creswell, J. W. (2014). A concise introduction to mixed methods research. Thousand Oaks, CA: Sage Publications.
   Google Scholar
• Darling-Hammond, L. (2010). Evaluating teacher effectiveness: How teacher performance assessments can measure and improve teaching. Washington, DC. Retrieved from https://edpolicy.stanford.edu/sites/default/files/publications/evaluating-teacher-effectiveness_0.pdf
   Google Scholar
• Darling-Hammond, L., Newton, S. P., & Wei, R. C. (2013). Developing and assessing beginning teacher effectiveness: The potential of performance assessments. Educational Assessment, Evaluation and Accountability, 25(3), 179–204. doi:10.1007/s11092-013-9163-0
   Web of Science ®Google Scholar
• Davis, S., & Darling-Hammond, L. (2012). Innovative principal preparation programs: What works and how we know. Planning and Changing, 43(1/2), 25–45.
   Google Scholar
• Davis, S., Darling-Hammond, L., LaPointe, M., & Meyerson, D. (2005). School leadership study: Developing successful principals. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.123.7780&rep=rep1&type=pdf
   Google Scholar
• Delandshere, G., & Petrosky, A. R. (1998). Assessment of complex performances: Limitations of key measurement assumptions. Educational Researcher, 27(2), 14–24. doi:10.3102/0013189X027002014
   Google Scholar
• Diamond, J. B. (2007). Where the rubber meets the road: Rethinking the connection between high-stakes testing policy and classroom instruction. Sociology of Education, 80(4), 285–313. doi:10.1177/003804070708000401
   Web of Science ®Google Scholar
• Elliott, S. N., & Clifford, M. (2014). Principal assessment: Leadership behaviors known to influence schools and the learning of all students. Document No. LS-5. Retrieved from http://ceedar.education.ufl.edu/wp-content/uploads/2014/09/LS-5_FINAL_09-26-14.pdf
   Google Scholar
• Fitchett, P. G., & Heafner, T. L. (2010). A national perspective on the effects of high-stakes testing and standardization on elementary social studies marginalization. Theory & Research in Social Education, 38(1), 114–130. doi:10.1080/00933104.2010.10473418
   Google Scholar
• Fry, B., Bottoms, G., O’Neill, K., & Walker, S. (2007). Schools need good leaders now: State progress in creating a learning-centered school leadership system. Retrieved from http://www.wallacefoundation.org/knowledge-center/Documents/Schools-Need-Good-Leaders-Now.pdf
   Google Scholar
• Goldring, E., Cravens, X. C., Murphy, J., Porter, A. C., Elliott, S. N., & Carson, B. (2009). The evaluation of principals: What and how do states and urban districts assess leadership? The Elementary School Journal, 110(1), 19–39. doi:10.1086/598841
   Web of Science ®Google Scholar
• Greenblatt, D., & O’Hara, K. E. (2015). Buyer beware: Lessons learned from EdTPA implementation in New York State. Teacher Education Quarterly, 42(2), 57–67.
   Google Scholar
• Grissom, J., Mitani, H., & Blissett, R. (2015, November). Principal licensure exams as barriers to entry and predictors of principal job performance. Paper presented at the Annual Convention of the University Council for Educational Administration, San Diego, CA.
   Google Scholar
• Grissom, J. A., Mitani, H., & Blissett, R. S. L. (2017). Principal licensure exams and future job performance: Evidence from the School Leaders Licensure Assessment. Educational Evaluation and Policy Analysis, 39(2), 248–280. doi:10.3102/0162373716680293
   Web of Science ®Google Scholar
• Hamilton, L. S., Stecher, B. M., & Klein, S. P. (2002). Making sense of test-based accountability in education. Santa Monica, CA: Rand Corporation.
   Google Scholar
• Hancock, D. R., & Algozzine, B. (2006). Doing case study research: A practical guide for beginning researchers. New York, NY: Teachers College Press.
   Google Scholar
• Hanushek, E. A., & Raymond, M. E. (2005). Does school accountability lead to improved student performance? Journal of Policy Analysis and Management: the Journal of the Association for Public Policy Analysis and Management, 24(2), 297–327. doi:10.1002/pam.20091
   Web of Science ®Google Scholar
• Hardy, I. (2015). A logic of enumeration: The nature and effects of national literacy and numeracy testing in Australia. Journal of Education Policy, 30(3), 335–362. doi:10.1080/02680939.2014.945964
   Web of Science ®Google Scholar
• Heilig, J. V., & Darling-Hammond, L. (2008). Accountability Texas-style: The progress and learning of urban minority students in a high-stakes testing context. Educational Evaluation and Policy Analysis, 30(2), 75–110. doi:10.3102/0162373708317689
   Web of Science ®Google Scholar
• Herman, J. L. (2004). The effects of testing on instruction. In S. H. Fuhrman & R. F. Elmore (Eds.), Redesigning accountability systems for education (pp. 141–166). New York, NY: Teachers College Press.
   Google Scholar
• Ikemoto, G., Keleman, M., Tucker, P., & Young, M. (2016). Guide to the state evaluation of principal preparation programs. Washington, DC: New Leaders, University Council for Educational Administration.
   Google Scholar
• Ivankova, N. V., Creswell, J. W., & Stick, S. L. (2006). Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1), 3–20. doi:10.1177/1525822X05282260
   Web of Science ®Google Scholar
• Jacob, B. A. (2005). Accountability, incentives and behavior: The impact of high-stakes testing in the Chicago Public Schools. Journal of Public Economics, 89(5–6), 761–796. doi:10.1016/j.jpubeco.2004.08.004
   Web of Science ®Google Scholar
• Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: A literature review. Quality & Quantity, 47(4), 2025–2047. doi:10.1007/s11135-011-9640-9
   Web of Science ®Google Scholar
• Leithwood, K., Louis, K. S., Anderson, S., & Wahlstrom, K. (2004). How leadership influences student learning. Retrieved from http://www.wallacefoundation.org/knowledge-center/school-leadership/key-research/Documents/How-Leadership-Influences-Student-Learning.pdf
   Google Scholar
• Leithwood, K., & Mascall, B. (2008). Collective leadership effects on student achievement. Educational Administration Quarterly, 44(4), 529–561. doi:10.1177/0013161X08321221
   Web of Science ®Google Scholar
• Leonard, J. (2018). The validity of a performance based assessment for aspiring school leaders. Education Policy Analysis Archives, 26(163). http://dx.doi.org/10.14507/epaa.26.3914
   Google Scholar
• Losee, E., & Orr, M. T. (2015). Performance Assessment for Leaders: Information from the 2014–15 field trial and policies and procedures for program year 2015–16. Malden: Massachusetts Department of Elementary and Secondary Education. Retrieved from http://www.doe.mass.edu/news/news.aspx?id=21237
   Google Scholar
• Madaus, G. F. (1988). The distortion of teaching and testing: High‐stakes testing and instruction. Peabody Journal of Education, 65(3), 29–46. doi:10.1080/01619568809538611
   Web of Science ®Google Scholar
• Madaus, G. F., & Clarke, M. (2001). The adverse impact of high stakes testing on minority students: Evidence from one hundred years of test data. Available from ERIC database (ED450183).
   Google Scholar
• Manna, P. (2015). Developing excellent school principals to advance teaching and learning: Considerations for state policy. Retrieved from New York http://www.wallacefoundation.org/knowledge-center/school-leadership/state-policy/Documents/Developing-Excellent-School-Principals.pdf
   Google Scholar
• Mason, J. (2002). Qualitative researching (2nd ed.). Thousand Oaks, CA: Sage.
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (2013). Folio checklist for administrative leadership preparation programs for initial licensure 2012–2013 submissions. Malden MA: Author.
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (2015). Administrative field guide for leadership preparation programs. Malden, MA: Author.
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (2016a). Administrative field guide for leadership preparation programs. Malden, MA: Author.
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (2016b). Candidate assessment handbook. Malden, MA: Author.
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (2016c). Guidelines for the Candidate Assessment of Performance: Assessment of teacher candidates. Malden, MA: Author. Retrieved from http://www.doe.mass.edu/edprep/cap/guidelines.docx
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (2016d). Overview of administrator routes to initial licensure 603 cmr 7.00 & guidelines for the administrative apprenticeship/internship and panel review routes. Malden, MA: Author. Retrieved from http://www.mass.gov/edu/docs/ese/educator-effectiveness/licensing/panel-review-administrator-routes.docx
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (n.d.a). Find a preparation program. Retrieved from https://gateway.edu.state.ma.us/elar/licensurehelp/ProgramSearchPageControl.ser
   Google Scholar
• Massachusetts Department of Elementary and Secondary Education. (n.d.b). Performance Assessment for Leaders (PAL). Retrieved from http://www.doe.mass.edu/pal/tasks.html
   Google Scholar
• Massachusetts Performance Assessment for Leaders. (2017). Retrieved from http://www.doe.mass.edu/pal/
   Google Scholar
• McDonnell, L. M. (2005). Assessment and accountability from the policymaker’s perspective. Yearbook of the National Society for the Study of Education, 104(2), 35–54. doi:10.1111/j.1744-7984.2005.00024.x
   Google Scholar
• Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13–23. doi:10.3102/0013189X023002013
   Google Scholar
• National Policy Board for Educational Administration. (2015). Professional standards for educational leaders 2015. Reston, VA: Author.
   Google Scholar
• Nehring, J. (2015). To measure, or to assess, learning? Education Week, 35(02), 19–20. Retrieved from http://www.edweek.org/ew/articles/2015/08/26/we-must-teach-for-range-and-depth.html
   Google Scholar
• Nichols, S., Glass, G., & Berliner, D. (2012). High-stakes testing and student achievement: Updated analyses with NAEP data. Education Policy Analysis Archives, 20, 20. doi:10.14507/epaa.v20n20.2012
   Google Scholar
• Nichols, S. L., & Berliner, D. C. (2005). The inevitable corruption of indicators and educators through high-stakes testing. Retrieved from https://files.eric.ed.gov/fulltext/ED508483.pdf
   Google Scholar
• Orr, M. T., & Hollingworth, L. (2018). How performance assessment for leaders (PAL) influences preparation program quality and effectiveness. School Leadership & Management. doi:10.1080/13632434.2018.1439464
   Web of Science ®Google Scholar
• Orr, M. T., Hollingworth, L., & Cook, J. (2016, November). Large-scale performance assessment for leaders in California: A pilot study. Paper presented at the Annual Convention of the University Council for Educational Administration, Detroit, MI.
   Google Scholar
• Orr, M. T., Pecheone, R., Hollingworth, L., Beaudin, B., Snyder, J., & Murphy, J. (2017). The performance assessment for leaders: Construct validity and reliability evidence. Journal of Research on Leadership Education, 39(2), 139–161. doi:10.1177/1942775117742646
   Google Scholar
• Orr, M. T., Pecheone, R., Nayfeld, I., Shear, B., Hollingworth, L., & Beaudin, B. (2016). Massachusetts Performance Assessment for Leaders (PAL) technical report: Summary of validity and reliability studies for 2014–15 field trial of PAL. New York, NY: Bank Street College of Education. Retrieved from http://www.doe.mass.edu/pal/TechnicalReport.docx
   Google Scholar
• Orr, M. T., Pecheone, R., Snyder, J. D., Murphy, J., Palanki, A., Beaudin, B., … Buttram, J. L. (2017). Performance assessment for principal licensure: Evidence from content and face validation and bias review. Journal of Research on Leadership Education, 13(2), 109–138. doi:10.1177/1942775117701179
   Web of Science ®Google Scholar
• Pearson Education. (2018a). What is PAL. Retrieved from http://www.ma-pal.nesinc.com/PageView.aspx?f=GEN_AboutPAL.html
   Google Scholar
• Pearson Education. (2018b). What is PAL: Timeline. Retrieved from http://www.ma-pal.nesinc.com/PageView.aspx?f=GEN_Timeline.html
   Google Scholar
• Peck, C. A., Gallucci, C., & Sloan, T. (2010). Negotiating implementation of high-stakes performance assessment policies in teacher education: From compliance to inquiry. Journal of Teacher Education, 61(5), 451–463. doi:10.1177/0022487109354520
   Web of Science ®Google Scholar
• Peske, H. (2015). Massachusetts Performance Assessment for Leaders (PAL) implementation. Malden, MA. Retrieved from http://www.doe.mass.edu/news/news.aspx?id=21370.
   Google Scholar
• Polesel, J., Rice, S., & Dulfer, N. (2014). The impact of high-stakes testing on curriculum and pedagogy: A teacher perspective from Australia. Journal of Education Policy, 29(5), 640–657. doi:10.1080/02680939.2013.865082
   Web of Science ®Google Scholar
• Ramirez, A. (1999). Assessment-driven reform: The emperor still has no clothes. Phi Delta Kappan, 81(3), 204–208.
   Web of Science ®Google Scholar
• Rentner, D. S., Scott, C., Kober, N., Chudowsky, N., Chudowsky, V., Joftus, S., & Zabala, D. (2006). From the capital to the classroom: Year 4 of the No Child Left Behind Act. Retrieved from https://www.cep-dc.org/displayDocument.cfm?DocumentID=301
   Google Scholar
• Robinson, V. M. J., Lloyd, C. A., & Rowe, K. J. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44(5), 635–674. doi:10.1177/0013161X08321509
   Web of Science ®Google Scholar
• Russell, M., Madaus, G., & Higgins, J. (2009). The paradoxes of high stakes testing: How they affect students, their parents, teachers, principals, schools, and society. Charlotte, NC: IAP.
   Google Scholar
• Sato, M. (2014). What is the underlying conception of teaching of the edTPA? Journal of Teacher Education, 65(5), 421–434. doi:10.1177/0022487114542518
   Web of Science ®Google Scholar
• Shavelson, R. J., Baxter, G. P., & Pine, J. (1992). Performance assessments: Political rhetoric and measurement reality. Educational Researcher, 21(4), 22–27. doi:10.2307/1177207
   Google Scholar
• Shelton, S. (2011). Strong leaders strong schools: 2010 school leadership laws. Retrieved from: http://www.wallacefoundation.org/knowledge-center/Documents/2010-Strong-Leaders-Strong-Schools.pdf
   Google Scholar
• Shelton, S. (2012). Preparing a pipeline of effective principals: A legislative approach (1580246745). Retrieved from: http://www.ncsl.org/documents/educ/PreparingaPipelineofEffectivePrincipalsFINAL.pdf
   Google Scholar
• Shulman, L. S. (1998). Theory, practice, and the education of professionals. The Elementary School Journal, 98(5), 511–526. doi:10.1086/461912
   Web of Science ®Google Scholar
• Stringfield, S., Wayman, J. C., & Yakimowski-Srebnick, M. (2005). Scaling up data use in classrooms, schools, and districts. In C. Dede, J. P. Honan, & L. C. Peters (Eds.), Scaling up success: Lessons learned from technology-based educational improvement (pp. 133–152). Hoboken, NJ: Jossey-Bass.
   Google Scholar
• Supovitz, J. (2009). Can high stakes testing leverage educational improvement? Prospects from the last decade of testing and accountability reform. Journal of Educational Change, 10(2–3), 211–227. doi:10.1007/s10833-009-9105-2
   Google Scholar
• Thompson, G., & Harbaugh, A. G. (2013). A preliminary analysis of teacher perceptions of the effects of NAPLAN on pedagogy and curriculum. The Australian Educational Researcher, 40(3), 299–314. doi:10.1007/s13384-013-0093-0
   Web of Science ®Google Scholar
• Winn, K. M., Anderson, E., Groth, C., Korach, S., Pounder, D., Rorrer, A., & Young, M. D. (n.d.). A deeper look: INSPIRE data demonstrates quality in educational leadership preparation. Charlottesville, VA: University Council for Educational Administration.
   Google Scholar