Feedback on reflection: comparing rating-scale and forced-choice formats for measuring and facilitating teacher team reflective practice

References

• Aupperle, K. E., Carroll, A. B., & Hatfield, J. D. (1985). An empirical examination of the relationship between corporate social responsibility and profitability. Academy of Management Journal, 28, 446–463.
   Web of Science ®Google Scholar
• Bright, B. (1996). Reflecting on ‘reflective practice’. Studies in the Education of Adults, 28, 162–184.
   Google Scholar
• Brookfield, S. D. (1995). Becoming a critically reflective teacher. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Brown, A., & Maydeu-Olivares, A. (2012). Fitting a Thurstonian IRT model to forced-choice data using Mplus. Behavior research methods, 44, 1135–1147.
   PubMed Web of Science ®Google Scholar
• Calandra, B., Gurvitch, R., & Lund, J. (2008). An exploratory study of digital video editing as a tool for teacher preparation. Journal of Technology and Teacher Education, 16, 137–153.
   Google Scholar
• Carroll, T., Fulton, K., & Doerr, H. (2010). Team up for 21st century teaching and learning: What research and practice reveal about professional learning. Washington, DC: National Commission on Teaching and America’s Future.
   Google Scholar
• Cheung, M. W. L., & Chan, W. (2002). Reducing uniform response bias with ipsative measurement in multiple-group confirmatory factor analysis. Structural Equation Modeling, 9, 55–77.
   Web of Science ®Google Scholar
• Chi, F. M. (2010). Reflection as teaching inquiry: examples from Taiwanese in-service teachers. Reflective Practice, 11, 171–183.
   Google Scholar
• Christiansen, N. D., Burns, G. N., & Montgomery, G. E. (2005). Reconsidering forced-choice item formats for applicant personality assessment. Human Performance, 18, 267–307.
   Web of Science ®Google Scholar
• Cochran-Smith, M., & Lytle, S. L. (1993). Inside/outside: Teacher research and knowledge. New York, NY: Teachers’ College Press.
   Google Scholar
• Collin, S., & Karsenti, T. (2011). The collective dimension of reflective practice: The how and why. Reflective Practice, 12, 569–581.
   Google Scholar
• Council of Chief State School Officers (CCSSO). (2013). Interstate teacher assessment and support consortium (InTASC) model core teaching standards and learning progressions for teachers 1.0. Washington, DC: Author. Retrieved from http://www.ccsso.org/Documents/2013/2013_INTASC_Learning_Progressions_for_Teachers.pdf
   Google Scholar
• Cruickshank, D., & Applegate, J. (1981). Reflective teaching as a strategy for teacher growth. Educational Leadership, 38(7), 553–554.
   Web of Science ®Google Scholar
• Dana, N. F., & Yendol-Hoppey, D. (2009). The reflective educator’s guide to classroom research: Learning to teach and teaching to learn through practitioner inquiry (2nd ed.). Thousand Oaks, CA: Corwin Press.
   Google Scholar
• Dewey, J. (1933). How we think. Mineloa, NY: Dover.
   Google Scholar
• Dieker, L. A., & Monda-Amaya, L. E. (1995). Reflective teaching: A process for analyzing journals of preservice educators. Teacher Education and Special Education: The Journal of the Teacher Education Division of the Council for Exceptional Children, 18, 240–252.
   Google Scholar
• Elmore, R. F., Peterson, P. L., & McCarthey, S. J. (1996). Restructuring in the classroom: Teaching, learning, and school organization. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Ermeling, B. A. (2010). Tracing the effects of teacher inquiry on classroom practice. Teaching and Teacher Education, 26, 377–388.
   Web of Science ®Google Scholar
• Ermeling, B. A. (2012). Improving teaching through continuous learning: The inquiry process John Wooden used to become coach of the century. Quest, 64, 197–208.
   Web of Science ®Google Scholar
• Ermeling, B. A., & Graff-Ermeling, G. (2016). Teaching better: Igniting and sustaining instructional improvement. Thousand Oaks, CA: Corwin.
   Google Scholar
• Farrell, T. S. (2004). Reflective practice in action: 80 reflective breaks for busy teachers. Thousand Oaks, CA: Corwin Press.
   Google Scholar
• Friedrich, L., & McKinney, M. (2010). Teacher inquiry for equity: Collaborating to improve teaching and learning. Language Arts, 87(4), 241–251.
   Google Scholar
• Gallimore, R., & Ermeling, B. A. (2012). Why durable teaching changes are elusive and what might we do about it. Journal of Reading Recovery, 12, 41–53.
   Google Scholar
• Gallimore, R., Ermeling, B. A., Saunders, W. M., & Goldenberg, C. (2009). Moving the learning of teaching closer to practice: Teacher education implications of school-based inquiry teams. Elementary School Journal, 109, 537–553.
   Web of Science ®Google Scholar
• Gallimore, R., & Stigler, J. (2003). Closing the teaching gap: Assisting teachers to adapt to changing standards and assessments. In C. Richardson (Ed.), Whither assessment (pp. 25–36). London: Qualifications and Curriculum Authority.
   Google Scholar
• Grant, A. M., Franklin, J., & Langford, P. (2002). The self-reflection and insight scale: A new measure of private self-consciousness. Social Behaviour and Personality, 30, 821–836.
   Web of Science ®Google Scholar
• Hatton, N., & Smith, D. (1995). Reflection in teacher education: Towards definition and implementation. Teaching and Teacher Education, 11, 22–49.
   Web of Science ®Google Scholar
• Hawkes, M., & Romiszowski, A. (2001). Examining the reflective outcomes of asynchronous computer-mediated communication on inservice teacher development. Journal of Technology and Teacher Education, 9(2), 283–306.
   Google Scholar
• Hoffman-Kipp, P., Artiles, A. J., & López-Torres, L. (2003). Beyond reflection: Teacher learning as praxis. Theory into Practice, 42, 248–254.
   Web of Science ®Google Scholar
• Hoyt, W. T. (1999). Magnitude and moderators of bias of observer ratings: A meta-analysis. Psychological Methods, 4, 403–424.
   Web of Science ®Google Scholar
• Hoyt, W. T. (2000). Rater bias in psychological research: When is it a problem and what can we do about it? Psychological Methods, 5, 64–86.
   PubMed Web of Science ®Google Scholar
• Jay, J. K., & Johnson, K. L. (2002). Capturing complexity: A typology of reflective practice for teacher education. Teaching and teacher education, 18, 73–85.
   Web of Science ®Google Scholar
• Kajder, S., & Parkes, K. (2012). Examining preservice teachers’ reflective practice within and across multimodal writing environments. Journal of Technology and Teacher Education, 20, 229–249.
   Google Scholar
• Kember, D., Leung, D., Jones, A., Loke, A., McKay, J., Sinclair, K., … & Yeung, E. (2000). Development of a questionnaire to measure the level of reflective thinking. Assessment and Evaluation in Higher Education, 25, 381–395.
   Google Scholar
• Killion, J., & Todnem, G. (1991). A process of personal theory building. Educational Leadership, 48(6), 14–17.
   Web of Science ®Google Scholar
• Kirby, P. C. (1988). Reflective teaching and teacher effectiveness: Measurement considerations ( Eric Document Reproduction No. ED 303506). New Orleans, LA: Department of Educational Leadership and Foundations, University of New Orleans.
   Google Scholar
• Kirby, P., & Teddlie, C. (1989). Development of the reflective teaching instrument. Journal of Research and Development in Education, 22(4), 45–51.
   Google Scholar
• Korthagen, F. A. (1993). Two modes of reflection. Teaching and Teacher Education, 9, 317–326.
   Web of Science ®Google Scholar
• Larrivee, B. (2000). Transforming teaching practice: Becoming the critically reflective teacher. Reflective Practice, 1, 293–307.
   Google Scholar
• Larrivee, B. (2008). Development of a tool to assess teacher’s level of reflective practice. Reflective Practice, 9, 341–360.
   Google Scholar
• Lasley, T. J. (1992). Inquiry and reflection: Promoting teacher reflection. Journal of Staff Development, 13(1), 24–29.
   Google Scholar
• Learning Forward. (2011). Standards for professional learning. Oxford, OH: Author. Retrieved from http://learningforward.org/docs/pdf/standardsreferenceguide.pdf?sfvrsn=0
   Google Scholar
• Little, J. W. (2003). Inside teacher community: Representations of classroom practice. Teachers College Record, 105, 913–945.
   Web of Science ®Google Scholar
• Luik, P., Taimalu, M., Kalk, K., & Täht, K. (2014). Validity and reliability of two instruments to measure reflection: A confirmatory study. Trames, 18, 121–134.
   Web of Science ®Google Scholar
• Lyons, N., Halton, C., & Freidus, H. (2013). Reflective inquiry as transformative self-study for professional education and learning. Studying Teacher Education, 9, 163–174.
   Google Scholar
• Maydeu-Olivares, A., & Brown, A. (2010). Item response modeling of paired comparison and ranking data. Multivariate Behavioral Research, 45, 935–974.
   PubMed Web of Science ®Google Scholar
• McDougall, D., Saunders, W. M., & Goldenberg, C. (2007). Inside the black box of school reform: explaining the how and why of change at getting results schools. International Journal of Disability, Development and Education, 54, 51–89.
   Google Scholar
• MLwiN (2.27) [Computer software]. http://www.bristol.ac.uk/cmm/software/mlwin/
   Google Scholar
• Mplus (7.3) [Computer software]. https://www.statmodel.com/
   Google Scholar
• Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. ETS Research Report Series, 1992(1), 1–30.
   Google Scholar
• Murphy, J., Hallinger, P., & Heck, R. (2013). Leading via teacher evaluation: The case of the missing clothes? Educational Researcher, 42(6), 349–354.
   Web of Science ®Google Scholar
• Murphy, K. R., Jako, R. A., & Anhalt, R. L. (1993). Nature and consequences of halo error: A critical analysis. Journal of Applied psychology, 78, 218–225.
   Web of Science ®Google Scholar
• Myford, C. M., & Wolfe, E. W. (2004). Detecting and measuring rater effects using many-facet Rasch measurement: Part II. Journal of Applied Measurement, 5(2), 189–227.
   PubMedGoogle Scholar
• National Board for Professional Teaching Standards (NBPTS). (2002). What teachers should know and be able to do (Rev. ed.). Arlington, VA: Author. Retrieved from http://www.nbpts.org/sites/default/files/documents/certificates/what_teachers_should_know.pdf
   Google Scholar
• Norton, J. (1994, February 12–16). Creative thinking and locus of control as predictors of reflective thinking in preservice teachers ( ERIC Document Reproduction No. ED 366 579). Paper presented at the 74th Annual Meeting of the Association of Teacher Educators, Atlanta, GA.
   Google Scholar
• Osterman, K. P., & Kottkamp, R. B. (1993/2004). Reflective practice for educators: Improving schooling through professional development. Thousand Oaks, CA: Corwin Press. ( Original work published 1993)
   Google Scholar
• Parkes, K. A., Dredger, K. S., & Hicks, D. (2013). ePortfolio as a measure of reflective practice. International Journal of ePortfolio, 3(2), 99–115.
   Google Scholar
• Pennington, R. (2011). Reflective thinking in elementary preservice teacher portfolios: Can it be measured and taught? Journal of Educational Research and Practice, 1(1), 37–49.
   Google Scholar
• Rodgers, C. (2002). Defining reflection: Another look at John Dewey and reflective thinking. Teachers College Record, 4, 842–866.
   Web of Science ®Google Scholar
• Ross, D. (1989). First steps in developing a reflective approach. Journal of Teacher Education, 40, 22–30.
   Web of Science ®Google Scholar
• Ross, D. D. (1990). Programmatic structures for the preparation of reflective teachers. In R. T. Clift, W. R. Houston, & M. C. Pugach (Eds.), Encouraging reflective practice in education: An analysis of issues and programs (pp. 97–118). New York, NY: Teachers College Press.
   Google Scholar
• Ross, E. W., & Hannay, L. M. (1986). Towards a critical theory of reflective inquiry. Journal of Teacher Education, 37, 9–15.
   Web of Science ®Google Scholar
• SAS (9.2) [Computer software]. http://www.sas.com/en_us/home.html
   Google Scholar
• Saunders, W., Goldenberg, C., & Gallimore, R. (2009). Increasing achievement by focusing grade level teams on improving classroom learning: evidence from a 5 year prospective, quasi-experimental study of title 1 schools. American Educational Research Journal, 46, 1006–1033.
   Web of Science ®Google Scholar
• Schön, D. A. (1987). Educating the reflective practitioner. Toward a new design for teaching and learning in the professions (The Jossey-Bass Higher Education Series). San Francisco, CA: Jossey-Bass.
   Google Scholar
• Seng, T. W. (2004). Measuring practicum student teachers’ reflectivity: The reflective pedagogical thinking scale. (Eric Document Reproduction No. ED490778). Kuching, Malaysia: Batu Lintang Teachers College.
   Google Scholar
• Sparks-Langer, G. M., Simmons, J. M., Pasch, M., Colton, A., & Starko, A. (1990). Reflective pedagogical thinking: How can we promote it and measure it? Journal of Teacher Education, 41, 23–32.
   Web of Science ®Google Scholar
• Stacks, A. M., Wong, K., & Dykehouse, T. (2013). Teacher reflective functioning: a preliminary study of measurement and self-reported teaching behavior. Reflective Practice, 14, 487–505.
   Google Scholar
• Stigler, J. (2010). Needed: Fresh thinking on teacher accountability. Education Week, 29(33), 30.
   Google Scholar
• Thompson, N., & Pascal, J. (2012). Developing critically reflective practice. Reflective Practice: International and Multidisciplinary Perspectives, 13, 311–325.
   Google Scholar
• Tripp, T., & Rich, P. (2012). Using video to analyze one’s own teaching. British Journal of Educational Technology, 43, 678–704.
   Web of Science ®Google Scholar
• Trumbull, D. J. (1999). The new science teacher: Cultivating good practice. Ways of knowing in science series. Williston, VT: Teachers College Press.
   Google Scholar
• Tziner, A., & Murphy, K. R. (1999). Additional evidence of attitudinal influences in performance appraisal. Journal of Business and Psychology, 13, 407–419.
   Web of Science ®Google Scholar
• Van Manen, M. (1977). Linking ways of knowing with ways of being practical. Curriculum Inquiry, 6(3), 205–228.
   Web of Science ®Google Scholar
• York-Barr, J., Sommers, W. A., Ghere, G. S., & Montie, J. (2006). Reflective practice to improve schools. Thousand Oaks, CA: Corwin Press.
   Google Scholar