Recent Developments in Classroom Observation Protocols for Undergraduate STEM: An Overview and Practical Guide

References

• American Association for the Advancement of Science (AAAS). (2013). Describing and measuring undergraduate STEM teaching practices. AAAS.
   Google Scholar
• Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom ’s taxonomy of educational objectives. Longman. http://eduq.info/xmlui/handle/11515/18345
   Google Scholar
• Eddy, S. L., Converse, M. S., & Wenderoth, M. P. (2015). PORTAAL: A classroom observation tool assessing evidence-based teaching practices for active learning in large science, technology, engineering and mathematics classes. CBE—Life Sciences Education, 14(2), article 23. https://doi.org/10.1187/cbe.14-06-0095
   Web of Science ®Google Scholar
• Harris, A. H., & Cox, M. F. (2003). Developing an observation system to capture instructional differences in engineering classrooms. Journal of Engineering Education, 94(4), 329–336. https://doi.org/10.1002/j.2168-9830.2003.tb00777.x
   Google Scholar
• Hora, M. T., & Ferrare, J. J. (2013). A review of classroom observation techniques in postsecondary settings [Working paper]. Wisconsin Center for Education Research.
   Google Scholar
• Hora, M. T., Oleson, A., & Ferrare, J. J. (2013). Teaching Dimensions Observation Protocol (TDOP) User ’s Manual. Wisconsin Center for Education Research, University of Wisconsin-Madison. http://tdop.wceruw.org/Document/TDOP-Users-Guide.pdf
   Google Scholar
• Klette, K., & Blikstad-Balas, M. (2018). Observation manuals as lenses to classroom teaching: Pitfalls and possibilities. European Educational Research Journal, 17(1), 129–146. https://doi.org/10.1177/1474904117703228
   Web of Science ®Google Scholar
• Ludwig, P. M., & Prins, S. (2019). A validated novel tool for capturing faculty-student joint behaviors with the COPUS instrument. Journal of Microbiology & Biology Education, 20(3). https://doi.org/10.1128/jmbe.v20i3.1535
   PubMed Web of Science ®Google Scholar
• Lund, T. J., Pilarz, M., Velasco, J. B., Chakraverty, D., Rosploch, K., Undersander, M., & Stains, M. (2015). The best of both worlds: Building on the COPUS and RTOP observation protocols to easily and reliably measure various levels of reformed instructional practice. CBE—Life Sciences Education, 14(2), article 18. https://doi.org/10.1187/cbe.14-10-0168
   PubMed Web of Science ®Google Scholar
• MacIsaac, D., & Falconer, K. (2002). Reforming physics instruction via RTOP. The Physics Teacher, 40(8), 479–485. https://doi.org/10.1119/1.1526620
   Google Scholar
• Marsh, H. W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective, pp. 319–383. Springer.
   Google Scholar
• Marshall, J. C., Smart, J., & Horton, R. M. (2009). The design and validation of EQUIP: An instrument to assess inquiry-based instruction. International Journal of Science and Mathematics Education, 8, 299–321. https://doi.org/10.1007/s10763-009-9174-y
   Web of Science ®Google Scholar
• Martin, P., & Bateson, P. (1986). Measuring behaviour: An introductory guide. Cambridge University Press.
   Google Scholar
• Mazur, E. (1997). Peer instruction: A users manual. Prentice Hall.
   Google Scholar
• Mazur, E. (2012, February 9). Eric Mazur shows interactive teaching [Video, Harvard Magazine]. YouTube. https://www.youtube.com/watch?v=wont2v_LZ1E
   Google Scholar
• National Science Board (NSB). (2007). National action plan for addressing the critical needs of the U.S. science, technology, engineering, and mathematics education system. National Science Foundation.
   Google Scholar
• Owens, M. T., Seidel, S. B., Wong, M., Bejines, T. E., Lietz, S., Perez, J. R., Sit, S., Subedar, Z., Acker, G. N., Akana, S. F., Balkukjian, B., Benton, H. P., Blair, J. R., Boaz, S. M., Boyer, K. E., Bram, J. B., Burrus, L. W., Byrd, D. T., Caporale, N., … Tanner, K. D. (2017). Classroom sound can be used to classify teaching practices in college science courses. PNAS, 114(12), 3085–3090. https://doi.org/10.1073/pnas.1618693114
   PubMed Web of Science ®Google Scholar
• Owens, M. T., Trujillo, G., Seidel, S. B., Harrison, C. D., Farrar, K. M., Benton, H. P., Blair, J. R., Boyer, K. E., Breckler, J. L., Burrus, L. W., Byrd, D. T., Caporale, N., Carpenter, E. J., Chan, Y. M., Chen, J. C., Chen, L., Chen, L. H., Chu, D. S., Chochlan, W. P., … Tanner, K. D. (2018). Collectively improving our teaching: Attempting biology department-wide professional development in scientific teaching. CBE—Life Sciences Education, 17(1), article 2. https://doi.org/10.1187/cbe.17-06-0106
   PubMed Web of Science ®Google Scholar
• President’s Council of Advisors on Science and Technology (PCAST). (2012). Engage to excel: Producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. Executive Office of the President. https://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/pcast-engage-to-excel-final_feb.pdf
   Google Scholar
• Reisner, B. A., Pate, C. L., Kinkaid, M. M., Paunovic, D. M., Pratt, J. M., Stewart, J. L., Raker, J. R., Bentley, A. K., Lin, S., & Smith, S. R. (2020). I’ve been given COPUS (Classroom Observation Protocol for Undergraduate STEM) data on my chemistry class … now what? Journal of Chemical Education, 97(4), 1181–1189. https://doi.org/10.1021/acs.jchemed.9b01066
   Web of Science ®Google Scholar
• Sawada, D., Turley, J., Falconer, K., Benford, R., & Bloom, I. (2002). Measuring reform practices in science and mathematics classrooms: The Reformed Teaching Observation Protocol. School Science and Mathematics, 102(6), 245–253. https://doi.org/10.1111/j.1949-8594.2002.tb17883.x
   Google Scholar
• Schlesinger, L., & Jentsch, A. (2016). Theoretical and methodological challenges in measuring instructional quality in mathematics education using classroom observations. ZDM Mathematics Education, 48, 29–40. https://doi.org/10.1007/s11858-016-0765-0
   Google Scholar
• Shekhar, P., Demonbrun, M., Borrego, M., Finelli, C., Prince, M., Henderson, C., & Waters, C. (2015). Development of an observation protocol to study undergraduate engineering student resistance to active learning. International Journal of Engineering Education, 31, 597.
   Web of Science ®Google Scholar
• Smith, M. K., Jones, F. H. M., Gilbert, S. L., & Wieman, C. E. (2013). The Classroom Observation Protocol for Undergraduate STEM (COPUS): A new instrument to characterize university STEM classroom practices. Cell Biology Education, 12, 618–627. https://doi.org/10.1187/cbe.13-08-0154
   Google Scholar
• Stains, M., Harshman, J., Barker, M. K., Chasteen, S. V., Cole, R., DeChenne-Peters, S. E., Eagan, M. K., Esson, J. M., Knight, J. K., Levis-Fitzgerald, M., McDonnell, L. M., Lee, C. J., Lo, S. M., McKay, T. A., Michelotti, N., Palmer, M. S., Plank, K. M., Rodela, T. M., Sanders, E. R., … Young, A. M. (2018). Anatomy of STEM teaching in North American universities. Science, 359(6383), 1468–1470. https://doi.org/10.1126/science.aap8892
   PubMed Web of Science ®Google Scholar
• Turpen, C., & Finkelstein, N. D. (2009). Not all interactive engagement is the same: Variations in physics professors’ implementation of peer instruction. Physical Review Physics Education Research, 5, 020101. https://doi.org/10.1103/PhysRevST-PER.5.020101
   Web of Science ®Google Scholar
• Walkington, C., Arora, P., Ihorn, S., Gordon, J., Walker, M., Abraham, L., & Marder, M. (2011). Development of the UTeach Observation Protocol: A classroom observation instrument to evaluate mathematics and science teachers from the UTeach Preparation Program [Technical report]. Southern Methodist University. https://www.researchgate.net/profile/Candace-Walkington/publication/265478444_Development_of_the_UTeach_Observation_Protocol_A_Class-room_Observation_Instrument_to_Evaluate_Mathematics_and_Science_Teachers_from_the_UTeach_Preparation_Program/links/543952900cf2d6698be16304/Development-of-the-UTeach-Observation-Protocol-A-Classroom-Observation-Instrument-to-Evaluate-Mathematics-and-Science-Teachers-from-the-UTeach-Preparation-Program.pdf
   Google Scholar
• William T. Grant Foundation, Spencer Foundation, & Bill & Melinda Gates Foundation. (2015). Measuring instruction in higher education: Summary of a convening. https://wtgrantfoundation.org/library/uploads/2015/11/Measuring-Instruction-in-Higher-Education.pdf
   Google Scholar