A Novel Rubric Format for Providing Feedback on Process Skills to STEM Undergraduate Students

References

• Association of American Colleges and Universities (AAC&U). (2018). Fulfilling the American dream: Liberal education and the future of work. AAC&U. https://www.aacu.org/sites/default/files/files/LEAP/2018EmployerResearchReport.pdf
   Google Scholar
• Bauer, C. F., & Cole, R. (2012). Validation of an assessment rubric via controlled modification of a classroom activity. Journal of Chemical Educaction, 89(9), 1104–1108.
   Web of Science ®Google Scholar
• Biggs, J. (2003). Aligning teaching and assessing to course objectives. Teaching and Learning in Higher Education: New Trends and Innovations, 2 (April), 13–17
   Google Scholar
• Cole, R., Lantz, J., Ruder, S., Reynders, G., & Stanford, C. (2018). Enhancing learning by assessing more than content knowledge. American Society for Engineering Education Annual Conference & Exposition. https://peer.asee.org/29991.
   Google Scholar
• Cole, R., Reynders, G., Ruder, S., Stanford, C., & Lantz, J. (2019). Constructive alignment beyond content: Assessing professional skills in student group interactions and written work in M. Schultz, S. Schmid, & G. Lawrie (Eds.), Research and practice in chemistry education: Selected contributions from the 25th IUPAC International Conference on Chemistry Education 2018 (pp. 203-222). Springer Singapore. https://doi.org/10.1007/978-981-13-6998-8
   Google Scholar
• Dawson, P. (2017). Assessment rubrics: towards clearer and more replicable design, research and practice. Assessment & Evaluation in Higher Education, 42(3), 347–360.
   Web of Science ®Google Scholar
• Ferguson, P. (2011). Student perceptions of quality feedback in teacher education. Assessment and Evaluation in Higher Education, 36(1), 51–62. https://doi.org/10.1080/02602930903197883
   Web of Science ®Google Scholar
• Fong, C. J., Schallert, D. L., Williams, K. M., Williamson, Z. H., Warner, J. R., Lin, S., & Kim, Y. W. (2018). When feedback signals failure but offers hope for improvement: A process model of constructive criticism. Thinking Skills and Creativity, 30, 42–53.
   Web of Science ®Google Scholar
• Hacker, D. J., Bol, L., Horgan, D. D., & Rakow, E. A. (2000). Test prediction and performance in a classroom context. Journal of Educational Psychology, 92(1), 160.
   Web of Science ®Google Scholar
• Hawker, M. J., Dysleski, L., & Rickey, D. (2016). Investigating general chemistry students’ metacognitive monitoring of their exam performance by measuring postdiction accuracies over time. Journal of Chemical Education, 93(5), 832840.
   Web of Science ®Google Scholar
• Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge.
   Google Scholar
• Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
   Web of Science ®Google Scholar
• Kluger, A. N., & Denisi, A. (1996). The effects of feedback interventions on performance. Psychological Bulletin, 119(2), 254–284.
   Web of Science ®Google Scholar
• Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated selfassessments. Journal of Personality and Social Psychology, 77(6), 1121.
   PubMed Web of Science ®Google Scholar
• Lizzio, A., & Wilson, K. (2008). Feedback on assessment: Students’ perceptions of quality and effectiveness. Assessment and Evaluation in Higher Education, 33(3), 263–275. https://doi.org/10.1080/02602930701292548
   Web of Science ®Google Scholar
• Moog, R. S. & Spencer, J. N. (2008). Process-oriented guided inquiry learning. American Chemical Society.
   Google Scholar
• Mulliner, E., & Tucker, M. (2017). Feedback on feedback practice: perceptions of students and academics. Assessment and Evaluation in Higher Education, 42(2), 266–288. https://doi.org/10.1080/02602938.2015.1103365
   Web of Science ®Google Scholar
• National Association of Colleges and Employers (NACE). (2020). Job outlook 2018. https://www.naceweb.org/store/2019/job-outlook-2020
   Google Scholar
• National Research Council (NRC). (2012). Education for life and work: Developing transferable knowledge and skills in the 21st century. The National Academies Press.
   Google Scholar
• Nicol, D., & MacFarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218. https://doi.org/10.1080/03075070600572090
   Web of Science ®Google Scholar
• Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435–448.
   Web of Science ®Google Scholar
• Reynders, G., Suh, E., Cole, R. S., & Sansom, R. (2019). Developing student process skills in a general chemistry laboratory. Journal of Chemical Education, 96(10), 2109–2119. https://doi.org/10.1021/acs.jchemed.9b00441
   Web of Science ®Google Scholar
• Reynders, G., Lantz, J., Ruder, S., Stanford, C., and Cole, R. (2020). Rubrics to assess critical thinking and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(1), 1–15.
   Web of Science ®Google Scholar
• Ruder, S. M., & Stanford, C. (2018). Strategies for training undergraduate teaching assistants to facilitate large active learning classrooms. Journal of Chemical Education, 95(12), 2126–2133.
   Web of Science ®Google Scholar
• Ruder, S. M., Stanford, C., & Gandhi, A. (2018). Scaffolding STEM classrooms to integrate key workplace skills: Development of resources for active learning environments. Journal of College Science Teaching 47 (5), 29–35.
   Google Scholar
• Ruder, S. M., & Stanford, C. (2020). Training undergraduate teaching assistants to facilitate and assess process skills in large enrollment courses. Journal of Chemical Education 97(10), 3182–3187.
   Web of Science ®Google Scholar
• Schneider, M., & Preckel, F. (2017). Variables associated with achievement in higher education: A systematic review of meta-analyses. Psychological Bulletin, 143(6), 565–600. https://doi.org/10.1037/bul0000098
   PubMed Web of Science ®Google Scholar
• Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795
   Web of Science ®Google Scholar
• Simonson, S. R. (2019). POGIL: An introduction to process oriented guided inquiry learning for those who wish to empower learners. Stylus Publishing.
   Google Scholar
• Singh, A., Karayev, S., Gutowski, K., & Abbeel, P. (2017). Gradescope: A fast, flexible, and fair system for scalable assessment of handwritten work. In Proceedings of the Fourth (2017) Association for Computing Machinery Conference on Learning@Scale (pp. 81–88). Association for Computing Machinery.
   Google Scholar
• Weaver, M. R. (2006). Do students value feedback? Student perceptions of tutors’ written responses. Assessment & Evaluation in Higher Education, 31(3), 379–394.
   Google Scholar
• Wollenschläger, M., Hattie, J., Machts, N., Möller, J., & Harms, U. (2016). What makes rubrics effective in teacher-feedback? Transparency of learning goals is not enough. Contemporary Educational Psychology, 44-45, 1-11. https://doi.org/10.1016/j.cedpsych.2015.11.003
   Google Scholar
• Zimbardi, K., Colthorpe, K., Dekker, A., Engstrom, C., Bugarcic, A., Worthy, P., Victor, R., Chunduri, P., Luka, L., & Long, P. (2017). Are they using my feedback? The extent of students’ feedback use has a large impact on subsequent academic performance. Assessment and Evaluation in Higher Education, 42(4), 625–644. https://doi.org/10.1080/02602938.2016.1174187
   Web of Science ®Google Scholar