Supervisors’ untrained postgraduate rubric use for formative and summative purposes

References

• Biggs, J. 1996. “Enhancing Teaching through Constructive Alignment.” Higher Education 32 (3): 347–364. doi:10.1007/BF00138871.
   Web of Science ®Google Scholar
• Bradley, E. J., S. Anderson, and L. Eagle. 2020. “Use of a Marking Rubric and Self-Assessment to Provide Feedforward to Level 5 Undergraduate Sport Students: Student Perceptions, Performance and Marking Efficiency.” Journal of Learning Development in Higher Education 2 (18): 1–23, September. doi:10.47408/jldhe.vi18.557.
   Google Scholar
• Broadbent, J., E. Panadero, and D. Boud. 2018. “Implementing Summative Assessment with a Formative Flavour: A Case Study in a Large Class.” Assessment & Evaluation in Higher Education 43 (2): 307–322. doi:10.1080/02602938.2017.1343455.
   Web of Science ®Google Scholar
• Brookhart, S. M. 2018. “Appropriate Criteria: Key to Effective Rubrics.” Frontiers in Education 3 (22): 1–12 (April). doi:10.3389/feduc.2018.00022.
   Google Scholar
• Brookhart, S. M., and F. Chen. 2015. “The Quality and Effectiveness of Descriptive Rubrics.” Educational Review 67 (3): 343–368. doi:10.1080/00131911.2014.929565.
   Web of Science ®Google Scholar
• Chan, C. K. Y., and J. Luo. 2021. “Exploring Teacher Perceptions of Different Types of ‘Feedback Practices’ in Higher Education: Implications for Teacher Feedback Literacy.” Assessment & Evaluation in Higher Education: 1–16. doi:10.1080/02602938.2021.1888074.
   Web of Science ®Google Scholar
• Chugh, R., S. Macht, and B. Harreveld. 2021. “Supervisory Feedback to Postgraduate Research Students: A Literature Review.” Assessment & Evaluation in Higher Education: 1–15. doi:10.1080/02602938.2021.1955241.
   Web of Science ®Google Scholar
• Cohen, S. A. 1987. “Instructional Alignment: Searching for a Magic Bullet.” Educational Researcher 16 (8): 16–20. doi:10.3102/0013189X016008016.
   Google Scholar
• Davis, L. 2016. “The Influence of Training and Experience on Rater Performance in Scoring Spoken Language.” Language Testing 33 (1): 117–135. doi:10.1177/0265532215582282.
   Web of Science ®Google Scholar
• Dawson, P. 2017. “Assessment Rubrics: Towards Clearer and More Replicable Design, Research and Practice.” Assessment & Evaluation in Higher Education 42 (3): 347–360. doi:10.1080/02602938.2015.1111294.
   Web of Science ®Google Scholar
• Ginkel, S., van, J. Gulikers, H. Biemans, and M. Mulder. 2017. “The Impact of the Feedback Source on Developing Oral Presentation Competence.” Studies in Higher Education 42 (9): 1671–1685. doi:10.1080/03075079.2015.1117064.
   Web of Science ®Google Scholar
• Goodrich, H. 1997. “Understanding Rubrics.” Educational Leadership 54 (4): 14–17.
   Web of Science ®Google Scholar
• Haagsman, M., B. Snoek, A. Peeters, K. Scager, F. Prins, and M. van Zanten. 2021. “Examiners’ Use of Rubric Criteria for Grading Bachelor Theses.” Assessment & Evaluation in Higher Education 46 (8): 1269–1215. doi:10.1080/02602938.2020.1864287.
   Web of Science ®Google Scholar
• Hamer, J., H. Purchase, A. Luxton-Reilly, and P. Denny. 2015. “A Comparison of Peer and Tutor Feedback.” Assessment & Evaluation in Higher Education 40 (1): 151–164. doi:10.1080/02602938.2014.893418.
   Web of Science ®Google Scholar
• Ito, H. 2015. “Is a Rubric Worth the Time and Effort? Conditions for Success.” International Journal of Learning, Teaching and Educational Research 10 (2): 32–45.
   Google Scholar
• Jeong, H. 2015. “Rubrics in the Classroom: Do Teachers Really Follow Them?” Language Testing in Asia 5 (1): 6. doi:10.1186/s40468-015-0013-5.
   Google Scholar
• Jonsson, A., and G. Svingby. 2007. “The Use of Scoring Rubrics: Reliability, Validity and Educational Consequences.” Educational Research Review 2 (2): 130–144. doi:10.1016/j.edurev.2007.05.002.
   Google Scholar
• Kilgour, P., M. Northcote, A. Williams, and A. Kilgour. 2020. “A Plan for the Co-Construction and Collaborative Use of Rubrics for Student Learning.” Assessment & Evaluation in Higher Education 45 (1): 140–153. doi:10.1080/02602938.2019.1614523.
   Web of Science ®Google Scholar
• Kutlu, O., O. Yildirim, and S. Bilican. 2010. “The Comparison of the Views of Teachers with Positive and Negative Attitudes towards Rubrics.” Procedia - Social and Behavioral Sciences 9: 1566–1573. doi:10.1016/j.sbspro.2010.12.366.
   Google Scholar
• Lovorn, M. G., and A. R. Rezaei. 2011. “Assessing the Assessment: Rubrics Training for Pre-Service and New in-Service Teachers.” Practical Assessment, Research and Evaluation 16 (16): 1–10. doi:10.7275/sjt6-5k13.
   Google Scholar
• Menéndez-Varela, J. L., and E. Gregori-Giralt. 2018. “The Reliability and Sources of Error of Using Rubrics-Based Assessment for Student Projects.” Assessment & Evaluation in Higher Education 43 (3): 488–499. doi:10.1080/02602938.2017.1360838.
   Web of Science ®Google Scholar
• Oakleaf, M. 2009. “Using Rubrics to Assess Information Literacy: An Examination of Methodology and Interrater Reliability.” Journal of the American Society for Information Science and Technology 60 (5): 969–983. doi:10.1002/asi.21030.
   Web of Science ®Google Scholar
• Panadero, E., and A. Jonsson. 2013. “The Use of Scoring Rubrics for Formative Assessment Purposes Revisited: A Review.” Educational Research Review 9: 129–144. doi:10.1016/j.edurev.2013.01.002.
   Web of Science ®Google Scholar
• Panadero, E., and A. Jonsson. 2020. “A Critical Review of the Arguments against the Use of Rubrics.” Educational Research Review 30 (March): 100329. doi:10.1016/j.edurev.2020.100329.
   Google Scholar
• Park, Y. S., A. Hyderi, G. Bordage, K. Xing, and R. Yudkowsky. 2016. “Inter-Rater Reliability and Generalizability of Patient Note Scores Using a Scoring Rubric Based on the USMLE Step-2 CS Format.” Advances in Health Sciences Education 21 (4): 761–773. doi:10.1007/s10459-015-9664-3.
   PubMed Web of Science ®Google Scholar
• Popham, J. W. 1997. “What’s Wrong—and What’s Right—with Rubrics.” Educational Leadership 55 (2): 72–75.
   Web of Science ®Google Scholar
• Prins, F. J., R. de Kleijn, and J. van Tartwijk. 2017. “Students’ Use of a Rubric for Research Theses.” Assessment & Evaluation in Higher Education 42 (1): 128–150. doi:10.1080/02602938.2015.1085954.
   Web of Science ®Google Scholar
• Pufpaff, L. A., L. Clarke, and R. E. Jones. 2015. “The Effects of Rater Training on Inter-Rater Agreement.” Mid-Western Educational Researcher 27 (2): 117–141.
   Google Scholar
• Reddy, Y. M., and H. Andrade. 2010. “A Review of Rubric Use in Higher Education.” Assessment & Evaluation in Higher Education 35 (4): 435–448. doi:10.1080/02602930902862859.
   Web of Science ®Google Scholar
• Rezaei, A. R., and M. Lovorn. 2010. “Reliability and Validity of Rubrics for Assessment through Writing.” Assessing Writing 15 (1): 18–39. doi:10.1016/j.asw.2010.01.003.
   Google Scholar
• Shafer, William D., Gwenyth Swanson, Nancy Bene, and George Newberry. 2001. “Effects of Teacher Knowledge of Rubrics on Student Achievement in Four Content Areas.” Applied Measurement in Education 14 (2): 151–170. doi:10.1207/S15324818AME1402_3.
   Web of Science ®Google Scholar
• Venning, J., and F. Buisman-Pijlman. 2013. “Integrating Assessment Matrices in Feedback Loops to Promote Research Skill Development in Postgraduate Research Projects.” Assessment & Evaluation in Higher Education 38 (5): 567–579. doi:10.1080/02602938.2012.661842.
   Web of Science ®Google Scholar