Why not rubrics in doctoral education?

References

• Australian Government Department of Education. 2019. Higher Degrees by Research Cohort Analysis, 2007-2017.
   Google Scholar
• Bazerman, C. 2009. “Genre and Cognitive Development: Beyond Writing to Learn.” In Genre in a Changing World, edited by Bazerman, C., Figueiredo, D., and Bonini, A., 279–294. West Lafayette: The WAC Clearing house.
   Google Scholar
• Bitchener, J., H. Basturkmen, and M. East. 2010. “The Focus of Supervisor Written Feedback to Thesis/Dissertation Students.” International Journal of English Studies 10 (2): 79–97. doi:10.6018/ijes/2010/2/119201.
   Google Scholar
• Boud, D., and P. Dawson. 2023. “What Feedback Literate Teachers Do: An Empirically-Derived Competency Framework.” Assessment & Evaluation in Higher Education 48 (2): 158–171. doi:10.1080/02602938.2021.1910928.
   Web of Science ®Google Scholar
• Bourke, S., A. Holbrook, T. Lovat, and P. Farley. 2004. “Attrition, Completion and Completion Times of PhD Candidates.” Paper presented at the AARE Annual Conference, Melbourne, November 28–December 2.
   Google Scholar
• Bourke, S., and A. Holbrook. 2013. “Examining PhD and Research Masters Theses.” Assessment & Evaluation in Higher Education 38 (4): 407–416. doi:10.1080/02602938.2011.638738.
   Web of Science ®Google Scholar
• Carless, D. 2015. Excellence in University Assessment: Learning from Award-Winning Practice. London: Routledge.
   Google Scholar
• Carless, D., and D. Boud. 2018. “The Development of Student Feedback Literacy: Enabling Uptake of Feedback.” Assessment & Evaluation in Higher Education 43 (8): 1315–1325. doi:10.1080/02602938.2018.1463354.
   Web of Science ®Google Scholar
• Carless, D., and N. Winstone. 2023. “Teacher Feedback Literacy and Its Interplay with Student Feedback Literacy.” Teaching in Higher Education 28 (1): 150–163. doi:10.1080/13562517.2020.1782372.
   Web of Science ®Google Scholar
• Carless, D., Jisun Jung, and Yongyan Li. 2023. “Feedback as Socialization in Doctoral Education: Towards the Enactment of Authentic Feedback.” Studies in Higher Education 49 (3): 534–545. doi:10.1080/03075079.2023.2242888.
   Web of Science ®Google Scholar
• Carter, S., and V. Kumar. 2017. “Ignoring Me is Part of Learning’: Supervisory Feedback on Doctoral Writing.” Innovations in Education and Teaching International 54 (1): 68–75. doi:10.1080/14703297.2015.1123104.
   Web of Science ®Google Scholar
• Chetcuti, D., J. Cacciottolo, and N. Vella. 2022. “What Do Examiners Look for in a PhD Thesis? Explicit and Implicit Criteria Used by Examiners across Disciplines.” Assessment & Evaluation in Higher Education 47 (8): 1358–1373. doi:10.1080/02602938.2022.2048293.
   Web of Science ®Google Scholar
• Dally, K., A. Holbrook, T. Lovat, and J. Budd. 2019. “Examiner Feedback and Australian Doctoral Examination Processes.” Australian Universities Review 61 (2): 31–41.
   Web of Science ®Google Scholar
• Dawson, P., M. Henderson, P. Mahoney, M. Phillips, T. Ryan, D. Boud, and E. Molloy. 2019. “What Makes for Effective Feedback: Staff and Student Perspectives.” Assessment & Evaluation in Higher Education 44 (1): 25–36. doi:10.1080/02602938.2018.1467877.
   Web of Science ®Google Scholar
• Delamont, S., P. Atkinson, and O. Parry. 2000. The Doctoral Experience. London: Falmer. doi:10.4324/9780203451403.
   Google Scholar
• Denicolo, P., D. Duke, and J. Reeves. 2020. Delivering Inspiring Doctoral Assessment. London: Sage
   Google Scholar
• Elgar, F. J. 2003. PhD Degree Completion in Canadian Universities. Nova Scotia, Canada: Dalhousie University, 1–31.
   Google Scholar
• Gardner, S. K., and B. Gopaul. 2012. “The Part-Time Doctoral Student Experience.” International Journal of Doctoral Studies 7: 063–078. http://ijds.org/Volume7/IJDSv7p063-078Gardner352.pdf. doi:10.28945/1561.
   Google Scholar
• Golding, C., S. Sharmini, and A. Lazarovitch. 2014. “What Examiners Do: What Thesis Students Should Know.” Assessment & Evaluation in Higher Education 39 (5): 563–576. doi:10.1080/02602938.2013.859230.
   Web of Science ®Google Scholar
• Grainger, P. 2020. “How Do Pre-Service Teacher Education Students Respond to Assessment Feedback?” Assessment & Evaluation in Higher Education 45 (7): 913–925. doi:10.1080/02602938.2015.1096322.
   Web of Science ®Google Scholar
• Grainger, P. R., D. Heck, and M. D. Carey. 2018. “Are Assessment Exemplars Perceived to Support Self-Regulated Learning in Teacher Education?” Frontiers in Education 3: 60. doi:10.3389/feduc.2018.00060.
   Google Scholar
• Grainger, P., K. Purnell, and R. Zipf. 2008. “Judging Quality through Substantive Conversations between Markers.” Assessment & Evaluation in Higher Education 33 (2): 133–142. doi:10.1080/02602930601125681.
   Web of Science ®Google Scholar
• Grainger, P., M. Christie, G. Thomas, S. Dole, D. Heck, M. Marshman, and M. Carey. 2017. “Improving the Quality of Assessment by Using a Community of Practice to Explore the Optimal Construction of Assessment Rubrics.” Reflective Practice 18 (3): 410–422. doi:10.1080/14623943.2017.1295931.
   Web of Science ®Google Scholar
• Hafner, J. C., and P. M. Hafner. 2003. “Quantitative Analysis of the Rubric as an Assessment Tool: An Empirical Study of Student Peer-Group Rating.” International Journal of Science Education 25 (12): 1509–1528. doi:10.1080/0950069022000038268.
   Web of Science ®Google Scholar
• Holbrook, A. 2001. PhD Examination – Assessment’s Least Mapped Frontier. Paper presented at the AARE Conference, Fremantle, December 2001.
   Google Scholar
• Holbrook, A., S. Bourke, T. Lovat, and K. Dally. 2004. “Investigating Ph.D. Thesis Examination Reports.” International Journal of Educational Research 41 (2): 98–120. doi:10.1016/j.ijer.2005.04.008.
   Google Scholar
• Ivankova, N. V., and S. L. Stick. 2007. “Students’ Persistence in a Distributed Doctoral Program in Educational Leadership in Higher Education: A Mixed Methods Study.” Research in Higher Education 48 (1): 93–135. doi:10.1007/s11162-006-9025-4.
   Web of Science ®Google Scholar
• Jeyaraj, J. J., Wei Keong Too, and Eni Ermawati Lasito. 2022. “A Framework for Supporting Postgraduate Research Writing: Insights from Students’ Writing Experiences.” Higher Education Research & Development 41 (2): 405–419. doi:10.1080/07294360.2020.1849037.
   Web of Science ®Google Scholar
• Jiranek, V. 2010. “Potential Predictors of Timely Completion among Dissertation Research Students at an Australian Faculty of Sciences.” International Journal of Doctoral Studies 5: 001–013. http://ijds.org/Volume5/IJDSv5p001-013Jiranek273.pdf. doi:10.28945/709.
   Google Scholar
• Johnston, S. 1997. “Examining the Examiners: An Analysis of Examiners’ Reports on Doctoral Theses.” Studies in Higher Education 22 (3): 333–347. doi:10.1080/03075079712331380936.
   Web of Science ®Google Scholar
• Jones, M. 2013. “Issues in Doctoral Studies – Forty Years of Journal Discussion: Where Have we Been and Where Are we Going?” International Journal of Doctoral Studies 8: 083–104. doi:10.28945/1871.
   Google Scholar
• Kearns, H., M. Gardiner, and K. Marshall. 2008. “Innovation in PhD Completion: The Hardy Shall Succeed (and Be Happy!).” Higher Education Research & Development 27 (1): 77–89. doi:10.1080/07294360701658781.
   Web of Science ®Google Scholar
• Kim, D., and C. Otts. 2010. “The Effect of Loans on Time to Doctorate Degree: Differences by Race/Ethnicity, Field of Study, and Institutional Characteristics.” Journal of Higher Education 81 (1): 1–32. doi:10.1080/00221546.2010.11778968.
   Web of Science ®Google Scholar
• Kim, Kyung Min. 2018. “Academic Socialization of Doctoral Students through Feedback Networks: A Qualitative Understanding of the Graduate Feedback Landscape.” Teaching in Higher Education 23 (8): 963–980. doi:10.1080/13562517.2018.1449741.
   Web of Science ®Google Scholar
• Kumar, V., and E. Stracke. 2007. “An Analysis of Written Feedback on a PhD Thesis.” Teaching in Higher Education 12 (4): 461–470. doi:10.1080/13562510701415433.
   Web of Science ®Google Scholar
• Kumar, V., and E. Stracke. 2017. “Reframing Doctoral Examination as Teaching.” Innovations in Education and Teaching International 55 (2): 219–227. doi:10.1080/14703297.2017.1285715.
   Web of Science ®Google Scholar
• Laurie, T., and L. Grealy. 2023. “Curious Care: Tacit Knowledge and Self-Trust in Doctoral Training.” Pedagogy, Culture & Society. doi:10.1080/14681366.2023.2255220.
   Web of Science ®Google Scholar
• Lott, J. L., S. Gardner, and D. A. Powers. 2010. “Doctoral Student Attrition in the STEM Fields: An Exploratory Event History Analysis.” Journal of College Student Retention: Research, Theory & Practice 11 (2): 247–266. doi:10.2190/CS.11.2.e.
   Google Scholar
• Lovat, T., A. Holbrook, S. Bourke, H. Fairbairn, M. Kiley, B. Paltridge, and S. Starfield. 2015. “Examining Doctoral Examination and the Question of the Viva.” Higher Education Review 47 (3): pp5–23.
   Google Scholar
• Lovitts, B. E. 2007. Making the Implicit Explicit: Creating Performance Expectations for the Dissertation. Sterling, VA: Stylus Publishing.
   Google Scholar
• Lovitts, B. E., and C. Nelson. 2000. “The Hidden Crisis in Graduate Education: Attrition from Ph. D.” Academe 86 (6): 44. doi:10.2307/40251951.
   Web of Science ®Google Scholar
• Manjet, K. 2016. “Graduate Students’ Needs and Preferences for Written Feedback on Academic Writing.” English Language Teaching 9 (12): 79–88.
   Google Scholar
• McAlpine, L., and C. Amundsen. 2011. “To Be or Not to Be? The Challenges of Learning Academic Work.” In Doctoral Education: Research-Based Strategies for Doctoral Students, Supervisors and Administrators, edited by L. McAlpine and C. Amundsen, 1–13. Dordrecht: Springer
   Google Scholar
• Mullins, G., and M. Kiley. 2002. “It’s a PhD, Not a Nobel Prize’: How Experienced Examiners Assess Research Theses.” Studies in Higher Education 27 (4): 369–386. doi:10.1080/0307507022000011507.
   Web of Science ®Google Scholar
• Nerad, N., D. Bogle, U. Kohl, C. O’Carroll, C. Peters, and B. Scholz. 2022. (Eds.) Towards a Global Core Value System in Doctoral Education. London: UCL Press.
   Google Scholar
• Nieminen, J. H., and D. Carless. 2023. “Feedback Literacy: A Critical Review of an Emerging Concept.” Higher Education 85 (6): 1381–1400. doi:10.1007/s10734-022-00895-9.
   Web of Science ®Google Scholar
• Paltridge, B. 2017. “Peer Review in Academic Settings.” In The Discourse of Peer Review. London: Palgrave Macmillan. doi:10.1057/978-1-137-48736-0_1.
   Google Scholar
• Paré, A. 2011. “Speaking of Writing: Supervisory Feedback and the Dissertation.” In Doctoral Education: Research-Based Strategies for Doctoral Students, Supervisors and Administrators, edited by L. McAlpine and C. Amundsen, 59–74. Dordrecht: Springer.
   Google Scholar
• Park, C. 2007. “Defining the doctorate.” http://eprints.lancs.ac.uk/435/1/RedefiningTheDoctorate.pdf
   Google Scholar
• Pereira, D., M. Assunção, and L. Niklasson. 2016. “Assessment Revisited: A Review of Research in Assessment and Evaluation in Higher Education.” Assessment & Evaluation in Higher Education 41 (7): 1008–1032. doi:10.1080/02602938.2015.1055233.
   Web of Science ®Google Scholar
• Perelman, L. 2018. “Towards a New NAPLAN: Testing to the Teaching.” Journal of Professional Learning 2: 1–52. https://cpl.asn.au/journal/semester-2-2018/towards-a-new-naplan-testing-to-the-teaching.
   Google Scholar
• Poole, B. 2015. “The Rather Elusive Concept of ‘Doctorateness’: A Reaction to Wellington.” Studies in Higher Education 40 (9): 1507–1522. doi:10.1080/03075079.2013.873026.
   Web of Science ®Google Scholar
• Reddy, Y. M., and Heidi Andrade. 2010. “A Review of Rubric Use in Higher Education.” Assessment & Evaluation in Higher Education 35 (4): 435–448. doi:10.1080/02602930902862859.
   Web of Science ®Google Scholar
• Sadler, D. R. 1989. “Formative Assessment and the Design of Instructional Systems.” Instructional Science 18 (2): 119–144. doi:10.1007/BF00117714.
   Web of Science ®Google Scholar
• Sadler, D. R. 2009. “Indeterminacy in the Use of Preset Criteria for Assessment and Grading in Higher Education.” Assessment & Evaluation in Higher Education 34 (2): 159–179. doi:10.1080/02602930801956059.
   Web of Science ®Google Scholar
• Sadler, D. R. 2010. “Beyond Feedback: Developing Student Capability in Complex Appraisal.” Assessment & Evaluation in Higher Education 35 (5): 535–550. doi:10.1080/02602930903541015.
   Web of Science ®Google Scholar
• Stracke, E., and V. Kumar. 2020. “Encouraging Dialogue in Doctoral Supervision: The Development of the Feedback Expectation Tool.” International Journal of Doctoral Studies 15: 265–284. doi:10.28945/4568.
   Google Scholar
• Tinkler, P., and C. Jackson. 2000. “Examining the Doctorate: Institutional Policy and the PhD Examination Process in Britain.” Studies in Higher Education 25 (2): 167–180. doi:10.1080/713696136.
   Web of Science ®Google Scholar
• Vaccari, D. A., and S. Thangam. 2010. A Proposed Doctoral Assessment Procedure and Rubric for Science and Engineering. Paper presented at 2010 Annual Conference & Exposition, Louisville, Kentucky.
   Google Scholar
• Visser, I., L. Chandler, and P. Grainger. 2017. “Engaging Creativity: Employing Assessment Feedback Strategies to Support Confidence and Creativity in Graphic Design Practice.” Art, Design & Communication in Higher Education 16 (1): 53–67. doi:10.1386/adch.16.1.53_1.
   Google Scholar
• Wellington, J. 2013. “Searching for Doctorateness.” Studies in Higher Education 38 (10): 1490–1503. doi:10.1080/03075079.2011.634901.
   Web of Science ®Google Scholar
• Williams, G., S. Bjarnason, and C. Loder. 1995. Postgraduate education in England. Report of a “Dipstick” survey, Centre for Higher Education Studies, Institute of Education, University of London, November reproduced in Review of Postgraduate Education Evidence Volume (May 1996) Section 1.
   Google Scholar
• Winstone, N. E., and D. Boud. 2020. “The Need to Disentangle Assessment and Feedback in Higher Education.” Studies in Higher Education 47 (3): 656–667. doi:10.1080/03075079.2020.1779687.
   Web of Science ®Google Scholar
• Winstone, N., and D. Carless. 2019. Designing Effective Feedback Processes in Higher Education: A Learning-Focused Approach. Abingdon: Routledge.
   Google Scholar
• Woodward-Kron, R. 2007. “Negotiating Meanings and Scaffolding Learning: Writing Support for non-English Speaking Background Postgraduate Students.” Higher Education Research & Development 26 (3): 253–268. doi:10.1080/07294360701494286.
   Google Scholar
• Wright, T., and R. Cochrane. 2000. “Factors Influencing Successful Submission of PhD Theses.” Studies in Higher Education 25 (2): 181–195. doi:10.1080/713696139.
   Web of Science ®Google Scholar