Do Rubrics Live up to Their Promise? Examining How Rubrics Mitigate Bias in Faculty Hiring

References

• Baldwin, R., Cave, M., & Lodge, M. (2011). Understanding regulation: Theory, strategy, and practice. Oxford University Press.
   Google Scholar
• Banaji, M. R., & Greenwald, A. G. (2016). Blindspot: Hidden biases of good people. Bantam.
   Google Scholar
• Bastedo, M. (2021). Holistic admissions as a global phenomenon. In H. Eggins, A. Smolentseva, & H. de Wit (Eds.), Higher education in the next decade (pp. 91–114). Brill.
   Google Scholar
• Beattie, G., Cohen, D., & McGuire, L. (2013). An exploration of possible unconscious ethnic biases in higher education: The role of implicit attitudes on selection for university posts. Semiotica, 2013(197), 171–201. https://doi.org/10.1515/sem-2013-0087
   Web of Science ®Google Scholar
• Bensimon E.M. (2007). The underestimated significance of practitioner knowledge in the scholarship on student success. The Review of Higher Education, 30(4), 441–469. https://doi.org/10.1353/rhe.2007.0032
   Web of Science ®Google Scholar
• Biernat, M., Collins, E. C., Katzarska-Miller, I., & Thompson, E. R. (2009). Race-based shifting standards and racial discrimination. Personality and Social Psychology Bulletin, 35(1), 16–28. https://doi.org/10.1177/0146167208325195
   PubMed Web of Science ®Google Scholar
• Blair-Loy, M., Mayorova, O. V., Cosman, P. C., & Fraley, S. I. (2022). Can rubrics combat gender bias in faculty hiring? Science, 377(6601), 35–37. https://doi.org/10.1126/science.abm2329
   PubMed Web of Science ®Google Scholar
• Brown, P. (2012). A nudge in the right direction? Social Policy & Society, 11(3), 305–317. https://doi.org/10.1017/S1474746412000061
   Google Scholar
• Chen, C. Y., Kahanamoku, S. S., Tripati, A., Alegado, R. A., Morris, V. R., Andrade, K., & Hosbey, J. (2022). Decades of systemic racial disparities in funding rates at the National Science Foundation. https://doi.org/10.31219/osf.io/xb57u
   Google Scholar
• Culpepper, D., Reed, A. M., Enekwe, B., Carter-Veale, W., LaCourse, W. R., McDermott, P., & Cresiski, R. H. (2021). A new effort to diversify faculty: Postdoc-to-tenure track conversion models. Frontiers in Psychology, Article #4992. https://doi.org/10.3389/fpsyg.2021.733995
   PubMed Web of Science ®Google Scholar
• Damgaard, M. T., & Nielsen, H. S. (2018). Nudging in education. Economics of Education Review, 64, 313–342. https://doi.org/10.1016/j.econedurev.2018.03.008
   Web of Science ®Google Scholar
• Devine, P. G., Forscher, P. S., & Cox, W. T. (2017). A gender bias habit-breaking intervention led to increased hiring of female faculty in STEMM departments. Journal of Experimental Social Psychology, 73, 211–215. https://doi.org/10.1016/j.jesp.2017.07.002
   PubMed Web of Science ®Google Scholar
• Eaton, A. A., Saunders, J. F., Jacobson, R. K., & West, K. (2020). How gender and race stereotypes impact the advancement of scholars in STEM: Professors’ biased evaluations of physics and biology post-doctoral candidates. Sex Roles, 82(3), 127–141. https://doi.org/10.1007/s11199-019-01052-w
   Web of Science ®Google Scholar
• Glod, W. (2015). How nudges often fail to treat people according to their own preferences. Social Theory and Practice, 41(4), 599–617. https://doi.org/10.5840/soctheorpract201541433
   Google Scholar
• Goldhaber, D., Grout, C., & Huntington-Klein, N. (2017). Screen twice, cut once: Assessing the predictive validity of applicant selection tools. Education Finance and Policy, 12(2), 197–223. https://doi.org/10.1162/EDFP_a_00200
   Web of Science ®Google Scholar
• Griffin, K. A. (2020). Institutional barriers, strategies, and benefits to increasing the representation of women and men of color in the professoriate. In L. W. Perna (Ed.), Higher education: Handbook of theory and research (Vol. 35, pp. 1–73). Springer.
   Google Scholar
• Harris, J. C., Snider, J. C., Anderson, J. L., & Griffin, K. A. (2021). Multiracial faculty members’ experiences with multiracial microaggressions. American Journal of Education, 127(4), 531–561. https://doi.org/10.1086/715004
   Web of Science ®Google Scholar
• Hummel, D., & Maedche, A. (2019). How effective is nudging? A quantitative review on the effect sizes and limits of empirical nudging studies. Journal of Behavioral and Experimental Economics, 80, 47–58. https://doi.org/10.1016/j.socec.2019.03.005
   Web of Science ®Google Scholar
• Isaac, C., Lee, B., & Carnes, M. (2009). Interventions that affect gender bias in hiring: A systematic review. Academic Medicine, 84(10), 1440–1446. https://doi.org/10.1097/ACM.0b013e3181b6ba00
   PubMed Web of Science ®Google Scholar
• Kahneman, D. (2011). Thinking: Fast and slow. Farrar, Straus and Giroux.
   Google Scholar
• Kosters, M., & Van der Heijden, J. (2015). From mechanism to virtue: Evaluating nudge theory. Evaluation, 21(3), 276–291. https://doi.org/10.1177/1356389015590218
   Web of Science ®Google Scholar
• Langin, K. (2021, August 3). Can anonymous faculty searches boost diversity? Science. https://www.science.org/content/article/can-anonymous-faculty-searches-boost-diversity
   Google Scholar
• Liera, R. (2020). Equity advocates using equity-mindedness to interrupt faculty hiring’s racial structure. Teachers College Record, 122(9), 1–42. https://doi.org/10.1177/016146812012200910
   Web of Science ®Google Scholar
• Liera, R., & Ching, C. (2019). Reconceptualizing “merit” and “fit”: An equity-minded approach to hiring. In A. Kezar & J. Posselt (Eds.), Administration for social justice and equity in higher education: Critical perspectives for leadership and decision-making (pp. 111–131). Routledge.
   Google Scholar
• Merriam, S. B., & Tisdell, E. J. (2016). Qualitative research: A guide to design and implementation (4th ed.). Jossey-Bass.
   Google Scholar
• Misra, J., Kuvaeva, A., O’Meara, K., Culpepper, D. K., & Jaeger, A. (2021). Gendered and racialized perceptions of faculty workloads. Gender & Society, 35(3), 358–394. https://doi.org/10.1177/08912432211001387
   Web of Science ®Google Scholar
• Mitchneck, B. (2020). Synthesizing research on gender biases and intersectionality in citation analyses and best practices. ARC Network. https://uploads-ssl.webflow.com/60ceadbbd1b31b75588b6cd7/616b4be13010b4087717f037_Mitchneck-ARC-VVS-Final-Report-Updated.pdf
   Google Scholar
• Moody, J. (2012). Faculty diversity: Removing the barriers (2nd ed.). Routledge.
   Google Scholar
• Muñoz, S. M., Basile, V., Gonzalez, J., Birmingham, D., Aragon, A., Jennings, L., & Gloeckner, G. (2017). Critical perspectives from a university cluster hire focused on diversity, equity, and inclusion. Journal of Critical Thought and Praxis, 6(2), 1–21. https://doi.org/10.31274/jctp-180810-71
   Google Scholar
• National Science Foundation. (2021). Women, minorities, and persons with disabilities in science and engineering. National Center for Science and Engineering Statistics (NCSES) https://ncses.nsf.gov/pubs/nsf21321/report
   Google Scholar
• O’Meara, K., Culpepper, D., Lennartz, C., & Braxton, J. (2022). Leveraging nudges to improve the academic workplace: Challenges and possibilities. In L. W. Perna (Ed.), Higher education: Handbook of theory and research (Vol. 37, pp. 277–346). Springer.
   Google Scholar
• O’Meara, K., Culpepper, D., Misra, J., & Jaeger, A. (2021). Equity-minded faculty workloads: What we can and should do now. American Council on Education. https://www.acenet.edu/Documents/Equity-Minded-Faculty-Workloads.pdf
   Google Scholar
• O’Meara, K., Culpepper, D., & Templeton, L. L. (2020). Nudging toward diversity: Applying behavioral design to faculty hiring. Review of Educational Research, 90(3), 311–348. https://doi.org/10.3102/0034654320914742
   Web of Science ®Google Scholar
• Posselt, J. (2016). Inside graduate admissions: Merit, diversity, and faculty gatekeeping.Harvard University Press.
   Google Scholar
• Posselt, J., Hernandez, T. E., Villarreal, C. D., Rodgers, A. J., & Irwin, L. N. (2020). Evaluation and decision making in higher education: Toward equitable repertoires of faculty practice. In L. Perna (Ed.), Higher education: Handbook of theory and research (Vol. 35, pp. 1–63). Springer.
   Google Scholar
• Rivera, L. A. (2017). When two bodies are (not) a problem: Gender and relationship status discrimination in academic hiring. American Sociological Review, 82(6), 1111–1138. https://doi.org/10.1177/0003122417739294
   Web of Science ®Google Scholar
• Rivera, L. A., & Tilcsik, A. (2019). Scaling down inequality: Rating scales, gender bias, and the architecture of evaluation. American Sociological Review, 84(2), 248–274. https://doi.org/10.1177/0003122419833601
   Web of Science ®Google Scholar
• Saldaña, J. (2016). The coding manual for qualitative researchers. Sage.
   Google Scholar
• Schmaling, K. B., Trevino, A. Y., Lind, J. R., Blume, A. W., & Baker, D. L. (2015). Diversity statements: How faculty applicants address diversity. Journal of Diversity in Higher Education, 8(4), 213–224. https://doi.org/10.1037/a0038549
   Web of Science ®Google Scholar
• Settles, I. H., Jones, M. K., Buchanan, N. T., & Dotson, K. (2020). Epistemic exclusion: Scholar (ly) devaluation that marginalizes faculty of color. Journal of Diversity in Higher Education, 14(4), 493–507. https://doi.org/10.1037/dhe0000174
   Web of Science ®Google Scholar
• Sheppard, L. D., Goffin, R. D., Lewis, R. J., & Olson, J. (2011). The effect of target attractiveness and rating method on the accuracy of trait ratings. Journal of Personnel Psychology, 10(1), 24–33. https://doi.org/10.1027/1866-5888/a000030
   Web of Science ®Google Scholar
• Stake, R. E. (2005). Multiple case study analysis. The Guilford Press.
   Google Scholar
• Sunstein, C. R. (2021). Sludge: What stops us from getting things done and what to do about it. MIT Press.
   Google Scholar
• Thaler, R. H., & Sunstein, C. (2008). Nudge: Improving decisions about health, wealth, and happiness. Yale University Press.
   Google Scholar
• Uhlmann, E. L., & Cohen, G. L. (2005). Constructed criteria: Redefining merit to justify discrimination. Psychological Science, 16(6), 474–480. https://doi.org/10.1111/j.0956-7976.2005.01559.x
   PubMed Web of Science ®Google Scholar
• White-Lewis, D. K. (2020). The facade of fit in faculty search processes. The Journal of Higher Education, 91(6), 833–857. https://doi.org/10.1080/00221546.2020.1775058
   Web of Science ®Google Scholar
• White-Lewis, D. (2022). The role of administrative and academic leadership in advancing faculty diversity. The Review of Higher Education, 45(3), 337–364. https://doi.org/10.1353/rhe.2022.0002
   Web of Science ®Google Scholar
• Yazan, B. (2015). Three approaches to case study methods in education: Yin, Merriam, and Stake. The Qualitative Report, 20(2), 134–152. doi:https://doi.org/10.46743/2160-3715/2015.2102
   Google Scholar
• Yin, R. K. (2018). Case study research and applications: Design and methods. Sage.
   Google Scholar