A collaborative comparison of objective structured clinical examination (OSCE) standard setting methods at Australian medical schools

References

• Angoff WH. 1971. Scales, norms, and equivalent scores. In: Educational measurement. Washington DC: American Council on Education; p. 514–515.
   Google Scholar
• Barman A. 2008. Standard setting in student assessment: is a defensible method yet to come? Ann Acad Med Singapore. 37:957–963.
   PubMed Web of Science ®Google Scholar
• Ben-David MF. 2000. AMEE Guide No. 18: standard setting in examinee assessment. Med Teach. 22:120–130.
   Web of Science ®Google Scholar
• Boulet JR, De Champlain AF, McKinley DW. 2003. Setting defensible performance standards on OSCEs and standardized patient examinations. Med Teach. 25:245–249.
   PubMed Web of Science ®Google Scholar
• Boursicot KAM, Roberts TE, Pell G. 2006. Standard setting for clinical competence at graduation from medical school: a comparison of passing scores across five medical schools. Adv Health Sci Educ Theory Pract. 11:173–183.
   PubMed Web of Science ®Google Scholar
• Boursicot KAM, Roberts TE, Pell G. 2007. Using borderline methods to compare passing standards for OSCEs at graduation across three medical schools. Med Educ. 41:1024–1031.
   PubMed Web of Science ®Google Scholar
• Cizek GJ. 2012. An introduction to contemporary standard setting. In: Setting performance standards: foundations, methods, and innovations. 2nd ed. New York: Routledge; p. 3–14.
   Google Scholar
• Cizek GJ. 1996. Setting passing scores. Educ Measure Issues Pract. 15:20–31.
   Google Scholar
• Cohen-Schotanus J, van der Vleuten CPM. 2010. A standard setting method with the best performing examinees as point of reference: practical and affordable. Med Teach. 32:154–160.
   PubMed Web of Science ®Google Scholar
• Cox EP. 1980. The optimal number of response alternatives for a scale: a review. J Marketing Res. 17:407–422.
   Web of Science ®Google Scholar
• Cusimano MD. 1996. Standard setting in medical education. Acad Med. 71:S112–S120.
   PubMed Web of Science ®Google Scholar
• Dochy F, Kyndt E, Baeten M, Pottier S, Veestraeten M. 2009. The effects of different standard setting methods and the composition of borderline groups: a study within a law curriculum. Stud Educ Eval. 35:174–182.
   Google Scholar
• Downing SM, Yudkowsky R. 2009. Assessment in health professions education. New York: Routledge.
   Google Scholar
• Ebel RL. 1972. Essentials of educational measurement. Englewood Cliffs (NJ): Prentice Hall; p. 492–494.
   Google Scholar
• George S, Haque MS, Oyebode F. 2006. Standard setting: comparison of two methods. BMC Med Educ. 6:46.
   PubMedGoogle Scholar
• Hambleton RK, Pitoniak MJ, Copella JM. 2012. Essential steps in setting performance standards on educational tests and strategies for assessing the reliability of results. In: Setting performance standards: Foundations, methods, and innovations. New York: Routledge; p. 47–76.
   Google Scholar
• Hodges B, McIlroy JH. 2003. Analytic global OSCE ratings are sensitive to level of training. Med Educ. 37:1012–1016.
   PubMed Web of Science ®Google Scholar
• Hofstee WKB. 1983. The case for compromise in educational selection and grading. In: On educational testing. Washington DC: Jossey Bass; p. 109–127.
   Google Scholar
• Humphrey-Murto S, MacFadyen JC. 2002. Standard setting: a comparison of case-author and modified borderline-group methods in a small-scale OSCE. Acad Med. 77:729–732.
   PubMed Web of Science ®Google Scholar
• Jaeger RM. 1982. An iterative structured judgment process for establishing standards on competency tests: theory and application. Educ Eval Policy Anal. 4:461–476.
   Google Scholar
• Kaufman DM, Mann KV, Muijtjens AMM, van der Vleuten CPM. 2000. A comparison of standard setting procedures for an OSCE in undergraduate medical education. Acad Med. 75:267–271.
   PubMed Web of Science ®Google Scholar
• Keely E, Myers K, Dojeiji S. 2002. Can written communication skills be tested in an objective structured clinical examination format? Acad Med. 77:82–86.
   PubMed Web of Science ®Google Scholar
• Kramer A, Muijtjens A, Jansen K, Dusman H, Tan L, van der Vleuten CPM. 2003. Comparison of a rational and an empirical standard setting procedure for an OSCE. Med Educ. 37:132–139.
   PubMed Web of Science ®Google Scholar
• Livingstone SA, Zieky MJ. 1982. Passing scores: a manual for setting standards of performance on educational and occupational tests. Princeton: Educational Testing Services.
   Google Scholar
• Malau-Aduli BS, Mulcahy S, Warnecke E, Otahal P, Teague PA, Turner R, Van der Vleuten C. 2012. Inter-rater reliability: comparison of checklist and global scoring for OSCEs. Creat Educ J. 3(Special Issue):937–942.
   Google Scholar
• Malau-Aduli BS, Teague PA, Turner R, Holman B, D’Souza K, Garne D, Heal C, Heggarty P, Hudson JN, Wilson IG. 2016. Improving assessment practice through cross-institutional collaboration: an exercise on the use of OSCEs. Med Teach. 38:263–271.
   PubMed Web of Science ®Google Scholar
• McKinley DW, Boulet JR, Hambleton RK. 2005. A work-centered approach for setting passing scores on performance-based assessments. Eval Health Prof. 28:349–369.
   PubMed Web of Science ®Google Scholar
• McKinley DW, Norcini JJ. 2013. How to set standards on performance-based examinations: AMEE Guide No. 85. Med Teach. 36:97–110.
   PubMed Web of Science ®Google Scholar
• Nedelsky L. 1954. Absolute grading standards for objective tests. Educ Psych Measure. 14:3–19.
   Web of Science ®Google Scholar
• Norcini JJ. 2003. Setting standards on educational tests. Med Educ. 37:464–469.
   PubMed Web of Science ®Google Scholar
• Payne NJ, Bradley EB, Heald EB, Maughan KL, Michaelsen VE, Wang X, Corbett EC. Jr. 2008. Sharpening the eye of the OSCE with critical action analysis. Acad Med. 83:900–905.
   PubMed Web of Science ®Google Scholar
• Taylor CA. 2011. Development of a modified Cohen method of standard setting. Med Teach. 33:e678–e682.
   PubMed Web of Science ®Google Scholar
• Wass V, van der Vleuten CPM, Shatzer J, Jones R. 2001. Assessment of clinical competence. Lancet. 357:945–949.
   PubMed Web of Science ®Google Scholar
• Weijters B, Cabooter E, Schillewaert N. 2010. The effect of rating scale format on response styles: the number of response categories and response category labels. Inter J Res Marketing. 27(3):236–247.
   Web of Science ®Google Scholar
• Wilkinson D, Schafer J, Hewett D, Eley D, Swanson D. 2014. Global benchmarking of medical examinee learning outcomes? Implementation and pilot results of the International Foundations of Medicine Clinical Sciences Exam at The University of Queensland, Australia. Med Teach. 36:62–67.
   PubMed Web of Science ®Google Scholar
• Wood TJ, Humphrey-Murto SM, Norman GR. 2006. Standard setting in a small scale OSCE: a comparison of the modified borderline-group method and the borderline regression method. Adv Health Sci Educ Theory Pract. 11:115–122.
   PubMed Web of Science ®Google Scholar