How to set standards on performance-based examinations: AMEE Guide No. 85

References

• American Educational Research Association, American Psychological Association, National Council on Measurement in Education, 1999. Standards for educational and psychological testing. American Educational Research Association, Washington DC.
   Google Scholar
• Angoff WH. Scales, norms, and equivalent scores. Thorndike RL, editor., In 1971, Educational measurement. Washington, DC: American Council on Education, pp 508–600
   Google Scholar
• Bandaranayake RC. Setting and maintaining standards in multiple choice examinations: AMEE Guide No. 37. Med Teach 2008; 30: 836–845
   PubMed Web of Science ®Google Scholar
• Ben-David MF. AMEE Guide No. 18: Standard setting in student assessment. Med Teach 2000; 22: 120–130
   Web of Science ®Google Scholar
• Beuk CH. A method for reaching a compromise between absolute and relative standards in examinations. J Educ Measure 1984; 21: 147–152
   Web of Science ®Google Scholar
• Boulet JR, De Champlain AF, McKinley DW. Setting defensible performance standards on OSCEs and standardized patient examinations. Med Teach 2003; 25: 245–249
   PubMed Web of Science ®Google Scholar
• Burrows PJ, Bingham L, Brailovsky CA. A modified contrasting groups method used for setting the passmark in a small scale standardised patient examination. Adv Health Sci Educ Theory Pract 1999; 4: 145–154
   PubMed Web of Science ®Google Scholar
• Clauser BE, Clyman SG. A contrasting-groups approach to standard setting for performance assessments of clinical skills. Acad Med 1994; 69: S42–S44
   PubMed Web of Science ®Google Scholar
• Cohen-Schotanus J, van der Vleuten CPM. A standard setting method with the best performing students as point of reference: Practical and affordable. Med Teach 2010; 32: 154–160
   PubMed Web of Science ®Google Scholar
• De Gruijter DNM. Compromise models for establishing examination standards. J Educ Measure 1985; 22: 263–269
   Web of Science ®Google Scholar
• Dijkstra J, Van der Vleuten CPM, Schuwirth LWT. A new framework for designing programmes of assessment. Adv Health Sci Educ Theory Pract 2010; 15: 379–393
   PubMed Web of Science ®Google Scholar
• Downing SM, Lieska NG, Raible MD. Establishing passing standards for classroom achievement tests in medical education: A comparative study of four methods. Acad Med 2003; 78: S85–S87
   PubMed Web of Science ®Google Scholar
• Downing SM, Tekian A, Yudkowsky R. Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med 2006; 18: 50–57
   PubMed Web of Science ®Google Scholar
• Ebel R. Essentials of educational measurement2nd. Prentice-Hall, Englewood Cliffs, NJ 1972
   Google Scholar
• Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, Harris P, Glasgow NJ, Campbell C, Dath D, et al. Competency-based medical education: Theory to practice. Med Teach 2010; 32: 638–645
   PubMed Web of Science ®Google Scholar
• Geisinger KF. Using standard-setting data to establish cutoff scores. Educ Measure: Issu Pract 1991; 10: 17–22
   Google Scholar
• Geisinger KF, McCormick CM. Adopting cut scores: Post-standard-setting panel considerations for decision makers. Educ Measure: Issu Pract 2010; 29: 38–44
   Google Scholar
• Haladyna T, Hess R. An evaluation of conjunctive and compensatory standard-setting strategies for test decisions. Educ Assess 1999; 6: 129–153
   Google Scholar
• Hambleton RK, Jaeger RM, Plake BS, Mills C. Setting performance standards on complex educational assessments. Appl Psychol Measur 2000; 24: 355–366
   Web of Science ®Google Scholar
• Hambleton RK, Slater SC. Reliability of credentialing examinations and the impact of scoring models and standard-setting policies. Appl Measur Educ 1997; 10: 19–28
   Web of Science ®Google Scholar
• Hofstee WKB. The case for compromise in educational selection and grading. On educational testing, SB Anderson, JS Helmick. Jossey-Bass, San Francisco, CA 1983; 109–127
   Google Scholar
• Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach 2010; 32: 676–682
   PubMed Web of Science ®Google Scholar
• Jaeger RM. Selection of judges for standard-setting. Educ Measu: Iss Pract 1991; 10: 3–14
   Google Scholar
• Kane MT. The assessment of professional competence. Eval Health Prof 1992; 15: 163–182
   PubMed Web of Science ®Google Scholar
• Kane MT. Validating interpretive arguments for licensure and certification examinations. Eval Health Prof 1994; 17: 133–159; discussion 236–241
   PubMed Web of Science ®Google Scholar
• Kane MT. Validation. Educational measurement, RL Brennan. American Council on Education and Praeger Publishers, Westport, CT 2006; 17–64
   Google Scholar
• Kaufman DM, Mann KV, Muijtjens AMM, van der Vleuten CPM. A comparison of standard-setting procedures for an OSCE in undergraduate medical education. Acad Med 2000; 75: 267–271
   PubMed Web of Science ®Google Scholar
• Linn RL, Burton E. Performance-based assessment: Implications of task specificity. Educ Measure: Issu Pract 1994; 13: 5–8
   Google Scholar
• Livingston SA, Zieky MJ, 1982. Passing scores: A manual for setting standards of perfromance on education and occupational tests. Educ Testing Serv. Princeton, New Jersey
   Google Scholar
• Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990; 65: S63–S67
   PubMed Web of Science ®Google Scholar
• Nedelsky L. Absolute grading standards for objective tests. Educ Psychol Measur 1954; 14: 3–19
   Web of Science ®Google Scholar
• Nestel D, Kneebone R, Black S. Simulated patients and the development of procedural and operative skills. Med Teach 2006; 28: 390–391
   PubMed Web of Science ®Google Scholar
• Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach 2007; 29: 855–871
   PubMed Web of Science ®Google Scholar
• Norcini JJ. Principles for setting standards on certifying and licensing examinations. Rothman AI, Cohen R, editors., In 1994, The Sixth Ottawa Conference on Medical Education. Toronto: University of Toronto Bookstore, pp 346–347
   Google Scholar
• Norcini JJ. Work based assessment. Br Med J 2003; 326: 753–755
   PubMed Web of Science ®Google Scholar
• Norcini J, McKinley D. Assessment methods in medical education. Teach Teacher Educ 2007; 23: 239–250
   Web of Science ®Google Scholar
• Norcini JJ, Stillman PL, Sutnick AI, Regan MB, Haley HL, Williams RG, Friedman M. Scoring and standard setting with standardized patients. Eval Health Prof 1993; 16: 322–332
   Web of Science ®Google Scholar
• Patil NG, Saing H, Wong J. Role of OSCE in evaluation of practical skills. Med Teach 2003; 25: 271–272
   PubMed Web of Science ®Google Scholar
• Pell G, Fuller R, Homer M, Roberts T. How to measure the quality of the OSCE: A review of metrics – AMEE guide no. 49. Med Teach 2010; 32: 802–811
   PubMed Web of Science ®Google Scholar
• Raymond MR, Reid J. Who made thee a judge? Selecting and training participants for standard setting. Setting performance standards: Concepts, methods, and perspectives, GJ Cizek. Lawrence Erlbaum Associates, Mahwah, NJ 2001; 119–158
   Google Scholar
• Reznick RK, Blackmore D, Dauphinée WD, Rothman AI, Smee S. Large-scale high-stakes testing with an OSCE: Report from the Medical Council of Canada. Acad Med 1996; 71: S19–S21
   PubMed Web of Science ®Google Scholar
• Rothman AI, Cohen R. A comparison of empirically- and rationally-defined standards for clinical skills checklists. Acad Med 1996; 71: S1–S3
   PubMed Web of Science ®Google Scholar
• Schindler N, Corcoran J, DaRosa D. Description and impact of using a standard-setting method for determining pass/fail scores in a surgery clerkship. Am J Surg 2007; 193: 252–257
   PubMed Web of Science ®Google Scholar
• Smee SM, Blackmore DE. Setting standards for an objective structured clinical examination: The borderline group method gains ground on Angoff. Med Educ 2001; 35: 1009–1010
   PubMed Web of Science ®Google Scholar
• Traub RE. Facing the challenge of multidimensionality in performance assessment. Proceedings of the Sixth Annual Ottawa Conference on Medical Education, AI Rothman, R Cohen. University of Toronto Bookstore, Toronto 1994; 9–11
   Google Scholar
• Wood TJ, Humphrey-Murto SM, Norman GR. Standard setting in a small scale OSCE: A comparison of the modified borderline-group method and the borderline regression method. Adv Health Sci Educ 2006; 11: 115–122
   PubMed Web of Science ®Google Scholar