Setting defensible performance standards on OSCEs and standardized patient examinations

References

• ANGOFF, W.H. (1971) Scales, Norms and Equivalent Scores, in: R.L. THORNDIKE (Ed.) Educational Measurement, American Council on Education, pp. 508–600 (Washington, DC, American Council on Education).
   Google Scholar
• BARROWS, H.S. & ABRAHAMSON, S. (1964) The programmed patient: a technique for appraising student performance in clinical neurology, Journal of Medical Education, 39, pp. 802–805.
   Google Scholar
• BouLET, J.R., Friedman BEN-DAVID, M., HAmELEToN, R.K., BURDICK, W.P., Ziv, A. & GARY, N.E. (1998) An investigation of the sources of measurement error in the post-encounter written scores from standard-ized patient examinations, Advances in Health Sciences Education, pp. 89–100.
   Google Scholar
• BRAILOVSKY, C.A., GRAND'MAISON, P. & LESCOP, J. (1992) A large-scale multicenter objective structured clinical examination for licensure, Academic Medicine, 67(10 Suppl.), pp. S37—S39.
   Google Scholar
• Brennan, R.L. (2001) Generalizabiliv Theory (New York, Springer-Verlag).
   Google Scholar
• CHAMBERS, KA., BouLET, J.R. & GARY, N.E. (2000) The management of patient encounter time in a high-stakes assessment using standardized patients, Medical Education, 34(10), pp. 813–817.
   Google Scholar
• CHINN, R.N. & Horrz, N.R. (2002) Alternative approaches to standard setting for licensing and certification examinations, Applied Measurement in Education, 15(1), pp. 1–14.
   Web of Science ®Google Scholar
• DAUPHINEE, W.D., BLACKMORE, D., SMEE, S., ROTHMAN, A.I. & REZNICK, R. (1997) Using the judgments of physician examiners in setting the standards for a national multi-center high stakes OSCE, Advances in Health Sciences Education, 2, pp. 201–211.
   Google Scholar
• DE CHAMPLAIN, A.F., MARGOLIS, M.J., MACMILLAN, M.K. & Kiss, D.J. (2001) Predicting mastery level on a large-scale standardized patient test: a comparison of case and instrument score-based models using discriminant function analysis, Advances in Health Sciences Education, 6(2), pp. 151–158.
   Web of Science ®Google Scholar
• FLORECK, L.M. & DE CHAMPLAIN, A.F. (2001) Assessing sources of score variability in a multisite medical performance assessment: an applica-tion of hierarchical linear modeling, Academic Medicine, 76(10 Suppl.), pp. S93—S95.
   Google Scholar
• FRIEDMAN BEN-DAVID, M. (2000) AMEE Guide No. 18: Standard setting in student assessment, Medical Teacher, 22(2), pp. 120–130.
   Google Scholar
• HARDEN, R.M., STEVENSON, M., DOWNIE, W.W. & WILSON, G.U. (1975) Assessment of clinical competence using objective structured examina-tion, British Medical Journal, 1, pp. 447–451.
   Google Scholar
• HODGES, B., MCNAUGHTON, N., REGEHR, G., TB3ERIUS, R. & HANSON, M. (2002) The challenge of creating new OSCE measures to capture the characteristics of expertise, Medical Education, 36(8), pp. 742–748.
   Google Scholar
• HUMPHREY-MURTO, S. & MACFADYEN, J.C. (2002) Standard setting: a comparison of case-author and modified borderline-group methods in a small-scale OSCE, Academic Medicine, 77(7), pp. 729–732.
   Web of Science ®Google Scholar
• KM, M.T., CROOKS, T.J. & COHEN, A.S. (1999) Designing and evaluating standard-setting procedures for licensure and certification tests, Advances in Health Sciences Education, 4, pp. 195–207.
   Google Scholar
• KEN-r, A. (2001) Setting standards for an objective structured clinical examination: the borderline group method gains ground on Angoff, Medical Education, 35, pp. 1009–1010.
   Google Scholar
• LINN, R.L. & BURTON, E. (1994) Performance-based assessment: implications of task specificity, Educational Measurement: Issues and Practice, 13, pp. 5–8.
   Google Scholar
• MARGOLIS, M.J., DE CHAMPLAIN, A.F. & KLASS, D.J. (1998) Setting examination-level standards for a performance-based assessment of physicians' clinical skills, Academic Medicine, 73(10 Suppl.), pp. S114—S116.
   Google Scholar
• MARTIN, I.G. & Joux, B. (2002) Predictive validity and estimated cut score of an objective structured clinical examination (OSCE) used as an assessment of clinical skills at the end of the first clinical year, Medical Education, 36(5), pp. 418–425.
   Web of Science ®Google Scholar
• MARTIN, J.A., REZNICK, R.K., ROTHMAN, A., TAMBLYN, R.M. & REGEHR, G. (1996) Who should rate candidates in an objective structured clinical examination? Academic Medicine, 71(2), pp. 170–175.
   Google Scholar
• MEARA, K.C., HAMBLETON, R.K. & StREci, S.G. (2001) Setting and validating standards on professional licensure and certification exams: a survey of current practices, CLEAR Exam Review, Summer, pp. 17–23. Medical Council of Canada (2002) Qualifying Examination Part II, Information Pamphlet (Ottawa, Ontario, Canada, Medical Council of Canada).
   Google Scholar
• NoRcsti, J. & GUILLE, R. (2002) Combining tests and setting standards, in: G.R. NORMAN, C.P.M. VAN DER VLEUTEN & D.I. NEWBLE (Eds) International Handbook of Research in Medical Education (Part Two), pp. 811–834 (Dordrecht, The Netherlands, Kluwer Academic). NORCINI, J.J., STILLMAN, P.L, SUTNICK, A.I., REGAN, M.B., HALEY, H.L.A., WwilAms, R.G. & FRIEDMAN, M. (1993) Scoring and standard setting with standardized patients, Evaluation and the Health Professions, 16(3), pp. 322–332.
   Google Scholar
• Ross, L.P., CLAUSER, B.E., MARGOLIS, M.J., Om, N.A. & KLASS, D.J. (1996) An expert-judgment approach to setting standards for a standardized-patient examination, Academic Medicine, 71(10, Suppl.), pp. S4—S6.
   Google Scholar
• SWANSON, D.B., CLAUSER, B.E. & CASE, S.M. (1999) Clinical skills assessment with standardized patients in high-stakes tests: a framework for thinking about score precision, equating, and security, Advances in Health Sciences Education, 4, pp. 67–106.
   Google Scholar
• SWANSON, D.B. & NoRaNi, J.J. (1989) Factors influencing reproducibility of tests using standardized patients, Teaching and Learning in Medicine, 1(3), pp . 158–166.
   Google Scholar
• VAN DER VLEUTEN, C.P., NORMAN, G.R. & De GRAAFF, E. (1991) Pitfalls in the pursuit of objectivity: issues of reliability, Medical Education, 25(2), pp. 110–118.
   Google Scholar
• WHELAN, G.P. (1999) Educational commission for foreign medical graduates: clinical skills assessment prototype, Medical Teacher, 21(2), pp. 156–160.
   Web of Science ®Google Scholar
• WI-ELAN, G.P., MCKINLEY, D.W., BOULET, J.R., MACRAE, J. & KAMHOLZ, S. (2001) Validation of the doctor—patient communication component of the Educational Commission for Foreign Medical Graduates Clinical Skills Assessment, Medical Education, 35(8), pp. 757–761.
   Web of Science ®Google Scholar
• WILKINSON, T.J., NEWBLE, D.I. & FRAMYTON, C.M. (2001) Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing score, Medical Education, 35(11), pp. 1043–1049.
   Web of Science ®Google Scholar