Advanced search
Publication Cover
Medical Teacher Volume 32, 2010 - Issue 10
Submit an article Journal homepage
8,894
Views
121
CrossRef citations to date
0
Altmetric
AMEE Guide

How to measure the quality of the OSCE: A review of metrics – AMEE guide no. 49

Godfrey Pell University of Leeds, UK; GODFREY PELL, BEng, MSc, FRSS, C.Stat, C.Sci, is a senior statistician who has a strong background in management. Before joining the University of Leeds, he was with the Centre for Higher Education Practice at the Open University. His current research includes standard setting for practical assessment in higher education, and the value of short-term interventionist programmes in literacy.Correspondence[email protected]
,
Richard Fuller University of Leeds, UK; RICHARD FULLER, MA, MBChB, FRCP, is a consultant physician, and director of the Leeds MB ChB undergraduate degree programme within the Institute of Medical Education. His research interests include clinical assessment, in particular monitoring and improving the quality of the OSCE.
,
Matthew Homer University of Leeds, UK; MATTHEW HOMER, BSc, MSc, PhD, is a research fellow at the University of Leeds, working in the both the Schools of Medicine and Education. He works on a range of research projects and provides general statistical support to colleagues. His research interests include the statistical side of assessment, particularly related to OSCEs.
&
Trudie Roberts University of Leeds, UK; TRUDIE ROBERTS, BSc, MBChB, PhD, FRCP, is a consultant physician, a professor of Medical Education and is the director of the Leeds Institute of Medical Education. Her research interests include clinical assessment.
Pages 802-811 | Published online: 20 Sep 2010

References

  • Cizek GJ, Bunch MB. Standard setting, 1st. Sage Publications, London 2007
  • Cohen DS, Colliver JA, Robbs RS, Swartz MH. A large-scale study of the reliabilities of checklist scores and ratings of interpersonal and communication skills evaluated on a standardized-patient examination. Adv Health Sci Educ 1997; 1: 209–213
  • Cusimano M. Standard setting in medical education. Acad Med 1996; 71(10)S112–S120
  • Eva KW, Rosenfeld J, Reiter H, Norman GR. An admissions OSCE: The multiple mini-interview. Med Educ 2004; 38: 314–326
  • Holmboe E. Faculty and the observation of trainees’ clinical skills: Problems and opportunities. Acad Med 2004; 79(1)16–22
  • Homer M, Pell G. The impact of the inclusion of simulated patient ratings on the reliability of OSCE assessments under the borderline regression method. Med Teach 2009; 31(5)420–425
  • Newble D. Techniques for measuring clinical competence: Objective structured clinical examinations. Med Educ 2004; 38: 199–203
  • Norcini J. Setting standards on educational tests. Med Educ 2003; 37(5)464–469
  • Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE guide No. 31. Med Teach 2007; 29(9)855–871
  • Pell G, Homer M, Roberts TE. Assessor training: Its effects on citerion based assessment in a medical context. Int J Res Method Educ 2008; 31(2)143–154
  • Pell G, Roberts TE. Setting standards for student assessment. Int J Res Method Educ 2006; 29(1)91–103
  • Postgraduate Medical Education Training and Education Board 2009. Workplace based assessment. A guide for implementation (London). [Accessed 2009 May 11]. Available from: www.pmetb.org.uk/fileadmin/user/QA/assessment/PMETB_WPBA_Guide_20090501.pdf
  • Regehr G, Macrae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998; 73(9)993–997
  • Roberts C, Newble D, Jolly B, Reed M, Hampton K. Assuring the quality of high-stakes undergraduate assessments of clinical competence. Med Teach 2006; 28(6)535–543
  • Streiner DL, Norman GR. Health measurement scales: A practical guide to their development and use, 4th. Oxford University Press, Oxford 2008
  • Wass V, Mcgibbon D, Van der Vleuten C. Composite undergraduate clinical examinations: How should the components be combined to maximise reliability?. Med Educ 2001; 35: 326–330

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.