Advanced search
Publication Cover
Medical Teacher Volume 35, 2013 - Issue 8
Submit an article Journal homepage
569
Views
8
CrossRef citations to date
0
Altmetric
Research Article

Estimating and comparing the reliability of a suite of workplace-based assessments: An obstetrics and gynaecology setting

Matt HomerUniversity of Leeds, UK; MATT HOMER, BSc, MSc, PhD is a researcher and teacher at the University of Leeds, working in both the Schools of Medicine and Education. His research has a quantitative focus, and within medical education relates to evaluating and improving assessment quality, standard setting and psychometrics.Correspondence[email protected]
,
Zeryab SetnaLady Dufferin Hospital, Pakistan; ZERYAB SETNA, MBBS, PG Cert, MRCOG, is a consultant obstetrician and gynaecologist at the Lady Dufferin hospital, Karachi. He has been involved in medical education for many years, both in assessment and teaching as well as in research. His main research work has been in work place based assessment, which is the subject of his MD thesis.
,
Vikram JhaUniversity of Liverpool, UK; VIKRAM JHA, MBBS, MMedEd, FRCOG, PhD, is Head of the Undergraduate School of Medicine at the University of Liverpool. He has been involved in medical education for many years, both in learning and teaching as well as in research. His main research work has been in professionalism, which was the subject of his PhD thesis.
,
Jenny HighamImperial College, UK; JENNY HIGHAM, MBBS, MD, FRCOG, FHEA, is Deputy Principal and Director of Education in the Faculty of Medicine at Imperial College. In addition to her senior management roles, she is a practicing surgical gynaecologist. Her research formerly focused on reproductive medicine and, more latterly, on medical education.
,
Trudie RobertsUniversity of Leeds, UK; TRUDIE ROBERTS, BSc (Hons) MBChB, PhD, FRCP, FHEA, is the Director of both the Leeds Institute of Medical Education and the Medical Education Unit in the School of Medicine at the University of Leeds. Her main interests and expertise are in the areas of assessment of competence, professionalism, inter-professional education and widening access and participation.
&
Katherine BoursicotSt George's, University of London, UK; KATHERINE BOURSICOT, BSc, MBBS, MRCOG, MAHPE, NTF, FHEA, is a Reader in Medical Education and Head of Assessment at St George's, University of London. Her main research interests are in standard setting, the assessment of clinical competence and professionalism and she has published articles on standard setting, OSCEs and equity and diversity issues in medicine.
Pages 684-691 | Published online: 19 Jun 2013

References

  • Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A. An Evaluation of the Feasibility, Validity, and Reliability of Laparoscopic Skills Assessment in the Operating Room. Ann Surg 2007; 245(6)992–999
  • Alves de Lima A, Barrero C, Baratta S, Castillo Costa Y, Bortman G, Carabajales J, Conde D, Galli A, Degrange G, Van der Vleuten Cees. Validity, reliability, feasibility and satisfaction of the Mini-Clinical Evaluation Exercise (Mini-CEX) for cardiology residency training. Med Teach 2007; 29(8)785–790
  • Brennan RL. Generalizability Theory1st. Springer, New York 2001
  • Crossley J, Davies H, Humphris G, Jolly B. Generalisability: A key to unlock professional assessment. Med Educ 2002; 36(10)972–978
  • Crossley J, Johnson G, Booth J, Wade W. Good questions, good answers: Construct alignment improves the performance of workplace-based assessment scales. Med Educ 2011; 45(6)560–569
  • Crossley J, Jolly B. Making sense of work-based assessment: Ask the right questions, in the right way, about the right things, of the right people. Med Educ 2012; 46(1)28–37
  • Goldstein H. Multilevel statistical models3rd. Arnold, London 1995
  • Govaerts MJ, Schuwirth LW, Van der Vleuten CP, Muijtjens AM. Workplace-based assessment: Effects of rater expertise. Adv Health Sci Educ Theory Pract 2010; 16(2)151–165
  • Govaerts MJ, van der Vleuten CP, Schuwirth LW, Muijtjens AM. Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract 2007; 12(2)239–260
  • Hatala R, Ainslie M, Kassen BO, Mackie I, Roberts JM. Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination. Med Educ 2006; 40(10)950–956
  • Heijne-penninga M, Kuks J, Schönrock-adema J, Snijders T, Cohen-schotanus J. Open-book Tests to Complement Assessment-programmes: Analysis of Open and Closed-book Tests. Adv Health Sci Educ Theory Pract 2008; 13(3)263–273
  • Hox JJ. Multilevel analysis: Techniques and applications. Lawrence Erlbaum Associates, Mahwah, NJ 2002
  • van Lohuizen MT, Kuks JB, van Hell EA, Raat AN, Stewart RE, Cohen-Schotanus J. The reliability of in-training assessment when performance improvement is taken into account. Adv Health Sci Educ Theory Pract 2010; 15(5)659–669
  • Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 1997; 84(2)273–278
  • Norcini J. The Mini Clinical Evaluation Exercise (mini-CEX). Clin Teach 2005; 2(1)25–30
  • Norcini J, Blank LL, Duffy FD, Fortna GS. The Mini-CEX: A Method for Assessing Clinical Skills. Ann Intern Med 2003; 138(6)476–481
  • Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach 2007; 29(9)855–871
  • Rasbash J, Charlton C, Browne W, Healy M, Cameron B, 2009. MLwiN version 2.1. Centre for Multilevel Modelling, University of Bristol
  • Setna Z, Jha V, Boursicot KAM, Roberts TE. Evaluating the utility of workplace-based assessment tools for speciality training. Best Pract Res Clin Obstet Gynaecol 2010; 24(6)767–782
  • Sultana CJ. The Objective Structured Assessment of Technical Skills and the ACGME Competencies. Obstet Gynecol Clin North Am 2006; 33(2)259–265
  • van der Vleuten C. The assessment of professional competence: Developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996; 1(1)41–67
  • Wilkinson JR, Crossley JGM, Wragg A, Mills P, Cowan G, Wade W. Implementing workplace-based assessment across the medical specialties in the United Kingdom. Med Educ 2008; 42(4)364–373

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.