Collaboration across the pond: The multi-school progress testing project

Abstract

This collaborative project between the National Board of Medical Examiners and four schools in the UK is investigating the feasibility and utility of a cross-school progress testing program drawing on test material recently retired from the United States Medical Licensing Examination (USMLE) Step 2 Clinical Knowledge (CK) examination. This article describes the design of the progress test; the process used to build, translate (localize), review, and finalize test forms; the approach taken to (web-based) test administration; and the procedure used to calculate and report scores. Results to date have demonstrated that it is feasible to use test items written for the US licensing examination as a base for developing progress test forms for use in the UK. Some content areas can be localized more readily than others, and care is clearly needed in review and revision of test materials to ensure that it is clinically appropriate and suitably phrased for use in the UK. Involvement of content experts in review and vetting of the test material is essential, and it is clearly desirable to supplement expert review with the use of quality control procedures based on the item statistics as a final check on the appropriateness of individual test items.

Additional information

Notes on contributors

D. B. Swanson

Dave Swanson is vice president for Program Development and Special Projects, National Board of Medical Examiners, USA.

K. Z. Holtzman

Kathy Holtzman is assistant vice president for Derivative Program Development & Special Projects, National Board of Medical Examiners, USA.

A. Butler

Aggie Butler is vice president for Medical Education and Health Profession Services, National Board of Medical Examiners, USA.

M. M. Langer

Michelle Langer is a psychometrician, Scoring Services, National Board of Medical Examiners, USA.

M. V. Nelson

Melanie Nelson is director of operations for Medical School Services, Medical Education and Health Profession Services, National Board of Medical Examiners, USA.

J. W. M. Chow

Jade Wm Chow is a consultant histopathologist and Associate Dean of Undergraduate Education, Faculty of Medicine and Biomedical Science, St George's, University of London, UK.

R. Fuller

Richard Fuller is director of the Leeds MBChB programme at the Leeds Institute of Medical Education, University of Leeds, UK.

J. A. Patterson

John Patterson is an honorary senior lecturer in Medical Education (formerly Associate Dean for Undergraduate Medical Studies) in the Centre for Medical Education, Barts and the London School of Medicine and Dentistry, UK.

M. Boohan

Mairead Boohan is deputy director, Centre for Medical Education, Queen's University Belfast, UK.

The Multi-School Progress Testing Committee

Mairead Boohan is deputy director, Centre for Medical Education, Queen's University Belfast, UK.