Predictive validity of measurements of clinical competence using the Team Objective Structured Bedside Assessment (TOSBA): Assessing the clinical competence of final year medical students

Abstract

Background: The importance of valid and reliable assessment of student competence and performance is gaining increased recognition. Provision of valid patient-based formative assessment is an increasing challenge for clinical teachers in a busy hospital setting. A formative assessment tool that reliably predicts performance in the summative setting would be of value to both students and teachers.

Aim: This study explores the utility of the team objective structured bedside assessment (TOSBA), a novel ward-based formative assessment tool, in predicting student performance in the final clinical examination.

Methods: The performance of a cohort of final year students (n = 191) in the TOSBA was compared with their subsequent performance in the final examination. A comparison was also made between student performance in the existing formative assessment tool, the objective structured long examination record (OSLER) and the final examination. We also examined the relationship between the TOSBA and the components of the final examination using clustering around latent variables analysis.

Results: There was a clear relationship between student performance in the TOSBA and performance in the final examination (r² = 0.35). Student performance in the OSLER showed a poor relationship with performance in the final examination (r² = 0.15) compared with the TOSBA. The TOSBA results showed particular correlation with specific components of the final examination which were clinically based.

Conclusion: TOSBA performance is a strong predictor of subsequent performance in the final examination. The clustering of the TOSBA with other assessments of clinical skills underlines its utility. Further research is required to determine whether performance in the TOSBA is predictive of subsequent performance during internship.

Additional information

Notes on contributors

Frances M. Meagher

F.M. MEAGHER is a Corrigan Lecturer in Medicine and Physician at the Royal College of Surgeons in Ireland (RCSI).

Marcus W. Butler

M.W. BUTLER is a Lecturer in Medicine and Specialist Registrars in Respiratory Medicine, RCSI.

Stanley D.W. Miller

S.D.W. MILLER is a Lecturer in Medicine and Specialist Registrars in Respiratory Medicine, RCSI.

Richard W. Costello

R.W. COSTELLO is a Senior Lecturer in Medicine, RCSI, and Respiratory Physician in Beaumont Hospital, Dublin.

Ronan M. Conroy

R.M. CONROY is a Senior Lecturer in Epidemiology and Public Health, RCSI.

Noel G. McElvaney

N.G. McELVANEY is a Professor of Medicine and Chairman of the Department of Medicine, RCSI, and Respiratory Physician, Beaumont Hospital, Dublin.