Evaluation of a national neurosurgical formative examination: the UK experience

Abstract

Introduction: Formative assessment is a key component in medical education and that it is a helpful process for all involved. Until recently there was no national formative examination for neurosurgical trainees. The Neurosurgery Annual in Training Examination (NAiTE) is an annual online, formative assessment that was introduced in 2014. In this paper, we seek to discuss how well NAiTE relates to established educational practice and principles and its fitness for purpose by discussing its rationale, structure and utility.

Methods: A national online examination was introduced in 2014. The NAiTE consists of 100 single best answer multiple choice questions. The examination and questions with were reviewed and the global results presented. The existing literature and educational theory are used to guide subjective assessment of the process.

Results: In 2016, 191 candidates participated in the NAiTE, of whom 154 were trainees working in UK neurosurgical units. The mean score for early stage UK trainees (years 1-3) was 52.4%, intermediate (years 4-5) 58.5% and senior (years 6-8) 65.4%. The NAiTE was found to be a reliable (Cronbach-Alpha of 0.89) and valid assessment of trainees with scores approximating those attained in the Intercollegiate Specialty Examination itself.

Discussion: Potential areas for improvement are highlighted, including reference to some that have already been implemented.

Conclusion: Overall, the examination is a cheap, viable and reliable means of testing trainees and encouraging their onward development and learning as they work towards the Intercollegiate Specialty Examination

Keywords:

• Basic neurosciences training
• higher speciality training
• junior doctors
• examination

Disclosure statement

IA acts as a peer-reviewer for the questions featured in the NAiTE.

ST is a clinical lead for ebrain and is part of the team that has established the annual formative neurosurgery examination.

IA, RC and ST have each authored multiple questions that feature within the NAiTE question bank.