Inter-school variations in the standard of examiners’ graduation-level OSCE judgements

Figures & data

Figure 1. Mean scores (+95% confidence intervals) allocated to video performances by different examiner-cohorts within each school.

Figure 2. Mean scores (+95% confidence intervals) allocated to video performances by examiners within each school.

Figure 3. Boxplot of students’ score adjustments by examiner-cohort (EC), depicting minimum, 1st quartile, median, 3rd quartile, maximum.

Figure 4. Relationship between students’ mean unadjusted and adjusted scores to the OSCE pass mark.

Solid black lines indicate cut score.

EC indicates examiner cohort.

Table 1. Influence of score adjustment on students’ categorisation (pass vs. fail) and rank position in the OSCE.

	Failure rate based on students raw (unadjusted) scores Frequency (%)	Failure rate based on students adjusted scores Frequency (%)
School 1	1 (4.17)	5 (20.83)
EC1	0 (0.00)	4 (33.33)
EC2	1 (8.33)	1 (8.33)
School 2	9 (39.13)	2 (8.70)
EC3	2 (18.18)	1 (9.09)
EC4	7 (58.33)	1 (8.33)
School 3	3 (17.65)	2 (11.76)
EC5	2 (25.00)	1 (12.50)
EC6	1 (11.11)	1 (11.11)
School 4	0 (0.00)	5 (21.74)
EC7	0 (0.00)	2 (16.67)
EC8	0 (0.00)	3 (27.27)

Data availability statement

Anonymous score data are available from the authors based on reasonable request.