A novel assessment of an evidence-based practice course using an authentic assignment

Figures & data

Table

Practice points

Many instruments used for summative assessment of EBP are of debatable quality. Several validated instruments have been developed but either do not test all the steps of EBP or lack authenticity. An authentic assignment marked by at least two raters using a grid is a valid, reliable and feasible summative assessment procedure for students following an EBP course in the general practice track. Consequential validity and reproducibility data are lacking.

Table 1.  The marking grid

Figure 1. Bland–Altman plots for scoring by three raters of the EBP assignments. Difference of scores is plotted against the mean score for each assignment (n = 20).

Table 2.  Inter-rater agreement for assignment marking

Raters	ICC (95% CI)
VD–TDF	0.83 [0.61; 0.93]
VD–PC	0.70 [0.38; 0.87]
TDF–PC	0.80 [0.56; 0.92]
All three raters	0.77 [0.59; 0.89]

ICC: intraclass correlation coefficient.