Abstract
The significance of item relevance and of instructions to student raters to pay attention to item relevance when providing ratings of instruction was assessed. Students' ratings of instruction were higher on relevant items, custom designed by the instructor, than on standard items. The pay-attention-to-relevance instructions lowered students' ratings on a standard evaluation form. Ratings of instruction were a function of item relevance only when students were instructed to pay attention to item relevance.