12,307
Views
42
CrossRef citations to date
0
Altmetric
Articles

How reliable are students’ evaluations of teaching quality? A variance components approach

&

Figures & data

Figure 1. Estimates of variance components estimated in previous studies. The study by Rantanen (Citation2013) included the interaction of teachers and courses. The study by Spooren (Citation2010) did not distinguish between teachers and courses as sources of variance.

Figure 1. Estimates of variance components estimated in previous studies. The study by Rantanen (Citation2013) included the interaction of teachers and courses. The study by Spooren (Citation2010) did not distinguish between teachers and courses as sources of variance.

Figure 2. Random effects included in the three models estimated for student evaluations of teaching.

Figure 2. Random effects included in the three models estimated for student evaluations of teaching.

Table 1. Estimates for the cross-classified linear mixed effect models (random intercepts) for the scales planning and presentation and interactions with students.

Table 2. Estimates for the cross-classified linear mixed effect models (random intercepts) for the scales interestingness and relevance and difficulty and complexity.

Table 3. Estimates for the cross-classified linear mixed effect models for the global ratings of courses and teachers.

Table 4. Correlations between criterion variables for seminars and lectures.

Figure 3. Proportions of variance explained by course, teacher, student, the students × teachers interaction and unexplained variance for the four scales of the evaluation questionnaire by Staufenbiel (Citation2000) and the two overall ratings for seminars (a) and lectures (b). Error bars represent 95% confidence intervals.

Figure 3. Proportions of variance explained by course, teacher, student, the students × teachers interaction and unexplained variance for the four scales of the evaluation questionnaire by Staufenbiel (Citation2000) and the two overall ratings for seminars (a) and lectures (b). Error bars represent 95% confidence intervals.