Instructional improvement and student engagement in post-secondary engineering courses: the complexity underlying small effect sizes

Abstract

The current study leveraged a professional development programme for engineering faculty at a large research university to examine the impact of instructional improvement on student engagement. Professors who participated in the professional development were observed three times and rated using an existing observation protocol. Students in courses with instructors who participated and did not participate in the professional development were surveyed about their classroom engagement. The responses were used to conduct quasi-experimental comparisons. Results indicated that students in courses with professors who participated in the professional development self-reported 3% more behavioural and 2% more cognitive engagement than students with professors who did not participate. Within professional development group, follow-up comparisons showed that students in courses with the highest rated instructors self-reported 7% more cognitive engagement than students with lower ranked professors. Thematic coding of the qualitative data suggests that the highest rated instructors may have achieved these gains through the use of three domain general instructional strategies: activating prior knowledge, facilitating classroom interaction and promoting reflection. Findings are contextualised within extant literature reporting similar effect sizes, and implications for future engagement research from a classroom systems perspective are discussed.

Keywords:

• Active learning
• collaboration
• complex systems
• engagement
• knowledge building

Acknowledgement

The authors would like to acknowledge Dr. Kaatje van der Hoven Kraft for the contribution to the data collection, and Dr. Gwen Marchand for the helpful comments on the manuscript.