Re-Examining the Effect of Audience Response Systems on Learning Outcomes: Evidence from the Last Decade

Abstract

Student response system which allows bi-directional communication between instruction and students is considered as useful educational technology. It increases learners’ attention, engagement, motivation, and achievement through constant interaction and immediate feedback. The purpose of the study is to assess the quantitative results of the previous studies concerning with the effectiveness of SRSs in cognitive and non-cognitive learning outcomes. Therefore, this study applies meta-analysis technique to synthesize the overall result and explains the controversial findings among the previously published studies. During the systematic review procedure, PRISMA checklist has been taken as a guideline. Initial data search yielded 12,605 articles from diverse databases. 142 raw data derived from 68 studies met the inclusion criteria of the meta-analysis; therefore, the analysis has been conducted with 142 independent effect sizes extracted from 68 articles. The meta-analysis yielded that SRS use has statistically significant small effect (i.e., combined effect size: Hedges’ g = 0.47, k = 109, p < 0.001) on cognitive learning outcome whereas statistically significant medium effect (i.e., combined effect size: Hedges’ g = 0.66, k = 33, p < 0.001) on non-cognitive learning outcome. Further moderator analyses provided evidence for the followings; (1) SRS use in K-12 is more effective than use in higher education, (2) use of SRS in some subject areas is more effective than in others, (3) some SRSs (i.e., Kahoot!) are more effective than others (i.e., Clicker). The meaning of the results was interpreted and discussed within the scope of reviewed literature.

Keywords:

• Teaching/learning strategies
• educational technology
• student response system
• clicker
• meta-analysis

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Tuncer Akbay

Tuncer Akbay received the PhD degree in Computer Education and Instructional Technology from Middle East Technical University in 2019. He is an Assistant Professor in Information Systems and Technology department. His research interest includes Educational Data Mining, Computer Assisted Testing, Gamification, and Cognitive Effort.

Neşe Sevim-Cirak

Neşe Sevim-Cirak Associate Professor Dr. in Computer Education and Instructional Technology Department at Burdur Mehmet Akif Ersoy University in Turkey. Her research area includes technology usage in early child education, SRS and Computer Assisted Testing, social media, and digital games.

Osman Erol

Osman Erol Associate Professor Dr. in Computer Education and Instructional Technology Department at Burdur Mehmet Akif Ersoy University in Turkey. His research area includes programming education, educational robotics, SRS and Computer Assisted Testing, social media, and internet addiction.