The equalizing effect of teacher dashboards on feedback in K-12 classrooms

References

• Becker, W. C., & Gersten, R. (1982). A follow-up of follow through: The later effects of the direct instruction model on children in fifth and sixth grades. American Educational Research Journal, 19(1), 75–92. https://doi.org/10.3102/00028312019001075
   Web of Science ®Google Scholar
• Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594X.2010.513678
   Google Scholar
• Brookhart, S. M. (2017). How to give effective feedback to your students. ASCD.
   Google Scholar
• Brooks, C., Carroll, A., Gillies, R. M., & Hattie, J. (2019). A matrix of feedback for learning. Australian Journal of Teacher Education, 44(4), 2. https://doi.org/10.14221/ajte.2018v44n4.2
   Web of Science ®Google Scholar
• Bodily, R., Kay, J., Aleven, V., Jivet, I., Davis, D., Xhakaj, F., & Verbert, K. (2018, March). Open learner models and learning analytics dashboards: a systematic review. In Proceedings of the 8th international conference on learning analytics and knowledge (pp. 41-50).
   Google Scholar
• Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281. https://doi.org/10.3102/00346543065003245
   Web of Science ®Google Scholar
• Civitillo, S., Denessen, E., & Molenaar, I. (2016). How to see the classroom through the eyes of a teacher: Consistency between perceptions on diversity and differentiation practices. Journal of Research in Special Educational Needs, 16, 587–591. https://doi.org/10.1111/1471-3802.12190
   Web of Science ®Google Scholar
• Clark, W., & Luckin, R. (2013). iPads in the classroom What The Research Says (Series). London: London Knowledge Lab/Institute of Education.
   Google Scholar
• Clariana, R. B. (1990). A comparison of answer-until-correct feedback and knowledgeof-correct-response feedback under two conditions of contextualization. Journal of Computer-Based Instruction, 17(4), 125–129.
   Web of Science ®Google Scholar
• Corno, L. Y. N. (2008). On teaching adaptively. Educational Psychologist, 43(3), 161–173. https://doi.org/10.1080/00461520802178466
   Web of Science ®Google Scholar
• Dalby, D., & Swan, M. (2019). Using digital technology to enhance formative assessment in mathematics classrooms. British Journal of Educational Technology, 50(2), 832–845.
   Web of Science ®Google Scholar
• De Jager, B., Jansen, M., & Reezigt, G. (2005). The development of metacognition in primary school learning environments. School Effectiveness and School Improvement, 16(2), 179–196. https://doi.org/10.1080/09243450500114181
   Web of Science ®Google Scholar
• Denessen, E. J. P. G. (2017). Dealing responsibly with differences: socio-cultural backgrounds and differentiation in education. Paper presented at the Inaugural lecture. University Leiden, Netherlands.
   Google Scholar
• Deunk, M. I., Doolaard, S., Smale-Jacobse, A., & Bosker, R. J. (2015). Differentiation within and across classrooms: A systematic review of studies into the cognitive effects of differentiation practices. GION onderwijs/onderzoek, Rijksuniversiteit Groningen.
   Google Scholar
• Dourado, R. A., Rodrigues, R. L., Ferreira, N., Mello, R. F., Gomes, A. S., & Verbert, K. (2021, April). A Teacher-facing Learning Analytics Dashboard for Process-oriented Feedback in Online Learning. In LAK21: 11th International Learning Analytics and Knowledge Conference (pp. 482–489).
   Google Scholar
• Elo, A. (1978). The rating of chess players, past and present. Arco.
   Google Scholar
• Faber, J. M., & Visscher, A. J. (2018). The effects of a digital formative assessment tool on spelling achievement: Results of a randomized experiment. Computers & Education, 122, 1–8. https://doi.org/10.1016/j.compedu.2018.03.008
   Web of Science ®Google Scholar
• Haßler, B., Major, L., & Hennessy, S. (2016). Tablet use in schools: A critical review of the evidence for learning outcomes. Journal of Computer Assisted Learning, 32(2), 139–156.
   Web of Science ®Google Scholar
• Gersten, R., Woodward, J., & Darch, C. (1986). Direct instruction: A research-based approach to curriculum design and teaching. Exceptional Children, 53(1), 17–31. https://doi.org/10.1177/001440298605300102
   PubMedGoogle Scholar
• Han, J., Kim, K. H., Rhee, W., & Cho, Y. H. (2021). Learning analytics dashboards for adaptive support in face-to-face collaborative argumentation. Computers & Education, 163, 104041. https://doi.org/10.1016/j.compedu.2020.104041
   PubMed Web of Science ®Google Scholar
• Hanna, G. S. (1976). Effects of total and partial feedback in multiple-choice testing upon learning. The Journal of Educational Research, 69(5), 202–205. https://doi.org/10.1080/00220671.1976.10884873
   Web of Science ®Google Scholar
• Harks, B., Rakoczy, K., Hattie, J., Besser, M., & Klieme, E. (2014). The effects of feedback on achievement, interest and self-evaluation: The role of feedback’s perceived usefulness. Educational Psychology, 34(3), 269–290. https://doi.org/10.1080/01443410.2013.785384
   Web of Science ®Google Scholar
• Hattie, J. (2012). Visible learning for teachers: Maximizing impact on learning. Routledge.
   Google Scholar
• Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
   Web of Science ®Google Scholar
• Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M. (2019). A large-scale implementation of predictive learning analytics in higher education: The teachers’ role and perspective. Educational Technology Research and Development, 67(5), 1273–1306. https://doi.org/10.1007/s11423-019-09685-0
   Web of Science ®Google Scholar
• Holstein, K., Hong, G., Tegene, M., McLaren, B. M., & Aleven, V. (2018, March). The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers. In Proceedings of the 8th international conference on learning Analytics and knowledge (pp. 79-88).
   Google Scholar
• Holstein, K., McLaren, B. M., & Aleven, V. (2017, March). Intelligent tutors as teachers’ aides: exploring teacher needs for real-time analytics in blended classrooms. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference (pp. 257–266). ACM.
   Google Scholar
• Inspectie van het Onderwijs. (2010). Opbrengstgericht werken in het basisonderwijs: Een onderzoek naar opbrengstgericht werken bij rekenen-wiskunde in het basisonderwijs. Utrecht: Inspectie van het onderwijs.
   Google Scholar
• Jivet, I., Scheffel, M., Specht, M., & Drachsler, H. (2018, March). License to evaluate: Preparing learning analytics dashboards for educational practice. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 31–40).
   Google Scholar
• Kasepalu, R., Chejara, P., Prieto, L. P., & Ley, T. (2021). Do Teachers Find Dashboards Trustworthy, Actionable and Useful? A Vignette Study Using a Logs and Audio Dashboard. Technology, Knowledge and Learning, 1–19.
   Google Scholar
• Keuvelaar-van den Bergh, L. L. (2013). Teacher feedback during active learning: the development and evaluation of a professional development program. Eindhoven: Technische Universiteit Eindhoven.
   Google Scholar
• Knoop-van Campen, C. A. N. & Molenaar, I. (2020). How Teachers Integrate Dashboards into Their Feedback Practices. Frontline Learning Research, 8(4), 37–51.
   Google Scholar
• Klinkenberg, S., Straatemeier, M., & van der Maas, H. L. (2011). Computer adaptive practice of maths ability using a new item response model for on the fly ability and difficulty estimation. Computers & Education, 57(2), 1813–1824. https://doi.org/10.1016/j.compedu.2011.02.003
   Web of Science ®Google Scholar
• Li, Q., Jung, Y., & Friend Wise, A. (2021). Beyond first encounters with analytics: Questions, techniques and challenges in instructors’ sensemaking. Proceedings of the 11th International Learning Analytics and Knowledge Conference (pp. 344–353). ACM.
   Google Scholar
• Lou, Y., Abrami, P. C., & Spence, J. C. (2000). Effect of within-class grouping on student achievement: An explanatory model. The Journal of Educational Research, 94(2), 101–112. https://doi.org/10.1080/00220670009598748
   Web of Science ®Google Scholar
• Martinez-Maldonado, R., Clayphan, A., Yacef, K., & Kay, J. (2015). MTFeedback: Providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Transactions on Learning Technologies, 8(2), 187–200. https://doi.org/10.1109/TLT.2014.2365027
   Web of Science ®Google Scholar
• Mason, B. J., & Bruning, R. (2001). Providing feedback in computer-based instruction: What the research tells us. Retrieved February, 15, 2007.
   Google Scholar
• Matcha, W., Gašević, D., & Pardo, A. (2019). A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective. IEEE Transactions on Learning Technologies, 13(2), 226–245. https://doi.org/10.1109/TLT.2019.2916802
   Web of Science ®Google Scholar
• Meelissen, M. R. M., Netten, A., Drent, M., Punter, R. A., Droop, M., & Verhoeven, L. (2012). PIRLS- en TIMSS-2011: Trends in leerprestaties in Lezen, Rekenen en Natuuronderwijs. Nijmegen/Enschede: Radboud Universiteit / Universiteit Twente. DOI: 10.3990/1.9789036534758.
   Google Scholar
• Molenaar, I., Horvers, A., & Baker, R. S. (2019). What can moment-by-moment learning curves tell about students’ self-regulated learning?. Learning and Instruction, 101206.
   Google Scholar
• Molenaar, I., Horvers, A., Dijkstra, R., & Baker, R. S. (2020, March). Personalized visualizations to promote young learners’ SRL: the learning path app. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge (pp. 330–339).
   Google Scholar
• Molenaar, I., & Knoop-van Campen, C. A. N. (2016, April). Learning analytics in practice: the effects of adaptive educational technology Snappet on students' arithmetic skills. In Proceedings of the sixth international conference on learning analytics & knowledge (pp. 538–539). https://doi.org/10.1145/2883851.2883892
   Google Scholar
• Molenaar, I., & Knoop-van Campen, C. A. N. (2017a, September). Teacher dashboards in practice: Usage and impact. In European conference on technology enhanced learning (pp. 125-138). Cham: Springer. https://doi.org/10.1007/978-3-319-66610-5_10
   Google Scholar
• Molenaar, I., & Knoop-van Campen, C. A. N. (2017b, September). How teachers differ in using dashboards: the classroom observation app. Presented at the workshop “multimodal learning analytics across (physical and digital) spaces” at European conference on technology enhanced learning. Cham: Springer.
   Google Scholar
• Molenaar, I., & Knoop-van Campen, C. A. N. (2018). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies, 12(3), 347–355.
   Web of Science ®Google Scholar
• Narciss, S. (2013). Designing and evaluating tutoring feedback strategies for digital learning. Digital Education Review, 23, 7–26.
   Google Scholar
• Norman, D. A. (1991). Cognitive artifacts. in J. M. Carroll (Ed.), Designing interaction: Psychology at the human-computer interface (pp. 17–38). Cambridge University Press.
   Google Scholar
• Prast, E. M., Van de Weijer-Bergsma, E., Kroesbergen, E. H., & Van Luit, J. E. H. (2015). Readiness-based differentiation in primary school mathematics: Expert recommendations and teacher self-assessment. Frontline Learning Research, 3(2), 90–116. https://doi.org/10.14786/flr.v3i2.163
   Google Scholar
• Rienties, B., Herodotou, C., Olney, T., Schencks, M., & Boroowa, A. (2018). Making sense of learning analytics dashboards: A technology acceptance perspective of 95 teachers. International Review of Research in Open and Distributed Learning, 19(5), 5. https://doi.org/10.19173/irrodl.v19i5.3493
   Web of Science ®Google Scholar
• Rosenthal, R. (1994). Interpersonal expectancy effects: A 30-year perspective. Current Directions in Psychological Science, 3(6), 176–179. https://doi.org/10.1111/1467-8721.ep10770698
   Web of Science ®Google Scholar
• Scager, K., Akkerman, S. F., Pilot, A., & Wubbels, T. (2014). Challenging high-abilty students. Studies in Higher Education, 39(4), 659–679. https://doi.org/10.1080/03075079.2012.743117
   Web of Science ®Google Scholar
• Schwendimann, B. A., Rodriguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., Gillet, D., & Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30–41. https://doi.org/10.1109/TLT.2016.2599522
   Web of Science ®Google Scholar
• Sedrakyan, G., Malmberg, J., Verbert, K., Järvelä, S., & Kirschner, P. A. (2020). Linking learning behavior analytics and learning science concepts: Designing a learning analytics dashboard for feedback to support learning regulation. Computers in Human Behavior, 107, 105512. https://doi.org/10.1016/j.chb.2018.05.004
   Web of Science ®Google Scholar
• Sergis, S., & Sampson, D. G. (2017). Teaching and learning analytics to support teacher inquiry: A systematic literature review. In A. Peña-Ayala (Ed.), Learning analytics: Fundaments, applications, and trends. Decision and control book series (SSDC) (Vol. 94, pp. 25–63). Cham: Springer. https://doi.org/10.1007/978-3-319-52977-6_2
   Google Scholar
• Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795
   Web of Science ®Google Scholar
• Snow, R. E., & Yalow, E. (1982). Education and intelligence. Handbook of Human Intelligence, 2, 493–585.
   Google Scholar
• Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers’ judgments of students’ academic achievement: A meta-analysis. Journal of Educational Psychology, 104(3), 743–762. https://doi.org/10.1037/a0027627
   Web of Science ®Google Scholar
• Tan, J. P.-L., Koh, E., & Jonathan, C. R. (2018, April). Visible teaching in action: Using the WiREAD learning analytics dashboard for pedagogical adaptivity. Paper Presented at the 2018 Annual Meeting of the American Educational Research Association. Retrieved October 31, from the AERA Online Paper Repository. http://doi.org/10.302/1321813
   Google Scholar
• Thurlings, M., Vermeulen, M., Bastiaens, T., & Stijnen, S. (2013). Understanding feedback: A learning theory perspective. Educational Research Review, 9, 1–15. https://doi.org/10.1016/j.edurev.2012.11.004
   Web of Science ®Google Scholar
• Tomlinson, C. A., Brighton, C., Hertberg, H., Callahan, C. M., Moon, T. R., Brimijoin, K., Conover, L. A., & Reynolds, T. (2003). Differentiating instruction in response to student readiness, interest, and learning profile in academically diverse classrooms: A review of literature. Journal for Education, 27(2), 119–145. https://doi.org/10.1177/016235320302700203
   Web of Science ®Google Scholar
• Van den Bergh, L., Ros, A., & Beijaard, D. (2013). Teacher feedback during active learning: Current practices in primary schools. British Journal of Educational Psychology, 83(2), 341–362. https://doi.org/10.1111/j.2044-8279.2012.02073.x
   PubMed Web of Science ®Google Scholar
• Van de Pol, J., & Elbers, E. (2013). Scaffolding student learning: A micro-analysis of teacher-student interaction. Learning, Culture and Social Interaction, 2(1), 32–41. https://doi.org/10.1016/j.lcsi.2012.12.001
   Web of Science ®Google Scholar
• Van Leeuwen, A. (2019). Teachers’ perceptions of the usability of learning analytics reports in a flipped university course: When and how does information become actionable knowledge? Educational Technology Research and Development, 67(5), 1043–1064. https://doi.org/10.1007/s11423-018-09639-y
   Web of Science ®Google Scholar
• Van Leeuwen, A., & Janssen, J. (2019). A systematic review of teacher guidance during collaborative learning in primary and secondary education. Educational Research Review, 27, 71–89. https://doi.org/10.1016/j.edurev.2019.02.001
   Web of Science ®Google Scholar
• Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL. Computers & Education, 79, 28–39. https://doi.org/10.1016/j.compedu.2014.07.007
   Web of Science ®Google Scholar
• Van Leeuwen, A., Knoop-van Campen, C. A. N., Molenaar, I., & Rummel, N. (2021). How teacher characteristics relate to how teachers use dashboards: Results from two case studies in K-12. Journal of Learning Analytics.
   Google Scholar
• Van Leeuwen, A., Rummel, N., & van Gog, T. (2019). What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? International Journal of Computer-Supported Collaborative Learning, https://doi.org/10.1007/s11412-019-09299-x
   Google Scholar
• Van Leeuwen, A., & Rummel, N. (2020, March). Comparing teachers' use of mirroring and advising dashboards. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge (pp. 26–34).
   Google Scholar
• Van Leeuwen, A., Teasley, S., & Wise, D., & F, A. (in press). Teacher and student facing learning analytics. In C. Lang, G. Siemens, A. F. Wise, D. Gasevic, & A. Mercernon (Eds.), Handbook of learning analytics. 2nd ed. SoLAR.
   Google Scholar
• Van Leeuwen, A., Van Wermeskerken, M., Erkens, G., & Rummel, N. (2017). Measuring teacher sense making strategies of learning analytics: A case study. Learning: Research and Practice, 3(1), 42–58.
   Google Scholar
• Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing, 18(6), 1499–1514. doi: 10.1007/s00779-013-0751-2
   Web of Science ®Google Scholar
• Verbert, K., Ochoa, X., De Croon, R., Dourado, R. A., & De Laet, T. (2020, March). Learning analytics dashboards: the past, the present and the future. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge (pp. 35–40).
   Google Scholar
• Voerman, L., Meijer, P. C., Korthagen, F. A. J., & Simons, R. J. (2012). Types and frequencies of feedback interventions in classroom interaction in secondary education. Teaching and Teacher Education, 28(8), 1107–1115. https://doi.org/10.1016/j.tate.2012.06.006
   Web of Science ®Google Scholar
• Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2), 53-69. DOI: https://doi.org/10.18608/jla.2019.62.4
   Google Scholar
• Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17(2), 89-100. 10.1111/j.1469-7610.1976.tb00381.x
   PubMed Web of Science ®Google Scholar