Piecing the learning analytics puzzle: a consolidated model of a field of research and practice

References

• Anderson, T., & Shattuck, J. (2012). Design-based research: A decade of progress in education research? Educational Researcher, 41(1), 16–25. doi:10.3102/0013189X11428813
   Web of Science ®Google Scholar
• Andreson, C. (2008). The End of Theory: The Data Deluge Makes the Scientific Method Obsolete. Retrieved January 13, 2017, from https://www.wired.com/2008/06/pb-theory/
   Google Scholar
• Apereo Foundation. (2016). Learning Analytics Initiative |Apereo. Retrieved January 5, 2017, from https://www.apereo.org/communities/learning-analytics-initiative
   Google Scholar
• Arnold, K. E., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In S. Dawson, C. Haythornthwaite, S. Buckingham Shum, D. Gasevic, & R. Ferguson (Eds.), Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). New York, NY: ACM. doi:10.1145/2330601.2330666
   Google Scholar
• Azevedo, R. (2015). Defining and measuring engagement and learning in science: Conceptual, theoretical, methodological, and analytical issues. Educational Psychologist, 50(1), 84–94. doi:10.1080/00461520.2015.1004069
   Web of Science ®Google Scholar
• Baker, R. (2014). Week 6: Feature Engineering in Data, Analytics and Learning MOOC. Retrieved from https://www.youtube.com/watch?v=5DWZoXI5z-E.
   Google Scholar
• Baker, R., & Siemens, G. (2014). Educational data mining and learning analytics. In R. K. Sawyer (Ed.), Cambridge handbook of the learning sciences. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Bakharia, A., Kitto, K., Pardo, A., Gašević, D., & Dawson, S. (2016). Recipe for success: Lessons learnt from using xAPI within the connected learning analytics toolkit. In D. Gasevic, G. Lynch, S. Dawson, H. Drachsler, & C. P. Rosé (Eds.), Proceedings of the sixth international conference on learning analytics & knowledge (pp. 378–382). New York, NY: ACM. doi:10.1145/2883851.2883882
   Google Scholar
• Bjork, E. L., & Bjork, R. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In M. A. Gernsbacher, R. W. Pew, L. M. Hough, & J. R. Pomerantz (Eds.), Psychology and the real world: Essays illustrating fundamental contributions to society (pp. 56–64). New York: Worth Publishers.
   Google Scholar
• Buckingham Shum, S., & Deakin Crick, R. (2012). Learning dispositions and transferable competencies: Pedagogy, modelling and learning analytics. In S. Dawson, C. Haythornthwaite, S. B. Shum, D. Gasevic, & R. Ferguson (Eds.), Proceedings of the 2Nd International Conference on Learning Analytics and Knowledge (pp. 92–101). New York, NY: ACM. doi:10.1145/2330601.2330629
   Google Scholar
• Buckingham Shum, S., & Deakin Crick, R. (2016). Learning Analytics for 21st Century Competencies. Journal of Learning Analytics, 3(2), 6–21. doi:10.18608/jla.2016.32.2
   Google Scholar
• Caulfield, M. (2013, November 12). What the Course Signals “Kerfuffle” is About, and What it Means to You. Retrieved from http://www.educause.edu/blogs/mcaulfield/what-course-signals-kerfuffle-about-and-what-it-means-you
   Google Scholar
• Chatti, M. A., Dyckhoff, A. L., Schroeder, U., & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5–6), 318–331. doi:10.1504/IJTEL.2012.051815
   Google Scholar
• Civitas Learning. (2016). Emerging Benchmarks & Student Success Trends From Across The Civitas (Community Insights Report No. Volume 1, Number 2). Austin, TX, USA: Civitas Learning. Retrieved from http://info.civitaslearning.com/community-insights-issue-2.
   Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. doi:10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Corrin, L., & De Barba, P. (2014). Exploring students’ interpretation of feedback delivered through learning analytics dashboards. In B. Hegarty, J. McDonald, & S.-K. Loke (Eds.), Proceedings of the ascilite 2014 conference (pp. 629–633). Dunedin, NZ.
   Google Scholar
• Dawson, S., Gašević, D., Siemens, G., & Joksimovic, S. (2014). Current state and future trends: A citation network analysis of the learning analytics field. In M. D. Pistilli, J. Willis, D. Koch, K. E. Arnold, S. D. Teasley, & A. Pardo (Eds.), Proceedings of the fourth international conference on learning analytics and knowledge (pp. 231–240). New York, NY: ACM. doi:10.1145/2567574.2567585.
   Google Scholar
• Dawson, S., Jovanović, J., Gašević, D., & Pardo, A. (2017). From prediction to impact: Evaluation of a learning analytics retention program. In A. F. Wise, P. H. Winne, G. Lynch, X. Ochoa, I. Molenaar, & S. Dawson (Eds.), Proceedings of the 7th International Conference on Learning Analytics and Knowledge (LAK 2017). Vancouver, BC: ACM Press.
   Google Scholar
• D’Mello, S. K. (2017). Emotional learning analytics. In C. Lang, G. Siemens, W. Alyssa, & D. Gašević (Eds.), Handbook of learning analytics & educational data mining (1st ed.). Edmonton, AB: Societz for Learning Analytics Research.
   Google Scholar
• Dowell, N. M., Skrypnyk, O., Joksimovic, S., Graesser, A. C., Dawson, S., Gaševic, D., … Kovanovic, V. (2015). Modeling learners’ social centrality and performance through language and discourse. In O. C. Santos, J. Boticario, C. Romero, M. Pechenizkiy, A. Merceron, P. Mitros ... M. Desmarais (Eds.), Proceedings of the 8th international educational data mining society (pp. 250–257). Madrid, Spain: IEDMS.
   Google Scholar
• Drachsler, H., & Greller, W. (2016). Privacy and analytics: It’s a DELICATE issue a checklist for trusted learning analytics. In D. Gasevic, G. Lynch, S. Dawson, H. Drachsler, & C. P. Rosé (Eds.), Proceedings of the sixth international conference on learning analytics & knowledge (pp. 89–98). New York, NY: ACM. doi:10.1145/2883851.2883893
   Google Scholar
• Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5), 304–317. doi:10.1504/IJTEL.2012.051816
   Google Scholar
• Ferguson, R., Hoel, T., Scheffel, M., & Drachsler, H. (2016). Guest editorial: Ethics and privacy in learning analytics. Journal of Learning Analytics, 3(1), 5–15. doi:10.18608/jla.2016.31.2
   Google Scholar
• Ferguson, R., Macfadyen, L. P., Clow, D., Tynan, B., Alexander, S., & Dawson, S. (2014). Setting learning analytics in context: Overcoming the barriers to large-scale adoption. Journal of Learning Analytics, 1(3), 120–144. doi:10.18608/jla.2014.13.7
   Google Scholar
• Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education, 28, 68–84. doi:10.1016/j.iheduc.2015.10.002
   Web of Science ®Google Scholar
• Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71. doi:10.1007/s11528-014-0822-x
   Web of Science ®Google Scholar
• Gašević, D., Mirriahi, N., Dawson, S., & Joksimović, S. (2017). Effects of instructional conditions and experience on the adoption of a learning tool. Computers in Human Behavior, 67, 207–220. doi:10.1016/j.chb.2016.10.026
   Web of Science ®Google Scholar
• Goodhue, D. L., & Thompson, R. L. (1995). Task-technology fit and individual performance. MIS Quarterly, 19(2), 213–236. doi:10.2307/249689
   Web of Science ®Google Scholar
• Goodyear, P. (2015). Teaching as design. HERDSA Review of Higher Education, 2, 27–50.
   Google Scholar
• Google Scholar. (2016). Educational Technology - Google Scholar Metrics. Retrieved January 15, 2017, from https://scholar.google.ca/citations?view_op=top_venues&hl=en&vq=soc_educationaltechnology
   Google Scholar
• Granovetter, M. (1982). The strength of weak ties: A network theory revisited. In P. V. Marsden & N. Lin (Eds.), Social structure and network analysis (pp. 105–130). Beverly Hill, CA: Sage.
   Google Scholar
• Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Journal of Educational Technology & Society, 15(3), 42–57.
   Web of Science ®Google Scholar
• Hattie, J. (2012). Visible learning for teachers: Maximizing impact on learning. London: Routledge.
   Google Scholar
• Jacobson, M. J, Kapur, M, & Reimann, P. (2016). Conceptualizing debates in learning and educational research: Toward a complex systems conceptual framework of learning. Educational Psychologist, 51(2), 210–218.
   Google Scholar
• Jayaprakash, S. M., Moody, E. W., Lauría, E. J. M., Regan, J. R., & Baron, J. D. (2014). Early alert of academically at-risk students: An open source analytics initiative. Journal of Learning Analytics, 1(1), 6–47. doi:10.18608/jla.2014.11.3
   Google Scholar
• Joksimović, S., Manataki, A., Gašević, D., Dawson, S., Kovanović, V., & De Kereki, I. F. (2016). Translating network position into performance: Importance of centrality in different network configurations. In D. Gasevic, G. Lynch, S. Dawson, H. Drachsler, & C. P. Rosé (Eds.), Proceedings of the sixth international conference on learning analytics & knowledge (pp. 314–323). New York, NY: ACM. doi:10.1145/2883851.2883928
   Google Scholar
• Käser, T., Klingler, S., & Gross, M. H. (2016). When to stop? Towards universal instructional policies. In D. Gasevic, G. Lynch, S. Dawson, H. Drachsler, & C. P. Rosé (Eds.), Proceedings of the sixth international conference on learning analytics & knowledge, LAK 2016, Edinburgh, United Kingdom, April 25–29, 2016 (pp. 289–298). doi:10.1145/2883851.2883961
   Google Scholar
• Kovanović, V., Gašević, D., Joksimović, S., Hatala, M., & Adesope, O. (2015). Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions. The Internet and Higher Education, 27, 74–89. doi:10.1016/j.iheduc.2015.06.002
   Web of Science ®Google Scholar
• Kovanović, V., Joksimović, S., Waters, Z., Gašević, D., Kitto, K., Hatala, M., & Siemens, G. (2016). Towards automated content analysis of discussion transcripts: A cognitive presence case. In D. Gasevic, G. Lynch, S. Dawson, H. Drachsler, & C. P. Rosé (Eds.), Proceedings of the sixth international conference on learning analytics & knowledge (pp. 15–24). New York, NY: ACM. doi:10.1145/2883851.2883950
   Google Scholar
• Krumm, A. E., Waddington, R. J., Teasley, S. D., & Lonn, S. (2014). A learning management system-based early warning system for academic advising in undergraduate engineering. In J. A. Larusson & B. White (Eds.), Learning analytics (pp. 103–119). New York: Springer. Retrieved from http://link.springer.com/chapter/10.1007/978-1-4614-3305-7_6
   Google Scholar
• Liu, Z., Nersessian, N. J., & Stasko, J. T. (2008). Distributed cognition as a theoretical framework for information visualization. IEEE Transactions on Visualization and Computer Graphics, 14(6), 1173–1180. doi:10.1109/TVCG.2008.121
   PubMed Web of Science ®Google Scholar
• Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57(10), 1439–1459. doi:10.1177/0002764213479367
   Web of Science ®Google Scholar
• Long, P. D., Siemens, G., Conole, G., & Gašević, D. (Eds.). (2011). Proceedings of the 1st International Conference on Learning Analytics and Knowledge (LAK’11). New York, NY: ACM.
   Google Scholar
• Lusher, D., Koskinen, J., & Robins, G. (2012). Exponential random graph models for social networks: Theory, methods, and applications. New York: Cambridge University Press.
   Google Scholar
• Lust, G., Elen, J., & Clarebout, G. (2013). Students’ tool-use within a web enhanced course: Explanatory mechanisms of students’ tool-use pattern. Computers in Human Behavior, 29(5), 2013–2021. doi:10.1016/j.chb.2013.03.014
   Web of Science ®Google Scholar
• Macfadyen, L. P., & Dawson, S. (2012). Numbers are not enough. Why e-Learning analytics failed to inform an institutional strategic plan. Educational Technology & Society, 15(3), 149–163.
   Web of Science ®Google Scholar
• Macfadyen, L. P, Dawson, S, Pardo, A, & Gasevic, D. (2014). Embracing big data in complex educational systems: The learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9(2), 17–28.
   Google Scholar
• Marbouti, F., & Wise, A. F. (2016). Starburst: A new graphical interface to support purposeful attention to others’ posts in online discussions. Educational Technology Research and Development, 64(1), 87–113. doi:10.1007/s11423-015-9400-y
   Web of Science ®Google Scholar
• Molenaar, I. (2014). Advances in temporal analysis in learning and instruction. Frontline Learning Research, 2(4), 15–24. doi:10.14786/flr.v2i4.118
   Google Scholar
• Pechenizkiy, M., & Gašević, D. (2014). Introduction into sparks of the learning analytics future. Journal of Learning Analytics, 1(3), 145–149. doi:10.18608/jla.2014.13.8
   Google Scholar
• Pijeira-Díaz, H. J., Drachsler, H., Järvelä, S., & Kirschner, P. A. (2016). Investigating collaborative learning success with physiological coupling indices based on electrodermal activity. In D. Gasevic, G. Lynch, S. Dawson, H. Drachsler, C. P. Rosé (Eds.), Proceedings of the sixth international conference on learning analytics & knowledge (pp. 64–73). New York, NY: ACM. doi:10.1145/2883851.2883897
   Google Scholar
• Reimann, P. (2016). Connecting learning analytics with learning research: The role of design-based research. Learning: Research and Practice, 2(2), 130–142. doi:10.1080/23735082.2016.1210198
   Google Scholar
• Rogers, T., Gašević, D., & Dawson, S. (2016). Learning analytics and the imperative for theory driven research. In C. Haythornthwaite, R. Andrews, J. Fransma, & E. Meyers (Eds.), The SAGE Handbook of E-Learning research (2nd ed., pp. 232–250). London, UK: SAGE Publications Ltd.
   Google Scholar
• Roll, I., & Winne, P. H. (2015). Understanding, evaluating, and supporting self-regulated learning using learning analytics. Journal of Learning Analytics, 2(1), 7–12. doi:10.18608/jla.2015.21.2
   Google Scholar
• Romero, C., & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 40(6), 601–618. doi:10.1109/TSMCC.2010.2053532
   Web of Science ®Google Scholar
• Scheffel, M., Drachsler, H., Stoyanov, S., & Specht, M. (2014). Quality indicators for learning analytics. Educational Technology & Society, 17(4), 117–132.
   Web of Science ®Google Scholar
• Siadaty, M., Gašević, D., & Hatala, M. (2016). Trace-based micro-analytic measurement of self-regulated learning processes. Journal of Learning Analytics, 3(1), 183–214. doi:10.18608/jla.2016.31.11
   Google Scholar
• Siemens, G., & Baker, R. S. J. D. (2012). Learning analytics and educational data mining: Towards communication and collaboration. In S. Dawson, C. Haythornthwaite, S. B. Shum, D. Gasevic, & R. Ferguson (Eds.), Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 252–254). New York, NY: ACM. doi:10.1145/2330601.2330661
   Google Scholar
• Siemens, G., & Gasevic, D. (2012). Guest editorial-learning and knowledge analytics. Educational Technology & Society, 15(3), 1–2.
   Web of Science ®Google Scholar
• Slater, S., Joksimović, S., Kovanovic, V., Baker, R. S., & Gasevic, D. (in press). Tools for educational data mining: A review. Journal of Educational and Behavioral Statistics. doi:10.3102/1076998616666808
   Web of Science ®Google Scholar
• Steiner, C., Kickmeier-Rust, M., & Türker, M. A. (2014). Review article about LA and EDM approaches (No. Deliverable D3.1). European Commission LEA’s Box Project. Retrieved from http://css-kmi.tugraz.at/mkrwww/leas-box/downloads/D3.1.pdf
   Google Scholar
• Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4), 295–312. doi:10.1016/0959-4752(94)90003-5
   Google Scholar
• Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using Signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4), 2414–2422. doi:10.1016/j.compedu.2011.05.016
   Web of Science ®Google Scholar
• Tsai, Y.-S., & Gašević, D. (in press). Learning analytics in higher education – Challenges and policies. In A. F. Wise, P. H. Winne, G. Lynch, X. Ochoa, I. Molenaar, & S. Dawson (Eds.), Proceedings of the 7th International Conference on Learning Analytics and Knowledge (LAK 2017). ACM Press.
   Google Scholar
• Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist, 57(10), 1500–1509. doi:10.1177/0002764213479363
   Web of Science ®Google Scholar
• Vessey, I. (1991). Cognitive fit: A theory-based analysis of the graphs versus tables literature*. Decision Sciences, 22(2), 219–240. doi:10.1111/j.1540-5915.1991.tb00344.x
   Web of Science ®Google Scholar
• Wasserman, S. (1994). Social network analysis: Methods and applications (Vol. 8). Cambridge: Cambridge University Press.
   Google Scholar
• Wasson, B., & Hansen, C. (2016). Data literacy and use for teaching. In P. Reimann, S. Bull, M. Kickmeier-Rust, R. Vatrapu, & B. Wasson (Eds.), Measuring and visualizing learning in the information-rich classroom (pp. 56–73). New York: Routledge.
   Google Scholar
• Winne, P. H. (1997). Experimenting to bootstrap self-regulated learning. Journal of Educational Psychology, 89(3), 397–410. doi:10.1037/0022-0663.89.3.397
   Web of Science ®Google Scholar
• Winne, P. H. (2006). How software technologies can improve research on learning and bolster school reform. Educational Psychologist, 41(1), 5–17. doi:10.1207/s15326985ep4101_3
   Web of Science ®Google Scholar
• Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277–304). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Wise, A. (2014). Designing pedagogical interventions to support student use of learning analytics. In M. D. Pistilli, J. Willis, D. Koch, K. E. Arnold, S. D. Teasley, & A. Pardo (Eds.), Proceedings of the fourth international conference on learning analytics and knowledge (pp. 203–211). New York, NY: ACM. doi:10.1145/2567574.2567588
   Google Scholar
• Wise, A., & Shaffer, D. W. (2015). Why theory matters more than ever in the age of big data. Journal of Learning Analytics, 2(2), 5–13. doi:10.18608/jla.2015.22.2
   Google Scholar
• Wise, A., Zhao, Y., & Hausknecht, S. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics, 1(2), 48–71. doi:10.18608/jla.2014.12.4
   Google Scholar
• Zhou, M., & Winne, P. H. (2012). Modeling academic achievement by self-reported versus traced goal orientation. Learning and Instruction, 22(6), 413–419. doi:10.1016/j.learninstruc.2012.03.004
   Web of Science ®Google Scholar