Click-level Learning Analytics in an Online Medical Education Learning Platform

References

• Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med. 2006;81(3):207–212. doi:10.1097/00001888-200603000-00002.
   PubMed Web of Science ®Google Scholar
• Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA. 2008;300(10):1181–1196. doi:10.1001/jama.300.10.1181.
   PubMed Web of Science ®Google Scholar
• Jones MG. Creating electronic learning environments: Games, flow, and the user interface. Paper presented at the National Convention of the Association for Educational Communications and Technology (AECT); 1998; St. Louis, MO. https://files.eric.ed.gov/fulltext/ED423842.pdf. Accessed March 22, 2020.
   Google Scholar
• Finn JD, Zimmer KS. Student engagement: what is it? Why does it matter? In: Christenson SL, Reschly AL, Wylie C, eds. Handbook of Research on Student Engagement. Boston, MA: Springer, 2012:97–131.
   Google Scholar
• Joksimović S, Poquet O, Kovanović V, et al. How do we model learning at scale? A systematic review of research on MOOCs. Rev Educ Res. 2018;88(1):43–86. doi:10.3102/0034654317740335.
   Web of Science ®Google Scholar
• Shernoff DJ, Schmidt JA. Further evidence of an engagement–achievement paradox among US high school students. J Youth Adolescence. 2008;37(5):564–580. doi:10.1007/s10964-007-9241-z.
   Web of Science ®Google Scholar
• Rowe KJ, Rowe KS. The relationship between inattentiveness in the classroom and reading achievement (Part B): an explanatory study. J Am Acad Child Adolescent Psychiatry. 1992;31(2):357–368. doi:10.1097/00004583-199203000-00026.
   PubMed Web of Science ®Google Scholar
• Cooper H, Jackson K, Nye B, Lindsay JJ. A model of homework’s influence on the performance evaluations of elementary school students. J Exp Educ. 2001;69(2):181–199. doi:10.1080/00220970109600655.
   Web of Science ®Google Scholar
• Cooper H, Valentine JC, Nye B, Lindsay JJ. Relationships between five after-school activities and academic achievement. J Educ Psychol. 1999;91(2):369–378. doi:10.1037/0022-0663.91.2.369.
   Web of Science ®Google Scholar
• Kovanović V, GašEvić D, Dawson S, Joksimović S, Baker RS, Hatala M, Does time-on-task estimation matter? Implications on validity of learning analytics findings. JLA. 2015;2(3):81–110. doi:10.18608/jla.2015.23.6.
   Google Scholar
• Roberge D, Rojas A, Baker R. Does the length of time off-task matter? In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge; April 29, 2012; Vancouver, British Columbia, Canada.
   Google Scholar
• Eccles JS, Barber BL. Student council, volunteering, basketball, or marching band: what kind of extracurricular involvement matters? J Adolescent Res. 1999;14(1):10–43. doi:10.1177/0743558499141003.
   Web of Science ®Google Scholar
• Marsh H, Kleitman S. Extracurricular school activities: the good, the bad, and the nonlinear. Harvard Educ Rev. 2002;72(4):464–515. doi:10.17763/haer.72.4.051388703v7v7736.
   Web of Science ®Google Scholar
• Cook DA, Andriole DA, Durning SJ, Roberts NK, Triola MM. Longitudinal research databases in medical education: facilitating the study of educational outcomes over time and across institutions. Acad Med. 2010;85(8):1340–1346.
   PubMed Web of Science ®Google Scholar
• Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306(9):978–988. doi:10.1001/jama.2011.1234.
   PubMed Web of Science ®Google Scholar
• Cirigliano MM, Guthrie C, Pusic MV, et al. “Yes, and…” exploring the future of learning analytics in medical education. Teach Learn Med. 2017;29(4):368–372. doi:10.1080/10401334.2017.1384731.
   PubMed Web of Science ®Google Scholar
• Ellaway RH, Pusic MV, Galbraith RM, Cameron T. Developing the role of big data and analytics in health professional education. Med Teach. 2014;36(3):216–222.
   Google Scholar
• Bienkowski M, Feng M, Means B. Enhancing Teaching and Learning through Educational Data Mining and Learning Analytics: An Issue Brief. Washington, DC: US Department of Education, Office of Educational Technology; 2012.
   Google Scholar
• MedU. CORE radiology course. http://www.med-u.org/core. Accessed July 12, 2015.
   Google Scholar
• MedU. About aquifer. https://www.aquifer.org/about-aquifer/. Accessed January 16, 2020.
   Google Scholar
• Fall LH, Berman NB, Smith S, White CB, Woodhead JC, Olson AL. Multi-institutional development and utilization of a computer-assisted learning program for the pediatrics clerkship: the CLIPP Project. Acad Med. 2005;80(9):847–855. doi:10.1097/00001888-200509000-00012.
   PubMed Web of Science ®Google Scholar
• Atkinson RK, Derry SJ, Renkl A, Wortham D. Learning from examples: instructional principles from the worked examples research. Rev Educ Res. 2000;70(2):181–214. doi:10.3102/00346543070002181.
   Web of Science ®Google Scholar
• Stark R, Kopp V, Fischer MR. Case-based learning with worked examples in complex domains: two experimental studies in undergraduate medical education. Learn Instr. 2011;21(1):22–33. doi:10.1016/j.learninstruc.2009.10.001.
   Web of Science ®Google Scholar
• Cook DA, Dupras DM. Teaching on the web: automated online instruction and assessment of residents in an acute care clinic. Med Teacher. 2004;26(7):599–603. doi:10.1080/01421590400004932.
   PubMed Web of Science ®Google Scholar
• Carney RN, Levin JR. Pictorial illustrations still improve students’ learning from text. Educ Psychol Rev. 2002;14(1):5–26.
   Web of Science ®Google Scholar
• Pusic MV, LeBlanc VR, Miller SZ. Linear versus web-style layout of computer tutorials for medical student learning of radiograph interpretation. Acad Radiol. 2007;14(7):877–889. doi:10.1016/j.acra.2007.04.013.
   PubMed Web of Science ®Google Scholar
• Gagne RM, Wager WW, Golas KC, Keller JM, Russell JD. Principles of instructional design. Nonprofit Manag Leadership. 2005;44(2):44–46. doi:10.1002/pfi.4140440211.
   Google Scholar
• Halgin RP, Leahy PM. Understanding and treating perfectionistic college students. J Counsel Dev. 1989;68(2):222–225. doi:10.1002/j.1556-6676.1989.tb01362.x.
   Web of Science ®Google Scholar
• Roediger IIH, Karpicke JD. Test-enhanced learning: taking memory tests improves long-term retention. Psychol Sci. 2006;17(3):249–255. doi:10.1111/j.1467-9280.2006.01693.x.
   PubMed Web of Science ®Google Scholar
• Sherbino J, Dore KL, Wood TJ, et al. The relationship between response time and diagnostic accuracy. Acad Med. 2012;87(6):785–791. doi:10.1097/ACM.0b013e318253acbd.
   PubMed Web of Science ®Google Scholar
• Fincham E, Whitelock-Wainwright A, Kovanović V, Joksimović S, van Staalduinen JP, Gašević D. Counting clicks is not enough: validating a theorized model of engagement in learning analytic. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge; March 4, 2019; Tempe, Arizona, USA.
   Google Scholar
• Leppink J, Pérez-Fuster P. Mental effort, workload, time on task, and certainty: beyond linear models. Educ Psychol Rev. 2019;31(2):421–428. doi:10.1007/s10648-018-09460-2.
   Web of Science ®Google Scholar
• Kohavi R, Longbotham R. Online controlled experiments and a/b testing. In: Sammut C, Webb GI, eds. Encyclopedia of Machine Learning and Data Mining 2nd ed. New York, NY: Springer; 2017:922–929.
   Google Scholar