Implementing randomised control trials in open and distance learning: a feasibility study

References

• Aboalshamat, K., Hou, X.- Y., & Strodl, E. (2015). The impact of a self-development coaching programme on medical and dental students’ psychological health and academic performance: A randomised controlled trial. BMC Medical Education, 15(1), 1–13. doi:10.1186/s12909-015-0412-4
   PubMed Web of Science ®Google Scholar
• Arbaugh, J. B. (2014). System, scholar, or students? Which most influences online MBA course effectiveness? Journal of Computer Assisted Learning, 30, 349–362. doi:10.1111/jcal.12048
   Web of Science ®Google Scholar
• Baker, R. S. (2010). Data mining for education. International Encyclopedia of Education, 7, 112–118.10.1016/B978-0-08-044894-7.01318-X
   Google Scholar
• Bienkowski, M., Feng, M., & Means, B. (2012). Enhancing teaching and learning through educational data mining and learning analytics: An issue brief (pp. 1–57). US Department of Education, Office of Educational Technology.
   Google Scholar
• Calvert, C. E. (2014). Developing a model and applications for probabilities of student success: A case study of predictive analytics. Open Learning: The Journal of Open, Distance and e-Learning, 29, 160–173. doi:10.1080/02680513.2014.931805
   Google Scholar
• Cartwright, N., & Hardie, J. (2012). Evidence-based policy a practical guide to doing it better. New York, NY: Oxford University Press.10.1093/acprof:osobl/9780199841608.001.0001
   Google Scholar
• Christie, H., Munro, M., & Fisher, T. (2004). Leaving university early: Exploring the differences between continuing and non-continuing students. Studies in Higher Education, 29, 617–636.10.1080/0307507042000261580
   Web of Science ®Google Scholar
• Ferguson, R., & Buckingham Shum, S. (2012). Social learning analytics: Five approaches. Paper presented at the proceedings of the 2nd international conference on Learning Analytics and Knowledge, Vancouver, BC.
   Google Scholar
• Franssen, R., & Nijhuis, J. (2011). Exploring student attrition in problem-based learning: tutor and student perceptions on student progress. In P. Van den Bossche, W. H. Gijselaers, & R. G. Milter (Eds.), Building learning experiences in a changing world (Vol. 3, pp. 139–146). Netherlands: Springer.10.1007/978-94-007-0802-0
   Google Scholar
• González-Torres, A., García-Peñalvo, F. J., & Therón, R. (2013). Human–computer interaction in evolutionary visual software analytics. Computers in Human Behavior, 29, 486–495. doi:10.1016/j.chb.2012.01.013
   Web of Science ®Google Scholar
• Hanson, J. (2009). Displaced but not replaced: The impact of e-learning on academic identities in higher education. Teaching in Higher Education, 14, 553–564. doi:10.1080/13562510903186774
   Web of Science ®Google Scholar
• Harford, T. (2014, April 25). The random risks of randomised trials. The Financial Times Magazine. Retrieved from http://www.ft.com/cms/s/2/59bb202c-ca7b-11e3-8a31-00144feabdc0.html#axzz2zvfIZC7h
   Google Scholar
• Hattie, J. (2009). Visible Learning: A synthesis of over 800 meta-analyses relating to achievement. New York, NY: Routledge.
   Google Scholar
• Hess, F. M., & Saxberg, B. (2013). Breakthrough leadership in the digital age: Using learning science to reboot schooling. Thousand Oaks, CA: Corwin Press.
   Google Scholar
• Hickey, D. T., Kelley, T. A., & Shen, X. (2014). Small to big before massive: Scaling up participatory learning analytics. Paper presented at the Proceedings of the Fourth International Conference on Learning Analytics and Knowledge.
   Google Scholar
• Hommes, J., Arah, O.A., de Grave, W., Schuwirth, Lambert W. T., Scherpbier, Albert J. J. A., & Bos, Gerard M. J. (2014). Medical students perceive better group learning processes when large classes are made to seem small. PLoS ONE, 9, e93328. doi:10.1371/journal.pone.0093328
   PubMed Web of Science ®Google Scholar
• IET Student Statistics and Survey Team. (2014). What reasons do students give for not completing modules? Non-returners research findings and outcomes. Report. The Open University, UK.
   Google Scholar
• Ilic, D., & Maloney, S. (2014). Methods of teaching medical trainees evidence-based medicine: A systematic review. Medical Education, 48, 124–135. doi:10.1111/medu.12288
   PubMed Web of Science ®Google Scholar
• Inkelaar, T., & Simpson, O. (2015). Challenging the ‘distance education deficit’ through ‘motivational emails’. Open Learning: The Journal of Open, Distance and e-Learning, 30, 152–163. doi:10.1080/02680513.2015.1055718
   Web of Science ®Google Scholar
• Macfadyen, L.P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54, 588–599. doi:10.1016/j.compedu.2009.09.008
   Web of Science ®Google Scholar
• MacNeill, S., Campbell, L. M., & Hawksey, M. (2014). Analytics for education. Journal of Interactive Media in Education, 2014(1), Part 7, 1–12. doi:10.5334/2014-07
   Google Scholar
• McMillan, J. H., & Schumacher, S. (2014). Research in education: Evidence-based inquiry. Harlow: Pearson Higher Ed.
   Google Scholar
• Norman, G. (2010). Is experimental research passé Advances in Health Sciences Education, 15, 297–301.10.1007/s10459-010-9243-6
   PubMed Web of Science ®Google Scholar
• Papamitsiou, Z., & Economides, A. (2014). Learning analytics and educational data mining in practice: A systematic literature review of empirical evidence. Educational Technology & Society, 17, 49–64.
   Web of Science ®Google Scholar
• Piderit, S.K. (2000). Rethinking resistance and recognizing ambivalence: A multidimensional view of attitudes toward an organizational change. The Academy of Management Review, 25, 783–794. doi:10.2307/259206
   Web of Science ®Google Scholar
• Richins, M.L. (1983). Negative word-of-mouth by dissatisfied consumers: A pilot study. Journal of Marketing, 47, 68–78.10.2307/3203428
   Web of Science ®Google Scholar
• Rienties, B., Boroowa, A., Cross, S., Kubiak, C., Mayles, K., & Murphy, S. (2016). Analytics4Action evaluation framework: A review of evidence-based learning analytics interventions at Open University UK. Journal of Interactive Media in Education, 1(2), 1–12. doi:10.5334/jime.394
   Google Scholar
• Rienties, B., Cross, S., & Zdrahal, Z. (2016). Implementing a learning analytics intervention and evaluation framework: What works? In B. K. Daniel (Ed.), Big data and learning analytics in higher education: current theory and practice (pp. 147–166). Heidelberg: Springer.
   Google Scholar
• Rienties, B., Giesbers, S., Lygo-Baker, S., Ma, S., & Rees, R. (2016). Why some teachers easily learn to use a new virtual learning environment: A technology acceptance perspective. Interactive Learning Environments, 24, 539–552. doi:10.1080/10494820.2014.881394
   Web of Science ®Google Scholar
• Rienties, B., & Toetenel, L. (2016). The impact of learning design on student behaviour, satisfaction and performance: A cross-institutional comparison across 151 modules. Computers in Human Behavior, 60, 333–341. doi:10.1016/j.chb.2016.02.074
   Web of Science ®Google Scholar
• Simpson, O. (2004). The impact on retention of interventions to support distance learning students. Open Learning, 19, 79–95. doi:10.1080/0268051042000177863
   Google Scholar
• Simpson, O. (2013). Supporting students for success in online and distance education. New York, NY: Routledge.
   Google Scholar
• Siroker, D., & Koomen, P. (2013). A/B testing: The most powerful way to turn clicks into customers. Hoboken, NJ: Wiley.
   Google Scholar
• Slavin, R. E. (2002). Evidence-based education policies: transforming educational practice and research. Educational Researcher, 31, 15–21. doi:10.2307/3594400
   Google Scholar
• Slavin, R. E. (2008). Perspectives on evidence-based research in education – What works? issues in synthesizing educational program evaluations. Educational Researcher, 37, 5–14. doi:10.3102/0013189X08314117
   Web of Science ®Google Scholar
• Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: Learning analytics in a data-rich context. Computers in Human Behavior, 47, 157–167. doi:10.1016/j.chb.2014.05.038
   Web of Science ®Google Scholar
• Tobarra, L., Robles-Gómez, A., Ros, S., Hernández, R., & Caminero, A. C. (2014). Analyzing the students’ behavior and relevant topics in virtual learning communities. Computers in Human Behavior, 31, 659–669. doi:10.1016/j.chb.2013.10.001
   Web of Science ®Google Scholar
• Torgerson, D. J., & Torgerson, C. (2008). Designing randomised trials in health, education and the social sciences: An introduction. London: Palgrave Macmillan.10.1057/9780230583993
   Google Scholar
• Wetzer, I. M., Zeelenberg, M., & Pieters, R. (2007). “Never eat in that restaurant, I did!”: Exploring why people engage in negative word-of-mouth communication. Psychology & Marketing, 24, 661–680.10.1002/(ISSN)1520-6793
   Web of Science ®Google Scholar
• Woods, R., & Keeler, J. (2001). The effect of instructor's use of audio e-mail messages on student participation in and perceptions of online learning: a preliminary case study. Open Learning: The Journal of Open, Distance and e-Learning, 16, 263–278. doi:10.1080/02680510120084977
   Google Scholar
• Ziliak, S., & Teather-Posadas, E. R. (2014). The unprincipled randomization principle in economics and medicine. In G. DeMartino & D. N. McCloskey (Eds.), Oxford university press handbook on professional economic ethics (pp. 1–29). New York, NY: Oxford.
   Google Scholar