A Randomized Study to Evaluate the Effect of a Nudge via Weekly E-mails on Students’ Attitudes Toward Statistics

References

• Boettcher, J. V., and Conrad, R.-M. (2016), The Online Teaching Survival Guide (2nd ed.), San Francisco: Jossey-Bass.
   Google Scholar
• Brown, A., Lawrence, J., Basson, M., Axelsen, M., Redmond, P., Turner, J., Maloney, S., and Galligan, L. (2022), “The Creation of a Nudging Protocol to Support Online Student Engagement in Higher Education,” Active Learning in Higher Education, 1–15. DOI: 10.1177/14697874211039077.
   Web of Science ®Google Scholar
• Crouch, C. H., and Mazur, E. (2001), “Peer Instruction: Ten Years of Experience and Results,” American Journal of Physics, 69, 970–977. DOI: 10.1119/1.1374249.
   Web of Science ®Google Scholar
• Damgaard, M. T., and Nielsen, H. S. (2018), “Nudging in Education,” Economics of Education Review, 64, 313–342, DOI: 10.1016/jeconedurev.2018.03.008.
   Web of Science ®Google Scholar
• Darby, F. (2019), Small Teaching Online: Applying Learning Science in Online Classes, Arlington: Jossey-Bass.
   Google Scholar
• Dreyhaupt, J., Mayer, B., Keis, O., Öchsner, W., and Muche, R. (2017), “Cluster-Randomized Studies in Educational Research: Principles and Methodological Aspects,” GMS Journal for Medical Education, 34, 1–12. DOI: 10.3205/zma001103.
   Web of Science ®Google Scholar
• Emmioğlu, E., and Capa-Aydin, Y. (2012), “Attitudes and Achievement in Statistics: A Meta-Analysis Study,” Statistics Education Research Journal, 11, 95–102. DOI: 10.52041/serj.v11i2.332.
   Google Scholar
• Fritz, J. (2017), “Using Analytics to Nudge Student Responsibility for Learning,” New Directions for Higher Education, 2017, 65–75, DOI: 10.1002/he.20244.
   Google Scholar
• GAISE College Report ASA Revision Committee (2016), “Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report 2016,” available at https://www.amstat.org/education/guidelines-for-assessment-and-instruction-in-statistics-education-(gaise)-reports.
   Google Scholar
• Gal, I. (2000), Adult Numeracy Development: Theory, Research, Practice. Series on Literacy: Research, Policy, and Practice, ERIC.
   Google Scholar
• Gal, I., Ginsburg, L., and Schau, C. (1997), “Monitoring Attitudes and Beliefs in Statistics Education,” The Assessment Challenge in Statistics Education, 12, 37–51.
   Google Scholar
• Gibbs, A. L., and Taback, N. (2018), “Encouraging Better Attitudes: The Story of an Investigation of Teaching and Learning Introductory Statistics,” available at https://alisongibbs.github.io/talks/2018-06-05-SSC.
   Google Scholar
• Gundlach, E., Richards, K. A. R., Nelson, D., and Levesque-Bristol, C. (2015), “A Comparison of Student Attitudes, Statistical Reasoning, Performance, and Perceptions for Web-Augmented Traditional, Fully Online, and Flipped Sections of a Statistical Literacy Class,” Journal of Statistics Education, 23, 1–33. DOI: 10.1080/10691898.2015.11889723.
   Web of Science ®Google Scholar
• Hassad, R. A. (2018), “An Exploration of the Perceived Usefulness of the Introductory Statistics Course and Students’ Intentions to Further Engage in Statistics,” Numeracy, 11, 1–10. DOI: 10.5038/1936–4660.11.1.7.
   Google Scholar
• Kahneman, D. (1994), “New Challenges to the Rationality Assumption,” Journal of Institutional and Theoretical Economics (JITE)/Zeitschrift für die gesamte Staatswissenschaft, 150, 18–36.
   Web of Science ®Google Scholar
• Kahneman, D., and Tversky, A. (1979), “Prospect Theory: An Analysis of Decision under Risk,” Econometrica, 47, 263–292. DOI: 10.2307/1914185.
   Web of Science ®Google Scholar
• Klein, G., and Dabney, A. (2013), The Cartoon Introduction to Statistics, New York: Hill and Wang.
   Google Scholar
• Lawrence, J., Brown, A., Redmond, P., Maloney, S., Basson, M., Galligan, L., and Turner, J. (2021), “Does Course Specific Nudging Enhance Student Engagement, Experience and Success?: A Data-Driven Longitudinal Tale,” Student Success, 12, 28–37. DOI: 10.5204/ssj.1914.
   Web of Science ®Google Scholar
• Lenth, R. V. (2016), “Least-Squares Means: The R Package lsmeans,” Journal of Statistical Software, 69, 1–33. DOI: 10.18637/jss.v069.i01.
   Web of Science ®Google Scholar
• Lesser, L. M., and Pearl, D. K. (2008), “Functional Fun in Statistics Teaching: Resources, Research and Recommendations,” Journal of Statistics Education, 16. DOI: 10.1080/10691898.2008.11889572.
   PubMedGoogle Scholar
• Lesser, L. M., Pearl, D. K., and Weber III, J. J. (2016), “Assessing Fun Items’ Effectiveness in Increasing Learning of College Introductory Statistics Students: Results of a Randomized Experiment,” Journal of Statistics Education, 24, 54–62. DOI: 10.1080/10691898.2008.11889572.
   Web of Science ®Google Scholar
• Loux, T. M., Varner, S. E., and VanNatta, M. (2016), “Flipping an Introductory Biostatistics Course: A Case Study of Student Attitudes and Confidence,” Journal of Statistics Education, 24, 1–7. DOI: 10.1080/10691898.2016.1158017.
   Web of Science ®Google Scholar
• MailChimp (n.d.), “Use Open Tracking in Emails,” available at https://mailchimp.com/help/about-open-tracking/, retrieved: July 19, 2022.
   Google Scholar
• Millar, A. M., and Schau, C. (2010), “Assessing Students’ Attitudes: The Good, the Bad, and the Ugly,” in Proceedings of the Joint Statistical Meetings, pp. 1133–1143.
   Google Scholar
• Nielsen, P. L., Bean, N. W., and Larsen, R. A. A. (2018), “The Impact of a Flipped Classroom Model of Learning on a Large Undergraduate Statistics Class,” Statistics Education Research Journal, 17, 121–140. DOI: 10.52041/serj.v17i1.179.
   Google Scholar
• Nolan, M. M., Beran, T., and Hecker, K. G. (2012), “Surveys Assessing Students’ Attitudes Toward Statistics: A Systematic Review of Validity and Reliability,” Statistics Education Research Journal, 11, 103–123. DOI: 10.52041/serj.v11i2.333.
   Google Scholar
• Oreopoulos, P. (2020), “Promises and Limitations of Nudging in Education,” IZA Discussion Papers, No. 13718, Institute of Labor Economics (IZA), Bonn, Available at https://docs.iza.org/dp13718.pdf.
   Google Scholar
• Page, L. C., Lee, J., and Gehlbach, H. (2020), “Conditions Under Which College Students can be Responsive to Nudging,” Available at http://www.edworkingpapers.com/ai20-242. DOI: 10.26300/vjfs–kv2.
   Google Scholar
• Pearl, D., Garfield, J., delMas, R., Groth, R., Kaplan, J., McGowan, H., and Lee, H. (2012), “Connecting Research to Practice in a Culture of Assessment for Introductory College-Level Statistics,” Available at http://www.causeweb.org/research/guidelines/ResearchReport_Dec_2012.pdf.
   Google Scholar
• Peterson, D. J. (2016), “The Flipped Classroom Improves Student Achievement and Course Satisfaction in a Statistics Course: A Quasi-Experimental Study,” Teaching of Psychology, 43, 10–15. DOI: 10.1177/0098628315620.
   Web of Science ®Google Scholar
• Rumsey, D. J. (2002), “Statistical Literacy as a Goal for Introductory Statistics Courses,” Journal of Statistics Education, 10. 898.2002.11910678. DOI: 10.1080/10691.
   Google Scholar
• Schau, C. (2003), “Survey of Attitudes Toward Statistics (SATS-36),” Available at https://www.evaluationandstatistics.com.
   Google Scholar
• Schau, C., and Emmioğlu, E. (2012), “Do Introductory Statistics Courses in the United States Improve Students’ Attitudes?” Statistics Education Research Journal, 11, 86–94. DOI: 10.52041/serj.v11i2.331.
   Google Scholar
• Taback, N., and Gibbs, A. (2022), “nudgedata,” DOI: 10.5281/zenodo.7080181.
   Google Scholar
• Thaler, R. H., and Sunstein, C. R. (2008), Nudge, New Haven: Yale University Press.
   Google Scholar
• Touchton, M. (2015), “Flipping the Classroom and Student Performance in Advanced Statistics: Evidence From a Quasi-Experiment,” Journal of Political Science Education, 11, 28–44. DOI: 10.1080/15512169.2014.985105.
   Web of Science ®Google Scholar
• Tversky, A., and Kahneman, D. (1971), “Belief in the Law of Small Numbers,” Psychological Bulletin, 76, 105– 110. DOI: 10.1037/h0031322.
   Google Scholar
• Tversky, A., and Kahneman, D. (1991), “Loss Aversion in Riskless Choice: A Reference-Dependent Model,” The Quarterly Journal of Economics, 106, 1039–1061. DOI: 10.2307/2937956.
   Web of Science ®Google Scholar
• Utts, J., Sommer, B., Acredolo, C., Maher, M. W., and Matthews, H. R. (2003), “A Study Comparing Traditional and Hybrid Internet-Based Instruction in Introductory Statistics Classes,” Journal of Statistics Education, 11. DOI: 10.1080/10691898.2003.11910722.
   Google Scholar
• van Buuren, S., and Groothuis-Oudshoorn, K. (2011), “mice: Multivariate Imputation by Chained Equations in R,” Journal of Statistical Software, 45, 1–67. DOI: 10.18637/jss.v045.i03.
   Web of Science ®Google Scholar
• van Oldenbeek, M., Winkler, T. J., Buhl-Wiggers, J., and Hardt, D. (2019), “Nudging in Blended Learning: Evaluation of Email-Based Progress Feedback in a Flipped-Classroom Information Systems Course,” in Proceedings of the 27th European Conference on Information Systems (ECIS), Stockholm & Uppsala, Sweden, Available at https://aisel.aisnet.org/ecis2019_rp/186.
   Google Scholar
• Wilson, S. G. (2013), “The Flipped Class: A Method to Address the Challenges of an Undergraduate Statistics Course,” Teaching of Psychology, 40, 193–199. DOI: 10.1177/00986283134874.
   Web of Science ®Google Scholar
• Winquist, J. R., and Carlson, K. A. (2014), “Flipped Statistics Class Results: Better Performance Than Lecture Over One Year Later,” Journal of Statistics Education, 22. DOI: 10.1080/10691898.2014.11889717.
   Google Scholar