Flipping Statistics Courses in Graduate Education: Integration of Cognitive Psychology and Technology

References

• Balota, D. A., Duchek, J. M., and Logan, J. M. (2007), “Is Expanded Retrieval Practice a Superior Form of Spaced Retrieval? A Critical Review of the Extent Literature,” in The Foundations of Remembering: Essay in Honor of Henry L. Roediger III, ed. J. Nairne, London: Psychology Press.
   Google Scholar
• Baum, S., and Steele, P. (2017), Who Goes to Graduate School and Who Succeeds? Washington, DC: Access Group, Inc. and Urban Institute.
   Google Scholar
• Blunt, J. R., and Karpicke, J. D. (2014), “Learning With Retrieval-Based Concept Mapping,” Journal of Educational Psychology, 106, 849–858. DOI: 10.1037/a0035934.
   Web of Science ®Google Scholar
• Brown, E. N., and Kass, R. E. (2009), “What Is Statistics?,” The American Statistician, 63, 105–110, DOI: 10.1198/tast.2009.0019.
   Web of Science ®Google Scholar
• Butler, A. C., Marsh, E. J., Slavinsky, J. P., and Baraniuk, R. G. (2014), “Integrating Cognitive Science and Technology Improves Learning in a STEM Classroom,” Educational Psychology Review, 26, 331–340, DOI: 10.1007/s10648-014-9256-4.
   Web of Science ®Google Scholar
• Carey, M. D., and Dunn, P. K. (2018), “Facilitating Language-Focused Cooperative Learning in Introductory Statistics Classrooms: A Case Study,” Statistics Education Research Journal, 17, 30–50.
   Google Scholar
• Carpenter, S. K. (2014), “Spacing and Interleaving of Study and Practice,” in Applying Science of Learning in Education, eds. V. A. Benassi, C. E. Overson, and C. M. Hakala, Washington, DC: American Psychological Association.
   Google Scholar
• Carpenter, S. K., Cepeda, N. J., Rohrer, D., Kang, S. H. K., and Pashler, H. (2012), “Using Spacing to Enhance Diverse Forms of Learning: Review of Recent Research and Implications for Instruction,” Educational Psychology Review, 24, 369–378, DOI: 10.1007/s10648-012-9205-z.
   Web of Science ®Google Scholar
• Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., and Rohrer, D. (2006), “Distributed Practice in Verbal Recall Tasks: A Review and Quantitative Synthesis,” Psychological Bulletin, 132, 354–380, DOI: 10.1037/0033-2909.132.3.354.
   PubMed Web of Science ®Google Scholar
• Cepeda, N. J., Vul, E., Rohrer, D., Wixted, J. T., and Pashler, H. (2008), “Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention,” Psychological Science, 19, 1095–1102. DOI: 10.1111/j.1467-9280.2008.02209.x.
   PubMed Web of Science ®Google Scholar
• Cheng, S., Ferris, M., and Perolio, J. (2018), “An Innovative Classroom Approach for Developing Critical Thinkers in the Introductory Statistics Course,” The American Statistician, 72, 354–358, DOI: 10.1080/00031305.2017.1305293.
   Web of Science ®Google Scholar
• Davenport, C. E. (2018), “Evolution in Student Perceptions of a Flipped Classroom in a Computer Programming Course,” Journal of College Science Teaching, 47, 30–35. DOI: 10.2505/4/jcst18_047_04_30.
   Google Scholar
• Dempster, F. N. (1989), “Spacing Effects and Their Implications for Theory and Practice,” Educational Psychology Review, 1, 309–330. DOI: 10.1007/BF01320097.
   Web of Science ®Google Scholar
• Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., and Willingham, D. T. (2013), “Improving Students’ Learning With Effective Learning Techniques Promising Directions From Cognitive and Educational Psychology,” Psychological Science in the Public Interest, 14, 4–58, DOI: 10.1177/1529100612453266.
   PubMed Web of Science ®Google Scholar
• GAISE College Report (2016), “Guidelines for Assessment and Instruction in Statistics Education College Report 2016,” available at http://www.amstat.org/education/gaise.
   Google Scholar
• Gal, I. (2002), “Adults’ Statistical Literacy: Meanings, Components, Responsibilities,” International Statistical Review, 70, 1–25. DOI: 10.1111/j.1751-5823.2002.tb00336.x.
   Web of Science ®Google Scholar
• Greenhouse, J. B., and Seltman, H. J. (2018), “On Teaching Statistical Practice: From Novice to Expert,” The American Statistician, 72, 147–154, DOI: 10.1080/00031305.2016.1270230.
   Web of Science ®Google Scholar
• Hamdan, N., McKnight, P., McKnight, K., and Arfstrom, K. M. (2013), “The Flipped Learning Model: A White Paper Based on the Literature Review Titled: A Review of Flipped Learning,” available at https://flippedlearning.org/wp-content/uploads/{\ldots}/WhitePaper{\_}FlippedLearning.pdf.
   Google Scholar
• Hopkins, R. F., Lyle, K. B., Hieb, J. L., and Ralston, P. A. S. (2016), “Spaced Retrieval Practice Increases College Students’ Short- and Long-Term Retention of Mathematics Knowledge,” Educational Psychology Review, 28, 853–873, DOI: 10.1007/s10648-015-9349-8.
   Web of Science ®Google Scholar
• Hopkins, R. F., Lyle, K. B., Ralston, P. A., Bego, C. R., and Heib, J. L. (2018), “Retrieval Practice and Spacing: Effects on Long-Term Learning Among Engineering Precalculus Students,” in American Society of Engineering Education Proceedings of the American Society of Engineering Education, Salt Lake City, UT.
   Google Scholar
• Karpicke, J. D. (2009), “Metacognitive Control and Strategy Selection: Deciding to Practice Retrieval During Learning,” Journal of Experimental Psychology: General, 138, 469–486. DOI: 10.1037/a0017341.
   PubMed Web of Science ®Google Scholar
• Karpicke, J. D. (2012), “Retrieval-Based Learning: Active Retrieval Promotes Meaningful Learning,” Current Directions in Psychological Science, 21, 157–163. DOI: 10.1177/0963721412443552.
   Web of Science ®Google Scholar
• Karpicke, J. D., Butler, A. C., and Roediger, J. L., III. (2009), “Metacognitive Strategies in Student Learning: Do Students Practice Retrieval When They Study on Their Own?,” Memory, 17, 471–479, DOI: 10.1080/09658210802647009.
   PubMed Web of Science ®Google Scholar
• Karpicke, J. D., and Grimaldi, P. J. (2012), “Retrieval-Based Learning: A Perspective for Enhancing Meaningful Learning,” Educational Psychology Review, 24, 401–418, DOI: 10.1007/s10648-012-9202-2.
   Web of Science ®Google Scholar
• Karpicke, J. D., and Roediger, H. L., III (2008), “The Critical Importance of Retrieval for Learning,” Science, 319, 966–968. DOI: 10.1126/science.1152408.
   PubMed Web of Science ®Google Scholar
• Karpicke, J. D., and Roediger, H. L., III (2010), “Is Expanding Retrieval a Superior Method for Learning Text Materials?,” Memory & Cognition, 38, 116–124. DOI: 10.3758/MC.38.1.116.
   PubMed Web of Science ®Google Scholar
• Karpicke, J. D., and Zaromb, F. M. (2010), “Retrieval Mode Distinguishes the Testing Effect From the Generation Effect,” Journal of Memory and Language, 62, 227–239. DOI: 10.1016/j.jml.2009.11.010.
   Web of Science ®Google Scholar
• Keeley, J., Zayac, R., and Correia, C. (2008), “Curvilinear Relationship Between Statistics Anxiety and Performance Among Undergraduate Students: Evidence for Optimal Anxiety,” Statistics Education Research Journal, 7, 4–15.
   Google Scholar
• Lage, M. J., Platt, G. J., and Treglia, M. (2000), “Inverting the Classroom: A Gateway to Creating Inclusive Learning Environment,” The Journal of Economic Education, 31, 30–43, DOI: 10.1080/00220480009596759.
   Web of Science ®Google Scholar
• Lawson, A. E. (2002), Science Teaching and Development of Thinking, Belmont, CA: Wadsworth/Thompson Learning.
   Google Scholar
• Lee, H. K. H. (2007), “Chocolate Chip Cookies as a Teaching Aid,” The American Statistician, 61, 351–355, DOI: 10.1198/000313007X246905.
   Web of Science ®Google Scholar
• Lindsay, B. G., Kettenring, J., and Siegmund, D. (2004), “A Report on the Future of Statistics,” Statistical Science, 19, 387–413, DOI: 10.1214/088342304000000404.
   Web of Science ®Google Scholar
• Lovett, M. C., and Greenhouse, J. B. (2000), “Applying Cognitive Theory to Statistics Instruction,” American Statistician, 54, 196–206, DOI: 10.1080/00031305.2000.10474545.
   Web of Science ®Google Scholar
• Lyle, K. B., and Crawford, N. A. (2011), “Retrieving Essential Material at the End of Lectures Improves Performance on Statistics Exams,” Teaching of Psychology, 38, 94–97, DOI: 10.1177/0098628311401587.
   Web of Science ®Google Scholar
• Mills, J. D. (2004), “Students’ Attitudes Towards Statistics: Implications for the Future,” College Student Journal, 38, 349–361.
   Google Scholar
• Mills, J. D., and Raju, D. (2011), “Teaching Statistics Online: A Decade’s Review of the Literature About What Works,” Journal of Statistics Education, 19, 1–28, DOI: 10.1080/10691898.2011.11889613.
   Google Scholar
• Nelson, L. R., and Zaichkowsky, L. D. (1979), “A Case for Using Multiple Regression Instead of ANOVA in Educational Research,” The Journal of Experimental Education, 47, 324–330. DOI: 10.1080/00220973.1979.11011701.
   Web of Science ®Google Scholar
• Nielsen, P. L., Bean, N. W., and Larsen, R. A. A. (2018), “The Impact of a Flipped Classroom Model of Learning on a Large Undergraduate Statistics Class,” Statistics Education Research Journal, 17, 121–140.
   Google Scholar
• Okahana, H., and Zhou, E. (2018), Graduate Enrollment and Degrees: 2007 to 2017. Washington, DC: Council of Graduate Schools.
   Google Scholar
• Pashler, H., Bain, P., Bottge, B., Gaesser, A., Koedinger, K., McDaniel, M., and Metcalfe, J. (2007), Organizing Instruction and Study to Improve Student Learning (NCER 2007–2004), Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education, available at http://ncer.ed.gov.
   Google Scholar
• Peterson, J. (2016), “The Flipped Classroom Improves Student Achievement and Course Satisfaction in a Statistics Course: A Quasi-Experimental Study,” Teaching of Psychology, 43, 10–15, DOI: 10.1177/0098628315620063.
   Web of Science ®Google Scholar
• Presti, C. R. (2016), “The Flipped Learning Approach in Nursing Education: A Literature Review,” Journal of Nursing Education, 55, 252–257, DOI: 10.3928/01484834-20160414-03.
   PubMed Web of Science ®Google Scholar
• Richland, L. E., Kornell, N., and Kao, L. S. (2009), “The Pretesting Effect: Do Unsuccessful Retrieval Attempts Enhance Learning?,” Journal of Experimental Psychology: Applied, 15, 243–257, DOI: 10.1037/a0016496.
   PubMed Web of Science ®Google Scholar
• Ridgway, J. (2016), “Implications of the Data Revolution for Statistics Education,” International Statistical Review, 84, 528–549, DOI: 10.111/insr.12110.
   Web of Science ®Google Scholar
• Roediger, H. L., and Karpicke, J. D. (2006), “Test-enhanced Learning: Taking Memory Tests Improves Long-Term Retention,” Psychological Science, 17, 249–255. DOI: 10.1111/j.1467-9280.2006.01693.x.
   PubMed Web of Science ®Google Scholar
• Roseth, C. J., Garfield, J. B., and Ben-Zvi, D. (2008), “Collaboration in Learning and Teaching Statistics,” Journal of Statistics Education, 16. DOI: 10.1080/10691898.2008.11889557.
   PubMedGoogle Scholar
• Schwartz, T. A. (2014), “Flipping the Statistics Classroom in Nursing Education,” The Journal of Nursing Education, 53, 199–206, DOI: 10.3928/0148434-20140325-02.
   PubMed Web of Science ®Google Scholar
• Schwieren, J., Barenberg, J., and Dutke, S. (2017), “The Testing Effect in the Psychology Classroom: A Meta-Analytic Perspective,” Psychology Learning & Teaching, 16, 179–196. DOI: 10.1177/1475725717695149.
   Google Scholar
• Smith, G. (1998), “Learning Statistics by Doing Statistics,” Journal of Statistics Education, 6. DOI: 10.1080/10691898.1998.11910623.
   Google Scholar
• Songsore, E., and White, B. J. G. (2018), “Students’ Perceptions of the Future Relevance of Statistics Afer Completing an Online Introductory Statistics Course,” Statistics Education Research Journal, 17, 120–140.
   Google Scholar
• Tishkovskaya, S., and Lancaster, G. A. (2012), “Statistical Education in the 21st Century: A Review of Challenges, Teaching Innovations and Strategies for Reform,” Journal of Statistics Education, 20, 1–43. DOI: 10.1080/10691898.2012.11889641.
   Google Scholar
• Winquist, J. R., and Carlson, K. A. (2014), “Flipped Statistics Class Results: Better Performance than Lecture Over One Year Later,” Journal of Statistics Education, 22, 1–10, DOI: 10.1090/10691898.2016.1158017.
   Google Scholar
• Wild, C. J., Pfannkuch, M., Regan, M., and Horton, N. J. (2004), “Towards More Accessible Conceptions of Statistical Inference,” Journal of the Royal Statistical Society, Series A, 174, 247–295. DOI: 10.1111/j.1467-985X.2010.00678.x.
   Google Scholar
• Zieffler, A., Garfield, J., Alt, S., Dupuis, D., Holleque, K., and Chang, B. (2008), “What Does Research Suggest About Teaching and Learning of Introductory Statistics at the College Level? A Review of the Literature,” Journal of Statistics Education, 16. DOI: 10.1080/10691898.2008.11889566.
   PubMedGoogle Scholar