The Flipped Classroom in Introductory Statistics: Early Evidence From a Systematic Review and Meta-Analysis

References

• Beatty, B. J., Merchant, Z., and Albert, M. (2017), “Analysis of Student Use of Video in a Flipped Classroom,” TechTrends, 63, 376–385, DOI: 10.1007/s11528-017-0169-1.
   Web of Science ®Google Scholar
• Bishop, J. L., and Verleger, M. A. (2013), “The Flipped Classroom: A Survey of the Research,” in 120th ASEE Annual Conference and Exposition, Atlanta, GA.
   Google Scholar
• Boaler, J. (2013), “Ability and Mathematics: The Mindset Revolution that is Reshaping Education,” Forum, 55, 143–152, DOI: 10.2304/forum.2013.55.1.143.
   Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P. T., and Rothstein, H. R. (2009), Introduction to Meta-Analysis, Chichester: Wiley.
   Google Scholar
• Bowen, W. G., Chingos, M., Lack, K. A., and Nygren, T. I. (2012), “Interactive Learning Online at Public Universities: Evidence From Randomized Trials,” Ithaka S + R, DOI: 10.18665/sr.22464.
   Google Scholar
• Bresnock, A. E., Graves, P., and White, N. E. (1989), “Multiple-Choice Testing: Question and Response Position,” The Journal of Economic Education, 20, 239–145, DOI: 10.1080/00220485.1989.10844626.
   Web of Science ®Google Scholar
• Briggs, A., Anderson, T., Gebrekristos, S., Simon, A., and Mei, A. (2019), “Evaluation of Adaptive Learning in Statistics (ALiS),” Urban Institute, available at https://www.urban.org/research/publication/evaluation-adaptive-learning-statistics-alis.
   Google Scholar
• Brown, M. J., and Tallon, J. (2015), “The Effects of Pre-Lecture Quizzes on Test Anxiety and Performance in a Statistics Course,” Education, 135, 346–350.
   Google Scholar
• Burgoyne, S., and Eaton, J. (2018), “The Partially Flipped Classroom: The Effects of Flipping a Module on ‘Junk Science’ in a Large Methods Course,” Teaching of Psychology, 45, 154–157, DOI: 10.1177/0098628318762894.
   Web of Science ®Google Scholar
• Chen, K. S., Monrouxe, L., Lu, Y., Jenq, C., Chang, Y., Chang, Y., and Chai, P. (2018), “Academic Outcomes of Flipped Classroom Learning: A Meta-Analysis,” Medical Education, 52, 910–924, DOI: 10.1111/medu.13616.
   PubMed Web of Science ®Google Scholar
• Cheng, L., Ritzhaupt, A. D., and Antonenko, P. (2019), “Effects of the Flipped Classroom Instructional Strategy on Students’ Learning Outcomes: A Meta-Analysis,” Educational Technology Research and Development, 67, 793–824, DOI: 10.1007/s11423-018-9633-7.
   Web of Science ®Google Scholar
• Chiou, C., Wang, Y., and Lee, L. (2014), “Reducing Statistics Anxiety and Enhancing Statistics Learning Achievement: Effectiveness of a One-Minute Strategy,” Psychological Reports, 115, 297–310, DOI: 10.2466/11.04.PR0.115c12z3.
   PubMed Web of Science ®Google Scholar
• *Cilli-Turner, E. (2015), “Measuring Learning Outcomes and Attitudes in a Flipped Introductory Statistics Course,” PRIMUS, 25, 833–846, DOI: 10.1080/10511970.2015.1046004.
   Google Scholar
• Conger, A. J. (1974), “A Revised Definition for Suppressor Variables: A Guide to Their Identification and Interpretation,” Educational and Psychological Measurement, 34, 35–46, DOI: 10.1177/001316447403400105.
   Web of Science ®Google Scholar
• Dove, A. (2013), “Students Perceptions of Learning in a Flipped Statistics Class,” in Proceedings of the Society for Information Technology & Teacher Education International Conference 2013, eds. R. McBride and M. Searson, Chesapeake, VA: AACE, pp. 393–398.
   Google Scholar
• Duval, S. J., and Tweedie, R. L. (2000), “Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis,” Biometrics, 56, 455–463, DOI: 10.1111/j.0006-341x.2000.00455.x.
   PubMed Web of Science ®Google Scholar
• Emmioglu, E., and Capa-Aydin, Y. (2012), “Attitudes and Achievement in Statistics: A Meta-Analysis Study,” Statistics Education Research Journal, 11, 95–102.
   Google Scholar
• Fulton, K. (2012), “Upside Down and Inside Out: Flip Your Classroom to Improve Student Learning,” Learning & Leading With Technology, 39, 12–17.
   Google Scholar
• Gillette, C., Rudolph, M., Kimble, C., Rockich-Winston, N., Smith, L., and Broedel-Zaugg, K. (2018), “A Meta-Analysis of Outcomes Comparing Flipped Classroom and Lecture,” American Journal of Pharmaceutical Education, 82, 6898–6440. DOI: 10.5688/ajpe6898.
   PubMed Web of Science ®Google Scholar
• Goldstein, H., Lackey, K. C., and Schneider, N. J. B. (2014), “A New Framework for Systematic Reviews: Application to Social Skills Interventions for Preschoolers With Autism,” Exceptional Children, 80, 262–286, DOI: 10.1177/0014402914522423.
   Web of Science ®Google Scholar
• *Gundlach, E. K., Richards, A. R., Nelson, D., and Levesque-Bristol, C. (2015), “A Comparison of Student Attitudes, Statistical Reasoning, Performance, and Perceptions for Web-Augmented Traditional, Fully Online, and Flipped Sections of a Statistical Literacy Class,” Journal of Statistics Education, 23, 1–33, DOI: 10.1080/10691898.2015.11889723.
   Web of Science ®Google Scholar
• Hedges, L. V., and Olkin, I. (1985), Statistical Methods for Meta-Analysis, San Diego, CA: Academic Press.
   Google Scholar
• *Heuett, W. J. (2017), “Flipping the Math Classroom for Non-Math Majors to Enrich Their Learning Experience,” PRIMUS, 27, 889–907, DOI: 10.1080/10511970.2016.1256925.
   Google Scholar
• Hew, K. F., and Lo, C. K. (2018), “Flipped Classroom Improves Student Learning in Health Professions Education: A Meta-Analysis,” BMC Medical Education, 18, 1–12, DOI: 10.1186/s12909-018-1144-z.
   PubMedGoogle Scholar
• Higgins, J. P. T., and Green, S., eds. (2011), “Guide to the Contents of a Cochrane Protocol and Review,” in The Cochrane Handbook for Systematic Reviews of Interventions, Chichester: Wiley-Blackwell.
   Google Scholar
• Hogg, R. V. (1991), “Statistical Education: Improvements Are Badly Needed,” The American Statistician, 45, 342–343, DOI: 10.1080/00031305.1991.10475832.
   Web of Science ®Google Scholar
• Hudak, M. A., and Anderson, D. E. (1990), “Formal Operations and Learning Style Predict Success in Statistics and Computer Science Courses,” Teaching in Psychology, 17, 231–234, DOI: 10.1207/s15328023top1704_4.
   Web of Science ®Google Scholar
• Hussey, H. D., Richmond, A. S., and Fleck, B. (2015), “A Primer for Creating a Flipped Psychology Course,” Psychology Learning & Teaching, 14, 169–185, DOI: 10.1177/1475725715592830.
   Google Scholar
• Israel, H., and Richter, R. R. (2011), “A Guide to Understanding Meta-Analysis,” The Journal of Orthopaedic and Sports Physical Therapy, 41, 496–504, DOI: 10.2519/jospt.2011.3333.
   PubMed Web of Science ®Google Scholar
• Jensen, J. L., Kummer, T. A., and Godoy, P. D. M. (2015), “Improvements From a Flipped Classroom May Simply Be the Fruits of Active Learning,” CBE—Life Sciences Education, 14, ar5,DOI: 10.1187/cbe.14-08-0129.
   PubMed Web of Science ®Google Scholar
• Karaca, C., and Ocak, M. A. (2017), “Effect of Flipped Learning on Cognitive Load: A Higher Education Research,” Journal of Learning and Teaching in Digital Age, 2, 20–27, DOI: 10.15345/iojes.2017.02.017.
   Google Scholar
• *Khan, R. N., and Watson, R. (2018), “The Flipped Classroom With Tutor Support: An Experience in a Level One Statistics Unit,” Journal of University Teaching & Learning Practice, 15, 1–19.
   Web of Science ®Google Scholar
• King, A. (1993), “From Sage on the Stage to Guide on the Side,” College Teaching, 41, 30–35. DOI: 10.1080/87567555.1993.9926781.
   Google Scholar
• Kraut, G. L. (2015), “Inverting an Introductory Statistics Classroom,” PRIMUS, 25, 683–693, DOI: 10.1080/10511970.2015.1045574.
   Google Scholar
• Kuiper, S. R., Carver, R. H., Posner, M. A., and Everson, M. G. (2015), “Four Perspectives on Flipping the Statistics Classroom: Changing Pedagogy to Enhance Student-Centered Learning,” PRIMUS, 25, 655–682, DOI: 10.1080/10511970.2015.1045573.
   Google Scholar
• Låg, T., and Saele, R. G. (2019), “Does the Flipped Classroom Improve Student Learning and Satisfaction? A Systematic Review and Meta-Analysis,” AERA Open, 5, 233285841987048. DOI: 10.1177/2332858419870489.
   Web of Science ®Google Scholar
• Lape, N. K., Levy, R., Yong, D. H., Haushalter, K. A., Eddy, R., and Hankel, N. (2014), “Probing the Inverted Classroom: A Controlled Study of Teaching and Learning Outcomes in Undergraduate Engineering and Mathematics,” in Proceedings of 121st ASEE Annual Conference & Exhibition: 360 Degrees of Engineering Education, Indianapolis (Paper ID #9475), Washington, DC: American Society for Engineering Education.
   Google Scholar
• *Maldonado, A. D., and Morales, M. (2019), “Modelling Dependency Structures Produced by the Introduction of a Flipped Classroom,” Mathematics, 8, 19–13, DOI: 10.3390/math8010019.
   Web of Science ®Google Scholar
• Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G, and PRISMA Group (2009), “Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement,” PLOS ONE, 6, 1–6, DOI: 10.1371/journal.pmed.1000097.
   Google Scholar
• *Nielsen, P. L., Bean, N. W., and Larsen, R. A. (2018), “The Impact of a Flipped Classroom Model of Learning on a Large Undergraduate Statistics Class,” Statistics Education Research Journal, 17, 121–140.
   Google Scholar
• Niemi, H. (2002), “Active Learning—A Cultural Change Needed in Teacher Education and Schools,” Teaching and Teacher Education, 18, 763–780, DOI: 10.1016/S0742-051X(02)00042-2.
   Web of Science ®Google Scholar
• Onwuegbuzie, A. J., and Wilson, V. A. (2003), “Statistics Anxiety: Nature, Etiology, Antecedents, Effects, and Treatments—A Comprehensive Review of the Literature,” Teaching in Higher Education, 8, 195–209, 52447. DOI: 10.1080/13562510320000.
   Google Scholar
• *Peterson, D. J. (2016), “The Flipped Classroom Improves Student Achievement and Course Satisfaction in a Statistics Course: A Quasi-Experimental Study,” Teaching of Psychology, 43, 10–15, DOI: 10.1177/00986283156200637.
   Web of Science ®Google Scholar
• R Core Team (2017), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing, available at https://www.R-project.org/.
   Google Scholar
• *Reyneke, F., Fletcher, L., and Harding, A. (2018), “The Effect of Technology-Based Interventions on the Performance of First Year University Statistics Students,” African Journal of Research in Mathematics, Science and Technology Education, 22, 231–242, DOI: 10.1080/18117295.2018.1477557.
   Web of Science ®Google Scholar
• Riley, R. D., Higgins, J. P., and Deeks, J. J. (2011), “Interpretation of Random Effects Meta-Analyses,” British Medical Journal, 342, d549,DOI: 10.1136/bmj.d549.
   PubMed Web of Science ®Google Scholar
• Rosenthal, R., and Fode, K. L. (2007), “The Effect of Experimenter Bias on the Performance of the Albino Rat,” Behavioral Science, 8, 183–189, DOI: 10.1002/bs.3830080302.
   Google Scholar
• Shi, L., and Lin, L. (2019), “The Trim-and-Fill Method for Publication Bias: Practical Guidelines and Recommendations Based on a Large Database of Meta-Analyses,” Medicine, 98, e15987, DOI: 10.1097/MD.00000000000015987.
   PubMed Web of Science ®Google Scholar
• *Shinaberger, L. (2017), “Components of a Flipped Classroom Influencing Student Success in an Undergraduate Business Statistics Course,” Journal of Statistics Education, 25, 122–130, DOI: 10.1080/10691898.2017.1381056.
   Web of Science ®Google Scholar
• Slootmaeckers, K., Kerremans, B., and Adriaensen, J. (2014), “Too Afraid to Learn: Attitudes Towards Statistics as a Barrier to Learning Statistics and to Acquiring Quantitative Skills,” Politics, 34, 191–200, DOI: 10.1111/1467-9256.12042.
   Web of Science ®Google Scholar
• Terrin, N., Schmid, C. H., Lau, J., and Olkin, I. (2003), “Adjusting for Publication Bias in the Presence of Heterogeneity,” Statistics in Medicine, 22, 2113–2126, DOI: 10.1002/sim.1461.
   PubMed Web of Science ®Google Scholar
• van Alten, D. C. D., Phielix, C., Janssen, J., and Kester, L. (2019), “Effects of Flipping the Classroom on Learning Outcomes and Satisfaction: A Meta-Analysis,” Educational Research Review, 28, 100281, DOI: 10.1016/j.edurev.2019.05.003.
   Web of Science ®Google Scholar
• Vaughan, M. (2014), “Flipping the Learning: An Investigation Into the Use of the Flipped Classroom Model in an Introductory Teaching Course,” Education Research and Perspectives, 41, 25–41.
   Google Scholar
• Stone, B. B. (2012), “Flip Your Classroom to Increase Active Learning and Student Engagement,” in Proceedings From 28th Annual Conference on Distance Teaching & Learning, Madison, WI, USA.
   Google Scholar
• Strayer, J. F. (2012), “How Learning in an Inverted Classroom Influences Cooperation, Innovation and Task Orientation,” Learning Environments Research, 15, 171–193, DOI: 10.1007/s10984-012-9108-4.
   Google Scholar
• Van den Bergh, L., Ros, A., and Beijaard, D. (2014), “Improving Teacher Feedback During Active Learning: Effects of a Professional Development Program,” American Educational Research Journal, 51, 772–809, DOI: 10.3102/0002831214531322.
   Web of Science ®Google Scholar
• van der Meij, H., and Dunkel, P. (2020), “Effects of a Review Video and Practice in Video-Based Statistics Training,” Computers & Education, 143, 103665–103614, DOI: 10.1016/j.compedu.2019.103665.
   Web of Science ®Google Scholar
• Viechtbauer, W. (2010), “Conducting Meta-Analyses in R With the metafor Package,” Journal of Statistical Software, 36, 1–48, DOI: 10.18637/jss.v036.i03.
   Web of Science ®Google Scholar
• Waples, J. A. (2016), “Building Emotional Rapport With Students in Statistics Courses,” Scholarship of Teaching and Learning in Psychology, 2, 285–293, DOI: 10.1037/stl0000071.
   Google Scholar
• Williams, M. L., Waldauer, C., and Duggal, V. G. (1992), “Gender Differences in Economic Knowledge: An Extension of the Analysis,” The Journal of Economic Education, 23, 219–231, DOI: 10.1080/00220485.1992.10844756.
   Web of Science ®Google Scholar
• *Wilson, S. G. (2013), “The Flipped Class: A Method to Address the Challenges of an Undergraduate Statistics Course,” Teaching of Psychology, 40, 193–199, DOI: 10.1177/0098628313487461.
   Web of Science ®Google Scholar
• Winquist, J. R., and Carlson, K. A. (2014), “Flipped Statistics Class Results: Better Performance Than Lecture Over One Year Later,” Journal of Statistics Education, 22, 1–10, DOI: 10.1080/10691898.2014.11889717.
   Google Scholar