Do we always need a difference? Testing equivalence in a blended learning setting

References

• Bernard, Robert M., Eugene Borokhovski, Richard F. Schmid, Rana M. Tamim, and Philip C. Abrami. 2014. “A Meta-Analysis of Blended Learning and Technology Use in Higher Education: From the General to the Applied.” Journal of Computing in Higher Education 26 (1): 87–122. doi:10.1007/s12528-013-9077-3.
   Web of Science ®Google Scholar
• Brown, Michael Geoffrey. 2016. “Blended Instructional Practice: A Review of the Empirical Literature on Instructors’ Adoption and Use of Online Tools in Face-to-Face Teaching.” The Internet and Higher Education 31 (Supplement C): 1–10. doi:10.1016/j.iheduc.2016.05.001.
   Google Scholar
• Chen, Der-Thanq. 2003. “Uncovering the Provisos Behind Flexible Learning.” Educational Technology & Society 6 (2): 25–30.
   Web of Science ®Google Scholar
• Cohen, Jacob. 1992. “A Power Primer.” Psychological Bulletin 112 (1): 155–159. doi: 10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Cumming, Geoff. 2012. Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis. New York: Routledge.
   Google Scholar
• Dienes, Zoltan. 2014. “Using Bayes to Get the Most out of Non-Significant Results.” Frontiers in Psychology 5 (Article 781): 1–17. doi:10.3389/fpsyg.2014.00781.
   PubMedGoogle Scholar
• Dinno, Alexis. 2014. “Comment on “The Effect of Same-Sex Marriage Laws on Different-Sex Marriage: Evidence From the Netherlands”.” Demography 51 (6): 2343–2347. doi:10.1007/s13524-014-0338-1.
   PubMed Web of Science ®Google Scholar
• Dinno, Alexis. 2018. “tost: Two One-Sided Tests of Equivalence”. STATA package version 3.0.2. [Computer software]. https://www.alexisdinno.com/stata/tost.html.
   Google Scholar
• Foster, Colin. 2018. “Developing Mathematical Fluency: Comparing Exercises and Rich Tasks.” Educational Studies in Mathematics 97 (2): 121–141. doi: 10.1007/s10649-017-9788-x
   Web of Science ®Google Scholar
• Fraenkel, Jack R., Norman E. Wallen, and Helen H. Hyun. 2015. How to Design and Evaluate Research in Education. 9th ed., McGraw-Hill Education. New York: McGraw-Hill.
   Google Scholar
• Graham, Charles Ray. 2006. “Blended Learning Systems: Definition, Current Trends, and Future Directions.” In The Handbook of Blended Learning: Global Perspectives, Local Designs, edited by Curtis Jay Bonk, and Charles Ray Graham, 3–21. San Francisco: Wiley & Sons.
   Google Scholar
• Kass, Robert E, and Adrian E Raftery. 1995. “Bayes Factors.” Journal of the American Statistical Association 90 (430): 773–795. doi: 10.1080/01621459.1995.10476572
   Web of Science ®Google Scholar
• Kruschke, John K. 2013. “Bayesian Estimation Supersedes the t Test.” Journal of Experimental Psychology: General 142 (2): 573–603. doi: 10.1037/a0029146
   PubMed Web of Science ®Google Scholar
• Kruschke, John K., and Mike Meredith. 2018. “BEST: Bayesian Estimation Supersedes the t-Test”. R package version 0.5.1. [Computer software]. https://CRAN.R-project.org/package=BEST.
   Google Scholar
• Lakens, Daniël. 2017. “Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses.” Social Psychological and Personality Science 8 (4): 355–362. doi:10.1177/1948550617697177.
   PubMed Web of Science ®Google Scholar
• Lakens, Daniël. 2018. “TOSTER: Two One-Sided Tests (TOST) Equivalence Testing”. R package version 0.3.4. [Computer software]. https://CRAN.R-project.org/package=TOSTER.
   Google Scholar
• Lakens, Daniël, Anne M. Scheel, and Peder M. Isager. 2018. “Equivalence Testing for Psychological Research: A Tutorial.” Advances in Methods and Practices in Psychological Science 1 (2): 259–269. doi:10.1177/2515245918770963.
   Google Scholar
• Liao, J. G., Vishal Midya, and Arthur Berg. 2019. “Connecting Bayes factor and the Region of Practical Equivalence (ROPE) Procedure for testing interval null hypothesis.” arXiv preprint arXiv:1903.03153.
   Google Scholar
• Means, B., Y. Toyama, R. Murphy, and M. Baki. 2013. “The Effectiveness of Online and Blended Learning: A Meta-Analysis of the Empirical Literature.” Teachers College Record 115 (3): 1–47.
   Web of Science ®Google Scholar
• Meyners, Michael. 2012. “Equivalence Tests – A Review.” Food Quality and Preference 26 (2): 231–245. doi:10.1016/j.foodqual.2012.05.003.
   Web of Science ®Google Scholar
• Mildenberger, Thoralf. 2019. “equivUMP: Uniformly Most Powerful Invariant Tests of Equivalence”. R package version 0.1.1. [Computer software]. https://CRAN.R-project.org/package=equivUMP.
   Google Scholar
• Morey, Richard D, and Jeffrey N Rouder. 2011. “Bayes Factor Approaches for Testing Interval Null Hypotheses.” Psychological Methods 16 (4): 406–419. doi: 10.1037/a0024377
   PubMed Web of Science ®Google Scholar
• Morey, Richard D, and Jeffrey N Rouder. 2018. “BayesFactor: Computation of Bayes Factors for Common Designs”. R package version 0.9.12–4.2. [Computer software]. https://CRAN.R-project.org/package=BayesFactor.
   Google Scholar
• Owston, Ron, and Dennis N. York. 2018. “The Nagging Question When Designing Blended Courses: Does the Proportion of Time Devoted to Online Activities Matter?” The Internet and Higher Education 36 (Supplement C): 22–32. doi:10.1016/j.iheduc.2017.09.001.
   Google Scholar
• Rogers, James L, Kenneth I Howard, and John T Vessey. 1993. “Using Significance Tests to Evaluate Equivalence Between Two Experimental Groups.” Psychological Bulletin 113 (3): 553–565. doi: 10.1037/0033-2909.113.3.553
   PubMed Web of Science ®Google Scholar
• Schmidt, F. L., and J. E. Hunter. 1997. “Eight Common but False Objections to Discontinuation of Significance Testing in the Analysis of Research Data.” In What if There Were No Significance Tests?, edited by Lisa Lavoie Harlow, Stanley A. Mulaik, and James H. Steiger, 37–64. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Schuirmann, Donald J. 1987. “A Comparison of the Two One-Sided Tests Procedure and the Power Approach for Assessing the Equivalence of Average Bioavailability.” Journal of Pharmacokinetics and Biopharmaceutics 15 (6): 657–680. doi: 10.1007/BF01068419
   PubMedGoogle Scholar
• Tucker, Richard, and Gayle Morris. 2012. “By Design: Negotiating Flexible Learning in the Built Environment Discipline.” Research in Learning Technology 20 (1): n1. doi:10.3402/rlt.v20i0.14404 doi: 10.3402/rlt.v20i0/14404
   Google Scholar
• Vo, Hien M., Chang Zhu, and Nguyet A. Diep. 2017. “The Effect of Blended Learning on Student Performance at Course-Level in Higher Education: A Meta-Analysis.” Studies in Educational Evaluation 53 (Supplement C): 17–28. doi:10.1016/j.stueduc.2017.01.002.
   Google Scholar
• Wellek, Stefan. 2010. Testing Statistical Hypotheses of Equivalence and Noninferiority. 2nd ed. Boca Raton: CRC Press.
   Google Scholar
• Wellek, Stefan, and Peter Ziegler. 2017. “EQUIVNONINF: Testing for Equivalence and Noninferiority”. R package version 1.0. [Computer software]. https://CRAN.R-project.org/package=EQUIVNONINF.
   Google Scholar