Using longitudinal progress test data to determine the effect size of learning in undergraduate medical education – a retrospective, single-center, mixed model analysis of progress testing results

References

• Wenghofer E, Klass D, Abrahamowicz M, et al. Doctor scores on national qualifying examinations predict quality of care in future practice. Med Educ. 2009;43(12):1166–9.
   PubMed Web of Science ®Google Scholar
• Glew RH, Ripkey DR, Swanson DB. Relationship between students’ performances on the NBME Comprehensive Basic Science Examination and the USMLE Step 1: a longitudinal investigation at one school. Acad Med. 1997;72(12):1097–1102.
   Web of Science ®Google Scholar
• Cook DA. If you teach them, they will learn: why medical education needs comparative effectiveness research. Adv in Health Sci Educ. 2012;17(3):305–310.
   PubMed Web of Science ®Google Scholar
• Cook D, Erwin P, Triola M. Computerized Virtual Patients in Health Professions Education: a Systematic Review and Meta-Analysis. Acad Med. 2010;85(10):1589.
   PubMed Web of Science ®Google Scholar
• Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306(9):978–988.
   PubMed Web of Science ®Google Scholar
• Cook DA, Levinson AJ, Garside S, et al. Internet-Based Learning in the Health Professions: a Meta-analysis. JAMA. 2008;300(10):1181–1196.
   PubMed Web of Science ®Google Scholar
• McGaghie WC, Issenberg SB, Cohen ER, et al. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med. 2011;86(6):706–711.
   PubMed Web of Science ®Google Scholar
• Hattie J. Visible Learning. London: Routledge; 2008.
   Google Scholar
• Hattie J. Visible Learning for Teachers. London: Routledge; 2012.
   Google Scholar
• Bloom BS. The 2 Sigma Problem: the Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educ Researcher. 1984;13(6):4.
   Google Scholar
• Verhoeven BH, Verwijnen GM, Scherpbier AJJA. van der Vleuten CPM. Growth of medical knowledge. Med Educ. 2002;36(8):711–717.
   PubMed Web of Science ®Google Scholar
• Freeman A, van der Vleuten C, Nouns Z. Progress testing internationally. Med Teach. 2010;32(6):451–455.
   PubMed Web of Science ®Google Scholar
• Arnold L, Willoughby TL. The quarterly profile examination. Acad Med. 1990;65(8):515–516.
   PubMed Web of Science ®Google Scholar
• van der Vleuten CPM, Verwijnen GM, Wijnen WHFW. Fifteen years of experience with progress testing in a problem-based learning curriculum. Med Teach. 2009;18(2):103–109.
   Google Scholar
• Schuwirth LWT. van der Vleuten CPM. The use of progress testing. Perspect Med Educ. 2012;1(1):24–30.
   PubMedGoogle Scholar
• Wrigley W, van der Vleuten CPM, Freeman A, et al. A systemic framework for the progress test: strengths, constraints and issues: AMEE Guide No. 71. Med Teach. 2012;34(9):683–697.
   PubMed Web of Science ®Google Scholar
• Bianchi F, Stobbe K, Eva K. Comparing academic performance of medical students in distributed learning sites: the McMaster experience. Med Teach. 2008;30(1):67–71.
   PubMed Web of Science ®Google Scholar
• Van der Veken J, Valcke M, De Maeseneer J, et al. Impact on knowledge acquisition of the transition from a conventional to an integrated contextual medical curriculum. Med Educ. 2009;43(7):704–713.
   PubMed Web of Science ®Google Scholar
• Peeraer G, De Winter BY, Muijtjens AMM, et al. Evaluating the effectiveness of curriculum change. Is there a difference between graduating student outcomes from two different curricula? Med Teach. 2009;31(3):e64–e68.
   PubMed Web of Science ®Google Scholar
• Muijtjens AMM, Schuwirth LWT, Cohen-Schotanus J, et al. van der Vleuten CPM. Benchmarking by cross-institutional comparison of student achievement in a progress test. Med Educ. 2008;42(1):82–88.
   PubMed Web of Science ®Google Scholar
• Schünemann HJ, Oxman AD, Vist GE. Chapter 12: interpreting Results and Drawing Conclusions in: higgins JPT. In: Green S, editor. Cochrane Handbook for Systematic Reviews of Interventions. Chichester (UK): John Wiley & Sons; 2008:403-431
   Google Scholar
• Fischer MR, Bauer D, Mohn K. NKLM-Projektgruppe. Finally finished! National Competence Based Catalogues of Learning Objectives for Undergraduate Medical Education (NKLM) and Dental Education (NKLZ) ready for trial. GMS Zeitschrift für Medizinische Ausbildung. 2015;32(3):Doc35.
   PubMedGoogle Scholar
• Cooke M, Irby DM, Sullivan W, et al. American medical education 100 years after the Flexner report. N Engl J Med. 2006;355(13):1339–1344.
   PubMed Web of Science ®Google Scholar
• Nouns ZM, Georg W. Progress testing in German speaking countries. Med Teach. 2010;32(6):467–470.
   PubMed Web of Science ®Google Scholar
• Schauber S, Nouns ZM. Using the cumulative deviation method for cross-institutional benchmarking in the Berlin progress test. Med Teach. 2010;32(6):471–475.
   PubMed Web of Science ®Google Scholar
• Nouns Z, Hanfler S, Brauns K, et al. presented at: AMEE-Conference, 2004 Edinburgh. Do Progress Tests Predict the Outcome of National Exams.
   Google Scholar
• Lakens D. Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Front Psychol. 2013;4. DOI:https://doi.org/10.3389/fpsyg.2013.00863.
   PubMed Web of Science ®Google Scholar
• Cohen J. Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Erlbaum; 1988.
   Google Scholar
• Nouns Z, Schauber S, Witt C, et al. Development of knowledge in basic sciences: a comparison of two medical curricula. Med Educ. 2012;46(12):1206–1214.
   PubMed Web of Science ®Google Scholar
• de Bruin ABH, Schmidt HG, Rikers RMJP. The role of basic science knowledge and clinical knowledge in diagnostic reasoning: a structural equation modeling approach. Acad Med. 2005;80(8):765–773.
   PubMed Web of Science ®Google Scholar
• Raupach T, Vogel D, Schiekirka S, et al. Increase in medical knowledge during the final year of undergraduate medical education in Germany. GMS Zeitschrift für Medizinische Ausbildung. 2013;30(3):Doc33.
   Google Scholar
• Kadmon G, Resch F, Duelli R, et al. Predictive value of the school-leaving grade and prognosis of different admission groups for academic performance and continuity in the medical course - a longitudinal study. 2014 GMS Zeitschrift für Medizinische Ausbildung;31(2):Doc21.
   Google Scholar