Test-enhanced learning in health professions education: A systematic review: BEME Guide No. 48

References

• Adesope OO, Trevisan DA, Sundararajan N. 2017. Rethinking the use of tests: a meta-analysis of practice testing. Rev Educ Res. 87:659–701.
   Web of Science ®Google Scholar
• Agarwal PK, Bain PM, Chamberlain RW. 2012. The value of applied research: retrieval practice improves classroom learning and recommendations from a Teacher, a Principal, and a Scientist. Educ Psychol Rev. 24:437–448.
   Web of Science ®Google Scholar
• Agarwal PK, Karpicke JD, Kang SHK, Roediger HL, McDermott KB. 2008. Examining the testing effect with open- and closed-book tests. Appl Cognit Psychol. 22:861–876.
   Web of Science ®Google Scholar
• Ali SH, Ruit KG. 2014. Psychometrics and test-enhanced learning in a patient-centered learning curriculum. Ann Arbor: The University of North Dakota.
   Google Scholar
• Augustin M. 2014. How to learn effectively in medical school: test yourself, learn actively, and repeat in intervals. Yale J Biol Med. 87:207–212.
   PubMedGoogle Scholar
• Baghdady M, Carnahan H, Lam EW, Woods NN. 2014. Test-enhanced learning and its effect on comprehension and diagnostic accuracy. Med Educ. 48:181–188.
   PubMed Web of Science ®Google Scholar
• Bangert-Drowns RL, Kulik C-LC, Kulik JA, Morgan M. 1991. The instructional effect of feedback in test-like events. Rev Educ Res. 61:213–238.
   Web of Science ®Google Scholar
• Beckman TJ, Cook DA, Mandrekar JN. 2005. What is the validity evidence for assessments of clinical teaching? J Gen Intern Med. 20:1159–1164.
   PubMed Web of Science ®Google Scholar
• Blunt JR, Karpicke JD. 2014. Learning with retrieval-based concept mapping. J Educ Psychol. 106:849–858.
   Web of Science ®Google Scholar
• Brame CJ, Biel R. 2015. Test-enhanced learning: the potential for testing to promote greater learning in undergraduate science courses. CBE-Life Sci Educ. 14:es4.
   PubMed Web of Science ®Google Scholar
• Butler AC, Karpicke JD, Roediger HL. 2007. The effect of type and timing of feedback on learning from multiple-choice tests. J Exp Psychol Appl. 13:273–281.
   PubMed Web of Science ®Google Scholar
• Butler AC, Karpicke JD, Roediger HL, III. 2008. Correcting a metacognitive error: feedback increases retention of low-confidence correct responses. J Exp Psychol Learn Mem Cogn. 34:918–928.
   PubMed Web of Science ®Google Scholar
• Butler AC, Marsh EJ, Goode MK, Roediger HL, III. 2006. When additional multiple-choice lures aid versus hinder later memory. Appl Cognit Psychol. 20:941–956.
   Web of Science ®Google Scholar
• Butler AC, Roediger HL, III. 2008. Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Mem Cogn. 36:604–616.
   PubMed Web of Science ®Google Scholar
• Cepeda NJ, Pashler H, Vul E, Wixted JT, Rohrer D. 2006. Distributed practice in verbal recall tasks: a review and quantitative synthesis. Psychol Bull. 132:354–380.
   PubMed Web of Science ®Google Scholar
• Chamberland M, Mamede S, St-Onge C, Setrakian J, Bergeron L, Schmidt H. 2015. Self-explanation in learning clinical reasoning: the added value of examples and prompts. Med Educ. 49:193–202.
   PubMed Web of Science ®Google Scholar
• Chen HY, Chuang CH. 2012. The learning effectiveness of nursing students using online testing as an assistant tool: a cluster randomized controlled trial. Nurs Educ Today. 32:208–213.
   PubMed Web of Science ®Google Scholar
• Cook DA, Beckman TJ. 2006. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 119:166.e7–166.e16.
   PubMedGoogle Scholar
• Cook DA, Reed DA. 2015. Appraising the quality of medical education research methods: the medical education research study quality instrument and the Newcastle-Ottawa Scale-Education. Acad Med. 90:1067–1076.
   PubMed Web of Science ®Google Scholar
• Cook DA, Thompson WG, Thomas KG. 2014. Test-enhanced web-based learning: optimizing the number of questions (a randomized crossover trial). Acad Med. 89:169–175.
   PubMed Web of Science ®Google Scholar
• DelSignore LA, Wolbrink TA, Zurakowski D, Burns JP. 2016. Test-enhanced e-learning strategies in postgraduate medical education: a randomized cohort study. J Med Internet Res. 18:e299.
   PubMed Web of Science ®Google Scholar
• Dobson J, Linderholm T. 2015. Self-testing promotes superior retention of anatomy and physiology information. Adv Health Sci Educ. 20:149–161.
   PubMed Web of Science ®Google Scholar
• Dobson JL, Linderholm T, Yarbrough MB. 2015. Self-testing produces superior recall of both familiar and unfamiliar muscle information. Adv Physiol Educ. 39:309–314.
   PubMed Web of Science ®Google Scholar
• Eisenkraemer RE, Jaeger A, Stein LM. 2013. A systematic review of the testing effect in learning. Paidéia (Ribeirão Preto). 23:397–406.
   Google Scholar
• Fitch ML, Drucker AJ, Norton JA, Jr. 1951. Frequent testing as a motivating factor in large lecture classes. J Educ Psychol. 42:1–20.
   Google Scholar
• Friedlander MJ, Andrews L, Armstrong EG, Aschenbrenner C, Kass JS, Ogden P, Schwartzstein R, Viggiano TR. 2011. What can medical education learn from the neurobiology of learning? Acad Med. 86:415–420.
   PubMed Web of Science ®Google Scholar
• Grossetta-Nardini HK, Wang L. 2017. The Yale MeSH Analyzer; [accessed 2017 April]. http://mesh.med.yale.edu/.
   Google Scholar
• Higgins JPT, Green S, editors. 2011. Cochrane handbook for systematic reviews of interventions version 5.1 [Data extraction for continuous outcomes]. London: The Cochrane Collaboration. Available from http://handbook.cochrane.org/.
   Google Scholar
• Hojat M, Xu G. 2004. A visitor's guide to effect sizes – statistical significance versus practical (clinical) importance of research findings. Adv Health Sci Educ. 9:241–249.
   PubMed Web of Science ®Google Scholar
• Hrynchak P, Glover Takahashi S, Nayer M. 2014. Key-feature questions for assessment of clinical reasoning: a literature review. Med Educ. 48:870–883.
   PubMed Web of Science ®Google Scholar
• Joint Committee on Standards for Educational and Psychological Testing of the American Educational Research Association; the American Psychological Association; and the National Council on Measurement in Education. 1999. Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• Karpicke J, Grimaldi P. 2012. Retrieval-based learning: a perspective for enhancing meaningful learning. Educ Psychol Rev. 24:401–418.
   Web of Science ®Google Scholar
• Karpicke JD, Butler AC, Roediger HL, III. 2009. Metacognitive strategies in student learning: do students practise retrieval when they study on their own? Memory. 17:471–479.
   PubMed Web of Science ®Google Scholar
• Karpicke JD, Roediger HL. 2008. The critical importance of retrieval for learning. Science. 319:966–968.
   PubMed Web of Science ®Google Scholar
• Karpicke JD, Roediger HL, III. 2007. Expanding retrieval practice promotes short-term retention, but equally spaced retrieval enhances long-term retention. J Exp Psychol Learn Mem Cogn. 33:704–719.
   PubMed Web of Science ®Google Scholar
• Kreiter CD, Green J, Lenoch S, Saiki T. 2013. The overall impact of testing on medical student learning: quantitative estimation of consequential validity. Adv Health Sci Educ. 18:835–844.
   PubMed Web of Science ®Google Scholar
• Kromann CB, Bohnstedt C, Jensen ML, Ringsted C. 2010. The testing effect on skills learning might last 6 months. Adv Health Sci Educ. 15:395–401.
   PubMed Web of Science ®Google Scholar
• Kromann CB, Jensen ML, Ringsted C. 2009. The effect of testing on skills learning. Med Educ. 43:21–27.
   PubMed Web of Science ®Google Scholar
• Landauer T, Bjork R. 1978. Optimum rehearsal patterns and name learning. In: Gruneburg M, Morris P, Sykes R, editors. Practical aspects of memory. London: Academic Press. p. 625–632.
   Google Scholar
• Larsen DP, Butler AC, Aung WY, Corboy JR, Friedman DI, Sperling MR. 2015. The effects of test-enhanced learning on long-term retention in AAN annual meeting courses. Neurology. 84:748–754.
   PubMed Web of Science ®Google Scholar
• Larsen DP, Butler AC, Lawson AL, Roediger HL. 2013a. The importance of seeing the patient: test-enhanced learning with standardized patients and written tests improves clinical application of knowledge. Adv Health Sci Educ. 18:409–425.
   PubMed Web of Science ®Google Scholar
• Larsen DP, Butler AC, Roediger HL,III. 2009. Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial. Med Educ. 43:1174–1181.
   PubMed Web of Science ®Google Scholar
• Larsen DP, Butler AC, Roediger HL. 2013b. Comparative effects of test-enhanced learning and self-explanation on long-term retention. Med Educ. 47:674–682.
   PubMed Web of Science ®Google Scholar
• Larsen DP, Butler AC, Roediger HL, III. 2008. Test-enhanced learning in medical education. Med Educ. 42:959–966.
   PubMed Web of Science ®Google Scholar
• Leppink J, O’Sullivan P, Winston K. 2016. Effect size - large, medium, and small. Perspect Med Educ. 5:347–349.
   PubMedGoogle Scholar
• McConnell MM, Azzam K, Xenodemetropoulos T, Panju A. 2015a. Effectiveness of Test-enhanced learning in continuing health sciences education: a randomized controlled trial. J Contin Educ Health Prof. 35:119–122.
   PubMed Web of Science ®Google Scholar
• McConnell MM, St-Onge C, Young ME. 2015b. The benefits of testing for learning on later performance. Adv Health Sci Educ. 20:305–320.
   PubMed Web of Science ®Google Scholar
• McDaniel MA, Anderson JL, Derbish MH, Morrisette N. 2007a. Testing the testing effect in the classroom. Eur J Cogn Psychol. 19:494–513.
   Web of Science ®Google Scholar
• McDaniel MA, Roediger HL, McDermott KB. 2007b. Generalizing test-enhanced learning from the laboratory to the classroom. Psychon Bull Rev. 14:200–206.
   PubMed Web of Science ®Google Scholar
• Messineo L, Gentile M, Allegra M. 2015. Test-enhanced learning: analysis of an experience with undergraduate nursing students approaches to teaching and learning. BMC Med Educ. 15:182.
   PubMed Web of Science ®Google Scholar
• Newble DI, Jaeger K. 1983. The effect of assessments and examinations on the learning of medical students. Med Educ. 17:165–171.
   PubMed Web of Science ®Google Scholar
• Oglesby R. 2013. Examining nursing students' retention of taught content by repeat study and repeat testing: a replicated study (D.N.P.), Gardner-Webb University. http://search.ebscohost.com/login.aspx?direct=true&db=c8h&AN=109863261&site=ehost-live&scope=site.
   Google Scholar
• Page G, Bordage G, Allen T. 1995. Developing key-feature problems and examinations to assess clinical decision-making skills. Acad Med. 70:194–201.
   PubMed Web of Science ®Google Scholar
• Pyc MA, Rawson KA. 2009. Testing the retrieval effort hypothesis: does greater difficulty correctly recalling information lead to higher levels of memory? J Mem Lang. 60:437–447.
   Web of Science ®Google Scholar
• Raupach T, Andresen JC, Meyer K, Strobel L, Koziolek M, Jung W, Brown J, Anders S. 2016. Test-enhanced learning of clinical reasoning: a crossover randomised trial. Med Educ. 50:711–720.
   PubMed Web of Science ®Google Scholar
• Reed DA, Beckman TJ, Wright SM, Levine RB, Kern DE, Cook DA. 2008. Predictive validity evidence for medical education research study quality instrument scores: quality of submissions to JGIM's Medical Education Special Issue. J Gen Intern Med. 23:903–907.
   PubMed Web of Science ®Google Scholar
• Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. 2007. Association between funding and quality of published medical education research. JAMA. 298:1002–1009.
   PubMed Web of Science ®Google Scholar
• Roediger HL, Agarwal PK, McDaniel MA, McDermott KB. 2011. Test-enhanced learning in the classroom: long-term improvements from quizzing. J Exp Psychol Appl. 17:382–395.
   PubMed Web of Science ®Google Scholar
• Roediger HL, Butler AC. 2011. The critical role of retrieval practice in long-term retention. Trends Cogn Sci. 15:20–27.
   PubMed Web of Science ®Google Scholar
• Roediger HL, III, Karpicke JD. 2006. Test-enhanced learning: taking memory tests improves long-term retention. Psychol Sci. 17:249–255.
   PubMed Web of Science ®Google Scholar
• Rowland CA. 2014. The effect of testing versus restudy on retention: a meta-analytic review of the testing effect. Psychol Bull. 140:1432–1463.
   PubMed Web of Science ®Google Scholar
• Schmidmaier R, Ebersbach R, Schiller M, Hege I, Holzer M, Fischer MR. 2011. Using electronic flashcards to promote learning in medical students: retesting versus restudying. Med Educ. 45:1101–1110.
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, Van der Vleuten CPM. 2011. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 33:478–485.
   PubMed Web of Science ®Google Scholar
• Wheeler MA, Roediger HL. 1992. Disparate effects of repeated testing: reconciling Ballard's (1913) and Bartlett's (1932) results. Psychol Sci. 3:240–245.
   Web of Science ®Google Scholar
• Yeh DD, Park YS. 2015. Improving learning efficiency of factual knowledge in medical education. J Surg Educ. 72:882–889.
   PubMed Web of Science ®Google Scholar