Effect of quiz format on student performance and answer-changing behaviour on formative assessments

References

• Azzi, A., C. Ramnanan, J. Smith, E. Dionne, and A. Jalali. 2015. “To Quiz or Not to Quiz: Formative Tests Help Detect Student Risk of Failing the Clinical Anatomy Course.” Anatomical Sciences Education 8 (5): 413–420. doi:10.1002/ase.1488.
   PubMed Web of Science ®Google Scholar
• Bauer, D., V. Kopp, and M. R. Fischer. 2007. “Answer Changing in Multiple Choice Assessment Change that Answer When in Doubt – And Spread the Word!” BMC Medical Education 7: 28. doi:10.1186/1472-6920-7-28.
   PubMedGoogle Scholar
• Beatty, I. D., W. J. Gerace, W. J. Leonar, and R. J. Dufresne. 2006. “Designing Effective Questions for Classroom Response System Teaching.” American Journal of Physics 74 (1): 31–39. doi:10.1119/1.2121753.
   Web of Science ®Google Scholar
• Benjamin, L. T., Jr., T. A. Cavell, and W. R. Shallenberger III. 1984. “Staying with Initial Answers on Objective Tests: Is It a Myth?” Teaching of Psychology 11 (3): 133–141. doi:10.1177/009862838401100303.
   Web of Science ®Google Scholar
• Biggs, J. B., and C. S. Tang. 2007. Teaching for Quality Learning at University: What the Student Does. 3rd ed. Buckingham: SRHE and Open University Press.
   Google Scholar
• Black, P., C. Harrison, C. Lee, B. Marshall, and D. Wiliam. 2004. “Working inside the Black Box: Assessment for Learning in the Classroom.” Phi Delta Kappan 86 (1): 8–21. doi:10.1177/003172170408600105.
   Web of Science ®Google Scholar
• Black, P., and D. Wiliam. 1998. “Inside the Black Box: Raising Standards through Classroom Assessment.” Phi Delta Kappan 80 (2): 139–144,146–148. doi:10.1177/003172171009200119.
   Web of Science ®Google Scholar
• Blasco-Arcas, L., I. Buil, B. Hernandez-Ortega, and F. J. Sese. 2013. “Using Clickers in Class. The Role of Interactivity, Active Collaborative Learning and Engagement in Learning Performance.” Computers & Education 62: 102–110. doi:10.1016/j.compedu.2012.10.019.
   Web of Science ®Google Scholar
• Boevé, A. J., R. R. Meijer, C. J. Albers, Y. Beetsma, and R. J. Bosker. 2015. “Introducing Computer-based Testing in High-stakes Exams in Higher Education: Results of a Field Experiment.” Plos One 10 (12). doi:10.1371/journal.pone.0143616.
   PubMed Web of Science ®Google Scholar
• Brookhart, S. M. 2001. “Successful Students’ Formative and Summative Uses of Assessment Information.” Assessment in Education: Principles, Policy & Practice 8 (2): 153–169. doi:10.1080/09695940123775.
   Google Scholar
• Caldwell, J. E. 2007. “Clickers in the Large Classroom: Current Research and Best-practice Tips.” CBE—Life Sciences Education 6 (1): 9–20. doi:10.1187/cbe.06-12-0205.
   PubMedGoogle Scholar
• Caldwell, J. E., J. Zelkowski, and M. Butler. 2006. “Using Personal Response Systems in the Classroom.” WVU Technology Symposium, Morgantown, WV, 11 April. Presented at. www.math.wvu.edu/∼mbutler/CompAndTechSymp.pdf.
   Google Scholar
• Carrillo-de-la-Pena, M. T., E. Bailles, X. Caseras, A. Martinez, G. Ortet, and J. Perez. 2009. “Formative Assessments and Academic Achievement in Pre-graduate Students of Health Sciences.” Advances in Health Sciences Education 14 (1): 61–67. doi:10.1007/s10459-007-9086-y.
   PubMed Web of Science ®Google Scholar
• Chun, M. M. 2011. “Visual Working Memory as Visual Attention Sustained Internally over Time.” Neuropsychologia 49 (6): 1407–1409. doi:10.1016/j.neuropsychologia.2011.01.029.
   PubMed Web of Science ®Google Scholar
• Clariana, R., and P. Wallace. 2002. “Paper–Based versus Computer–Based Assessment: Key Factors Associated with the Test Mode Effect.” British Journal of Educational Technology 33 (5): 593–602. doi:10.1111/1467-8535.00294.
   Web of Science ®Google Scholar
• Clinton, B. D., and J. M. Kohlmeyer III. 2005. “The Effects of Group Quizzes on Performance and Motivation to Learn: Two Experiments in Cooperative Learning.” Journal of Accounting Education 23 (2): 96–116. doi:10.1016/j.jaccedu.2005.06.001.
   Google Scholar
• Conole, G., and B. Warburton. 2005. “A Review of Computer-assisted Assessment.” Research in Learning Technology 13 (1): 17. doi:10.1080/0968776042000339772.
   Google Scholar
• Cooper, E. 2009. “Overloading on Slides: Cognitive Load Theory and Microsoft’s Slide Program PowerPoint.” Association for the Advancement of Computing in Education Journal 17 (2): 127–135.
   Google Scholar
• Couchman, J. J., N. E. Miller, S. J. Zmuda, K. Feather, and T. Schwartzmeyer. 2016. “The Instinct Fallacy: The Metacognition of Answering and Revising during College Exams.” Metacognition and Learning 11 (2): 171–185. doi:10.1007/s11409-015-9140-8.
   Web of Science ®Google Scholar
• Deutsch, T., K. Herrmann, T. Frese, and H. Sandholzer. 2012. “Implementing Computer-based assessment–A Web-based Mock Examination Changes Attitudes.” Computers & Education 58 (4): 1068–1075. doi:10.1016/j.compedu.2011.11.013.
   Web of Science ®Google Scholar
• Elmore, R. F. 2002. Bridging The Gap between Standards and Achievement: The Imperative for Professional Development in Education. Washington, DC: Albert Shanker Institute.
   Google Scholar
• Evans, D. J., P. Zeun, and R. A. Stainer. 2014. “Motivating Student Learning Using a Formative Assessment Journey.” Journal of Anatomy 224 (3): 296–303. doi:10.1111/joa.12117.
   PubMed Web of Science ®Google Scholar
• Flavell, J. 1979. “Metacognition and Cognitive Monitoring: A New Area of Cognitive-developmental Inquiry.” American Psychologist 34 (10): 906–911. doi:10.1037/0003-066X.34.10.906.
   Web of Science ®Google Scholar
• Franklin, S., M. Peat, and A. Lewis. 2003. “Non-traditional Interventions to Stimulate Discussion: The Use of Games and Puzzles.” Journal of Biological Education 37 (2): 79–84. doi:10.1080/00219266.2003.9655856.
   Web of Science ®Google Scholar
• George, T. P., M. A. Muller, and J. D. Bartz. 2016. “A Mixed-methods Study of Prelicensure Nursing Students Changing Answers on Multiple Choice Examinations.” Journal of Nursing Education 55 (4): 220–223. doi:10.3928/01484834-20160316-07.
   PubMed Web of Science ®Google Scholar
• Heinze, A., and M. Erhard. 2006. “How Much Time Do Students Have to Think about Teacher Questions? an Investigation of the Quick Succession of Teacher Questions and Student Responses in the German Mathematics Classroom.” ZDM Mathematics Education 38 (5): 388–398. doi:10.1007/BF02652800.
   Google Scholar
• Holmes, N. 2018. “Engaging with Assessment: Increasing Student Engagement through Continuous Assessment.” Active Learning in Higher Education 19 (1): 23–34. doi:10.1177/1469787417723230.
   Web of Science ®Google Scholar
• Hubbard, J., M. Potts, and B. Couch. 2017. “How Question Types Reveal Student Thinking: An Experimental Comparison of Multiple-true-false and Free-response Formats.” CBE-Life Sciences Education 16 (2): 1–13. doi:10.1187/cbe.16-12-0339.
   Web of Science ®Google Scholar
• Hudson, J. N., and D. R. Bristow. 2006. “Formative Assessment Can Be Fun as Well as Educational.” Advances in Physiology Education 30 (1): 33–37. doi:10.1152/advan.00040.2005.
   PubMed Web of Science ®Google Scholar
• Kane, C. J., E. R. Burns, P. S. O’Sullivan, T. J. Hart, J. R. Thomas, and I. A. Pearsall. 2007. “Design, Implementation, and Evaluation of the Transition from Paper and Pencil to Computer Assessment in the Medical Microscopic Anatomy Curriculum.” Medical Science Educator 17: 38–44.
   Google Scholar
• Kwak, S. G., and J. H. Kim. 2017. “Central Limit Theorem: The Cornerstone of Modern Statistics.” Korean Journal of Anesthesiology 70 (2): 144. doi:10.4097/kjae.2017.70.2.144.
   PubMed Web of Science ®Google Scholar
• Lee, G., and P. Weerakoon. 2001. “The Role of Computer-aided Assessment in Health Professional Education: A Comparison of Student Performance in Computer-based and Paper-and-pen Multiple-choice Tests.” Medical Teacher 23 (2): 152–157. doi:10.1080/01421590020031066.
   PubMed Web of Science ®Google Scholar
• Mayer, R. E., and R. Moreno. 2003. “Nine Ways to Reduce Cognitive Load in Multimedia Learning.” Educational Psychologist 38 (1): 43–52. doi:10.1207/S15326985EP3801_6.
   Web of Science ®Google Scholar
• McConnell, M. M., G. Regehr, T. J. Wood, and K. W. Eva. 2012. “Self-monitoring and Its Relationship to Medical Knowledge.” Advances in Health Sciences Education 17 (3): 311–323. doi:10.1007/s10459-011-9305-4.
   PubMed Web of Science ®Google Scholar
• Nikou, S., and A. A. Economides. 2013. “Student Achievement in Paper, computer/web and Mobile Based Assessment.” Paper presented at the 6th Balkan Conference on Informatics, BCI-2013, Thessaloniki, September.
   Google Scholar
• Ogilvie, R., T. C. Trusk, and A. V. Blue. 1999. “Students’ Attitudes Towards Computer Testing in a Basic Science Course.” Medical Education 33: 828–831. doi:10.1046/j.1365-2923.1999.00517.x.
   PubMed Web of Science ®Google Scholar
• Pellegrino, J. W., N. Chudowsky, and R. Glaser. 2001. Knowing What Students Know: The Science and Design of Educational Assessment. Washington, DC: National Academies Press.
   Google Scholar
• Poljicanin, A., A. Caric, K. Vilovic, V. Kosta, M. M. Guic, J. Aljinovic, and I. Grkovic. 2009. “Daily Mini Quizzes as Means for Improving Student Performance in Anatomy Course.” Croatian Medical Journal 50: 55–60. doi:10.3325/cmj.2009.50.55.
   PubMed Web of Science ®Google Scholar
• Pratten, M., D. Merrick, and S. A. Burr. 2013. “Group in Course-assessment Promotes Cooperative Learning and Increases Performance.” Anatomical Sciences Education 7 (3): 224–233. doi:10.1002/ase.1397.
   PubMed Web of Science ®Google Scholar
• Preckel, F., and H. Thieman. 2003. “Online-versus Paper-pencil Version of a High Potential Intelligence Test.” Swiss Journal of Psychology 62: 132–138. doi:10.1024//1421-0185.62.2.131.
   Web of Science ®Google Scholar
• Qiao, Y. Q., J. Shen, X. Liang, S. Ding, F. Y. Chen, L. Shao, Q. Zheng, and Z. H. Ran. 2014. “Using Cognitive Theory to Facilitate Medical Education.” BMC Medical Education 14: 79. doi:10.1186/1472-6920-14-79.
   PubMed Web of Science ®Google Scholar
• Rickman, J., and M. Grudzinski. 2000. “Student Expectations of Information Technology Use in the Classroom.” Educause Quarterly 23 (1): 24–30.
   Google Scholar
• Rinaldi, V. D., N. A. Lorr, and K. Williams. 2017. “Evaluating a Technology Supported Interactive Response System during the Laboratory Section of a Histology Course.” Anatomical Sciences Education 10 (4): 328–338. doi:10.1002/ase.1667.
   PubMed Web of Science ®Google Scholar
• Schwarz, S. P., R. F. McMorris, and L. P. DeMers. 1991. “Reasons for Changing Answers: An Evaluation Using Personal Interviews.” Journal of Educational Measurement 28 (2): 163–171. doi:10.1111/jedm.1991.28.issue-2.
   Web of Science ®Google Scholar
• Seaman, M. A. 1998. “Developing Visual Displays for Lecture-based Courses.” Teaching of Psychology 25 (2): 141–145. doi:10.1207/s15328023top2502_19.
   Web of Science ®Google Scholar
• Shapiro, A. M., J. Sims-Knight, G. V. O’Rielly, P. Capaldo, T. Pedlow, L. Gordon, and K. Monteiro. 2017. “Clickers Can Promote Fact Retention but Impede Conceptual Understanding: The Effect of the Interaction between Clicker Use and Pedagogy on Learning.” Computers & Education 111: 44–59. doi:10.1016/j.compedu.2017.03.017.
   Web of Science ®Google Scholar
• Struyven, K., F. Dochy, and S. Janssens. 2003. “Students’ Perceptions about New Modes of Assessment in Higher Education: A Review.” Assessment & Evaluation in Higher Education 3 (4): 171–223.
   Google Scholar
• Sweller, J. 2010. “Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load.” Educational Psychology Review 22 (2): 123–138. doi:10.1007/s10648-010-9128-5.
   Web of Science ®Google Scholar
• Travis, S. L., J. B. Mattingley, and P. E. Dux. 2013. “On the Role of Working Memory in Spatial Contextual Cueing.” Journal of Experimental Psychology: Learning, Memory, and Cognition 39 (1): 208–219. doi:10.1037/a0028644.
   PubMed Web of Science ®Google Scholar
• Trumbull, E., and A. Lash. 2013. Understanding Formative Assessment: Insights from Learning Theory and Measurement Theory. San Francisco: WestEd.
   Google Scholar
• Waddell, D. L., and J. C. Blankenship. 1994. “Answer Changing: A Meta-analysis of the Prevalence and Patterns.” Journal of Continuing Education in Nursing 25 (4): 155–158.
   PubMedGoogle Scholar
• Weston-Green, K., and M. Wallace. 2016. “A Method of Providing Engaging Formative Feedback to Large Cohort First-year Physiology and Anatomy Students.” Advances in Physiology Education 40 (3): 393–397. doi:10.1152/advan.00174.2015.
   PubMed Web of Science ®Google Scholar
• Wiliam, D. 2011. “What Is Assessment for Learning?” Studies in Educational Evaluation 37: 3–14. doi:10.1016/j.stueduc.2011.03.001.
   Google Scholar