Technology-enabled assessment of health professions education: Consensus statement and recommendations from the Ottawa 2010 conference

References

• Bradley P. The history of simulation in medical education and possible future directions. Med Educ 2006; 40(3)254–262
   PubMed Web of Science ®Google Scholar
• Bennett RE. Using new technology to improve assessment. Educ Meas 2005; 18(3)5–12, Available from: http://www3.interscience.wiley.com/journal/119079459/abstract?CRETRY=1&SRETRY=0 (accessed 4 June 2010)
   Google Scholar
• Boulet JR, Murray D, Kras J, Woodhouse J, Mcallister J, Ziv A. Reliability and validity of a simulation-based acute care skills assessment for medical students and residents. Anesthesiol 2003; 99: 1270–1280
   PubMed Web of Science ®Google Scholar
• Boulet JR. Summative assessment in medicine: The promise of simulation for high-stakes evaluation. Acad Emerg Med 2008; 15(11)1017–1024
   PubMed Web of Science ®Google Scholar
• Boulet JR, Murray D. Simulation-based assessment in anesthesiology: Requirements for practical implementation. Anesthesiol 2010; 112(4)1041–1052
   PubMed Web of Science ®Google Scholar
• Bradley P, Bligh J. Clinical skills centres: Where are we going?. Med Educ 2005; 39(7)649–650
   PubMedGoogle Scholar
• California HealthCare Foundation 2010. How smart phone is changing health care for consumers and providers. Available from http://www.chcf.org/publications/2010/04/how-smartphones-are-changing-health-care-for-consumers-and-providers (accessed 23 June 2010)
   Google Scholar
• Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 2006; 119: 166.e7–e16
   PubMedGoogle Scholar
• Dev P, Youngblood P, Heinrichs WL, Kusumoto L. Virtual worlds and team training. Anesthesiol Clin 2007; 25: 321–336
   PubMedGoogle Scholar
• Dillon GF, Boulet JR, Hawkins RE, Swanson DB. Simulation in the United States medical licensing examination™ (USMLE™). Qual Saf Health Care 2004; 13: 41–45
   PubMedGoogle Scholar
• Downing SM, Haladyna TM. Validity threats: Overcoming interference with proposed interpretations of assessment data. Med Educ 2004; 38: 327–333
   PubMed Web of Science ®Google Scholar
• Economist 2010. Wireless health care when your carpet calls your doctor. 8 April 2010. New York. Available from: http://www.economist.com/business-finance/displaystory.cfm?story_id=15868133&source=hptextfeature (accessed 10 April 2010)
   Google Scholar
• Ellaway RH, Kneebone R, Lachapelle K, Topps D. Practica continua: Connecting and combining simulation modalities for integrated teaching, learning and assessment. Med Teach 2009; 31(8)725–731
   PubMed Web of Science ®Google Scholar
• Ellaway R, Martin R. What's mine is yours – open source as a new paradigm for sustainable healthcare education. Med Teach 2008; 30(2)175–179
   PubMed Web of Science ®Google Scholar
• Ellaway R, Masters K. AMEE Guide 32: e-learning in medical education Part 1: Learning, teaching and assessment. Med Teach 2008; 30(5)455–473
   PubMed Web of Science ®Google Scholar
• Epstein RM, Hundert EM. Defining and assessing clinical competence. JAMA 2002; 387: 226–235
   Google Scholar
• Errichetti A, Boulet JR. Comparing traditional and computer-based training methods for standardized patients. Acad Med 2006; 81(10)S91–S94
   PubMedGoogle Scholar
• Fischer M, Kopp V, Holzer M, Ruderich F, Jünger J. A modified electronic key feature examination for undergraduate medical students: Validation threats and opportunities. Med Teach 2005; 27(5)450–455
   PubMed Web of Science ®Google Scholar
• Fried MP, Satava R, Weghorst S, Gallagher A, Sasaki C, Ross D, Sinanan M, Uribe J, Zeltsan M, Arora H, et al. Identifying and reducing errors with surgical simulation. Qual Saf Health Care 2004; 13: 19–26
   PubMed Web of Science ®Google Scholar
• Galvagno SM, Segal BS. Critical action procedures testing: A novel method for test enhanced learning. Med Educ 2009; 43: 1182–1187
   PubMedGoogle Scholar
• Gesundheit N, Brutlag P, Youngblood P, Gunning WT, Zary N, Fors U. The use of virtual patients to assess the clinical skills and reasoning of medical students: Initial insights on student acceptance. Med Teach 2009; 31(8)739–742
   PubMed Web of Science ®Google Scholar
• Gordon JA, Wilkerson WM, Shaffer DW, Armstrong EG. Practicing medicine without risk: Students’ and educators’ responses to high-fidelity patient simulation. Acad Med 2001; 76(5)469–472
   PubMed Web of Science ®Google Scholar
• Graham G. The internet: A philosophical inquiry. Routledge, LondonUK 1999
   Google Scholar
• Greenhalgh T. Computer assisted learning in undergraduate medical education. BMJ 2001; 322: 40–44
   PubMed Web of Science ®Google Scholar
• Hersh W. Relevance and retrieval evaluation: Perspectives from medicine. J Am Soc Inform Sci 1994; 45(3)201–206
   Google Scholar
• Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, Waugh RA, Brown DD, Safford RR, Gessner IH, et al. Simulation technology for health care professional skills training and assessment. JAMA 1999; 282: 861–866
   PubMed Web of Science ®Google Scholar
• Issenberg SB, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Med Teach 2005; 27(1)10–28
   PubMed Web of Science ®Google Scholar
• Kneebone RL. Practice, rehearsal, and performance: An approach for simulation-based surgical and procedure training. JAMA 2009a; 302: 1336–1388
   PubMedGoogle Scholar
• Kneebone R. Perspective: Simulation and transformational change: The paradox of expertise. Acad Med 2009b; 84(7)954–957
   PubMed Web of Science ®Google Scholar
• Kneebone R, Arora S, King D, Bello F, Sevdalis N, Kassab E, Aggarwal R, Darzi A, Nestel D. Distributed simulation – accessible immersive training. Med Teach 2010; 32: 65–70
   PubMed Web of Science ®Google Scholar
• Kneebone R, Kidd J, Nestel D, Asvall S, Paraskeva P, Darzi A. An innovative model for teaching and learning clinical procedures. Med Educ 2002; 36: 628–634
   PubMed Web of Science ®Google Scholar
• Kress G. Multimodality: A social semiotic approach to contemporary communication. Routledge, LondonUK 2010
   Google Scholar
• Larsen PD, Butler A, Roediger III HL. Repeated testing improves long-term retention relative to repeated study: A randomised controlled trial. Med Educ 2009; 43: 1174–1181
   PubMed Web of Science ®Google Scholar
• Margolis MB, Clauser BE, Harik P. Scoring the computer-based case simulation component of USMLE Step 3: A comparison of preoperational and operational data. Acad Med 2004; 79: S62–S64
   PubMedGoogle Scholar
• Norcini JJ, McKinley DW. Assessment methods in medical education. Teach Teach Educ 2007; 23: 239–250
   Web of Science ®Google Scholar
• Norcini JJ, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, Galbraith R, Hays R, Kent A, Perrott V. Criteria of good assessment Consensus statement and recommendations from the Ottawa 2010 Conference 2010 Conference. Med Teach 2011; 33(3)206–214
   PubMed Web of Science ®Google Scholar
• Reiser SJ. Technological medicine: The changing world of doctors and patients. Cambridge University Press, New York 2009
   Google Scholar
• Reznick RK, MacRea H. Teaching surgical skills – changes in the wind. N Engl J Med 2006; 355: 2664–2669
   PubMed Web of Science ®Google Scholar
• Round J, Conradi E, Poulton T. Improving assessment with virtual patients. Med Teach 2009; 31(8)759–763
   PubMed Web of Science ®Google Scholar
• Scalese RJ, Obeso VT, Issenberg SB. Simulation technology for skills training and competency assessment in medical education. J Gen Intern Med 2007; 23(Suppl 1)46–49
   Google Scholar
• Scarborough H, Corbett JM. Technology and organization: Power, meaning and design. Routledge, LondonUK 1992
   Google Scholar
• Schuwirth LWT, van der Vleuten CPM, De Kock CA, Peperkamp AGW, Donkers HHLM. Computerized case-based testing: A modern method to assess clinical decision making. Med Teach 1996; 18(4)294–299
   Web of Science ®Google Scholar
• Shachak A, Hadas-Dayagi M, Ziv A, Reis S. Primary care physicians’ use of an electronic medical record system: A cognitive task analysis. J Gen Intern Med 2009; 24(3)341–348
   PubMed Web of Science ®Google Scholar
• Shavit I, Keidan I, Hoffmann Y, Mishuk L, Rubin O, Ziv A, Steiner I. Enhancing patient safety during pediatric sedation: The impact of simulation-based training of non-anesthesiologists. Arch Pediatr Adolesc Med 2007; 161(8)740–743
   PubMedGoogle Scholar
• Sica GT, Barron DM, Blum R, Frenna TH, Raemer DB. Computerized realistic simulation: A teaching module for crisis management in radiology. AJR Am J Roentqenol 1999; 172: 301–304
   PubMed Web of Science ®Google Scholar
• Tekian A, McGuire CH, McGaghie WC, 1999. Innovative simulations for assessing professional competence: From paper-and-pencil to virtual reality. Chicago. Dept of Medical Education, University of Illinois at Chicago. Chicago, USA
   Google Scholar
• Wiggins G. Assessing student performance exploring the purpose and limits of testing. Jossey-Bass, San Francisco, USA 1993
   Google Scholar
• Wong SH, Ng KF, Chen PP. The application of clinical simulation in crisis management Training. Hong Kong Med J 2002; 8: 131–135
   PubMedGoogle Scholar
• Ziv A, Wolpe PR, Small SD, Glick S. Simulation-based medical education: An ethical imperative. Acad Med 2003; 78: 783–788
   PubMed Web of Science ®Google Scholar