Twelve tips for clinicians dealing with uncertainty when assessing learners

References

• Arborelius E, Bremberg S, Timpka T. 1991. What is going on when the general practitioner doesn't grasp the situation? Fam Pract. 8:3–9.
   PubMed Web of Science ®Google Scholar
• Auger KA, Kahn RS, Davis MM, Beck AF, Simmons JM. 2013. Medical home quality and readmission risk for children hospitalized with asthma exacerbations. Pediatrics. 131:64–70.
   PubMed Web of Science ®Google Scholar
• Bodenheimer T, Lorig K, Holman H, Grumbach K. 2002. Patient Self-management of Chronic Disease in Primary Care. JAMA. 288:2469–2475.
   PubMed Web of Science ®Google Scholar
• Boud D. 2007. Reframing assessment as if learning was important. In: Boud, D. & Falchikov, N., editors. Rethinking assessment for higher education: learning for the longer term. London: Routledge; p. 14–25.
   Google Scholar
• Boud D. 2015. Feedback: ensuring that it leads to enhanced learning. Clin Teach. 12:3–7.
   PubMed Web of Science ®Google Scholar
• Bush HM, Schreiber RS, Oliver SJ. 2013. Failing to fail: clinicians' experience of assessing underperforming dental students. Eur J Dent Educ. 17:198–207.
   PubMed Web of Science ®Google Scholar
• Carless D. 2013. Trust and its role in facilitating dialogic feedback. In: Boud D, Molloy E ,editors. Feedback in higher and professional education. London: Routledge; p. 90–103.
   Google Scholar
• Cleland JA, Knight LV, Rees CE, Tracey S, Bond CM. 2008. Is it me or is it them? Factors that influence the passing of underperforming students. Med Educ. 42:800–809.
   PubMed Web of Science ®Google Scholar
• Dudek NL, Marks MB, Regehr G. 2005. Failure to fail: the perspectives of clinical supervisors. Acad Med. 80:S84–S87.
   PubMed Web of Science ®Google Scholar
• Eva KW. 2009. Assessment strategies in medical education. New York (NY): Nova Science Publishers.
   Google Scholar
• Eva KW, Armson H, Holmboe E, Lockyer J, Loney E, Mann K, Sargeant J. 2012. Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processes. Adv in Health Sci Educ. 17:15–26.
   PubMed Web of Science ®Google Scholar
• Eva KW, Neville AJ, Norman GR. 1998. Exploring the etiology of content specificity: factors influencing analogic transfer and problem solving. Acad Med. 73:S1–S5.
   PubMed Web of Science ®Google Scholar
• Eva KW, Solomon P, Neville AJ, Ladouceur M, Kaufman K, Walsh A, Norman GR. 2007. Using a sampling strategy to address psychometric challenges in tutorial-based assessments. Adv Health Sci Educ Theory Pract. 12:19–33.
   PubMed Web of Science ®Google Scholar
• Frank JR, Snell L, Sherbino J. 2015. CanMEDS 2015 Physician Competency Framework. Ottawa: Royal College of Physicians and Surgeons of Canada.
   Google Scholar
• Gerrity MS, DeVellis RF, Earp JA. 1990. Physicians' reactions to uncertainty in patient care. A new measure and new insights. Med Care. 28:724–736.
   PubMed Web of Science ®Google Scholar
• Gerrity MS, DeVellis RF, Light DW. 1992. Uncertainty and Professional Work: Perceptions of Physicians in Clinical Practice. Am J Soc. 97:1022–1051.
   Web of Science ®Google Scholar
• Gingerich A, Regehr G, Eva KW. 2011. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 86:S1–S7.
   PubMed Web of Science ®Google Scholar
• Grande I, Berk M, Birmaher B, Vieta E. 2016. Bipolar disorder. Lancet. 387:1561–1572.
   PubMed Web of Science ®Google Scholar
• Ha JF, Longnecker N. 2010. Doctor-patient communication: a review. Ochsner J. 10:38–43.
   PubMedGoogle Scholar
• Hernandez AF, Greiner MA, Fonarow GC, Hammill BG, Heidenreich PA, Yancy CW, Peterson ED, Curtis LH. 2010. Relationship between early physician follow-up and 30-day readmission among Medicare beneficiaries hospitalized for heart failure. JAMA. 303:1716–1722.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Sherbino J, Englander R, Snell L, Frank JR. 2017. A call to action: The controversy of and rationale for competency-based medical education. Med Teach. 39:574–581.
   PubMed Web of Science ®Google Scholar
• Hu WC, Thistlethwaite JE, Weller J, Gallego G, Monteith J, McColl GJ. 2015. 'It was serendipity': a qualitative study of academic careers in medical education. Med Educ. 49:1124–1136.
   PubMed Web of Science ®Google Scholar
• Hughes P, Kerr I. 2000. Transference and countertransference in communication between doctor and patient. Adv Psychiatr Treat. 6:57–64.
   Google Scholar
• Ilgen JS, Eva KW, Regehr G. 2016. What's in a Label? Is Diagnosis the Start or the End of Clinical Reasoning? J Gen Intern Med. 31:435–437.
   PubMed Web of Science ®Google Scholar
• Institute of Medicine. 1989. Assessment of diagnostic technology in health care: rationale, methods, problems, and directions. Washington, DC: The National Academies Press.
   Google Scholar
• Institute of Medicine. 2008. Retooling for an aging America: building the health care workforce. Washington (DC): The National Academies Press.
   Google Scholar
• Institute of Medicine. 2013. Delivering high-quality cancer care: charting a new course for a system in crisis. Washington (DC): The National Academies Press.
   Google Scholar
• Jackson C, Shahsahebi M, Wedlake T, DuBard CA. 2015. Timeliness of Outpatient Follow-up: An Evidence-Based Approach for Planning After Hospital Discharge. Ann Fam Med. 13:115–122.
   PubMed Web of Science ®Google Scholar
• Larsen DP, Butler AC, Roediger HL. 2008. Test-enhanced learning in medical education. Med Educ. 42:959–966.
   PubMed Web of Science ®Google Scholar
• Larsen DP, Dornan T. 2013. Quizzes and conversations: Exploring the role of retrieval in medical education. Med Educ. 47:1236–1241.
   PubMed Web of Science ®Google Scholar
• Lessing JN, Mathias PC, Pierce RG. 2016. A tincture of time—latent crystal formation and clinical decision-making in acute gout: A teachable moment. JAMA Intern Med. 176:165–166.
   PubMed Web of Science ®Google Scholar
• Mann R, Williams J. 2003. Standards in medical record keeping. Clin Med (Lond). 3:329–332.
   PubMed Web of Science ®Google Scholar
• Merriam-Webster. [accessed 2018 Apr 13]. https://www.merriam-webster.com/dictionary/uncertain.
   Google Scholar
• Moroz A, Horlick M, Mandalaywala N, Stern DT. 2018. Faculty feedback that begins with resident self-assessment: motivation is the key to success. Med Educ. 52:314–323.
   PubMed Web of Science ®Google Scholar
• Muus KJ, Knudson A, Klug MG, Gokun J, Sarrazin M, Kaboli P. 2010. Effect of post-discharge follow-up care on re-admissions among US veterans with congestive heart failure: a rural-urban comparison. Rural Remote Health. 10:1447.
   PubMed Web of Science ®Google Scholar
• National Academies of Sciences, Engineering, and Medicine. 2015. Improving diagnosis in health care. Washington (DC): The National Academies Press.
   Google Scholar
• Nicol DJ, Macfarlane‐Dick D. 2006. Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice. Stud High Educ. 31:199–218.
   Web of Science ®Google Scholar
• Norman G, Eva K. 2010. Diagnostic error and clinical reasoning. Med Educ. 44:94–100.
   PubMed Web of Science ®Google Scholar
• Norman G, Davis DA, Lamb S, Hanna E, Caulford P, Kaigas T. 1993. Competency assessment of primary care physicians as part of a peer review program. JAMA. 270:1046–1051.
   PubMed Web of Science ®Google Scholar
• O'Riordan M, Dahinden A, Aktürk Z, Ortiz JMB, Dağdeviren N, Elwyn G, Micallef A, Murtonen M, Samuelson M, Struk P, et al. 2011. Dealing with uncertainty in general practice: an essential skill for the general practitioner. Qual Prim Care. 19:175–181.
   PubMedGoogle Scholar
• Pell GF, R, Homer M, Roberts T. 2012. Is short-term remediation after OSCE failure sustained? A retrospective analysis of the longitudinal attainment of underperforming students in OSCE assessments. Med Teach. 34:146–150.
   PubMed Web of Science ®Google Scholar
• Politi MC, Street RL. Jr. 2011. The importance of communication in collaborative decision making: facilitating shared mind and the management of uncertainty. J Eval Clin Pract. 17:579–584.
   PubMed Web of Science ®Google Scholar
• Rowe AD. 2017. Feelings about Feedback: the role of emotions in assessment for learning. In: Carless D., Bridges S., Chan C., Glofcheski R., editors. Scaling up assessment for learning in higher education: the enabling power of assessment. Vol. 5. Singapore: Springer.
   Google Scholar
• Rudland J, Wilkinson T, Wearn A, Nicol P, Tunny T, Owen C, O'Keefe M. 2013. A student-centred feedback model for educators. Clin Teach. 10:99–102.
   PubMedGoogle Scholar
• Ryan J, Kang S, Dolacky S, Ingrassia J, Ganeshan R. 2013. Change in readmissions and follow-up visits as part of a heart failure readmission quality improvement initiative. Am J Med. 126:989–994.
   PubMed Web of Science ®Google Scholar
• Schor R, Pilpel D, Benbassat J. 2000. Tolerance of uncertainty of medical students and practicing physicians. Med Care. 38:272–280.
   PubMed Web of Science ®Google Scholar
• Simpkin AL, Schwartzstein RM. 2016. Tolerating Uncertainty - The Next Medical Revolution? N Engl J Med. 375:1713–1715.
   PubMed Web of Science ®Google Scholar
• Steinert Y, Macdonald ME. 2015. Why physicians teach: giving back by paying it forward. Med Educ. 49:773–782.
   PubMed Web of Science ®Google Scholar
• Stewart M, Brown JB, Weston WW, McWhinney IR, McWilliam CL, Freeman TR. 2014. Patient-centered medicine: transforming the clinical method. 3rd ed. London: Radcliffe.
   Google Scholar
• Telio S, Regehr G, Ajjawi R. 2016. Feedback and the educational alliance: examining credibility judgements and their consequences. Med Educ. 50:933–942.
   PubMed Web of Science ®Google Scholar
• van der Vleuten CPM, Schuwirth LWT, Driessen EW, Govaerts MJB, Heeneman S. 2015. Twelve Tips for programmatic assessment. Med Teach. 37:641–646.
   PubMed Web of Science ®Google Scholar
• Rosser WW, Slawson DC, Shaughnessy AF. 2004. Information mastery: evidence-based family medicine. 2nd ed. Hamilton, Ontario: BC Decker Inc.
   Google Scholar
• Waska R. 2011. Moments of uncertainty in therapeutic practice: interpreting within the matrix of projective identification, countertransference, and enactment. Columbia University Press.
   Google Scholar
• Wearne S. 2016. Effective feedback and the educational alliance. Med Educ. 50:891–892.
   PubMed Web of Science ®Google Scholar
• Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. 1999. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 318:527–530.
   PubMed Web of Science ®Google Scholar
• Yeates P, O’Neill P, Mann K, Eva K. 2013. Seeing the same thing differently: mechanisms that contribute to assessor differences in directly-observed performance assessments. Adv Health Sci Educ. 18:325–341.
   PubMed Web of Science ®Google Scholar
• Yepes-Rios M, Dudek N, Duboyce R, Curtis J, Allard J, Varpio L. 2016. The failure to fail underperforming trainees in health professions education: A BEME systematic review: BEME Guide No. 42. Med Teach. 38:1092–1099.
   PubMed Web of Science ®Google Scholar
• Zinn WM. 1990. Transference phenomena in medical practice: being whom the patient needs. Ann Intern Med. 113:293–298.
   PubMed Web of Science ®Google Scholar