Direct Observation of Clinical Skills Feedback Scale: Development and Validity Evidence

References

• Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Medical Teacher 2010;32:638–45.
   PubMed Web of Science ®Google Scholar
• Hodder RV, Rivington RN, Calcutt LE, Hart IR. The effectiveness of immediate feedback during the Objective Structured Clinical Exam. Medical Education 1989;23:184–8.
   PubMed Web of Science ®Google Scholar
• Wood BP. Feedback: A key feature of medical training. Radiology 2000;215:17–9.
   PubMed Web of Science ®Google Scholar
• Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB. Systematic review of the literature on assessment, feedback and physicians' clinical performance: BEME Guide No 7. Medical Teacher 2006;28:117–28.
   PubMed Web of Science ®Google Scholar
• Hattie J, Timperley H. The power of feedback. Review of Educational Research 2007;77:81–112.
   Web of Science ®Google Scholar
• Cantillon P, Sargeant J. Giving feedback in clinical settings. The British Medical Journal 2008;10:337.
   Google Scholar
• Hesketh EA, Laidlaw JM. Developing the teaching instinct: 1: feedback. Medical Teacher 2002;24:245–8.
   PubMed Web of Science ®Google Scholar
• Wolverton S, Bosworth M. A survey of resident perceptions of effective teaching behaviors. Family Medicine 1985;17:106–8.
   PubMedGoogle Scholar
• Mann K, van der Vleuten C, Eva K, Armson H, Chesluk B, Dornan T, et al. Tensions in informed self-assessment: How the desire for feedback and reticence to collect and use it can conflict. Academic Medicine 2011;86:1120–7.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Conforti LN, Bernabeo EC, Durning SJ, Hauer KE, Holboe ES. Faculty staff perceptions of feedback to residents after direct observation of clinical skills. Medical Education 2012;46:201–15.
   PubMed Web of Science ®Google Scholar
• Isaacson JH, Posk LK, Litaker DG, Halperin AK. Resident perceptions of the evaluation process. Journal of General Internal Medicine 1995;10 Suppl:89.
   PubMed Web of Science ®Google Scholar
• Gil DH, Heins M, Jones PB. Perceptions of medical-school faculty members and students on clinical clerkship feedback. The Journal of Medical Education 1984;59:856–64.
   PubMedGoogle Scholar
• De SK, Henke PK, Ailawadi G, Dimick JB, Colletti LM. Attending, house officer, and medical student perceptions about teaching in the third-year medical school general surgery clerkship. Journal of the American College of Surgeons 2004;199:932–42.
   PubMed Web of Science ®Google Scholar
• Sender-Liberman A, Liberman M, Steinert Y, McLeod P, Meterissian S. Surgery residents and attending surgeons have different perceptions of feedback. Medical Teacher 2005;27:470–2.
   PubMed Web of Science ®Google Scholar
• Jensen AR, Wright AS, Kim S, Horvath KD, Calhoun KE. Educational feedback in the operating room: A gap between resident and faculty perceptions. American Journal of Surgery 2012;204:248–55.
   PubMed Web of Science ®Google Scholar
• Yarris LM, Linden JA, Gene Hern H, Lefebvre C, Nestler DM, Fu R, et al. Attending and resident satisfaction with feedback in the emergency department. Academic emergency medicine 2009;16:S76–S81.
   PubMed Web of Science ®Google Scholar
• Brunkner H, Altkorn DL, Cook S, Quinn MT, McNabb WL. Giving effective feedback to medical students: A workshop for faculty and house staff. Medical Teacher 1999;21:161–5.
   PubMed Web of Science ®Google Scholar
• Watling CJ, Lingard L. Toward meaningful evaluation of medical trainees: The influence of participants' perceptions of the process. Advances in Health Sciences Education: Theory and Practice 2010;17:183–94.
   PubMed Web of Science ®Google Scholar
• Hewson MG, Little ML. Giving feedback in medical education. Journal of General Internal Medicine 1998;13:111–6.
   PubMed Web of Science ®Google Scholar
• Sachdeva AK. Use of effective feedback to facilitate adult learning. Journal of Cancer Education 1996;11:106–18.
   PubMedGoogle Scholar
• Meyer K. An analysis of the research on faculty development for online teaching and identification of new directions. Journal of Asynchronous Learning Network 2014;17:1–20.
   Google Scholar
• Boehler ML, Rogers DA, Schwind CJ, Mayforth R, Quin J, Williams RG, et al. An investigation of medical student reactions to feedback: A randomised controlled trial. Medical Education 2006;40:746–9.
   PubMed Web of Science ®Google Scholar
• Reiter HI, Rosenfeld J, Nandagopal K, Eva KW. Do clinical clerks provide candidates with adequate formative assessment during Objective Structured Clinical Examinations? Advances in Health Sciences Education: Theory and Practice 2004;9:189–99.
   PubMed Web of Science ®Google Scholar
• Miller A, Archer J. Impact of workplace based assessment on doctors' education and performance: a systematic review. The British Medical Journal 2010;341:c5064.
   PubMed Web of Science ®Google Scholar
• May W, Fisher D, Souder D. Development of an instrument to measure the quality of standardized/simulated patient verbal feedback. Medical Education Development 2012;2:9–12.
   Google Scholar
• Messick S. Validity. In RL Linn (Ed.), Educational measurement (3rd ed., pp. 13–104). New York: NY: American Council on Education & Macmillan, 1989.
   Google Scholar
• American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Psychological Association, 1999 Available at: http://www.apa.org/science/programs/testing/standards.aspx. Accessed July 2, 2014.
   Google Scholar
• Downing SM. Validity: On the meaningful interpretation of assessment data. Medical Education 2003;37:830–7.
   PubMed Web of Science ®Google Scholar
• Jones J, Hunter D. Consensus methods for medical and health services research. The British Medical Journal 1995;311:376–80.
   PubMed Web of Science ®Google Scholar
• Van de Ridder JM, Stokking KM, McGaghie WC, ten Cate OT. What is feedback in clinical education? Medical Education 2008;42:189–97.
   PubMed Web of Science ®Google Scholar
• Cummins RA, Gullone E. Why we should not use 5-point Likert scales: The case for subjective quality of life measurement. Proceedings of the Second International Conference on Quality of Life in Cities. Signapore: National University of Singapore, 2000.
   Google Scholar
• Krosnick JA, Pressure S. Question and questionnaire design. In PV Marsden, JD Wright (Eds.), Handbook of survey research (2nd ed., pp. 263–313). Bingley, UK: Emerald, 2010.
   Google Scholar
• Bernardin HJ, Smith PC. A clarification of some issues regarding the development and use of behaviorally anchored rating scales (BARS). Journal of Applied Psychology 1981;66:458–63.
   Web of Science ®Google Scholar
• PERD. The Program for Educational Research and Development. Available at: http://fhsperd.mcmaster.ca/g_string/index.html. Accessed June 2, 2014.
   Google Scholar
• Brennan R, GENOVA suite programs. 2003. Available at: http://www.uiowa.edu/∼casma/computer_programs.htm. Accessed June 2, 2014.
   Google Scholar
• Richardson BK. Feedback. Academic Emergency Medicine 2004;11:189–99.
   Google Scholar
• Haynes SN, Richard DC, Kubany ES. Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment 1995;7:238–47.
   Web of Science ®Google Scholar
• Downing SM, Haladyna TM. Validity. In SM Downing, R Yudkowsky (Eds.), Assessment in health professions education (pp. 21–55). New York, NY: Routledge, 2009.
   Google Scholar
• Creswell JW. Research design qualitative and quantitative approaches. Thousand Oaks, CA: Sage, 1994.
   Google Scholar
• Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine 2006;119e7–16.
   Google Scholar
• van der Vleuten CPM, Swanson DB. Assessment of clinical skills with standardized patients: State of the art. Teaching and Learning in Medicine 1990;2:58–76.
   Google Scholar
• Shute VJ. Focus on formative feedback. Review of Educational Research 2008;78:153–89.
   Web of Science ®Google Scholar
• Bing-You RG, Trowbridge RL. Why medical educators may be failing at feedback. The Journal of the American Medical Association 2009;302:1330–1.
   PubMed Web of Science ®Google Scholar
• Boud D, Malloy E. Rethinking models of feedback for learning: The challenge of design. Assessment & Evaluation in Higher Education 2012;38(6):1-15.
   Google Scholar
• Molloy E. Time to pause: Giving and receiving feedback in clinical education. In C Delany, E Molloy (Eds.) Clinical education in the health professions (pp. 128–146). Sydney, Australia: Churchill Livingston, 2009.
   Google Scholar
• Sargeant J, Armson H, Chesluk B, Dornan T, Eva K, Holmboe E, et al. The processes and dimensions of informed self-assessment: A conceptual model. Academic Medicine 2010;85:1212–20.
   PubMed Web of Science ®Google Scholar
• Eva KW, Armson H, Holmboe E, Lockyer J, Loney E, Mann K, et al. Factors influencing responsiveness to feedback: On the interplay between fear, confidence, and reasoning processes. Advances in Health Sciences Education: Theory and Practice 2012;17:15–26.
   PubMed Web of Science ®Google Scholar
• Telio S, Ajjawi R, Regehr G. The “educational alliance” as a framework for reconceptualizing feedback in medical education. Academic Medicine 2015;90:609–14.
   PubMed Web of Science ®Google Scholar