When less is more: validating a brief scale to rate interprofessional team competencies

References

• Reeves S, Perrier L, Goldman J, et al. Interprofessional education: effects on professional practice and health care outcomes (update). Cochrane Database Syst Rev. 2013;3:CD002213. DOI:10.1002/14651858.CD002213.pub3
   Web of Science ®Google Scholar
• Zwarenstein M, Goldman J, Reeves S. Interprofessional collaboration: effects of practice-based interventions on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2009;3:CD000072. DOI:10.1002/14651858.CD000072.pub2
   PubMed Web of Science ®Google Scholar
• Wen J, Schulman KA. Can team-based care improve patient satisfaction? A systematic review of randomized controlled trials. PLoS ONE. 2014;9(7):e100603. DOI:10.1371/journal.pone.0100603
   PubMed Web of Science ®Google Scholar
• World Health Organization. Framework for action on interprofessional education & collaborative practice. 2010. [ cited 2016 Nov 10]. Available from: http://whqlibdoc.who.int/hq/2010/WHO_HRH_HPN_10.3_eng.pdf
   Google Scholar
• Royal College of Physicians and Surgeons of Canada. Interprofessional education and training in the United States: resurgence and refocus. 2011. [ cited 2016 Nov 10]. Available from: http://rcpsc.medical.org/publicpolicy/imwc/Interprofessional_Education_US_Brandt_Schmitt.PDF
   Google Scholar
• Orchard C, Bainbridge L, Bassendowski S, et al. A national interprofessional competency framework. 2010. [ cited 2016 Nov 10]. Available from: http://www.cihc.ca/files/CIHC_IPCompetencies_Feb1210.pdf.
   Google Scholar
• Association of American Medical Colleges. Core IPEC competencies. 2011. [ cited 2016 Nov 10]. Available from: https://members.aamc.org/eweb/upload/Core%20Competencies%20for%20Interprofessional%20Collaborative%20Practice_Revised.pdf
   Google Scholar
• Lutfiyya MN, Brandt BF, Cerra F. Reflections from the intersection of health professions education and clinical practice: the state of the science of interprofessional education and collaborative practice. Acad Med. 2016;91(6):766–10.
   PubMed Web of Science ®Google Scholar
• Reeves S, Zwarenstein M, Goldman J, et al. The effectiveness of interprofessional education: key findings from a new systematic review. J Interprof Care. 2010;24(3):230–241.
   PubMed Web of Science ®Google Scholar
• Zorek J, Raehl C. Interprofessional education accreditation standards in the USA: a comparative analysis. J Interprof Care. 2013;27(2):123–130.
   PubMed Web of Science ®Google Scholar
• Havyer RD, Nelson DR, Wingo MT, et al. Addressing the interprofessional collaboration competencies of the association of American medical colleges: a systematic review of assessment instruments in undergraduate medical education. Acad Med. 2016;91(6):865–888.
   PubMed Web of Science ®Google Scholar
• Kirkpatrick DI. Evaluating training programs: the four levels. San Francisco (CA): Berrett-Koehler; 1994.
   Google Scholar
• Hean S, Craddock D, O’Halloran C. Learning theories and interprofessional education: a user’s guide. Learn Health Soc Care. 2009;8:250–262.
   Google Scholar
• Havyer RD, Wingo MT, Comfere NI, et al. Teamwork assessment in internal medicine: a systematic review of validity evidence and outcomes. J Gen Intern Med. 2014;29(6):894–910.
   PubMed Web of Science ®Google Scholar
• Olson R, Bialocerkowski A. Interprofessional education in allied health: a systematic review. Med Educ. 2014;48(3):236–246. DOI:10.1111/medu.12290
   PubMed Web of Science ®Google Scholar
• Shoemaker SJ, Parchman ML, Fuda KK, et al. A review of instruments to measure interprofessional team-based primary care. J Interprof Care. 2016 Jul;30(4):423–432. Epub 2016 May 21. DOI:10.3109/13561820.2016.1154023
   PubMed Web of Science ®Google Scholar
• Olupeliyawa A, Balasooriya C, Hughes C, et al. Educational impact of an assessment of medical students’ collaboration in health care teams. Med Educ. 2014;48(2):146–156.
   Web of Science ®Google Scholar
• Olupeliyawa AM, O’Sullivan AJ, Hughes C, et al. The teamwork mini-clinical evaluation exercise (T-MEX): a workplace-based assessment focusing on collaborative competencies in health care. Acad Med. 2014;89(2):359–365.
   PubMed Web of Science ®Google Scholar
• Garbee DD, Paige J, Barrier K, et al. Interprofessional teamwork among students in simulated codes: A quasi-experimental study. Nurs Educ Perspect. 2013;34(5):339–344.
   Google Scholar
• Frankel A, Gardner R, Maynard L, et al. Using the communication and teamwork skills (CATS) assessment to measure healthcare team performance. Jt Comm J Qual Patient Saf. 2007;33(9):549–558.
   Google Scholar
• Thistlethwaite J. Interprofessional education: a review of context, learning and the research agenda. Med Educ. 2012;46(1):58–70.
   PubMed Web of Science ®Google Scholar
• McMaster/Ottawa TOSCE (Team observed structured clinical encounter) Toolkit. [ cited 2016 Nov 10]. Available from: http://fhs.mcmaster.ca/tosce/en/toolkit_guidelines.html
   Google Scholar
• Solomon P, Marshall D, Boyle A, et al. Establishing face and content validity of the McMaster-Ottawa team observed clinical encounter (TOSCE). J Interprof Care. 2011;25(4):302–304.
   PubMed Web of Science ®Google Scholar
• Singleton A, Smith F, Harris T, et al. An evaluation of the team objective structured clinical examination (TOSCE). Med Educ. 1999;33(1):34–41.
   PubMed Web of Science ®Google Scholar
• Cullen L, Fraser D, Symonds I. Strategies for interprofessional education: the interprofessional team objective structured clinical examination for midwifery and medical students. Nurse Educ Today. 2003;23(6):427–433.
   PubMed Web of Science ®Google Scholar
• Marshall D, Hall P, Taniguchi A. Team OSCEs: evaluation methodology or educational encounter? Med Educ. 2008;42(11):1129–1130.
   PubMed Web of Science ®Google Scholar
• Murray-Davis B, Solomon P, Malott A, et al. A team observed structured clinical encounter (TOSCE) for pre-licensure learners in maternity care: a short report on the development of an assessment tool for collaboration. JRIPE. 2013;3(1):122–128.
   Google Scholar
• Hall P, Marshall D, Weaver L, et al. A method to enhance student teams in palliative care: piloting the McMaster-Ottawa team observed structured clinical encounter. J Palliat Med. 2011;14(6):744–750.
   PubMed Web of Science ®Google Scholar
• Lie DA, May W, Richter R, et al. Adapting the McMaster-Ottawa scale for assessing individual and team performance in a team objective structured clinical examination (TOSCE). Med Educ Online. 2015;20:26691.
   PubMed Web of Science ®Google Scholar
• Lie DA, Forest CP, Kysh L, et al. Interprofessional education and practice guide No. 5: interprofessional teaching for prequalification students in clinical settings. J Interprof Care. 2016;30(3):324–330.
   PubMed Web of Science ®Google Scholar
• Forest CP, Lie DA, Ma SB. Evaluating interprofessional team performance: a faculty rater tool. MedEdPORTAL Publications. 2016;12:10447. DOI:10.15766/mep_2374-8265.10447
   Google Scholar
• Feldman M, Lazzara EH, Vanderbilt AA, et al. Rater training to support high-stakes simulation-based assessments. J Contin Educ Health Prof. 2012;32(4):279–286.
   PubMed Web of Science ®Google Scholar
• Gorman CA, Rentsch JR. Evaluating frame-of-reference rater training effectiveness using performance schema accuracy. J Applied Psychol. 2009;94(5):1336–1344.
   PubMed Web of Science ®Google Scholar
• Crick GE, Brennan RL. GENOVA: a generalized analysis of variance system [FORTRAN IV computer program and manual]. Dorchester (MA): Computer Facilities, University of Massachusetts at Boston; 1982.
   Google Scholar
• Brennan RL. Generalizability theory. New York (NY): Springer; 2001.
   Google Scholar
• Eppich W, Nannicelli AP, Seivert NP, et al. A rater training protocol to assess team performance. J Contin Educ Health Prof. 2015;35(2):83–90.
   Web of Science ®Google Scholar
• Emmert MC, Li C. A pilot study to test the effectiveness of an innovative interprofessional education assessment strategy. J Interprof Care. 2015;29(5):451–456.
   PubMed Web of Science ®Google Scholar
• Thistlethwaite J, Dallest K, Moran M, et al. Introducing the individual teamwork observation and Feedback Tool (iTOFT): development and description of a new interprofessional teamwork measure. J Interprof Care. 2016 Jul;30(4):526–528. Epub 2016 Jun 8. DOI:10.3109/13561820.2016.1169262
   PubMed Web of Science ®Google Scholar
• West C, Veronin M, Landry K, et al. Tools to investigate how interprofessional education activities link to competencies. Med Educ. 2015;20:28627. Online.
   Web of Science ®Google Scholar
• Blue AV, Chesluk BJ, Conforti LN, et al. Assessment and evaluation in interprofessional education: exploring the field. J Allied Health. 2015;44(2):73–82.
   PubMedGoogle Scholar
• Smith-Jentsch K, Johnston J, Payne S. Measuring team-related expertise in complex environments. In: Cannon-Bowers JA, Salas E, editors. Making decisions under stress: implications for individual and team training. Washington (DC): American Psychological Association; 1998. p. 61–87.
   Google Scholar