Preliminary evidence for a Tool to Observe the Construction of Knowledge in Interprofessional teams (TOCK–IP)

References

• Berg, J. A., Ely, G. E., Espinoza, K., Everhart, D., Neff, D. F., Pastor, D. K., … Salyer, J. (2019). State of the science: A synthesis of interprofessional collaborative practice research [White Paper]. National Academies of Practice. https://nap.memberclicks.net/assets/docs/NAP%20State%20of%20the%20Science%20-%20Final%20for%20publication.pdf
   Google Scholar
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
   Google Scholar
• Chan, T. M., Sebok-Syer, S. S., Sampson, C., & Monteiro, S. (2020). The quality of assessment of learning (Qual) score: Validity evidence for a scoring system aimed at rating short, workplace-based comments on trainee performance. Teaching and Learning in Medicine, 32(3), 319–329. https://doi.org/10.1080/10401334.2019.1708365
   PubMed Web of Science ®Google Scholar
• Charters, E. (2003). The use of think-aloud methods in qualitative research an introduction to think-aloud methods. Brock Education Journal, 12(2), 68–82. https://doi.org/10.26522/brocked.v12i2.38
   Google Scholar
• Chi, M. T. H., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. https://doi.org/10.1080/00461520.2014.965823
   Web of Science ®Google Scholar
• Cook, D. A., & Beckman, T. J. (2006). Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine, 119(2), 166–e7. https://doi.org/10.1016/j.amjmed.2005.10.036
   PubMedGoogle Scholar
• Curran, V., Hollett, A., Casimiro, L. M., McCarthy, P., Banfield, V., Hall, P., Lackie, K., Oandasan, I., Simmons, B., & Wagner, S. (2011). Development and validation of the interprofessional collaborator assessment rubric ((ICAR)). Journal of Interprofessional Care, 25(5), 339–344. https://doi.org/10.3109/13561820.2011.589542
   PubMed Web of Science ®Google Scholar
• De Wever, B., Van Keer, H., Schellens, T., & Valcke, M. (2010). Roles as a structuring tool in online discussion groups: The differential impact of different roles on social knowledge construction. Computers in Human Behavior, 26(4), 516–523. https://doi.org/10.1016/j.chb.2009.08.008
   Web of Science ®Google Scholar
• Downing, S. M. (2003). Validity: On the meaning and interpretation of assessment data. Medical Education, 37(9), 830–837. https://doi.org/10.1046/j.1365-2923.2003.01594.x
   PubMed Web of Science ®Google Scholar
• Floren, L. C., Donesky, D., Whitaker, E., Irby, D. M., Ten Cate, O., & O’Brien, B. C. (2018). Are we on the same page? Shared mental models to support clinical teamwork among health professions learners: A scoping review. Academic Medicine, 93(3), 498–509. https://doi.org/10.1097/ACM.0000000000002019
   PubMed Web of Science ®Google Scholar
• Floren, L. C., Ten Cate, O., Irby, D. M., & O’Brien, B. C. (2020). An interaction analysis model to study knowledge construction in interprofessional education: Proof of concept. Journal of Interprofessional Care, 35(5), 1–8. https://doi.org/10.1080/13561820.2020.1797653
   Google Scholar
• Frank, J. R., Snell, L. S., ten Cate, O., Holmboe, E. S., Carraccio, C., Swing, S. R., … Harris, K. A. (2010). Competency-based medical education: Theory to practice. Medical Teacher, 32(8), 638–645. https://doi.org/10.3109/0142159X.2010.501190
   PubMed Web of Science ®Google Scholar
• Gunawardena, C. N., Lowe, C. A., & Anderson, T. (1997). Analysis of a holistic online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computing Research, 17(4), 397–431. https://doi.org/10.2190/7MQV-X9UJ-C7Q3-NRAG
   Web of Science ®Google Scholar
• Havyer, R. D., Nelson, D. R., Wingo, M. T., Comfere, N. I., Halvorsen, A. J., McDonald, F. S., & Reed, D. A. (2016). Addressing the interprofessional collaboration competencies of the association of American medical colleges: A systematic review of assessment instruments in undergraduate medical education. Academic Medicine, 91(6), 865–888. https://doi.org/10.1097/ACM.0000000000001053
   PubMed Web of Science ®Google Scholar
• Higham, H., Greig, P. R., Rutherford, J., Vincent, L., Young, D., & Vincent, C. (2019). Observer-based tools for non-technical skills assessment in simulated and real clinical environments in healthcare: A systematic review. BMJ Quality & Safety, 28(8), 672–686. https://doi.org/10.1136/bmjqs-2018-008565
   PubMed Web of Science ®Google Scholar
• Kash, B. A., Cheon, O., Halzack, N. M., & Miller, T. R. (2018). Measuring team effectiveness in the health care setting: An inventory of survey tools. Health Services Insights, 11, 1–18. https://doi.org/10.1177/1178632918796230
   Web of Science ®Google Scholar
• Landis, J. R., & Koch, G. G. (1977). An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics, 33(2), 363–374. https://doi.org/10.2307/2529786
   PubMed Web of Science ®Google Scholar
• McGaghie, W. C., Butter, J., & Kaye, M. (2009). Observational assessment. In S. M. Downing & R. Yudkowsky (Eds.), Assessment in health professions education (pp. 185–215). Routledge. https://doi.org/10.4324/9780203880135
   Google Scholar
• Messick, S. (1989). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18(2), 5–11. https://doi.org/10.3102/0013189X018002005
   Google Scholar
• Moore, D. E., Jr. (2018). Assessment of learning and program evaluation in health professions education programs. New Directions for Adult and Continuing Education, 157(157), 51–64. https://doi.org/10.1002/ace.20268
   Google Scholar
• O’Keefe, M., Henderson, A., & Chick, R. (2017). Defining a set of common interprofessional learning competencies for health profession students. Medical Teacher, 39(5), 463–468. https://doi.org/10.1080/0142159X.2017.1300246
   PubMed Web of Science ®Google Scholar
• Oikawa, S., & Donkers, J. (2021). Assessment of teamwork in interprofessional education. Journal of Interprofessional Care, 1–8. https://doi.org/10.1080/13561820.2021.1908971
   Google Scholar
• Olson, A. P., Durning, S. J., Branson, C. F., Sick, B., Lane, K. P., & Rencic, J. J. (2020). Teamwork in clinical reasoning–cooperative or parallel play? Diagnosis, 7(3), 307–312. https://doi.org/10.1515/dx-2020-0020
   Web of Science ®Google Scholar
• Ong, I. L., Diño, M. J. S., Calimag, M. M. P., & Hidalgo, F. A. (2019). Development and validation of interprofessional learning assessment tool for health professionals in continuing professional development (CPD). PloS One, 14(1), e0211405. https://doi.org/10.1371/journal.pone.0211405
   PubMedGoogle Scholar
• Padilla, J. L., & Benitez, I. (2014). Validity evidence based on response processes. Psicothema, 26(1), 136–144. https://doi.org/10.7334/psicothema2013.259
   PubMed Web of Science ®Google Scholar
• Quinlan, E. (2009). The ‘actualities’ of knowledge work: An institutional ethnography of multi‐disciplinary primary health care teams. Sociology of Health & Illness, 31(5), 625–641. https://doi.org/10.1111/j.1467-9566.2009.01167.x
   PubMed Web of Science ®Google Scholar
• Rogers, G. D., Thistlethwaite, J. E., Anderson, E. S., Abrandt Dahlgren, M., Grymonpre, R. E., Moran, M., & Samarasekera, D. D. (2017). International consensus statement on the assessment of interprofessional learning outcomes. Medical Teacher, 39(4), 347–359. https://doi.org/10.1080/0142159X.2017.1270441
   PubMed Web of Science ®Google Scholar
• Rosen, M. A., Salas, E., Wilson, K. A., King, H. B., Salisbury, M., Augenstein, J. S., Robinson, D. W., & Birnbach, D. J. (2008). Measuring team performance in simulation-based training: Adopting best practices for healthcare. Simulation in Healthcare, 3(1), 33–41. https://doi.org/10.1097/SIH.0b013e3181626276
   PubMedGoogle Scholar
• Shrader, S., Farland, M. Z., Danielson, J., Sicat, B., & Umland, E. M. (2017). A systematic review of assessment tools measuring interprofessional education outcomes relevant to pharmacy education. American Journal of Pharmaceutical Education, 81(6), 119. https://doi.org/10.5688/ajpe816119
   PubMed Web of Science ®Google Scholar
• Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. (2007). Using multivariate statistics (5th ed., pp. 481–498). Pearson.
   Google Scholar
• Thistlethwaite, J., Dallest, K., Moran, M., Dunston, R., Roberts, C., Eley, D., Bogossian, F., Forman, D., Bainbridge, L., Drynan, D., & Fyfe, S. (2016). Introducing the individual Teamwork Observation and Feedback Tool (iTOFT): Development and description of a new interprofessional teamwork measure. Journal of Interprofessional Care, 30(4), 526–528. https://doi.org/10.3109/13561820.2016.1169262
   PubMed Web of Science ®Google Scholar
• Thistlethwaite, J. E., Forman, D., Matthews, L. R., Rogers, G. D., Steketee, C., & Yassine, T. (2014). Competencies and frameworks in interprofessional education: A comparative analysis. Academic Medicine, 89(6), 869–875. https://doi.org/10.1097/ACM.0000000000000249
   PubMed Web of Science ®Google Scholar
• van der Vleuten, C. P. (2016). A programmatic approach to assessment. Medical Science Educator, 26(1), 9–10. https://doi.org/10.1007/s40670-016-0343-7
   Google Scholar
• Wetzel, E., Böhnke, J. R., & Brown, A. (2016). Response biases. In F. T. L. Leong & D. Iliescu (Eds.), The ITC international handbook of testing and assessment (pp. 349–363). Oxford University Press. https://doi.org/10.1093/med:psych/9780199356942.003.0024
   Google Scholar
• World Health Organization. (2010). Framework for action on interprofessional education and collaborative practice (No. WHO/HRH/HPN/10.3). WHO.
   Google Scholar