The VOTIS, part 1: development and pilot trial of a tool to assess students’ interprofessional skill development using video-reflexive ethnography

References

• Anderson, P., Coverdale, S., Kelly, M., & Forster, S. (2018). Interprofessional simulation: Developing teamwork using a two-tiered debriefing approach. Clinical Simulation in Nursing, 20, 15–23. https://doi.org/10.1016/j.ecns.2018.04.003
   Web of Science ®Google Scholar
• Bajpai, S., Bajpai, R. C., & Chaturvedi, H. K. (2015). Evaluation of inter-rater agreement and inter-rater reliability for observational data: An overview of concepts and methods. Journal of the Indian Academy of Applied Psychology, 41(3), 20–27 https://psycnet.apa.org/record/2015-47418-003.
   Google Scholar
• Blue, A., Chesluk, B., Conforti, L., & Holmboe, E. (2015). Assessment and evaluation in interprofessional education: exploring the field. Journal of Allied Health, 44(2), 73–82 https://www.ingentaconnect.com/content/asahp/jah/2015/00000044/00000002/art00004.
   PubMedGoogle Scholar
• Brewer, M., Gribble, N., Lloyd, A., Robinson, P., & White, S. 2014. Interprofessional capability assessment tool. Curtin University Revision. Curtin University.
   Google Scholar
• Brewer, M. L., & Jones, S. (2013). An interprofessional practice capability framework focusing on safe, high quality client centred health service. Journal of Allied Health, 42(2), e45–e49.
   PubMedGoogle Scholar
• Bridges, D., Davidson, R. A., Soule Odegard, P., Maki, I. V., & Tomkowiak, J. (2011). Interprofessional collaboration: Three best practice models of interprofessional education. Medical Education Online, 16(1), 6035. https://doi.org/10.3402/meo.v16i0.6035
   PubMed Web of Science ®Google Scholar
• Briggs, S., & Cheek, J. (1986). The role of factor analysis in the development and evaluation of personality scales. Journal of Personality, 54(1), 106–148. https://doi.org/10.1111/j.1467-6494.1986.tb00391.x
   Web of Science ®Google Scholar
• Canadian Interprofessional Health Collaborative (2010). A National Interprofessional Competency Framework. University of British Columbia. http://www.cihc.ca/files/CIHC_IPCompetencies_Feb1210.pdf
   Google Scholar
• Carroll, K., Mesman, J., McLeod, H., Boughey, J., Keeney, G., & Habermann, E. (2021). Seeing what works: Identifying and enhancing successful interprofessional collaboration between pathology and surgery. Journal of Interprofessional Care 35 4 , , 490–502. https://doi.org/10.1080/13561820.2018.1536041
   PubMed Web of Science ®Google Scholar
• Centre for Advancement of Interprofessional Education. (2002). Definition of Interprofessional Education. https://www.caipe.org/about-us
   Google Scholar
• Cilliers, F., Schuwirth, L., Adendorff, H., Herman, N., & Vleuten, C. (2010). The mechanism of impact of summative assessment on medical students’ learning. Theory and Practice, 15(5), 695–715. https://doi.org/10.1007/s10459-010-9232-9
   Google Scholar
• Combined Universities Interprofessional Unit. (2009). Self-Assessment of Interprofessional Capability [Measurement instrument]. https://shuspace.shu.ac.uk/bbcswebdav/institution/HWB/IPL/Learning_Materials/2010_IP_curriculum/capability_framework_mag/index.htm
   Google Scholar
• Conigliaro, R. L., Kuperstein, J., Welsh, D., Taylor, S., Weber, D., & Jones, M. (2015). Application and student perceptions of the PEEER© Model for effective healthcare team communications. Health & Interprofessional Practice, 2(3 eP1079). https://doi.org/10.7710/2159-1253.1079
   Google Scholar
• Cook, D. A., & Beckman, T. J. (2006). Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine, 119(2), 166.e7–e16. https://doi.org/10.1016/j.amjmed.2005.10.036
   Google Scholar
• Cook, D. A., Brydges, R., Ginsburg, S., & Hatala, R. (2015). A contemporary approach to validity arguments: A practical guide to Kane’s framework. Medical Education, 49(6), 560–575. https://doi.org/10.1111/medu.12678
   PubMed Web of Science ®Google Scholar
• Crawford, E., Caine, A., Hunter, L., Hill, A. E., Mandrusiak, A., Anemaat, L., Dunwoodie, R., Fagan, A., & Quinlan, T. (2017). Service learning in developing countries: Student outcomes including personal successes, seeing the world in new ways, and developing as health professionals. Journal of Interprofessional Education and Practice, 9, 74–81. https://doi.org/10.1016/j.xjep.2017.08.006
   Google Scholar
• Curran, V., Hollett, A., Casimiro, L. M., McCarthy, P., Banfield, V., Hall, P., Lackie, K., Oandasan, I., Simmons, B., & Wagner, S. (2011). Development and validation of the interprofessional collaborator assessment rubric (ICAR). Journal of Interprofessional Care, 25(5), 339–344. https://doi.org/10.3109/13561820.2011.589542
   PubMed Web of Science ®Google Scholar
• Dow, A. W., DiazGranados, D., Mazmanian, P. E., & Retchin, S. M. (2014). An exploratory study of an assessment tool derived from the competencies of the interprofessional education collaborative. Journal of Interprofessional Care, 28(4), 299–304. https://doi.org/10.3109/13561820.2014.891573
   PubMed Web of Science ®Google Scholar
• Dreyfus, S. E. (2004). The five-stage model of adult skill acquisition. Bulletin of Science, Technology & Society, 24(3), 177–181. https://doi.org/10.1177/0270467604264992
   Google Scholar
• Emmert, M. C., & Cai, L. (2015). A pilot study to test the effectiveness of an innovative interprofessional education assessment strategy. Journal of Interprofessional Care, 29(5), 451–456. https://doi.org/10.3109/13561820.2015.1025373
   PubMed Web of Science ®Google Scholar
• Gillan, C., Lovrics, E., Halpern, E., Wiljer, D., & Harnett, N. (2011). The evaluation of learner outcomes in interprofessional continuing education: A literature review and an analysis of survey instruments. Medical Teacher, 33(9), e461–e470. https://doi.org/10.3109/0142159X.2011.587915
   PubMed Web of Science ®Google Scholar
• Helyer, R. (2015). Learning through reflection: The critical role of reflection in work-based learning (WBL). Journal of Work-Applied Management, 7(1), 15–27. https://doi.org/10.1108/JWAM-10-2015-003
   Google Scholar
• Iedema, R., Mesman, J., & Carroll, K. (2013). Visualising health care practice improvement: Innovation from within. Radcliffe Publishing Ltd.
   Google Scholar
• Interprofessional Education Collaborative. (2016). Core competencies for interprofessional collaborative practice: 2016 update.
   Google Scholar
• Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000
   Web of Science ®Google Scholar
• Kogan, J. R., Hatala, R., Hauer, K. E., & Holmboe, E. (2017). Guidelines: The do’s, don’ts and don’t knows of direct observation of clinical skills in medical education. Perspectives on Medical Education, 6(5), 286–305. https://doi.org/10.1007/s40037-017-0376-7
   PubMed Web of Science ®Google Scholar
• Landis, J., & Koch, G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
   PubMed Web of Science ®Google Scholar
• Lewis, A., Moore, C., & Nang, C. (2015). Using video of student-client interactions to engage students in reflection and peer review. Journal of University Teaching & Learning Practice, 12(4), 7. https://doi.org/10.53761/1.12.4.7
   Google Scholar
• Lumague, M., Morgan, A., Mak, D., Hanna, M., Kwong, J., Cameron, C., Zener, D., & Sinclair, L. (2006). Interprofessional education: The student perspective. Journal of Interprofessional Care, 20(3), 246–253. https://doi.org/10.1080/13561820600717891
   PubMedGoogle Scholar
• McManus, I. C., Thompson, M., & Mollon, J. (2006). Assessment of examiner leniency and stringency (‘hawk-dove effect’) in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling. BMC Medical Education 6 , 42. https://doi.org/10.1186/1472-6920-6-42
   PubMedGoogle Scholar
• Mertens, D. M. (2010). Research and evaluation in education and psychology: Integrating diversity with quantitative, qualitative, and mixed methods (3rd ed.). Sage Publications.
   Google Scholar
• Naumann, F., Mullins, R., Cawte, A., Beavis, S., Musial, J., & Hannan-Jones, M. (2021). Designing, implementing and sustaining IPE within an authentic clinical environment: The impact on student learning. Journal of Interprofessional Care 35 6 , , 907–913. https://doi.org/10.1080/13561820.2020.1837748
   PubMed Web of Science ®Google Scholar
• Newman, I., Lim, J., & Pineda, F. (2013). Content validity using a mixed methods approach: Its application and development through the use of a table of specifications methodology. Journal of Mixed Methods Research, 7(3), 243–260. https://doi.org/10.1177/1558689813476922
   Web of Science ®Google Scholar
• Nisbet, G., Jorm, C., Roberts, C., Gordon, C., & Chen, T. F. (2017). Content validation of an interprofessional learning video peer assessment tool. BMC Medical Education, 17(1), 258. https://doi.org/10.1186/s12909-017-1099-5
   PubMedGoogle Scholar
• Ohtake, P. J., Lyons, A., Glogowski, M., Stellrecht, E., Aronoff, N., Grabowski, J., & Zafron, M. L. (2018). Using an interprofessional flipped classroom educational strategy for developing evidence-based practice knowledge and skills. Journal of Interprofessional Education & Practice, 11, 7–11. https://doi.org/10.1016/j.xjep.2017.12.010
   Google Scholar
• Olson, R., Copley, J., Bartle, E., Hill, A., Barnett, T., Dunwoodie, R., & Zuber, A. (2022). The VOTIS, part 2: Using a video-reflexive assessment activity to foster dispositional learning in interprofessional education. Journal of Interprofessional Care doi:10.1080/13561820.2022.2037531 e-pub ahead of print .
   Google Scholar
• Olson, R., Klupp, N., & Astell-Burt, T. (2016). Reimagining health professional socialisation: An interactionist study of interprofessional education. Health Sociology Review, 25(1), 92–107. https://doi.org/10.1080/14461242.2015.1101702
   Web of Science ®Google Scholar
• Orchard, C. A., King, G. A., Khalili, H., & Bezzina, M. B. (2012). Assessment of interprofessional team collaboration scale (AITCS): Development and testing of the instrument. Journal of Continuing Education in the Health Professions, 32(1), 58–67. https://doi.org/10.1002/chp.21123
   PubMed Web of Science ®Google Scholar
• Osmanoglu, A. (2016). Prospective teachers’ teaching experience: Teacher learning through the use of video. Educational Research, 58(1), 39–55. https://doi.org/10.1080/00131881.2015.1117321
   Web of Science ®Google Scholar
• Peltonen, J., Leino-Kilpi, H., Heikkilä, H., Rautava, P., Tuomela, K., Siekkinen, M., Sulosaari, V., & Stolt, M. (2019). Instruments measuring interprofessional collaboration in healthcare – A scoping review. Journal of Interprofessional Care, 34(2), 147–161. https://doi.org/10.1080/13561820.2019.1637336
   PubMed Web of Science ®Google Scholar
• Reddy, Y., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation In Higher Education, 35(4), 435–448. https://doi.org/10.1080/02602930902862859
   Web of Science ®Google Scholar
• Rogers, G. D., Thistlethwaite, J. E., Anderson, E. S., Abrandt Dahlgren, M., Grymonpre, R. E., Moran, M., & Samarasekera, D. D. (2017). International consensus statement on the assessment of interprofessional learning outcomes. Medical Teacher, 39(4), 347–359. https://doi.org/10.1080/0142159X.2017.1270441
   PubMed Web of Science ®Google Scholar
• San Martín-Rodríguez, L., Beaulieu, M.-D., D’Amour, D., & Ferrada-Videla, M. (2009). The determinants of successful collaboration: A review of theoretical and empirical studies. Journal of Interprofessional Care, 19(sup 1), 132–147. https://doi.org/10.1080/13561820500082677
   Google Scholar
• Schmuck, H., & Arvin, M. K. (2018). Use of a board game format to promote interprofessional learning. Journal of Interprofessional Education & Practice, 12, 51–56. https://doi.org/10.1016/j.xjep.2018.05.007
   Google Scholar
• Schwindt, R., Agley, J., Mcnelis, A. M., Hudmon, K. S., Lay, K., & Bentley, M. (2017). Assessing perceptions of interprofessional education and collaboration among graduate health professions students using the interprofessional collaborative competency attainment survey (ICCAS). Journal of Interprofessional Education & Practice, 8, 23–27. https://doi.org/10.1016/j.xjep.2017.05.005
   Google Scholar
• Sertdemir, Y., Burgut, H. R., Alparslan, Z. N., Unal, I., & Gunasti, S. (2013). Comparing the methods of measuring multi-rater agreement on an ordinal rating scale: A simulation study with an application to real data. Journal of Applied Statistics, 40(7), 1506–1519. https://doi.org/10.1080/02664763.2013.788617
   Web of Science ®Google Scholar
• Skinner, K., Robson, K., & Vien, K. (2021). Interprofessional education: A unique approach to addressing the challenges of student assessment. Journal of Interprofessional Care 35 4 , , 564–573. https://doi.org/10.1080/13561820.2020.1780202
   PubMed Web of Science ®Google Scholar
• Streiner, D., & Norman, G. (2008). Health measurement scales: A practical guide to their development and use (4th ed.). Oxford University Press.
   Google Scholar
• Thistlethwaite, J., & Dallest, K. (2014). Interprofessional teamwork: Still haven’t decided what we are educating for? Medical Education, 48(6), 556–558. https://doi.org/10.1111/medu.12471
   PubMed Web of Science ®Google Scholar
• Thistlethwaite, J., Dallest, K., Moran, M., Dunston, R., Roberts, C., Eley, D., Bogossian, F., Forman, D., Bainbridge, L., Drynan, D., & Fyfe, S. (2016). Introducing the individual teamwork observation and feedback tool (iTOFT): Development and description of a new interprofessional teamwork measure. Journal of Interprofessional Care, 30(4), 526–528. https://doi.org/10.3109/13561820.2016.1169262
   PubMed Web of Science ®Google Scholar
• Thistlethwaite, J. E., Dunston, R., & Yassine, T. (2019). The times are changing: Workforce planning, new health-care models and the need for interprofessional education in Australia. Journal of Interprofessional Care, 33(4), 361–368. https://doi.org/10.1080/13561820.2019.1612333
   PubMed Web of Science ®Google Scholar
• Thistlethwaite, J. E., Forman, D., Matthews, L. R., Rogers, G. D., Steketee, C., & Yassine, T. (2014). Competencies and frameworks in interprofessional education: A comparative analysis. Academic Medicine, 89(6), 869–875. https://doi.org/10.1097/ACM.0000000000000249
   PubMed Web of Science ®Google Scholar
• Varpio, L., O’Brien, B., Rees, C. E., Monrouxe, L., Ajjawi, R., & Paradis, E. (2021). The applicability of generalisability and bias to health professions education’s research. Medical Education, 55(2), 167–173. https://doi.org/10.1111/medu.14348
   PubMed Web of Science ®Google Scholar
• Welkowitz, J., Cohen, B., & Ewen, R. (2007). Introductory statistics for the behavioral sciences. John Wiley and Sons Inc.
   Google Scholar
• World Health Organization. (2010). Framework for action on interprofessional education and collaborative practice. http://www.who.int/hrh/resources/framework_action/en/index.html
   Google Scholar
• Zorek, J., Maclaughlin, E., Fike, D., Maclaughlin, A., Samiuddin, M., & Young, R. (2014). Measuring changes in perception using the student perceptions of physician-pharmacist interprofessional clinical education (SPICE) instrument. BMC Medical Education, 14(1), 101. https://doi.org/10.1186/1472-6920-14-101
   PubMed Web of Science ®Google Scholar