![Sample our Health and Social Care journals, sign in here to start your FREE access for 14 days]({"type":"image" , "src" : "/sda/5938/TOC-Subject-Sample-2021-Health-Social-Care.jpg"})
Abstract
The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = −0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test–retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach’s α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.
Acknowledgements
We gratefully acknowledge the assistance of Dr. Melody Hertzog in the statistical analysis. We acknowledge funding from the Nebraska Department of Health and Human Services that supported the TeamSTEPPS™ training and the International Fellowship from the American Association of University Women awarded to the corresponding author.
Declaration of interest
The authors report no conflicts of interest. The authors alone are responsible for the writing and content of this article.