Combining different methods improves assessment of competence in colonoscopy

Abstract

Objectives: To develop a reliable method of assessing competence in colonoscopy based on multiple sources.

Materials and methods: Physicians with varying degrees of experience in colonoscopy performed two colonoscopies each in a standardized simulated environment. Their performances were assessed under direct observation by an expert rater and by automatic computerized analysis of operator movements and scope movements, respectively. Reliability (Cronbach’s alpha) for subjective assessment, time to cecum, analysis of operator movement and analysis of scope movements were calculated. Composite score calculations were used to explore different combinations of the measures.

Results: Twenty physicians were included in the study. The reliability (Cronbach’s alpha) were 0.92, 0.57, 0.87 and 0.55 for the subjective score assessed under direct observation, time to cecum, distance between operator’s hands and colonoscopy progression score, respectively. Equal weight (=25%) to all four methods resulted in a reliability of 0.91 and optimal weighting of the methods (55%, 10%, 25% and 10%, respectively) resulted in a maximum reliability of 0.95.

Conclusion: Combining subjective expert ratings with automated objective assessments results in a less biased and more reliable assessment of competence in colonoscopy.

Keywords:

• Colonoscopy
• competence
• assessment
• composite scores
• multisource assessment

Disclosure statement

The algorithm for analyzing scope progression is patented by Professor Lars Konge, Morten Bo Søndergaard Svendsen, and Professor Lars Bo Svendsen. Dr. Louise Preisler and Yoon Soo Park have no conflicts of interest to report.