Rorschach Intercoder Reliability for Protocol-Level Comprehensive System Variables in an International Sample

Abstract

This study examines the intercoder reliability of Rorschach Comprehensive System (CS; Exner, 2001) protocol-level variables. A large international sample was combined to obtain intercoder agreement for 489 Rorschach protocols coded using the CS. Intercoder agreement was calculated using an Iota coefficient, a statistical coefficient similar to kappa that is corrected for chance. Iota values for the variables analyzed ranged from .31 to 1.00, with 2 in the poor range of agreement, 4 in the fair range, 25 in the good range, and 116 in the excellent range of agreement. Discrepancies between variables are discussed.

Acknowledgments

This article is based on a doctoral dissertation by Jennifer Sahly as partial fulfillment for her PhD at the California School of Professional Psychology at Alliant International University.

We acknowledge the assistance lent by Harald Janson, whose reviews and comments significantly improved the quality of this project.