Rorschach Reliability: Toward a Training Model for Interscorer Agreement

Abstract

Little or no research has been done with Rorschach Scoring Systems to standardize instructional materials and methods which would yield high interscorer agreement by the conclusion of a time-limited course of study in a classroom setting. Clinical applications and research with the Rorschach would benefit from training methods which yield high interscorer reliability. Training materials based on the Perceptanalytic system were standardized on 250 graduate level psychology students over an 11-year span of time, using one class per year. The final training materials were replicated using three classes (n = 58) to test the stability of the system. Data analysis on interscorer agreement involved 20,042 comparisons of pairs of scores and summaries at two levels of difficulty: Intermediate and Advanced. Overall interscorer agreement was consistently high for all replications.