An Evaluation of the Utility of Statistical Versus Clinical Significance in Determining Improvement in Alcohol and Other Drug (AOD) Treatment in Correctional Settings

Abstract

Despite widespread endorsement from researchers focusing on treatment, clinical significance methodology remains underutilized in treatment evaluations. Using data collected from a treatment program for persons jailed for alcohol and other drug (AOD)-related offenses, clinical significance methodology is demonstrated and contrasted with traditional significance testing across a variety of symptom and dysfunction areas. A total of 124 participants completed a self-report questionnaire (Health Dynamics Inventory; Saunders & Wojcik, 1997) at intake and discharge from treatment. Consistent with previous research utilizing clinical significance methodology, each participant appeared to have a unique treatment experience characterized by a specific pattern of symptom-level change across the areas assessed. The level of pretreatment functioning and the potential for symptoms to worsen during treatment are discussed as important factors to consider when using clinical significance methodology.

Notes

*p < .05.

***p < .001.

*Note: Cannot move from functional to dysfunctional ranges as any patients in functional range at time 1 have been removed from analysis.

*Note: Cannot be categorized as “clinically significant deterioration” since any patients in functional range at time 1 have been removed from analysis.