Comparative Content Analysis of Self-Report Scales for Level of Personality Functioning

Abstract

Content validity analyses of eight self-report instruments for assessing severity of personality disorder (PD), also known as Level of Personality Functioning (LPF), were conducted using the conceptual scheme of the Alternative Model for Personality Disorders (AMPD; APA, 2013). The item contents of these eight inventories were characterized for the LPF constructs of Identity (ID), Self-Direction (SD), Empathy (EM), and Intimacy (IN) along with the pathological personality trait domains of Negative Affectivity, Detachment, Antagonism, Disinhibition, and Psychoticism. Severity of pathology (SV) reflected in item content was also rated. Raters demonstrated robust agreement for AMPD and SV constructs across instruments. Similarity between instrument AMPD construct profiles was quantified by intraclass correlations (ICC). Results showed the instruments were generally similar in AMPD-construct coverage, but some important differences emerged. The subscales of the instruments also were characterized for the degree to which they reflect the four LPF (ID, SD, EM, IN) domain constructs. Collectively, these content validity comparisons clarify the equivalence of instruments for AMPD constructs and the relative proportions of construct coverage within instrument subscales. These results can inform future research with LPF self-report instruments and guide clinicians in selecting an LPF-related instrument for use in practice.

Acknowledgments

We thank the individuals listed in the following citation for ratings on an abbreviated set of instruments, the data of which were included in the present study. Florimbio, A.R., Waugh, M.H., Lenger, K.A., Fillauer, J.P., Abernathy-Johnson, S.J., McCain, C.M., Grigorian, H.L., DeVore, E.N., Fox, .LP., Keller, E.M., Kors, S.B., Lewis, K.C., Mariotti, E.C., Moody, A.T., Mulay, A.L., Noose, S.K., Ridenour, J.M., Rosecrance, P.H., Russell, A.N., & Smith, C.L. (March 2019). Comparative Content Validity Analysis of Self-Report Measures of Criterion A and B of the Alternative Model of Personality Disorders. Paper presented at the 81st Annual Society for Personality Assessment Convention, New Orleans, LA.

Notes

1 https://www.deviersprong.nl/wp-content/uploads/2016/01/SIPP-SF_English_NEW_2006.pdf).

2 Note: comparing the instrument AMPD profiles without the SV variable gives a very similar result (.68 single rater and .94 mean rater).

3 .01 = small, .06= medium, .14= large (Cohen, 1988; Cohen, Cohen, West, & Aiken, 2003)

4 Criterion B trait domain rating means were calculated separately over the items of each of the instrument’s five subscales rather than the entire instrument because the psychometric structure of Criterion B and PID-5 instruments are presumed to be multifactorial.