1,522
Views
2
CrossRef citations to date
0
Altmetric
Articles

Robustness of the Maladaptive Personality Plaster: An Investigation of Stability of the PSY-5-r in Adults over 20 Years

, , &
Pages 27-32 | Received 15 Aug 2018, Accepted 14 Jan 2020, Published online: 03 Mar 2020

Abstract

The long-term stability of maladaptive personality traits in the general population has been under-investigated. The current study examined the longitudinal 20-year mean-level stability and rank-order consistency of five maladaptive personality traits—as measured with the Personality Psychopathology-5-r scales. Correlations and regression analysis were conducted to test both types of stability comparing raw scores of scale administrations in a general population sample in both 1992 and 2012 (N = 65). Repeated measures analysis of variance demonstrated significant mean-level stability of the PSY-5-r traits over 20 years. The PSY-5-r scales demonstrated significant rank-order consistency as evidenced by correlational analyses and reliability coefficients. The scales Aggressiveness-r (r = .73), Neuroticism/Negative Emotionality-r (r = .65), Introversion/Low Positive Emotionality-r (r = .63), and Disconstraint-r (r = .56), evidenced strong rank-order stability, whereas Psychoticism-r (r = .3) showed moderate rank-order consistency. The results of the present study indicate that maladaptive personality traits as measured with the PSY-5-r scales are relatively stable over 20 years in an adult community population.

Conventional theories of personality describe personality traits as stable factors over the life span. Personality traits are historically regarded as permanent, or “set like plaster,” after the age of 30 (James, Citation1890). However, over the past few decades, scholars have posited a more nuanced view on personality trait stability, implying that personality traits are not entirely robust over age and time (Roberts, Walton, & Viechtbauer, Citation2006). Before expounding upon the extant literature, it is important to discuss the distinction between two different types of constructs that define stability and change. First, mean-level difference (or absolute stability, typically measured with effect size d) reflects the average change between two time points when comparing a group-level score, and is mostly used in longitudinal research to indicate normative change (Roberts et al., Citation2006; Wagner, Ram, Smith, & Gerstorf, Citation2016). Further, mean-level change typically indicates systematic changes in the average scale score (Ashton, Citation2007). Second, rank-order consistency (or differential stability) represents an individual’s relative position on a trait compared to others—typically operationalized using test-retest correlations—and can exist alongside mean-level change (Anusic & Schimmack, Citation2016; Roberts et al., Citation2006). For example, a certain group can have a relatively stable score on a certain measure overall, while individuals within that group have inconsistent scores over time. Rank order consistency assesses whether change is consistent across groups of individuals (Ashton, Citation2007). The present study examines both forms of stability of the Personality Psychopathology-Five-Revised (PSY-5-r), a model of maladaptive personality traits (Harkness & McNulty, Citation2007).

Over the last few decades, many empirical findings support the notion that normative personality traits undergo mean-level changes across multiple life phases, including adolescence (Allik, Laidra, Realo, & Pullman, Citation2004), adulthood (Roberts et al., Citation2006; Srivastava, John, Gosling, & Potter, Citation2003), late adulthood and old age (Debast et al., Citation2014; Mõttus, Johnson, & Deary, Citation2012). Regarding mean-level changes in the Big Five personality traits (i.e., Neuroticism, Extraversion, Openness, Agreeableness, Conscientiousness), a large meta-analysis reported robust changes, showing that individuals become more agreeable, more conscientious and less neurotic as they age (Roberts et al., Citation2006). However, results appear to be less straightforward for rank-order stability of these constructs. Some studies indicate that personality traits become increasingly stable (i.e., display a stronger test-retest correlation) over the adult life-course, and that this effect plateaus (i.e., displaying weaker test-retest correlation) after the age of 50 (Roberts & DelVecchio, Citation2000). Another study found a U-shaped temporal trajectory of rank-order instability of four of the Big Five traits, such that traits were found less stable before the age of 40 and after the age of 60, and this instability was found to be largely influenced by environmental changes and maturation (Specht, Egloff, & Schmukle, Citation2011). These findings suggest that normative personality may have both dynamic and stable aspects in adulthood and that personality stability should be interpreted in the context of life phase and stability type.

To date, most research on personality stability has focused on the assessment of normative personality traits (Krueger et al., Citation2011). Significantly fewer research efforts have focused on investigation of the stability of maladaptive personality traits, or the outermost levels of the normative personality spectra. In one study, dimensional measures of personality disorders (i.e., the SNAP-2 scales) showed strong rank-order stability (mean r =.69) and moderate mean-level stability (mean d = .21) in a clinical sample over a two-year period, indicating robust stability (Samuel et al., Citation2011). In addition, the maladaptive personality traits of the Personality Psychopathology 5 model (PSY-5) showed mean-level stability over a 6-month period in clinical and normative samples, consisting of adults between 20 and 84 years old (specifically, measures of the constructs Psychoticism, Negative Emotionality/Neuroticism and Introversion/Low Positive Emotionality;). Also, all five traits showed strong rank-order consistency (Trull, Useda, Costa, & McCrae, Citation1995).

Further investigation of the stability of maladaptive personality measures could be valuable in several ways. First, empirical evidence for stability (or change) of maladaptive personality traits increases understanding of the course and structure of personality pathology, especially in context of a dimensional approach to personality and psychopathology (Hopwood & Bleidorn, Citation2018). Second, maladaptive personality traits can be interpreted in the larger context of dimensional psychopathology taxonomies (Kotov et al., Citation2017). Third, acquiring a deeper understanding of the measurement of maladaptive personality traits may add to the predictive value of diagnostic assessment in specific life phases (Clark, Citation2009; Hopwood & Bleidorn, Citation2018; Malouff, Thorsteinsson, & Schutte, Citation2005). Fourth, longitudinal research on reliability and stability of dimensional measures and maladaptive personality is valuable for assessment and treatment planning. Lastly, these findings could also contribute to insight in the temporal stability of Criterion B of the Alternative Model of Personality Disorders in DSM-5 and to the temporal stability of higher order factors of the Hierarchical Taxonomy of Psychopathology (Anderson et al., Citation2013; Kotov et al., Citation2017). True stability of dimensional models such as Criterion B of the Alternative Model of Personality Disorders would underline the notion that dimensional models are more valid and reliable than categorical taxonomies, which increases dimensional models’ value in clinical context. The present study utilizes the PSY-5-r personality scales (Harkness & McNulty, Citation2007) of the MMPI-2-RF, a dimensional measure of personality and psychopathology (Ben-Porath & Tellegen, Citation2008). Stability is investigated in an adult normative community sample over 20 years.

The aim of the present study is to investigate both mean-level and rank order consistency of the five PSY-5-r scales over a 20-year period. First, we expect a significant mean-level change of three of the PSY-5-r scales, as reflected in significant differences in the average scale scores between the two measurement points of 1992 and 2012. Given the 20-year difference between time-point one (ages 25 to 65) and time-point two (ages 45 to 85), participants have undergone a significant shift in life phase. This shift in life phase may be associated with mean-level changes in maladaptive personality scale scores (Roberts et al., Citation2006; Srivastava et al., Citation2003). Regarding direction and strength of these effects, we expect NEGE-r and PSYCH-r, INTR-r scales scores to moderately decrease (d ≥ .50) with age, and we expect DISC-r and AGGR-r scale scores to show no significant mean-level change. These hypotheses are in line with directions found by Trull et al. (Citation1995). Second, regarding rank-order consistency we expect to see robust 20-year stability of all five PSY-5-r personality measures, consistent with previous findings on rank-order consistency of maladaptive personality constructs over shorter periods (Harkness, McNulty, et al., Citation2014; Trull et al., Citation1995) and personality disorders (Hopwood et al., Citation2013). Robust rank-order consistency of these traits is expected to be evidenced by strong test-retest correlations (r ≥ .50) of 1992 scores and 2012 scores on these scales.

Methods

Measures

The MMPI–2–RF is an internationally used self-report dimensional measure of personality and psychopathology constructs (Ben-Porath & Tellegen, Citation2008). Details regarding the psychometric properties and translation processes of the Dutch-language versions of the MMPI–2–RF and its predecessor—the Dutch language version of the MMPI-2—are provided in the respective manuals (Derksen, De Mey, Sloore, & Hellenbosch, Citation2006, Van der Heijden, Rossi, Van der Veld, Derksen, & Egger, Citation2013). The psychometric properties of the Dutch language version of the MMPI–2–RF and PSY-5-r are comparable to those of the US version (Van der Heijden, Egger, & Derksen, Citation2008, Citation2010). displays detailed information on the PSY-5-r scales.

Table 1. Psychopathology Five-Revised (PSY-5-r) scale descriptions and psychometric properties.

Participants and procedure

As part of the standardization of the Dutch language version of the MMPI-2, a representative community sample was recruited in 1992 (N = 1244, Mage = 44.23, 45.3% female) by a Dutch national survey agency. To update this standardization sample, a second Dutch community sample was recruited in 2012 (N = 2140, Mage = 52.47, 47.9% female). At both time points, sampling procedures were closely monitored and stratified in order to accurately represent the general Dutch population. By happenstance, 66 participants completed the MMPI-2 in 1992 as well as in 2012. During both time points, all eligible and enrolled subjects (18 years and older) completed the MMPI-2 through an online portal. Computers with internet connection were provided for participants who did not have access to the necessary technology. Further, all participants were compensated for their time and effort.

In the present study, raw item scores were used in statistical analyses derived from scores obtained by computer administration of the MMPI-2 booklet. Non-gendered T-scores for the MMPI–2–RF validity scales were computed for both time points to examine the validity of the profiles. One respondent was excluded from analyses due to an elevated T-score on the TRIN-r scale (T = 96, in 2012). The MMPI–2–RF profiles of all other participants met the following inclusion criteria at both moments (1992 and 2012, based on calculation of non-gendered norms for the specific time of administration): Cannot Say raw scores < 14, VRIN-r and TRIN-r T score ≤ 80, Fp-r T score < 100, and L-r ≤ 80 (Ben-Porath & Tellegen, Citation2008). In the final sample (N = 65) participants were between the ages of 25 and 65 years old (Mage1992 = 44.52, 58.5% female) in 1992, and 45 and 85 years old (Mage2012 = 64.52) in 2012. The raw, PSY-5-r scores of 65 participants were used to address the research question.

Analysis procedures

Independent-samples t-tests were conducted to compare the current sample (N = 65) to the larger sample at both time points to check for differences in age and sex. With regard to the 1992 group, results indicated that the subsample (N = 65) was about 1 year younger on average (Msubsample = 45.02 vs. Mlargesample = 44.19) than the larger 1992 sample (N = 1178), and this difference was statistically significant (t = -.463, p = .005, Cohen’s d = .07). In contrast, there was no statistical difference in sex (%femalesubsample = 43.1 vs %femalelargesample = 45.3; χ2 (1) = 1.232, p = .267, d = .058) between the subsample (N = 65) and the larger 1992-sample (N = 1178). With regard to the 2012 group, results indicated that the subsample (N = 65) was about 12 years older on average (Msubsample = 65.02 vs. Mlargesample = 53.33) than the larger 2012 sample (N = 2087), and this difference was statistically significant (t = −5.559, p < .001, Cohen’s d = .83). In addition, there was no statistical difference in sex (%femalesubsample = 43.1 vs %femalelargesample = 47.9; χ2 (1) = 1.232, t = .267, d = .11) between the subsample (N = 65) and the larger 2012-sample (N = 2087). Thus, our subsample was significantly different in mean age compared to the entire normative samples at both time points. However, these differences in mean age are due to the 20-year difference between time point one and time point two: in 1992 they were relatively younger (age range 25–45) whereas in 2012 this group was relatively older (age range 45–65).

First, we confirmed that our sample exceeded the minimum number of participants (i.e., N = 64) to assume a power of .80, based on α = .05 and a hypothesized medium effect size (Cohen, Citation1992; Faul, Erdfelder, Buchner, & Lang, Citation2009). Next, we examined mean-level change using repeated-measures analysis of variance (ANOVA). We calculated Cohen’s d as effect size (Dunlap, Cortina, Vaslow, & Burke, Citation1996). Second, we assessed Pearson correlations between the 1992 and 2012 time points to investigate rank-order consistency of the PSY-5-r scales. We interpreted these correlations (r) as effect sizes based on established cutoff values: .10 (small), .30 (medium) and .50 (large; Cohen, Citation1992). Furthermore, we compared the test-retest correlations over 20 years found in this study with test-retest correlations obtained over 6 weeks in 1993, by calculation of Fisher’s r-to-z transformation between the correlations and the 1993 test-retest correlations of the PSY-5-r (Fisher, Citation2006). We calculated Cohen’s q to evaluate the effect size of this statistical comparison (Cohen, Citation1992).

Results

Results of various ANOVAs indicated no significant differences between the 1992 and 2012 means for all five of the PSY-5-r scales. displays a summary of statistics of the conducted mean-level analysis of the PSY-5-r scales between the 1992 and 2012 time-points, including mean T-scores, mean raw scores, raw score standard deviations, Standard Errors of the Mean, F-values, p-values and Cohen’s d-values.

Table 2. Repeated measures ANOVA results of the 2012 PSY-5-r scales onto each single 1992 PSY-5-r scales.

displays detailed findings of the correlational analyses. Overall, all five correlations were significant and ranged between moderate (.30) and strong (.73), indicating rank-order consistency of all 5 scales. We applied Fisher’s r-to-z transformations (Fisher, Citation2006) to compare findings in the present investigation with test-retest correlations over 6 weeks that were computed in a different subsample of the normative sample (N = 161), randomly selected in 1992 during the standardization process (Derksen & De Mey, Citation1992). Results showed significant differences between correlations in the present study (i.e., over 20 years) and test-retest correlations found in the 1992 normative sample (i.e., over 6 weeks). This indicates that the PSY-5-r scales are significantly less reliable over 20 years than over a 6-week period, The effect sizes for the differences between these correlation (i.e., test-retest over 6 weeks compared test-retest over 20 years) were all in the small-medium range: AGGR-r (q = .27); DISC-r (q = .40); NEGE-r (q = .40) and INTR-r (q = .39), except for PSYC-r (q = .82) which can be considered moderate to large. displays statistics around rank-order consistency, including test-retest correlations, and Fisher’s z-values, p-values and q-values.

Table 3. Correlations in comparison to Test-Retest Correlations reported in the manual and Fisher z and p-values of the PSY-5-r scales.

Discussion

The purpose of the present investigation was to examine mean-level change and rank-order consistency of the PSY-5-r scales over 20 years in a Dutch community sample. First, all PSY-5-r scales demonstrated a lack of significant mean-level change, which supports the notion that these five maladaptive personality constructs may have absolute stability. We hypothesized that 3 out of 5 PSY-5-r scales (PSYC-r, NEGE-r, INTR-r) would show significant mean-level change over 20 years and 2 out of the 5 PSY-5-r scales (AGGR-r, DISC-r) would not. Thus, our hypotheses were only partially confirmed. Second, correlational results indicated that all PSY-5-r scales but the PSYC-r scale show rank-order consistency, as evidenced by moderate to strong correlations across the two time points. However, after controlling for measurement error, rank-order consistency evidenced to be moderate. Overall, our findings imply that the constructs measured by the PSY-5-r could be considered stable on a group level (i.e., absolute stability), whereas the PSY-5-r scales show moderate stability on an individual level (i.e., differential stability). The latter results, however, must be interpreted in light of imperfect measurement reliability of the scales.

The findings from the present study are derived from rare, multi-decade longitudinal data and offer a unique contribution to the scientific literature regarding the reliability of scales that measure these five constructs as well as the stability of underlying maladaptive personality traits. Our findings on reliability of the PSY-5-r scales align with the notion that personality psychopathology constructs are relatively stable when measured dimensionally, which is consistent with previous results showing reliability of dimensional measurement of personality psychopathology and personality disorders (Samuel et al., Citation2011; Trull et al., Citation1995). However, there is variation in reliability among the scales. Particularly, the PSYC-r scale appears to be the most susceptible to measurement error over 20 years, whereas AGGR-r appears to be the most reliable scale. The PSYC-r’s lack of robust reliability may be due to its unique property of measuring both normal and clinical components of the Psychoticism construct, potentially causing it to be the least reliable due to a lack of clinical-level variance in normative populations. The influence of measurement error on the reliability implies that further research is needed to disentangle the true differential stability of maladaptive traits from the reliability of the scales.

The stability of underlying maladaptive personality constructs warrants discussion of implications, contextualizing our results within the broader literature on rank-order consistency (i.e., differential stability) of the PSY-5-r traits. Assuming true score stability of the PSY-5-r over 20 years would be consistent with findings by Trull et al. (Citation1995), who found rank-order consistency of the PSY-5 (the predecessor of the PSY-5-r) constructs over 6 months. These researchers also found that these constructs predict most forms of personality disorders at both time points, which was not assessed in the present study. Notably, stability was found between specific life phases, particularly early adulthood (ages 25 to 45) to late adulthood (65–85), though the present study did not cover early life stages. However, given the range of ages covered, one could interpret our results to support the claim that the PSY-5-r is stable in adulthood on an individual level. Lastly, the maladaptive side of the personality traits could be linked to theories of evolved major systems, as discussed in Harkness, Reynolds, and Lilienfeld (Citation2014). Individual differences in trait levels across life phases may represent an evolved adaptation to the external environment. For example, there might be an evolutionary benefit to stability of certain levels of trait Aggressiveness (measured by AGGR-r), because continuation of this trait reflects agenda protection (Harkness, Reynolds, et al., Citation2014), benefitting the individual in the long-term. Therefore, certain trait levels have become psychopathological (i.e., standardized scores above 65) in modern society, though stable individual differences may reflect an originally adaptive system, evolved as a result of influences of environmental shaping.

Despite the lack of clear differential stability conclusions, the PSY-5-r constructs show meaningful absolute stability. Whereas normative personality traits have been found to show mean-level change in adulthood (Roberts et al., Citation2006; Srivastava et al., Citation2003) and late adulthood (Debast et al., Citation2014; Mõttus et al., Citation2012), the present study indicates that the five maladaptive PSY-5-r constructs may follow a somewhat stable temporal trajectory in healthy adults. One could conclude that the majority of PSY-5-r scales are stable when assessed between adult cohorts of healthy individuals. The present study did not allow for investigation of non-linear relationships and therefore we cannot rule out other types of temporal trajectories within the 20-year time span, such as a U-shaped trajectory found by Specht et al. (Citation2011). Cross-sectional and longitudinal study designs investigating stability in different generational and diverse samples may be able to identify detailed information regarding the life-long nature of maladaptive trait stability.

The mean-level change of the PSY-5-r scales over two decades emphasizes the unique psychometric properties of the PSY-5-r as a clinical assessment tool. Individuals scoring particularly high on any of the five maladaptive personality scales may continue to score high over time. If this finding is replicated, scholars should direct their attention to studying intervention as a means of adjusting the stable course of maladaptive personality traits (Roberts et al., Citation2017). When interpreting scores on the PSY-5-r, clinicians should be knowledgeable of norm differences that might occur across ages, generation, and samples (i.e., clinical and non-clinical adults). Further, clinicians and clinical researchers ought to be mindful of the differences in applying adaptive versus maladaptive measurement models. Whereas adaptive personality traits (e.g., the Big Five), evidences fluctuating stability based on the life phase (Debast et al., Citation2014; Mõttus et al., Citation2012; Roberts et al., Citation2006; Srivastava et al., Citation2003), the present study indicates maladaptive traits may be more stable in middle to late adulthood. Moreover, our findings indicate there may be stability differences among the five PSY-5-r maladaptive constructs and these should not be considered equally stable in clinical samples, perhaps due to differences in the extent to which they encompass symptomatology. Constructs containing more symptom-like features are expected to be more sensitive to change over time (Hopwood et al., Citation2013).

Some limitations of the present investigation warrant discussion. Our limited sample size puts constraints on the generalizability of the results. Additionally, the present study relies exclusively on self-report, and given the complexity of personality constructs overall, research should involve multiple ways of measuring personality to validly measure the assumed latent variable (McDonald, Citation2008). Furthermore, the community sample utilized in the current study may have introduced a risk of bias. Conducting this study in a clinical sample may have produced greater variance in the latent constructs, given the range of maladaptive symptoms assessed. Rank-order stability specifically could evidence a different temporal path in a controlled, clinical sample where one might expect stronger effects overall. Lastly, unidentified sampling error may have been introduced due to the nature of the present study’s selection process.

As previously mentioned, a reliable investigation of the temporal path of maladaptive personality constructs ought to include multiple time points, while simultaneously applying sophisticated statistical analysis to control for measurement error. Future research should also address other types of stability (e.g., ipsative stability, intrapersonal stability) to strengthen conclusions on overall stability. Results from the present study imply that individuals in community-based settings may show a tendency toward stable maladaptive personality traits. However, these results require replication efforts in varying samples in order to draw conclusions that have strong implications for clinical practice. Further, investigation of different models of maladaptive personality would contribute to external validation of stability claims. Studying the nature of dimensional psychopathology should not only include stability of personality constructs, but also stability of other dimensional personality-related concepts, including higher-order psychopathology constructs such as internalizing, externalizing and thought dysfunction dimensions (Bornstein, Citation2019; Kotov et al., Citation2017).

In sum, the present study shows that maladaptive personality traits—measured by the PSY-5-r—are relatively stable over a 20-year period. These results support the use of the MMPI–2–RF as a clinical tool to assess maladaptive personality over time in community samples.

Acknowledgments

The authors wish to extend their gratitude to Huub Schaeks and Theo Bögels for their support in this research project.

Additional information

Funding

Robbert Langwerden gratefully acknowledges use of the services and facilities of the Research Center in Minority Institutions at Florida International University (U54MD012393).

References

  • Allik, J., Laidra, K., Realo, A., & Pullman, H. (2004). Personality development from 12 to 18 years of age: Changes in mean levels and structure of traits. European Journal of Personality, 18(6), 445–462. doi:10.1002/per.524
  • Anderson, J. L., Sellbom, M., Bagby, R. M., Quilty, L. C., Veltri, C. O., Markon, K. E., & Krueger, R. F. (2013). On the convergence between PSY-5 domains and PID-5 domains and facets: Implications for assessment of DSM-5 personality traits. Assessment, 20(3), 286–294. doi:10.1177/1073191112471141
  • Anusic, I., & Schimmack, U. (2016). Stability and change of personality traits, self-esteem, and well-being: Introducing the meta-analytic stability and change model of retest correlations. Journal of Personality and Social Psychology, 110(5), 766–781. doi:10.1037/pspp0000066
  • Ashton, M.C. (2007). Individual differences and personality. London: Academic Press.
  • Ben-Porath, Y. S., & Tellegen, A. (2008). MMPI-2 RF: Minnesota Multiphasic Personality Inventory-2 Restructured Form: Hand scoring starter kit with 5 softcover test booklets. Minnesota: University of Minnesota Press.
  • Bornstein, R. F. (2019). From structure to process: On the integration of AMPD and HiTOP. Journal of Personality Assessment, 101(4), 360–366. doi:10.1080/00223891.2018.1501696
  • Clark, L. A. (2009). Stability and change in personality disorder. Current Directions in Psychological Science, 18(1), 27–31. doi:10.1111/j.1467-8721.2009.01600.x
  • Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. doi:10.1037/0033-2909.112.1.155
  • Debast, I., Van Alphen, S. P., Rossi, G., Tummers, J. H., Bolwerk, N., Derksen, J. J., & Rosowsky, E. (2014). Personality traits and personality disorders in late middle and old age: Do they remain stable? A literature review. Clinical Gerontologist, 37(3), 253–271. doi:10.1080/07317115.2014.885917
  • Derksen, J. J. L., & De Mey, H. R. A. (1992). US and Dutch norms for the MMPI–2: A comparison. In 27th Annual Symposium on Recent Developments in the Use of the MMPI–2/MMPI–A Workshop and Symposia, Minneapolis, MN.
  • Derksen, J., De Mey, H., Sloore, H., & Hellenbosch, G. (2006). MMPI–2: Handleiding bij afname, scoring en interpretatie. Tweede, gewijzigde uitgave [Minnesota Multiphasic Personality Inventory–2: Manual for administration, scoring, and interpretation].
  • Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996). Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods, 1(2), 170–177. doi:10.1037/1082-989X.1.2.170
  • Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. doi:10.3758/BRM.41.4.1149
  • Fisher, R. A. (2006). Statistical methods for research workers. New York, NY: Springer.
  • Harkness, A. R., & McNulty, J. L. (2007). Restructured versions of the MMPI-2 Personality Psychopathology Five (PSY-5) scales. In Meeting of the American Psychological Association, San Francisco, CA.
  • Harkness, A. R., McNulty, J. L., Finn, J. A., Reynolds, S. M., Shields, S. M., & Arbisi, P. (2014). The MMPI–2–RF Personality Psychopathology Five (PSY–5–RF) scales: Development and validity research. Journal of Personality Assessment, 96(2), 140–150. doi:10.1080/00223891.2013.823439
  • Harkness, A. R., Reynolds, S. M., & Lilienfeld, S. O. (2014). A review of systems for psychology and psychiatry: Adaptive systems, Personality Psychopathology Five (PSY–5), and the DSM–5. Journal of Personality Assessment, 96(2), 121–139. doi:10.1080/00223891.2013.823438
  • Hopwood, C. J., & Bleidorn, W. (2018). Stability and change in personality and personality disorders. Current Opinion in Psychology, 21, 6–10. doi:10.1016/j.copsyc.2017.08.034
  • Hopwood, C. J., Morey, L. C., Donnellan, M. B., Samuel, D. B., Grilo, C. M., McGlashan, T. H., … Skodol, A. E. (2013). Ten‐year rank‐order stability of personality traits and disorders in a clinical sample. Journal of Personality, 81(3), 335–344. doi:10.1111/j.1467-6494.2012.00801.x
  • James, W. (1890). The principles of psychology, Vol. 2. NY, US: Henry Holt and Company.
  • Krueger, R. F., Eaton, N. R., Clark, L. A., Watson, D., Markon, K. E., Derringer, J., … Livesley, W. J. (2011). Deriving an empirical structure of personality pathology for DSM-5. Journal of Personality Disorders, 25(2), 170–191. doi:10.1521/pedi.2011.25.2.170
  • Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., … Zimmerman, M. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454–477. doi:10.1037/abn0000258
  • Malouff, J. M., Thorsteinsson, E. B., & Schutte, N. S. (2005). The relationship between the five- factor model of personality and symptoms of clinical disorders: A meta-analysis. Journal of Psychopathology and Behavioral Assessment, 27(2), 101–114. doi:10.1007/s10862-005-5384-y
  • McDonald, J. D. (2008). Measuring personality constructs: The advantages and disadvantages of self-reports, informant reports and behavioural assessments. Enquire, 1(1), 1–19.
  • Mõttus, R., Johnson, W., & Deary, I. J. (2012). Personality traits in old age: Measurement and rank-order stability and some mean-level change. Psychology and Aging, 27(1), 243–249. doi:10.1037/a0023690
  • Roberts, B. W., & DelVecchio, W. F. (2000). The rank-order consistency of personality traits from childhood to old age: A quantitative review of longitudinal studies. Psychological Bulletin, 126(1), 3–25. doi:10.1037/0033-2909.126.1.3
  • Roberts, B. W., Luo, J., Briley, D. A., Chow, P. I., Su, R., & Hill, P. L. (2017). A systematic review of personality trait change through intervention. Psychological Bulletin, 143(2), 117–141. doi:10.1037/bul0000088
  • Roberts, B. W., Walton, K. E., & Viechtbauer, W. (2006). Patterns of mean-level change in personality traits across the life course: A meta-analysis of longitudinal studies. Psychological Bulletin, 132(1), 1–25. doi:10.1037/0033-2909.132.1.1
  • Samuel, D. B., Hopwood, C. J., Ansell, E. B., Morey, L. C., Sanislow, C. A., Markowitz, J. C., … Grilo, C. M. (2011). Comparing the temporal stability of self-report and interview assessed personality disorder. Journal of Abnormal Psychology, 120(3), 670–680. doi:10.1037/a0022647
  • Specht, J., Egloff, B., & Schmukle, S. C. (2011). Stability and change of personality across the life course: The impact of age and major life events on mean-level and rank-order stability of the Big Five. Journal of Personality and Social Psychology, 101(4), 862–882. doi:10.1037/a0024950
  • Srivastava, S., John, O. P., Gosling, S. D., & Potter, J. (2003). Development of personality in early and middle adulthood: Set like plaster or persistent change? Journal of Personality and Social Psychology, 84(5), 1041. doi:10.1037/0022-3514.84.5.1041
  • Trull, T. J., Useda, J. D., Costa Jr, P. T., & McCrae, R. R. (1995). Comparison of the MMPI-2 Personality Psychopathology Five (PSY-5), the NEO-PI, and the NEO-PI- R. Psychological Assessment, 7(4), 508. doi:10.1037/1040-3590.7.4.508
  • Van der Heijden, P. T., Egger, J. I. M., & Derksen, J. J. L. (2008). Psychometric evaluation of the MMPI–2 restructured clinical scales in two Dutch samples. Journal of Personality Assessment, 90(5), 456–464. doi:10.1080/00223890802248745
  • Van der Heijden, P. T., Egger, J. I. M., & Derksen, J. J. L. (2010). Comparability of scores on the MMPI–2–RF scales generated with the MMPI-2 and MMPI–2–RF booklets. Journal of Personality Assessment, 93, 254–259. doi:10.1080/00223891003670208
  • Van der Heijden, P. T., Rossi, G. M., Van der Veld, W. M., Derksen, J. J., & Egger, J. I. (2013). Personality and psychopathology: Higher order relations between the five-factor model of personality and the MMPI-2 restructured Form. Journal of Research in Personality, 47(5), 572–579. doi:10.1016/j.jrp.2013.05.001
  • Wagner, J., Ram, N., Smith, J., & Gerstorf, D. (2016). Personality trait development at the end of life: Antecedents and correlates of mean-level trajectories. Journal of Personality and Social Psychology, 111(3), 411–429. doi:10.1037/pspp0000071