Feasibility of generic, short, and easy-to-use assessment of psychological distress during psychotherapy: Longitudinal measurement invariance of CORE-10 and -OM

References

• Arndt, A., Lutz, W., Rubel, J., Berger, T., Meyer, B., Schröder, J., Späth, C., Hautzinger, M., Fuhr, K., Rose, M., Hohagen, F., Klein, J. P., & Moritz, S. (2020). Identifying change-dropout patterns during an internet-based intervention for depression by applying the Muthen-Roy model. Cognitive Behaviour Therapy, 49(1), 22–40. https://doi.org/10.1080/16506073.2018.1556331
   PubMed Web of Science ®Google Scholar
• Barkham, M., Bewick, B., Mullin, T., Gilbody, S., Connell, J., Cahill, J., Mellor-Clark, J., Richards, D., Unsworth, G., & Evans, C. (2013). The CORE-10: A short measure of psychological distress for routine use in the psychological therapies. Counselling and Psychotherapy Research, 13(1), 3–13. https://doi.org/10.1080/14733145.2012.729069
   Google Scholar
• Barkham, M. C., Evans, C., Margison, F., McGrath, G., Mellor-Clark, J., Milne, D., & Connell, J. (1998). The rationale for developing and outcome batteries for routine use in service settings and psychotherapy outcome research implementing core. Journal of Mental Health, 7(1), 35–47. https://doi.org/10.1080/09638239818328
   Google Scholar
• Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., Meier, M. H., Ramrakha, S., Shalev, I., Poulton, R., & Moffitt, T. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2(2), 119–137. https://doi.org/10.1177/2167702613497473
   PubMedGoogle Scholar
• Caspi, A., & Moffitt, T. E. (2018). All for one and one for all: Mental disorders in one dimension. The American Journal of Psychiatry, 175(9), 831–844. https://doi.org/10.1176/appi.ajp.2018.17121383
   PubMed Web of Science ®Google Scholar
• Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
   Web of Science ®Google Scholar
• Constantinou, M. P., Goodyer, I. M., Eisler, I., Butler, S., Kraam, A., Scott, S., Pilling, S., Simes, E., Ellison, R., Allison, E., & Fonagy, P. (2019). Changes in general and specific psychopathology factors over a psychosocial intervention. Journal of the American Academy of Child and Adolescent Psychiatry, 58(8), 776–786. https://doi.org/10.1016/j.jaac.2018.11.011
   PubMed Web of Science ®Google Scholar
• Counsell, A., Cribbie, R. A., & Flora, D. B. (2020). Evaluating equivalence testing methods for measurement invariance. Multivariate Behavioral Research, 55(2), 312–328. https://doi.org/10.1080/00273171.2019.1633617
   PubMed Web of Science ®Google Scholar
• Cuijpers, P., Cristea, I. A., Karyotaki, E., Reijnders, M., & Hollon, S. D. (2019). Component studies of psychological treatments of adult depression: A systematic review and meta-analysis. Psychotherapy Research, 29(1), 15–29. https://doi.org/10.1080/10503307.2017.1395922
   PubMed Web of Science ®Google Scholar
• Cuijpers, P., Reijnders, M., & Huibers, M. J. H. (2019). The role of common factors in psychotherapy outcomes. Annual Review of Clinical Psychology, 15(1), 207–231. https://doi.org/10.1146/annurev-clinpsy-050718-095424
   PubMed Web of Science ®Google Scholar
• de Jonge, P., Wardenaar, K. J., Lim, C. C. W., Aguilar-Gaxiola, S., Alonso, J., Andrade, L. H., Bunting, B., Chatterji, S., Ciutan, M., Gureje, O., Karam, E. G., Lee, S., Medina-Mora, M. E., Moskalewicz, J., Navarro-Mateu, F., Pennell, B.-E., Piazza, M., Posada-Villa, J., Torres, Y., … Scott, K. (2018). The cross-national structure of mental disorders: Results from the world mental health surveys. Psychological Medicine, 48(12), 2073–2084. https://doi.org/10.1017/S0033291717003610
   PubMed Web of Science ®Google Scholar
• Diamantopoulos, A., Riefler, P., & Roth, K. P. (2008). Advancing formative measurement models. Journal of Business Research, 61(12), 1203–1218. https://doi.org/10.1016/j.jbusres.2008.01.009
   Web of Science ®Google Scholar
• Eaton, N. R., Krueger, R. F., Keyes, K. M., Skodol, A. E., Markon, K. E., Grant, B. F., & Hasin, D. S. (2011). Borderline personality disorder co-morbidity: Relationship to the internalizing–externalizing structure of common mental disorders. Psychological Medicine, 41(5), 1041–1050. https://doi.org/10.1017/S0033291710001662
   PubMed Web of Science ®Google Scholar
• Eid, M., Geiser, C., Koch, T., & Heene, M. (2017). Anomalous results in G-factor models: Explanations and alternatives. Psychological Methods, 22(3), 541–562. https://doi.org/10.1037/met0000083
   PubMed Web of Science ®Google Scholar
• Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. The British Journal of Psychiatry, 180(1), 51–60. https://doi.org/10.1192/bjp.180.1.51
   PubMed Web of Science ®Google Scholar
• Garrido, L. E., Abad, F. J., & Ponsoda, V. (2013). A new look at Horn’s parallel analysis with ordinal variables. Psychological Methods, 18(4), 454–474. https://doi.org/10.1037/a0030005
   PubMed Web of Science ®Google Scholar
• Garrido, L. E., Abad, F. J., & Ponsoda, V. (2016). Are fit indices really fit to estimate the number of factors with categorical variables? Some cautionary findings via Monte Carlo simulation. Psychological Methods, 21(1), 93–111. https://doi.org/10.1037/met0000064
   PubMed Web of Science ®Google Scholar
• Gluschkoff, K., Jokela, M., & Rosenström, T. (2019). The general psychopathology factor: Structural stability and generalizability to within-individual changes. Frontiers in Psychiatry, 10, 594. https://doi.org/10.3389/fpsyt.2019.00594
   PubMed Web of Science ®Google Scholar
• Gluschkoff, K., Jokela, M., & Rosenström, T. (2021). The general psychopathology factor and borderline personality disorder: Evidence for significant overlap from two nationally representative surveys of US adults. Personality Disorders: Theory, Research, and Treatment, 12(1), 86–92. https://doi.org/10.1037/per0000405
   Web of Science ®Google Scholar
• Goulet-Pelletier, J.-C., & Cousineau, D. (2018). A review of effect sizes and their confidence intervals, part I: The Cohen’s d family. The Quantitative Methods for Psychology, 14(4), 242–265. https://doi.org/10.20982/tqmp.14.4.p242
   Web of Science ®Google Scholar
• Hayashi, K., Bentler, P. M., & Yuan, K.-H. (2007). On the likelihood ratio test for the number of factors in exploratory factor analysis. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 505–526. https://doi.org/10.1080/10705510701301891
   Web of Science ®Google Scholar
• Honkalampi, K., Laitila, A., Juntunen, H., Lehmus, K., Piiparinen, A., Törmänen, I., Inkinen, M., & Evans, C. (2017). The Finnish clinical outcome in routine evaluation outcome measure: Psychometric exploration in clinical and non-clinical samples. Nordic Journal of Psychiatry, 71(8), 589–597. https://doi.org/10.1080/08039488.2017.1365378
   PubMed Web of Science ®Google Scholar
• Hopwood, C. J., Bagby, R. M., Gralnick, T., Ro, E., Ruggero, C., Mullins-Sweatt, S., Kotov, R., Bach, B., Cicero, D. C., Krueger, R. F., Patrick, C. J., Chmielewski, M., DeYoung, C. G., Docherty, A. R., Eaton, N. R., Forbush, K. T., Ivanova, M. Y., Latzman, R. D., Pincus, A. L., … Zimmermann, J. (2020). Integrating psychotherapy with the hierarchical taxonomy of psychopathology (HiTOP). Journal of Psychotherapy Integration, 30(4), 477–497. https://doi.org/10.1037/int0000156
   Web of Science ®Google Scholar
• Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993). A phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology, 61(4), 678–685. https://doi.org/10.1037/0022-006X.61.4.678
   PubMed Web of Science ®Google Scholar
• Jennrich, R. I., & Bentler, P. M. (2011). Exploratory bi-factor analysis. Psychometrika, 76(4), 537–549. https://doi.org/10.1007/s11336-011-9218-4
   PubMed Web of Science ®Google Scholar
• Juntunen, H., Piiparinen, A., Honkalampi, K., Inkinen, M., & Laitila, A. (2015). CORE-OM-mittarin suomalainen validointitutkimus yleisväestössä [The Finnish validation study of the CORE-OM measure: Non-clinical sample]. Psykologia, 50(4), 257–276. https://urn.fi/URN:NBN:fi:ELE-1768688
   Google Scholar
• Kotov, R., Krueger, R. F., Watson, D., Cicero, D. C., Conway, C. C., DeYoung, C. G., Eaton, N. R., Forbes, M. K., Hallquist, M. N., Latzman, R. D., Mullins-Sweatt, S. N., Ruggero, C. J., Simms, L. J., Waldman, I. D., Waszczuk, M. A., & Wright, A. G. C. (2021). The hierarchical taxonomy of psychopathology (HiTOP): A quantitative nosology based on consensus of evidence. Annual Review of Clinical Psychology, 17(1), 83–108. https://doi.org/10.1146/annurev-clinpsy-081219-093304
   PubMedGoogle Scholar
• Lahey, B. B., Moore, T. M., Kaczkurkin, A. N., & Zald, D. H. (2021). Hierarchical models of psychopathology: Empirical support, implications, and remaining issues. World Psychiatry, 20(1), 57–63. https://doi.org/10.1002/wps.20824
   PubMed Web of Science ®Google Scholar
• Liu, Y., Millsap, R. E., West, S. G., Tein, J.-Y., Tanaka, R., & Grimm, K. J. (2017). Testing measurement invariance in longitudinal data with ordered-categorical measures. Psychological Methods, 22(3), 486–506. https://doi.org/10.1037/met0000075
   PubMed Web of Science ®Google Scholar
• Lyne, K. J., Barrett, P., Evans, C., & Barkham, M. (2006). Dimensions of variation on the CORE-OM. The British Journal of Clinical Psychology, 45(Pt 2), 185–203. https://doi.org/10.1348/014466505X39106
   PubMedGoogle Scholar
• Markon, K. E. (2019). Bifactor and hierarchical models: Specification, inference, and interpretation. Annual Review of Clinical Psychology, 15(1), 51–69. https://doi.org/10.1146/annurev-clinpsy-050718-095522
   PubMed Web of Science ®Google Scholar
• Murray, A. L., McKenzie, K., Murray, K., & Richelieu, M. (2020). Examining response shifts in the clinical outcomes in routine evaluation-outcome measure (CORE-OM). British Journal of Guidance & Counselling, 48(2), 276–288. https://doi.org/10.1080/03069885.2018.1483007
   Web of Science ®Google Scholar
• Oltmanns, J. R., Smith, G. T., Oltmanns, T. F., & Widiger, T. A. (2018). General factors of psychopathology, personality, and personality disorder: Across domain comparisons. Clinical Psychological Science, 6(4), 581–589. https://doi.org/10.1177/2167702617750150
   PubMed Web of Science ®Google Scholar
• Ringwald, W. R., Forbes, M. K., & Wright, A. G. C. (2021). Meta-analysis of structural evidence for the hierarchical taxonomy of psychopathology (HiTOP) model. Psychological Medicine, 1–14. https://doi.org/10.1017/S0033291721001902
   Google Scholar
• Rosenström, T., Gjerde, L. C., Krueger, R. F., Aggen, S. H., Czajkowski, N. O., Gillespie, N. A., Kendler, K. S., Reichborn-Kjennerud, T., Torvik, F. A., & Ystrom, E. (2019). Joint factorial structure of psychopathology and personality. Psychological Medicine, 49(13), 2158–2167. https://doi.org/10.1017/S0033291718002982
   PubMed Web of Science ®Google Scholar
• Rosenström, T., Ritola, V., Saarni, S., Joffe, G., & Stenberg, J.-H. (2021). Measurement invariant but non-normal treatment responses in guided internet psychotherapies for depressive and generalized anxiety disorders. Assessment, https://doi.org/10.1177/10731911211062500
   PubMed Web of Science ®Google Scholar
• Skre, I., Friborg, O., Elgarøy, S., Evans, C., Myklebust, L. H., Lillevoll, K., Sørgaard, K., & Hansen, V. (2013). The factor structure and psychometric properties of the clinical outcomes in routine evaluation-outcome measure (CORE-OM) in Norwegian clinical and non-clinical samples. BMC Psychiatry, 13(1), 99. https://doi.org/10.1186/1471-244X-13-99
   PubMedGoogle Scholar
• Stochl, J., Fried, E. I., Fritz, J., Croudace, T. J., Russo, D. A., Knight, C., Jones, P. B., & Perez, J. (2020). On dimensionality, measurement invariance, and suitability of sum scores for the PHQ-9 and the GAD-7. Assessment, 29(3), 355–366. https://doi.org/10.1177/1073191120976863
   PubMed Web of Science ®Google Scholar
• Verhulst, B., & Neale, M. C. (2021). Best practices for binary and ordinal data analyses. Behavior Genetics, 51(3), 204–214. https://doi.org/10.1007/s10519-020-10031-x
   PubMed Web of Science ®Google Scholar
• Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2nd ed.). Routledge.
   Google Scholar
• Yuan, K.-H., & Chan, W. (2016). Measurement invariance via multigroup SEM: Issues and solutions with chi-square-difference tests. Psychological Methods, 21(3), 405–426. https://doi.org/10.1037/met0000080
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., Chan, W., Marcoulides, G. A., & Bentler, P. M. (2016). Assessing structural equation models by equivalence testing with adjusted fit indexes. Structural Equation Modeling: A Multidisciplinary Journal, 23(3), 319–330. https://doi.org/10.1080/10705511.2015.1065414
   Web of Science ®Google Scholar
• Zeldovich, M., & Alexandrowicz, R. W. (2019). Comparing outcomes: The clinical outcome in routine evaluation from an international point of view. International Journal of Methods in Psychiatric Research, 28(3), e1774. https://doi.org/10.1002/mpr.1774
   PubMed Web of Science ®Google Scholar