Development and validation of the relational depth frequency scale

References

• American Psychological Association. (2015). Demographics of the US psychology workforce: Findings from the American community survey. Washington, DC: APA. Retrieved from http://www.apa.org/workforce/publications/13-demographics/index.aspx
   Google Scholar
• Barrett-Lennard, G. T. (2015). The relationship inventory: A complete resource and iuide. London: John Wiley.
   Google Scholar
• Bordin, E. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16(3), 252–260. doi: 10.1037/h0085885
   Google Scholar
• Busse, A., & Ferri, R. B. (2003). Methodological reflections on a three-step-design combining observation, stimulated recall and interview. Zentralblatt für Didaktik der Mathematik, 35(6), 257–264. doi: 10.1007/BF02656690
   Google Scholar
• Cahill, J., Stiles, W. B., Barkham, M., Hardy, G. E., Stone, G., Agnew-Davies, R., & Unsworth, G. (2012). Two short forms of the Agnew relationship measure: The ARM-5 and ARM-12. Psychotherapy Research, 22(3), 241–255.
   PubMed Web of Science ®Google Scholar
• Castonguay, L. G., Constantino, M. J., & Holtforth, M. G. (2006). The working alliance: Where are we and where should we go? Psychotherapy: Theory, Research, Practice, Training, 43(3), 271–279. doi: 10.1037/0033-3204.43.3.271
   PubMed Web of Science ®Google Scholar
• Choi, S. W. (2016). lordif: Logistic Ordinal Regression Differential Item Functioning using IRT. R package version 0.3-3. (With contributions from Gibbons, L. E. and Crane, P. K.): ftp://200.236.31.3/CRAN/web/packages/lordif/lordif.pdf
   Google Scholar
• Cooper, M. (2005). Therapists’ experiences of relational depth: A qualitative interview study. Counselling and Psychotherapy Research, 5(2), 87–95. doi: 10.1080/17441690500211130
   Google Scholar
• Cooper, M. (2013). Experiencing relational depth in therapy: What we know so far. In R. Knox, D. Murphy, S. Wiggins, & M. Cooper (Eds.), Relational depth: New perspectives and developments (pp. 62–76). Basingstoke: Palgrave.
   Google Scholar
• Cooper, M., & Knox, R. (2018). Therapists’ self-reported chronic strategies of disconnection in everyday life and in counselling and psychotherapy: An exploratory study. British Journal of Guidance & Counselling, 46(2), 185–200. doi: 10.1080/03069885.2017.1343457
   Web of Science ®Google Scholar
• DeVellis, R. F. (2016). Scale development: Theory and applications (Vol. 26). Sage publications.
   Google Scholar
• Elliott, R., & Shapiro, D. A. (1992). Client and therapist as analysts of significant events. In S. G. Toukmanian & D. L. Rennie (Eds.), Psychotherapy process research: Paradigmatic and Narrative Approaches (pp. 163–186). London: Sage.
   Google Scholar
• Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM. British Journal of Psychiatry, 180(1), 51–60. doi: 10.1192/bjp.180.1.51
   PubMed Web of Science ®Google Scholar
• Falkenström, F., Granström, F., & Holmqvist, R. (2013). Therapeutic alliance predicts symptomatic improvement session by session. Journal of Counseling Psychology, 60, 317–328. doi: 10.1037/a0032258
   PubMed Web of Science ®Google Scholar
• Falkenström, F., Kuria, M., Othieno, C., & Kumar, M. (2018). Working alliance predicts symptomatic improvement in public hospital-delivered psychotherapy in Nairobi, Kenya. Journal of Consulting and Clinical Psychology. doi: 10.1192/S2056474000001938
   PubMed Web of Science ®Google Scholar
• Fisher, C. R. (2014). A Pedagogic Demonstration of Attenuation of Correlation Due to Measurement Error, Spreadsheets in Education (eJSiE): Vol. 7: Iss. 1, Article 4. Retrieved from http://epublications.bond.edu.au/ejsie/vol7/iss1/4
   Google Scholar
• Fluckiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018). The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy (Chic), 55(4), 316–340. doi: 10.1037/pst0000172
   PubMed Web of Science ®Google Scholar
• Fuertes, J. N., Mislowack, A., Brown, S., Gur-Arie, S., Wilkinson, S., & Gelso, C. J. (2007). Correlates of the real relationship in psychotherapy: A study of dyads. Psychotherapy Research, 17(4), 423–430. doi: 10.1080/10503300600789189
   Web of Science ®Google Scholar
• Gelso, C. J. (2004, June). A theory of real relationship in psychotherapy. International Conference of the Society for psychotherapy research, Rome.
   Google Scholar
• Gelso, C. J., Kelley, F. A., Fuertes, J. N., Marmarosh, C., Holmes, S. E., Costa, C., & Hancock, G. R. (2005). Measuring the real relationship in psychotherapy: Initial validation of the therapist form. Journal of Counseling Psychology, 52(4), 640–649. doi: 10.1037/0022-0167.52.4.640
   Web of Science ®Google Scholar
• Gelso, C. J., Kivlighan, D. M. J., & Markin, R. D. (2018). The real relationship and its role in psychotherapy outcome: A meta-analysis. Psychotherapy, 55(4), 434–445. doi: 10.1037/pst0000183
   PubMed Web of Science ®Google Scholar
• Guadagnoli, E., & Velicer, W. F. (1988). Relation to sample size to the stability of component patterns. Psychological Bulletin, 103(2), 265–275. doi: 10.1037/0033-2909.103.2.265
   PubMed Web of Science ®Google Scholar
• Hak, T., Van der Veer, K., & Jansen, H. (2004). The three-Step test-interview (TSTI): An observational instrument for pretesting self-completion questionnaires. Rotterdam: Erasmus Research Institute of Management. doi: 10.18148/srm/2008.v2i3.1669
   Google Scholar
• Hak, T., van der Veer, K., & Ommundsen, R. (2006). An Application of the three-step test interview (TSTI): A validation study of the Dutch and Norwegian versions of the ‘illegal Aliens scale’. International Journal of Social Research Methodology, 9(3), 215–227. doi: 10.1080/13645570600656264
   Google Scholar
• Hatcher, R. L., & Gillaspy, J. A. (2006). Development and validation of a revised short version of the working alliance Inventory. Psychotherapy Research, 16(1), 12–25. doi: 10.1080/10503300500352500
   Web of Science ®Google Scholar
• Hinkin, T. R. (2005). Scale development principles and practices. In R. A. Swanson & E. F. Holton III (Eds.), Research in organizations: Foundations and methods of inquiry (pp. 161–179). San Francisco: Berrett-Koehler.
   Google Scholar
• Hinkin, T. R., Tracey, J. B., & Enz, C. A. (1997). Scale construction: Developing reliable and valid measurement instruments [Electronic version]. Retrieved 22nd April 2018 from Cornell University, School of Hotel Administration site. Retrieved from http://scholarship.sha.cornell.edu/articles/613
   Google Scholar
• Horvarth, A. O., & Bedi, R. P. (2002). The alliance. In J. C. Norcross (Ed.), Psychotherapy relationships that work: Therapist contributions and Responsiveness to Patients (pp. 37–69). Oxford: Oxford University Press.
   Google Scholar
• Jansen, H., & Hak, T. (2005). The productivity of the three-step test-interview (TSTI) compared to an expert review of a self-administered questionnaire on alcohol consumption. Journal of Official Statistics, 21(1), 103–120. doi: 10.18148/srm/2008.v2i3.1669
   Google Scholar
• Kelley, F. A., Gelso, C. J., Fuertes, J. N., Marmarosh, C., & Lanier, S. H. (2010). The real relationship Inventory: Development and psychometric investigation of the client form. Psychotherapy: Theory, Research, Practice, Training, 47(4), 540–553. doi: 10.1037/a0022082
   PubMed Web of Science ®Google Scholar
• Knox, R. (2011). Clients’ experiences of relational depth (PhD dissertation). University of Strathclyde, Glasgow.
   Google Scholar
• Knox, R., & Cooper, M. (2010). Relationship qualities that are associated with moments of relational depth: The client’s perspective. Person-Centered and Experiential Psychotherapies, 9(3), 236–256. doi: 10.1080/14779757.2010.9689069
   Google Scholar
• Knox, R., Murphy, D., Wiggins, S., & Cooper, M. (2013). Relational depth: New perspectives and developments. Basingstoke: Palgrave.
   Google Scholar
• Leung, J. (2008). A quantitative online study exploring the factors associated with the experience and perception of relational depth (DPsych. dissertation). University of Strathclyde, Glasgow.
   Google Scholar
• Linacre, J. M. (2017). A user’s guide to WINSTEPS MINISTEP Rasch-model computer programs. Version 4.0.0. Winsteps.com. ISBN 0-941938-03-4
   Google Scholar
• Mavranezouli, I., Brazier, J. E., Young, T. A., & Barkham, M. (2011). Using Rasch analysis to form plausible health states amenable to valuation: The development of CORE-6D from a measure of common mental health problems (CORE-OM). Quality of Life Research, 20(3), 321–333. Retrieved from https://link.springer.com/article/10.1007/s11136-010-9768-4
   PubMed Web of Science ®Google Scholar
• Mearns, D., & Cooper, M. (2005). Working at relational depth in Counselling and psychotherapy. London: Sage.
   Google Scholar
• Mearns, D., & Cooper, M. (2018). Working at relational depth in Counselling and psychotherapy (2nd ed.). London: Sage.
   Google Scholar
• Munder, T., Wilmers, F., Leonhart, R., Linster, H. W., & Barth, J. (2010). Working alliance Inventory-short revised (WAI-SR): psychometric properties in outpatients and inpatients. Clinical Psychology & Psychotherapy, 17(3), 231–239. doi: 10.1002/cpp.658
   PubMed Web of Science ®Google Scholar
• Murphy, D., & Cramer, D. (2014). Mutuality of Rogers's therapeutic conditions and treatment progress in the first three psychotherapy sessions. Psychotherapy Research, 24(6), 651–661. doi: 10.1080/10503307.2013.874051
   PubMed Web of Science ®Google Scholar
• Norcross, J. C., & Lambert, M. J. (2018). Psychotherapy relationships that work III. Psychotherapy, 55(4), 303–315. doi: 10.1037/pst0000193
   PubMed Web of Science ®Google Scholar
• Orlinsky, D. E., Rønnestad, M. H., & Collaborative Research Network of the Society for Psychotherapy Rkesearch. (2005). How psychotherapists develop: A study of therapeutic work and professional growth. Washington, DC: American Psychological Association. doi: 10.1037/11157-000
   Google Scholar
• R Core Team. (2018). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. URL https://www.R-project.org/
   Google Scholar
• Rizopoulos, D. (2006). Ltm: An R package for latent variable Modelling and item response theory analyses. Journal of Statistical Software, 17(5), 1–25. doi: 10.18637/jss.v017.i05
   Web of Science ®Google Scholar
• Rogers, C. R. (1957). The necessary and sufficient conditions of therapeutic personality change. Journal of Consulting Psychology, 21, 95–103. doi: 10.1037/h0045357
   PubMedGoogle Scholar
• Rosseel, Y. (2012). Lavaan: An R package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1–36. doi: 10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Rubel, J. A., Bar-Kalifa, E., Atzil-Slonim, D., Schmidt, S., & Lutz, W. (2018). Congruence of therapeutic bond perceptions and its relation to treatment outcome: Within-and between-dyad effects.
   Google Scholar
• Stern, D. N. (2004). The present moment in psychotherapy and Everyday Life. New York: W. W. Norton.
   Google Scholar
• Tang, T. Z., & DeRubeis, R. J. (1999). Sudden gains and critical sessions in cognitive-behavioral therapy for depression. Journal of Consulting and Clinical Psychology, 67(6), 894–904. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.488.1236&rep=rep1&type=pdf
   PubMed Web of Science ®Google Scholar
• Tangen, J. L., & Cashwell, C. S. (2016). Touchstones of connection: A concept mapping study of counselor factors that contribute to relational depth. The Journal of Humanistic Counseling, 55(1), 20–36.
   Web of Science ®Google Scholar
• Widaman, K. F., Little, T. D., Preacher, K. J., & Sawalani, G. M. (2011). On creating and using short forms of scales in secondary research. In K. H. Trzesniewski, M. B. Donnellan, & R. E. Lucas (Eds.), Secondary data analysis: An introduction for psychologists (pp. 39–61). Washington, DC: APA. doi: 10.1037/12350-003
   Google Scholar
• Wiggins, S. (2012). Development and testing of a measure of relational depth in counselling and psychotherapy (PhD thesis). University of Strathclyde, Glasgow. Retrieved from http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.576407
   Google Scholar
• Wiggins, S., Elliott, R., & Cooper, M. (2012). The prevalence and characteristics of relational depth events in psychotherapy. Psychotherapy Research, 22(2), 139–158. doi: 10.1080/10503307.2011.629635
   PubMed Web of Science ®Google Scholar
• Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. doi: 10.1177/0011000006288127
   Web of Science ®Google Scholar
• Zilcha-Mano, S. (2017). Is the alliance really therapeutic? Revisiting this question in light of recent methodological advances. American Psychologist, 72(4), 311–325. doi: 10.1037/a0040435
   PubMed Web of Science ®Google Scholar
• Zilcha-Mano, S., Dinger, U., McCarthy, K. S., & Barber, J. P. (2014). Does alliance predict symptoms throughout treatment, or is it the other way around? Journal of Consulting and Clinical Psychology, 82(6), 931–935. doi: 10.1037/a0035141
   PubMed Web of Science ®Google Scholar