Quantitative naturalistic methods for detecting change points in psychotherapy research: An illustration with alliance ruptures

References

• Aderka , I.M. , Nickerson , A. , Bøe , H.J. and Hofmann , S.G. 2012 . Sudden gains during psychological treatments of anxiety and depression: A meta-analysis . Journal of Consulting and Clinical Psychology , 80 : 93 – 101 .
   PubMed Web of Science ®Google Scholar
• Agnew , R.M. , Harper , H. , Shapiro , D.A. and Barkham , M. 1994 . Resolving a challenge to the therapeutic relationship: A single-case study . British Journal of Medical Psychology , 67 : 155 – 170 .
   PubMed Web of Science ®Google Scholar
• Agnew-Davies , R. , Stiles , W.B. , Hardy , G.E. , Barkham , M. and Shapiro , D.A. 1998 . Alliance structure assessed by the Agnew Relationship Measure (ARM) . British Journal of Clinical Psychology , 37 : 155 – 172 .
   PubMed Web of Science ®Google Scholar
• Alemi , F. 2004 . Tukey's control chart . Quality Management in Health Care , 13 : 216 – 221 .
   PubMedGoogle Scholar
• Battle , C.C. , Imber , S.D. , Hoehn-Saric , R. , Stone , A.R. , Nash , E.R. and Frank , J.D. 1966 . Target complaints as criteria of improvement . American Journal of Psychotherapy , 20 : 184 – 192 .
   PubMed Web of Science ®Google Scholar
• Bergin , A.E. and Strupp , H.H. 1972 . Changing frontiers in the science of psychotherapy , Chicago : Aldine .
   Google Scholar
• Berk , E. , Safran , J.D. , Muran , J.C. , & Eubanks-Carter , C. 2010 , June . The development of the Segmented Working Alliance Inventory-Observer Form (S-WAI-O) . In C. Eubanks-Carter (Chair) , Advances in observer-based methods for identifying and examining alliance ruptures and resolutions and their relationship to process and outcome . Panel conducted at the annual meeting of the Society for Psychotherapy Research , Asilomar , California .
   Google Scholar
• Borckardt , J.J. 2006 . DataTool (Version 1.0) [Computer software] . Knoxville , TN : ClinicalResearcher .
   Google Scholar
• Callahan , C.D. and Barisa , M.T. 2005 . Statistical process control and rehabilitation outcome: The single-subject design reconsidered . Rehabilitation Psychology , 50 : 24 – 33 .
   Web of Science ®Google Scholar
• Cattell , R. B. 1966 . The scree test for the number of factors . Multivariate Behavioral Research , 1 : 245 – 276 .
   PubMed Web of Science ®Google Scholar
• Derogatis , L.R. 1983 . SCL-90-R: Administration, scoring, & procedures manual II , Towson , MD : Clinical Psychiatric Research .
   Google Scholar
• Duncan , A.J. 1986 . Quality control and industrial statistics , 5th ed , Homewood , IL : Irwin .
   Google Scholar
• Endicott , J. , Spitzer , R.L. , Fleiss , J.L. and Cohen , J. 1976 . The Global Assessment Scale: A procedure for measuring overall severity of psychiatric disturbance . Archives of General Psychiatry , 33 : 766 – 771 .
   PubMed Web of Science ®Google Scholar
• Erdman , C. and Emerson , J.W. 2007 . Bcp: An R package for performing a Bayesian analysis of change point problems . Journal of Statistical Software , 23 ( 3 ) : 1 – 13 .
   Web of Science ®Google Scholar
• Eubanks-Carter , C. , Muran , J.C. and Safran , J.D. 2010 . “ Alliance ruptures and resolution ” . In The therapeutic alliance: An evidence-based approach to practice and training , Edited by: Muran , J.C. and Barber , J.P. 74 – 94 . New York : Guilford Press .
   Google Scholar
• Finch , A.E. , Lambert , M.J. and Schaalje , B.G. 2001 . Psychotherapy quality control: The statistical generation of expected recovery curves for integration into an early warning system . Clinical Psychology & Psychotherapy , 8 : 231 – 242 .
   Web of Science ®Google Scholar
• First , M.B. , Spitzer , R.L. , Gibbon , M. and Williams , J.B.W. 1995 . Structured Clinical Interview for DSM-IV , New York : Biometrics Research Department, New York Psychiatric Institute .
   Google Scholar
• Fisher , W.D. 1958 . On grouping for maximum homogeneity . Journal of the American Statistical Association , 53 : 789 – 798 .
   Web of Science ®Google Scholar
• Fox , J. 2005 . The R Commander: A basic-statistics graphical user interface to R . Journal of Statistical Software , 14 : 1 – 42 .
   Web of Science ®Google Scholar
• Gorman , B.S. and Allison , D.B. 1996 . “ Statistical alternatives for single-case designs ” . In Design and analysis of single-case research , Edited by: Franklin , R.D. , Allison , D.B. and Gorman , B.S. 159 – 214 . Hillsdale , NJ : Lawrence Erlbaum .
   Google Scholar
• Greenberg , L.S. 1986 . Change process research . Journal of Consulting and Clinical Psychology , 54 : 4 – 9 .
   PubMed Web of Science ®Google Scholar
• Greenberg , L.S. and Watson , J.C. 2006 . “ Change process research ” . In Evidence-based practices in mental health: Debate and dialogue on the fundamental questions , Edited by: Norcross , J.C. , Beutler , L.E. and Levant , R.F. 81 – 89 . Washington , DC : American Psychological Association .
   Google Scholar
• Hartigan , J.A. 1975 . Clustering algorithms , New York : Wiley .
   Google Scholar
• Hayes , A.M. , Laurenceau , J.-P. , Feldman , G. , Strauss , J.L. and Cardaciotto , L. 2007 . Change is not always linear: The study of nonlinear and discontinuous patterns of change in psychotherapy . Clinical Psychology Review , 27 : 715 – 723 .
   PubMed Web of Science ®Google Scholar
• Hoaglin , D.C. , Mosteller , F. , & Tukey , J.W. 2000 . Understanding robust and exploratory data analysis . New York : Wiley-Interscience .
   Google Scholar
• Hopwood , C.J. , Pincus , A.L. , DeMoor , R.M. and Koonce , E.A. 2008 . Psychometric characteristics of the Inventory of Interpersonal Problems-Short Circumplex (IIP-SC) with college students . Journal of Personality Assessment , 90 : 615 – 618 .
   PubMed Web of Science ®Google Scholar
• Horowitz , L.M. , Alden , L.E. , Wiggens , J.S. and Pincus , A.L. 2000 . Inventory of Interpersonal Problems , New York : The Psychological Corporation .
   Google Scholar
• Horvath , A.O. and Greenberg , L.S. 1989 . Development and validation of the Working Alliance Inventory . Journal of Counseling Psychology , 36 : 223 – 233 .
   Web of Science ®Google Scholar
• Huber , P. J. 1981 . Robust Statistics , New York : Wiley .
   Google Scholar
• Jacobson , N.S. and Truax , P. 1991 . Clinical significance: A statistical approach to defining meaningful change in psychotherapy research . Journal of Consulting and Clinical Psychology , 59 : 12 – 19 .
   PubMed Web of Science ®Google Scholar
• Kazdin , A.E. 2007 . Mediators and mechanisms of change in psychotherapy research . Annual Review of Clinical Psychology , 3 : 1 – 27 .
   PubMed Web of Science ®Google Scholar
• Kim , H.-J. , Fay , M.P. , Feuer , E.J. and Midthune , D.N. 2000 . Permutation tests for joinpoint regression with applications to cancer rates . Statistics in Medicine , 19 : 335 – 351 .
   PubMed Web of Science ®Google Scholar
• Kivlighan , D.M. and Shaughnessy , P. 2000 . Patterns of working alliance development: A typology of client's working alliance ratings . Journal of Counseling Psychology , 47 : 362 – 371 .
   Web of Science ®Google Scholar
• Klein , M.H. , Benjamin , L.S. , Treece , C. , Rosenfeld , R. and Greist , J. 1993 . The Wisconsin Personality Inventory: Development, reliability and validity . Journal of Personality Disorders , 7 : 285 – 303 .
   Web of Science ®Google Scholar
• Kramer , U. , de Roten , Y. , Beretta , V. , Michel , L. and Despland , J.-N. 2008 . Patient's and therapist's views of early alliance building in dynamic psychotherapy: Patterns and relation to outcome . Journal of Counseling Psychology , 55 : 89 – 95 .
   Web of Science ®Google Scholar
• Lambert , M. 2007 . Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care . Psychotherapy Research , 17 : 1 – 14 .
   Web of Science ®Google Scholar
• Marmar , C.R. , Weiss , D.S. and Gaston , L. 1989 . Toward the validation of the California Therapeutic Alliance Rating System . Psychological Assessment , 1 : 46 – 52 .
   Google Scholar
• Mergenthaler , E. 1996 . Emotion-abstraction patterns in verbatim protocols: A new way of describing psychotherapeutic processes . Journal of Consulting and Clinical Psychology , 64 : 1306 – 1315 .
   PubMed Web of Science ®Google Scholar
• Muran , J.C. 2002 . A relational approach to understanding change: Plurality and contextualism in a psychotherapy research program . Psychotherapy Research , 12 : 113 – 138 .
   Web of Science ®Google Scholar
• Muran , J.C. , Safran , J.D. , Gorman , B.S. , Samstag , L.W. , Eubanks-Carter , C. and Winston , A. 2009 . The relationship of early alliance ruptures and their resolution to process and outcome in three time-limited psychotherapies for personality disorders . Psychotherapy: Theory, Research, Practice, Training , 46 : 233 – 248 .
   PubMed Web of Science ®Google Scholar
• Muran , J.C. , Safran , J.D. , Samstag , L.W. and Winston , A. 1992 . Patient and therapist postsession questionnaires, Version 1992 , New York : Beth Israel Medical Center .
   Google Scholar
• Muran , J.C. , Safran , J.D. , Samstag , L.W. and Winston , A. 2005 . Evaluating an alliance-focused treatment for personality disorders . Psychotherapy: Theory, Research, Practice, Training , 42 : 532 – 545 .
   Web of Science ®Google Scholar
• National Cancer Institute . 2008 . Joinpoint Regression Program, Version 3.3 [Computer software] . Retrieved from http://srab.cancer.gov/joinpoint/ .
   Google Scholar
• Page , E.S. 1954 . Continuous inspection schemes . Biometrika , 41 : 100 – 115 .
   Web of Science ®Google Scholar
• Pande , P.S. , Neuman , R.P. and Cavanagh , R.R. 2000 . The Six Sigma way: How GE, Motorola, and other top companies are honing their performance , New York : McGraw-Hill .
   Google Scholar
• Pascual-Leone , A. 2009 . Dynamic emotional processing in experiential therapy: Two steps forward, one step back . Journal of Consulting and Clinical Psychology , 77 : 113 – 126 .
   PubMed Web of Science ®Google Scholar
• Pfadt , A. and Wheeler , D.J. 1995 . Using statistical process control to make data-based clinical decisions . Journal of Applied Behavior Analysis , 28 : 349 – 370 .
   PubMed Web of Science ®Google Scholar
• R Development Core Team . 2004 . R: A language and environment for statistical computing . Vienna : R Foundation for Statistical Computing .
   Google Scholar
• Roberts , S.W. 1959 . Control chart tests based on geometric moving averages . Technometrics , 1 : 239 – 250 .
   Google Scholar
• Rodionov , S. 2004 . A sequential algorithm for testing climate regime shifts . Geophysical Research Letters , 31 , L09204 . doi: 10.1029/2004GL019448 .
   Web of Science ®Google Scholar
• Safran , J.D. and Muran , J.C. 1996 . The resolution of ruptures in the therapeutic alliance . Journal of Consulting and Clinical Psychology , 64 : 447 – 458 .
   PubMed Web of Science ®Google Scholar
• Safran , J.D. and Muran , J.C. 2000 . Negotiating the therapeutic alliance: A relational treatment guide , New York : Guilford Press .
   Google Scholar
• Safran , J.D. , Muran , J.C. and Eubanks-Carter , C. 2011 . “ Repairing alliance ruptures ” . In Psychotherapy relationships that work: Evidence-based responsiveness , 2nd ed , Edited by: Norcross , J.C. 224 – 238 . New York : Oxford University Press .
   Google Scholar
• Scrucca , L. 2004 . qcc: an R package for quality control charting and statistical process control . R News , 4 ( 1 ) : 11 – 17 .
   Google Scholar
• Shewhart , W.A. 1931 . Economic control of quality of manufactured product , Princeton , NJ : Van Nostrand-Reinhold Co .
   Google Scholar
• Soldz , S. , Budman , S. , Demby , A. and Merry , J. 1995 . A short form of the Inventory of Interpersonal Problems Circumplex scales . Assessment , 2 : 53 – 63 .
   Google Scholar
• Sommerfeld , E. , Orbach , I. , Zim , S. and Mikulincer , M. 2008 . An in-session exploration of ruptures in working alliance and their associations with clients’ core conflictual relationship themes, alliance-related discourse, and clients’ postsession evaluation . Psychotherapy Research , 18 : 377 – 388 .
   PubMed Web of Science ®Google Scholar
• Stevens , C.L. , Muran , J.C. , Safran , J.D. , Gorman , B.S. and Winston , A. 2007 . Levels and patterns of the therapeutic alliance in brief psychotherapy . American Journal of Psychotherapy , 61 : 109 – 129 .
   PubMedGoogle Scholar
• Stiles , W.B. , Glick , M.J. , Osatuke , K. , Hardy , G.E. , Shapiro , D.A. Agnew-Davies , R. 2004 . Patterns of alliance development and the rupture-repair hypothesis: Are productive relationships U-shaped or V-shaped? . Journal of Counseling Psychology , 51 : 81 – 92 .
   Web of Science ®Google Scholar
• Strauss , J.L. , Hayes , A.M. , Johnson , S.L. , Newman , C.F. , Brown , G.K. Barber , J.P. 2006 . Early alliance, alliance ruptures, and symptom change in a nonrandomized trial of cognitive therapy for avoidant and obsessive-compulsive personality disorders . Journal of Consulting and Clinical Psychology , 74 : 337 – 345 .
   PubMed Web of Science ®Google Scholar
• Tang , T.Z. and DeRubeis , R.J. 1999 . Sudden gains and critical sessions in cognitive-behavioral therapy for depression . Journal of Consulting and Clinical Psychology , 67 : 894 – 904 .
   PubMed Web of Science ®Google Scholar
• Taylor , W.A. 2000 . Change-Point Analyzer [Computer software] . Libertyville , IL : Taylor Enterprises, Inc .
   Google Scholar
• Tracey , T.J. and Kokotovic , A.M. 1989 . Factor structure of the Working Alliance Inventory . Psychological Assessment , 1 : 207 – 210 .
   Google Scholar
• Tryon , G.S. , Blackwell , S.C. and Hammel , E.F. 2008 . The magnitude of client and therapist working alliance ratings . Psychotherapy: Theory, Research, Practice, Training , 45 : 546 – 551 .
   PubMed Web of Science ®Google Scholar
• Wild , C.J. and Seber , G.A.F. 2000 . Chance encounters: A first course in data analysis and inference , New York : John Wiley & Sons .
   Google Scholar
• Western Electric . 1956 . Statistical Quality Control Handbook . Indianapolis , IN : Western Electric Corporation .
   Google Scholar
• Wheeler , D.J. and Chambers , D.S. 1992 . Understanding statistical process control , 2nd ed , Knoxville , TN : SPC Press .
   Google Scholar
• Woodall , W.H. 2000 . Controversies and contradictions in statistical process control . Journal of Quality Technology , 32 : 341 – 350 .
   Web of Science ®Google Scholar
• Zeileis , A. , Leisch , F. , Hornik , K. and Kleiber , C. 2002 . strucchange: An R package for testing for structural change in linear regression models . Journal of Statistical Software , 7 : 1 – 38 .
   Google Scholar