209
Views
0
CrossRef citations to date
0
Altmetric
ORIGINAL RESEARCH

Validation of the Working Alliance Inventory- Short Form for Patient (WAI-S-P) in Peruvian Adults

, , , & ORCID Icon
Pages 2365-2376 | Received 24 May 2023, Accepted 10 Aug 2023, Published online: 25 Sep 2023

Abstract

Background

Although the importance of the therapeutic alliance in the treatment process and health outcomes is recognized, so far, there has been no evaluation in the Peruvian context that considers possible individual differences that could influence this assessment.

Purpose

This study assessed the psychometric properties of the WAI-S-P in a sample of individuals from Peru who are receiving psychological therapy. Furthermore, a network analysis was conducted to investigate the direct relationships between the therapeutic alliance and several relevant sociodemographic variables.

Methods

The short version of the Working Alliance Inventory was used in a sample of 241 participants (Mage=32.58, SD=12.67) that had attended less than 6 sessions. Three models were considered, including a three-factor and a two-factor correlated model, as well as a bifactor model. In addition, a network of partial associations was created including the overall therapeutic alliance, sex, age, and number of psychotherapeutic sessions.

Results

The bifactor model, with an overall therapeutic alliance factor and two specific factors (“contact” and “contract”), better fit the data. Invariance of the structure by sex and age showed equitable measurement. On the other hand, network analysis revealed a positive correlation between total session attendance and therapeutic alliance. Men reported higher therapeutic alliance, while women had higher total session attendance.

Conclusion

The results of this study suggest that the therapeutic alliance is better represented by a bifactor model and demonstrates invariance across sex and age in Peruvian adults. Additionally, findings indicate that differences in life experiences and the sex of patients may need to be verified in future studies to better understand nuanced needs in forming therapeutic alliances at least in the early stages of session attendance.

Introduction

The therapeutic alliance is an interactive process that has its roots in Freud’s ideas on transference and was later explored by Rogers in the context of humanistic therapy, emphasizing the importance of the therapist’s empathy towards the patient.Citation1 The systematic study and conceptualization of the therapeutic alliance was carried out by Anderson,Citation2 who introduced the term “rapport”. Since then, several researchers have contributed to the empirical testing of this concept.Citation3,Citation4

The therapeutic alliance can be described as a collaborative relationship that is established between an individual seeking treatment and the mental health professional, and is one of the key elements in both receiving and providing psychotherapy.Citation5,Citation6 In fact, the therapeutic alliance is considered a predictor of the success or failure of a psychotherapeutic treatment, regardless of the approach used.Citation7 In addition, this factor is relevant in the appropriate management of various mental health disorders, such as schizophrenia,Citation8 post-traumatic stress,Citation9 depression and anxiety,Citation10 personality disorders,Citation11 addiction,Citation12 eating disorders,Citation13 and obsessive-compulsive disorder.Citation14

Among the elements involved in the therapeutic alliance, previous research has highlighted its relationship with patient dropout,Citation15,Citation16 therapeutic failure,Citation17,Citation18 insight,Citation8 participation in therapy and symptom reduction,Citation19,Citation20 commitment and satisfaction with therapy,Citation21 and the results of the treatment.Citation22 These findings indicate that the therapeutic alliance in psychotherapy is crucial for managing progress to prevent discontinuity and improve satisfaction outcomes. Additionally, as supported by a systematic review, these results suggest that therapeutic alliance plays a crucial role in influencing the effectiveness of the change process even across diverse patients, disorders, and settings.Citation23

Previous research has found that sociodemographic aspects such as age and sex can play a significant role in the establishment of an adequate therapeutic alliance, particularly in the early stages of the sessions. For example, research with large samples has revealed significant differences according to sex in seeking psychological help,Citation24 as well as a higher positive response to psychological therapy in older adults compared to young individuals.Citation25 Despite these findings, differences according to sex and age in psychotherapy alliance have not been profoundly studied in the literature. Some research has identified that age may be a predictor of the quality of the therapeutic alliance in the context of online psychological therapy,Citation26 while others have reported the effects of this variable on treatment improvement when therapists are younger than patients.Citation27 Previous research with young adults, as a systematic reviewCitation28 suggests that they are more willing to seek psychological support, particularly with therapists who establish a strong, friendly, and highly individualized relationship. This strengthened therapeutic alliance can play a significant role in motivating young adults to continue attending additional therapy sessions. However, studies specifically examining the influence of age on the therapeutic alliance are still limited in the scientific literature. Regarding sex, there is evidence that men are less likely to seek psychological care;Citation29 however, when they do, they tend to focus more on intervention tasks than women.Citation30 On the other hand, it has been observed that women tend to seek psychological help more than men,Citation31 however, results regarding trust, commitment, and satisfaction with therapists of both sexes are mixed and vary across studies.Citation27,Citation32 Therefore, based on such evidence, it is necessary to continue investigating whether age and sex are relevant variables at the time of initiating or maintaining an adequate therapeutic relationship.

Due to the importance of the therapeutic alliance, several instruments have been developed for its study and measurement. These instruments have been designed in versions intended to be completed by both the therapist and the patient. A systematic review identified 32 different scales, questionnaires, and inventories to measure therapeutic alliance. Among these options, the Working Alliance Inventory in its patient version (WAI-P) stands out due to its solid theoretical support and psychometric properties tested in various populations.Citation1,Citation33 The WAI-P, developed by Horvath and Greenberg, is a widely used scale to assess therapeutic alliance.Citation34 The original version consists of 36 items that are grouped into three main dimensions. The first dimension, called “Bonds”, refers to the establishment of an interpersonal bond based on trust, acceptance, and confidence between patient and the therapist. The second dimension, called “Goals”, involves the agreement between the patient and the therapist on therapeutic goals, which should be perceived as relevant and effective. The third dimension, called “Tasks”, focuses on the specific activities or tasks that will be carried out to achieve the therapeutic objectives and agreements previously established.Citation34,Citation35 However, there is also a short version called WAI-SP, which consists of 12 items developed by Tracey & Kokotovic.Citation36

Although the WAI-SP is widely used, research that has evaluated the psychometric properties of the instrument has revealed inconsistencies in its internal structure; which were mostly examined by means of exploratory and confirmatory factor analysis, yielding divergent results of 1, 2, and 3 factors, including proposals for bifactor models.Citation6,Citation20,Citation37 For example, the original WAI-SP study found that the bifactor model, which includes one general factor and three specific factors, had a better fit in both the patient and therapist versions,Citation36 This measurement model has also been replicated in a study conducted in Norway.Citation38 In addition, the three-factor correlated structure of the WAI-SP has been validated in different countries. For example, in Canada,Citation39 Turkey,Citation40 and Poland.Citation41 Recent research also confirms this factorial model in Asian participants from ChinaCitation42 where favorable results were obtained for the bifactor model, and Thailand, where both the unidimensional and three-dimensional models are plausible, suggesting that both structures are equally valid for explaining the nature of the therapeutic alliance in that context.Citation43 It has even been observed that the factor structure of the WAI-SP remains invariant over time, ie, it does not vary between different psychotherapeutic sessions.Citation44 While other research focused only on evaluating the internal consistency of the instrument.Citation33,Citation45

On the other hand, an example of a study that proposed an alternative psychometric-theoretical model for the WAI-SP was carried out in Belgium, where a two-factor model was developed: contact and contract. These factors represent the interpersonal bond of trust and commitment to achieve the objectives agreed upon and positively accepted by the patient.Citation46 This model has also been evaluated in other studies involving mental health professionals.Citation47 It is important to note that, so far, none of the studies have investigated the invariance of the WAI-SP in relation to sex and age, despite evidence suggesting that both variables may influence the therapeutic alliance.Citation26,Citation27,Citation32,Citation48 Measurement invariance refers to the equivalence in the measurement of the therapeutic alliance between different groups, which is relevant to understanding whether the instrument measures consistently in different populations.

In Japan, evidence has been found to support the existence of two dimensions in the therapeutic alliance, which has led to the development of a unidimensional version of the WAI-SP with five items.Citation45 In China, it has been observed that the three-dimensional model of the WAI-SP does not present a clear conceptual distinction due to the high correlations between its factors. As a result, a two-dimensional model of the instrument has been proposed, in which items 2 and 4 were eliminated.Citation49

The main objective of this study is to analyze the psychometric properties of the WAI-SP in a sample of people from Peru who are receiving psychological therapy. This research is justified due to the lack of previous studies that have examined the validity and reliability of the WAI-SP in the Peruvian population. Therefore, having a brief tool that meets these characteristics can be very useful to assess the therapeutic alliance from the patient’s perspective in an easier and faster way. This is especially relevant, since the therapeutic alliance is a predictor of better outcomes in therapy and a lower dropout rate.Citation15,Citation16,Citation22,Citation23 As a second objective of the study, a network analysis was conducted to investigate the direct relationships between the therapeutic alliance and relevant sociodemographic variables, such as sex, age, and total session attendance. This complementary analysis seeks to take into account the differentiation of attributes that may influence trust and commitment in psychological interventions in Peruvian patients, which would help psychologists and psychiatrists to achieve better results in clinical practice.

Materials and Methods

Participants

The study included 241 participants (50.6% female) aged 18 to 72 years (M= 32.58, SD =12.67). Among them, 97.5% had secondary education, while 2.5% had higher education. Regarding the overall psychotherapeutic sessions, it was observed that 66% of the participants had attended between two and three sessions, 32% had attended between four and five sessions, and only 2% had attended six sessions or more. A non-probabilistic purposive convenience sampling approach was used, in which the sample selection was based on specific criteria of the researchers, taking into account the ease of access of the participants.Citation50 The inclusion criteria used for the selection of participants were the following: to be over 17 years of age, to be Peruvian nationals, to have attended a minimum of 2 therapy sessions, and to reside in Lima. The sample size complied with the minimum required according to the calculator for models based on structural equation analysis. This calculator takes into account the number of variables used, both observable and latent, as well as the minimum predicted effect size (0.30, minimum for factor loadings), probability level (0.05), and statistical power (0.95).Citation51

Measurement Instrument

Working Alliance Inventory-Short:Citation36 It is a self-report instrument consisting of 12 items grouped into three dimensions, called task (1, 2, 10, and 12), bonds (3, 5, 7, and 9) and goals (4, 6, 8, and 11) measured through a Likert-type scale with scores ranging from 1 = Never to 7 = Always. There are versions for both therapists and patients. In this research, the version adapted to Spanish by Andrade-González & Fernández-Liria was used.Citation52 Regarding the psychometric properties, the original research indicates a structure with three correlated and second-order dimensions, with adequate goodness-of-fit indices, which had a high internal consistency in general (α = 0.98) and in each of its components with 0.90, 0.92, and 0.90 for task, bond, and goal, respectively.Citation36 In addition, the translated version showed that the WAI-SP was related to therapeutic changes in the client (R2 = 0.16).Citation52

Procedure

First, permission for the use and administration of the instrument was requested via e-mail from the authors who translated it.Citation52 Then, the linguistic adaptation process of the WAI-SP to the Peruvian context was carried out using the criteria of judges. This was done with the help of four psychologists specialized in psychotherapy and clinical psychology, who reside in the city of Lima. Each of the psychologists evaluated the 12 items that constitute the instrument on three criteria: relevance, pertinence, and clarity, which refer to the degree of importance, belonging to the dimension, and comprehension of the items, respectively. Then, the agreement between jurors was quantified with Aiken’s V, for which a cut-off point of 0.80 was taken into account.Citation53

Data collection was carried out during the second semester of 2021 due to the persistence of the state of emergency in Peru due to COVID-19, which made it difficult to conduct face-to-face interviews or surveys. Instead of traditional face-to-face data collection methods, an online data collection method was used. Participants were recruited from a population-wide survey. For this purpose, a Google Form was implemented, which is a widely used tool in psychological research and follows the guidelines of the Internet-Based Methodology. In addition, it was ensured to comply with all ethical recommendations necessary to protect the privacy and confidentiality of the participants.

Before completing the questionnaire, each potential participant was provided with detailed information about the purpose of the study, the confidentiality of the data collected, and the voluntary and anonymous nature of their participation. In addition, it was ensured that all procedures carried out in the study adhered to the ethical standards established by article 81 of the Code of Ethics of the Peruvian College of Psychologists and the Declaration of Helsinki. The research protocol was reviewed and approved by the Research Ethics Committee of the Faculty of Health Sciences of the Universidad Peruana Unión (Approval number: N°00124-2020/UPeU/FCS/CIISA). Additionally, informed consent was obtained from the participants. Finally, the scores were imported into an Excel spreadsheet and then analyzed in the statistical software JAMOVI 2.3.24.

Data Analysis

The sociodemographic analysis of the participants was carried out by calculating frequencies, which made it possible to describe and summarize the sociodemographic characteristics of the sample. The quantification of the judges’ criteria was performed with Aiken’s V based on the scores obtained from the four expert judges in three criteria: relevance, clarity, and pertinence, where values greater than 0.80 were considered.Citation53

Then, a preliminary analysis of the items was made using univariate statistics, such as kurtosis and skewness in order to determine whether the data follow a normal distribution. For this purpose, a cut-off point of ±1.5 was used.Citation54 Next, a confirmatory factor analysis (CFA) was performed to examine the internal structure of the WAI-SP in accordance with previous studies. For this purpose, an oblique two-dimensional model and a bifactor model were created, due to the high correlations between them. Within the bifactor model, hierarchical omega coefficient measures were calculated for the specific factors (ωh) and for the general factor (ωH), since they allow considering the maximum reliability of the specific factors with a control of the influence of the overall factor, for which a ωH > 0.80 would indicate unidimensionality and a ωh > 0.30 would indicate substantiality of the specific factors. Calculation of the Extracted Common Variance (ECV) and the Percentage of Uncontaminated Correlations (PUC) with a value greater than 0.70 would provide additional evidence to conclude that the model is mainly unidimensional.Citation55 The Dueber online calculator was used to analyze these additional indices of the bifactor model.Citation56

The Unweighted Least Squares (ULS) estimator was used throughout due to its robustness to the assumption of normality of the data and its good performance in the analysis of ordinal variables.Citation57 To evaluate the models, a CFI > 0.95, RMSEA < 0.06, and SRMR < 0.08 were taken into account.Citation58 The model with the best fit was subjected to invariance according to sex and age, since both variables have been found to be involved in the therapeutic alliance;Citation27,Citation48 for this purpose, a cut-off point of CFI > 0.001 and RMSEA < 0.015 was taken into account.Citation59 Internal consistency was evaluated with the omega coefficient, taking into account a cut-off point > 0.70.Citation60

Finally, to evaluate the relationships with other categorical variables, network analysis was used. In this analysis, the connections between variables represent partial correlations, allowing the influence of the other variables in the network to be controlled. Network analysis is a useful tool for visualizing and understanding the interactions between variables and examining how they relate to each other. By using this approach, the structure and patterns of the network can be identified, as well as the relative importance of each variable in the context of the others. This provides a more complete understanding of the relationships between categorical variables and their influence on the phenomenon studied.Citation61,Citation62 In addition, the accuracy and robustness of the association weights were evaluated by running 3000 bootstrap samples.Citation63

Finally, to assess the relationships between all study variables and sociodemographics, network analysis was employed as the methodology. This technique represents connections (edges or lines) between nodes (circles representing variables), forming a global system that activates each variable to a varying degree. The network analysis module of the JASP software was used, applying the partial correlation estimator to control for the influence of all introduced variables, isolating only the “true” partial relationships between each variable.Citation58,Citation59 In the network, blue paths are interpreted as positive partial correlations, and red paths, negative partial correlations. Additionally, to evaluate the stability and precisionCitation60 of the associations, 2000 bootstrap samples were generated, producing multiple network samples from the observed data. This demonstrated a tendency to obtain the same associations reported in this study.

Results

The results of the CFA are shown in . It is observed that both the two and three correlated dimensions models presented the same fit indices (CFI = 0.965; TLI = 0.955; SRMR = 0.085; RMSEA = 0.082). However, in the original three-factor model, saturations of lower magnitude were observed (between 0.330 and 0.862), and the dimensions presented reliability values between 0.62 and 0.70. Furthermore, these dimensions showed a high correlation with each other (between 0.931 and 1.094). These questionable findings could indicate a poor fit of the data to the proposed model.Citation64 Regarding the two-dimensional model, item 3 presented lower saturation (λ = 0.333), while item 8 had higher factorial weight (λ = 0.863). However, the interfactor correlation was r= 0.98, therefore a bifactor model was created (general factor and three specific dimensions), whose goodness-of-fit indices were optimal (CFI = 0.983; TLI = 0.973; SRMR = 0.067; RMSEA = 0.064). As for the factor loadings of specific dimensions, there are items with saturations below 0.30, such as items 4, 8, 10, 11, and 12, which are part of the “contract” factor, and 7 and 9, which belong to the “contact” factor. In contrast, the general factor reports factor loadings greater than 0.30.

Table 1 Factorial Models of the Short Version of the Work Alliance Inventory

On the other hand, other goodness-of-fit indices that allow a more precise interpretation were calculated, such as the ECV, PUC, and ωH. The results showed a ωH value of 0.830, an ECV of 0.748, and a PUC of 0.485. Based on these values, it can be concluded that the WAI-SP is essentially unidimensional.

Because the bifactor model had better fits, factorial invariance was carried out with this structure. The results are shown in , where it is observed that metric, scalar and strict invariance are met, when sex was taken into account, thus the variance was < 0.01 and < 0.015 for ΔCFI and ΔRMSEA, respectively. Regarding age, the results were similar. Therefore, it is concluded that the WAI-SP meets with the equivalence of measurement according to sex and age.

Table 2 Factorial Invariance According Sex and Age of the Short Version of the Working Alliance Inventory

In addition, a network was estimated that included the therapeutic alliance variables along with other sociodemographic variables such as sex and age. This network is illustrated in . In the network analysis, a positive relationship was identified between the total session attendance and the therapeutic alliance, suggesting that as participants attended more sessions, their alliance related to compromise and achieving therapy goals was also greater. In addition, it was observed that men reported a higher therapeutic alliance compared to women, while women showed a higher total psychotherapy session attendance. On the other hand, data revealed a negative association between age and total session attendance, indicating that younger individuals tended to have a higher total number of therapy sessions. Finally, a small but significant direct relationship was found between age and therapeutic alliance.

Figure 1 Network analysis including therapeutic alliance, sex, age, and total session attendance.

Notes: Blue paths indicate positive associations; red paths indicate negative associations. Regarding sex, dummy codes were 1=men, 2=women.
Figure 1 Network analysis including therapeutic alliance, sex, age, and total session attendance.

Discussion

The therapeutic alliance is one of the fundamental factors that influence the success or failure of psychotherapy regardless of the therapeutic approach, the reason for consultation, and diagnosis.Citation7 Different instruments have been developed to assess the therapeutic alliance; however, one of the most widely used is the short version of the Working Alliance Inventory for Patients (WAI-SP), which has not yet been validated in the Peruvian context. In this sense, the first objective of this research was to examine the psychometric properties of this tool in the Peruvian population who attend psychological therapy.

Initially, after performing the analyses with three different factorial structures, it was observed that the bidimensional model showed good fit indices compared to the trifactorial model. The bidimensional model was generated from two main dimensions: “contact” (resulting from the high correlation between the original “task” and “goals” factors) and “contract”. This factorial model was also used in adults in BelgiumCitation46 and the Netherlands.Citation47 In the Japanese context, favorable results supporting the two-dimensional structure of the instrument were observed in patients with musculoskeletal conditions.Citation45 Similarly, in China, significant correlations were found between the dimensions of the instrument, supporting a bidimensional model.Citation49 This finding has also been replicated in Spain, where evidence of two-dimensional structure was obtained through exploratory factor analysis.Citation6 However, it is important to note that in the two-factor solution, high correlations were also observed between the “contact” and “contract” dimensions, suggesting a lack of a clear conceptual distinction between these dimensions. Therefore, the possibility of considering bifactor structures that include general and specific components instead of a completely bidimensional model is raised.

After considering the significant correlations between the factors, we proceeded to evaluate a bifactor model, which provided a better representation of the factor structure of the therapeutic alliance scale. This model includes the dimensions of “contact” (bonding) and “contract” (therapeutic goal orientation), which showed some overlap between them. The bifactor approach is a valuable tool to describe more precisely the structure of psychological variables, allowing the analysis of complementary and more complex dimensions. Unlike other factor models, the bifactor model offers the advantage that items can belong to both a general factor and specific factors at the same time.Citation65 This representation at the psychometric level is consistent in capturing the integrative model of the therapeutic alliance proposed by Bordin.Citation3 According to Bordin, the therapeutic alliance has a common general characteristic and encompasses several more specific domains that influence the quality and strength of the patient-therapist relationship. In this context, the affective component of the bond with the therapist and the active commitment to self-improvement can be considered complementary, as both aspects influence the patient’s overall perception of the ongoing therapeutic relationship.Citation66 These findings indicated evidence in favor of the estimated model, thus the WAI-SP should be considered as essentially unidimensional.Citation55 Such results were previously reported in different countries, including the original WAI-SP model in the United States, which had a strong influence of the general factor on the items, although indices such as ECV or hierarchical omega were not reported.Citation66 In China, favorable results were obtained for the bifactor model, indicating that this model is adequate to describe the structure of the therapeutic alliance in that population.Citation42 On the other hand, in Thailand, both the unidimensional and three-dimensional models are plausible, suggesting that both structures are equally valid for explaining the nature of the therapeutic alliance in that context.Citation43 Regarding reliability, the results showed a coefficient above what was suggested to conclude that the unidimensionality of the WAI-SP would be more appropriate, which coincides with the antecedents.Citation36,Citation42,Citation43 These findings highlight the importance of considering cultural and contextual differences when investigating the structure of the therapeutic alliance, as there may be variations in how patients perceive and experience the relationship with their therapist.

To date, there have been no studies examining the invariance of the therapeutic alliance according to sex and age, despite the fact that a relationship between these variables and the therapeutic alliance has been observed.Citation26 Concerning to sex, studies have found that there tends to be a greater alliance when the sex of the therapist and the patient coincide.Citation67 Consequently, the results obtained from the equivalence analysis of the WAI-SP provide an opportunity to evaluate the effects of sex and age, as the instrument has been shown to be invariant with respect to these two factors. This means that any differences found in the therapeutic alliance between different demographic groups cannot be attributed to measurement bias.

Regarding the results of associations through network analysis, the therapeutic alliance was mainly correlated with male participants, which could have some explanatory hypotheses. Previous research has reported that men tend to show lower emotional expression and seek less psychological help.Citation29,Citation68 However, when engaged in therapy, this group may exhibit higher therapeutic commitment from the beginning due to the culturally associated role of problem-solving quickly and showing efficacy, avoiding feelings of vulnerability in front of others.Citation29 This tendency could also be supported by studies suggesting that men tend to have a greater task orientation and focus on achieving practical outcomes during therapy, which might foster increased collaboration in tasks and goals with the therapist.Citation30 In addition, correlations were found between women and higher session attendance. This finding is in line with previous studies that report a higher prevalence of women seeking psychological help for various reasons (eg, sex of the therapist, need to be heard, among others).Citation27 This tendency may be related to women’s predisposition to explore and express emotions, which may motivate them to seek professional help to address and manage their problems, even if they are not necessarily related to mental disorders.Citation69

An additional finding revealed that the therapeutic alliance showed a direct association both with age and total session attendance. Older people tend to accumulate more life experiences and have greater emotional maturity, which may lead them to show a greater willingness and commitment to work on their well-being through therapy.Citation70 In addition, it is important to note that as more therapeutic sessions are conducted, the opportunity to establish a trusting and collaborative relationship increases, which may contribute to better intervention outcomes. However, these findings need to be corroborated in larger samples to obtain more solid conclusions.Citation71 Finally, the negative relationship between age and attendance at network sessions indicates that younger patients attended a greater number of psychotherapy sessions. Finally, the negative relationship between age and total attendance sessions suggests that there may be differences in the perception and needs of interventions compared to older adults. These findings highlight the importance of considering the specific characteristics and demands of different age groups when designing and delivering psychotherapy services. In the Peruvian context, young adults often face socioeconomic challenges and are in a transitional stage in which they must assume new responsibilities and make important decisions. This combination of factors can generate a greater need for personal exploration and psychological support.Citation72 In addition, young adults are often more willing to seek counseling or psychological support, especially when they find therapists who establish a strong, friendly relationship tailored to their individual needs. This age group may be more receptive to participating in the therapeutic process and exploring emotional and personal issues in a safe and trusting environment. When a strong therapeutic alliance is established and they feel understood and supported, young adults can make the most of the psychotherapy sessions and work on areas of personal development and emotional well-being.Citation28 Indeed, the strength of the therapeutic relationship may be a motivating factor for young adults to continue to attend more therapy sessions.

Strengths and Limitations

This research has limitations in terms of the generalizability of the results due to the use of a non-probability sampling method. In addition, being a cross-sectional study, neither the temporal stability of internal consistency nor longitudinal invariance can be assessed.Citation44 Another relevant limitation was the relatively low total number of psychotherapy sessions, specifically fewer than six sessions. Caution should be exercised when interpreting the results, or at least, considering that therapeutic alliance was primarily assessed during the initial five sessions, also focusing on Peruvian adults in a context of post-pandemic recovery. Additionally, this research did not take into account certain variables that could influence the association findings, such as the type of psychotherapy used, the sex or age of the therapists, as well as the severity of the patients’ diagnosis. These variables can play a significant role in the therapeutic relationship and psychotherapy outcomes. For example, different psychotherapy approaches may have different emphases on the therapeutic relationship and the strategies used. Similarly, the severity of the diagnosis may affect the duration and intensity of therapy, as well as the perception of the therapeutic alliance.

It is important to consider these variables in future research to obtain a more complete and accurate understanding of the therapeutic relationship and its effects. These factors can provide additional information on how the therapeutic alliance is developed and maintained, as well as its impact on treatment outcomes. By taking these variables into account, a more complete picture of the influence of various factors on the therapeutic relationship can be obtained and ultimately improve the quality of psychotherapy and outcomes for patients. However, the main objective was to validate a therapeutic alliance assessment instrument in Peruvian patients, offering a relevant tool for evaluating the quality therapeutic relationships in Latin America.

The study also presents strengths, such as being the first psychometric study that analyzes the WAI-SP in Peruvian patients, which is valuable for psychologists and psychiatrists in their clinical and research practice. In addition, it is important to note that this research is pioneering in providing evidence on the invariance of WAI-SP in relation to sex and age, which contributes significantly to the existing knowledge in this field. Likewise, associations with relevant variables such as sex, age, and total session attendance have been evidenced, which complements information for future comparative studies and administration to patients with different characteristics. These findings open new perspectives for understanding how sex and age may influence the perception and experience of the therapeutic alliance, and may have important implications for clinical practice and the tailoring of therapeutic interventions.

Conclusion

In conclusion, the results of this study indicate that the Peruvian version of the WAI-SP presents a good fit for a bifactor model, which is invariant according to the sex and age of the participants. Therefore, it should be interpreted as essentially unidimensional. Likewise, this structure has an adequate internal structure. Consequently, it is valid, reliable, and invariant.

Finally, in addition to the psychometric examination, network analysis findings suggest that the sex and age of Peruvian patients may represent significant variables to improve specific trust needs and psychotherapeutic goals. However, these preliminary results require further investigation to determine if such sociodemographic variables need to be considered in tailoring interventions to strengthen the therapeutic alliance in adults based on age groups or sexes. This approach, in future studies, will optimize therapeutic outcomes and foster greater effectiveness in the psychological treatment process.

Data Sharing Statement

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

Disclosure

The authors declare that they have no conflicts of interest.

References

  • Elvins R, Green J. The conceptualization and measurement of therapeutic alliance: an empirical review. Clin Psychol Rev. 2008;28(7):1167–1187. doi:10.1016/j.cpr.2008.04.002
  • Anderson RP, Anderson GV. Development of an instrument for measuring rapport. Pers Guid J. 1962;41(1):18–24. doi:10.1002/j.2164-4918.1962.tb02226.x
  • Bordin ES. The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy. 1979;16(3):252–260. doi:10.1037/h0085885
  • Luborsky L, Crits-Christoph P, Alexander L, Margolis M, Cohen M. Two helping alliance methods for predicting outcomes of psychotherapy. A counting signs vs. a global rating method. J Nerv Ment Dis. 1983;171(8):480–491. doi:10.1097/00005053-198308000-00005
  • Luis Botella SC. Alianza terapéutica evaluada por el paciente y mejora sintomática a lo largo del proceso terapéutico. Boletín Psicol. 2011;101:21–33.
  • Corbella S, Botella L, Gómez AM, Herrero O, Pacheco M. Psychometric characteristics of the Spanish version of the Working Alliance Inventory-Short (WAI-S). An Psicol Ann Psychol. 2011;27(2):298–301.
  • Impala T, Dobson KS, Kazantzis N. Does the working alliance mediate the therapist competence-outcome relationship in cognitive behavior therapy for depression? Psychother Res. 2022;32(1):16–28. doi:10.1080/10503307.2021.1946195
  • Misdrahi D, Petit M, Blanc O, Bayle F, Llorca PM. The influence of therapeutic alliance and insight on medication adherence in schizophrenia. Nord J Psychiatry. 2012;66(1):49–54. doi:10.3109/08039488.2011.598556
  • Keller SM, Zoellner LA, Feeny NC. Understanding Factors associated with early therapeutic alliance in PTSD treatment: adherence, childhood sexual abuse history, and social support. J Consult Clin Psychol. 2010;78(6):974. doi:10.1037/a0020758
  • Pihlaja S, Stenberg JH, Joutsenniemi K, Mehik H, Ritola V, Joffe G. Therapeutic alliance in guided internet therapy programs for depression and anxiety disorders - A systematic review. Internet Interv. 2017;11:1–10. doi:10.1016/j.invent.2017.11.005
  • Bedics JD, Atkins DC, Harned MS, Linehan MM. The therapeutic alliance as a predictor of outcome in dialectical behavior therapy versus nonbehavioral psychotherapy by experts for borderline personality disorder. Psychotherapy. 2015;52(1):67–77. doi:10.1037/a0038457
  • van Benthem P, Spijkerman R, Blanken P, Kleinjan M, Vermeiren RRJM, Hendriks VM. A dual perspective on first-session therapeutic alliance: strong predictor of youth mental health and addiction treatment outcome. Eur Child Adolesc Psychiatry. 2020;29(11):1593–1601. doi:10.1007/s00787-020-01503-w
  • Zaitsoff S, Pullmer R, Cyr M, Aime H. The role of the therapeutic alliance in eating disorder treatment outcomes: a systematic review. Eat Disord. 2015;23(2):99–114. doi:10.1080/10640266.2014.964623
  • Wheaton MG, McIngvale E, Van Meter AR, Björgvinsson T. Quality of the therapeutic working alliance as a factor in intensive residential treatment of obsessive-compulsive disorder. Psychother Res. 2023;33(4). doi:10.1080/10503307.2022.2138618
  • Murphy ST, Garcia RA, Cheavens JS, Strunk DR. The therapeutic alliance and dropout in cognitive behavioral therapy of depression. Psychother Res. 2022;32(8):995–1002. doi:10.1080/10503307.2021.2025277
  • Sharf J, Primavera LH, Diener MJ. Dropout and therapeutic alliance: a meta-analysis of adult individual psychotherapy. Psycho Theory Res Pract Train. 2010;47(4):637–645. doi:10.1037/a0021175
  • Moshe-Cohen R, Kivity Y, Huppert JD, et al. Agreement in patient-therapist alliance ratings and its relation to dropout and outcome in a large sample of cognitive behavioral therapy for panic disorder. Psychother Res. 2022;2022:1–3.
  • Weck F, Grikscheit F, Jakob M, Höfling V, Stangier U. Treatment failure in cognitive-behavioural therapy: therapeutic alliance as a precondition for an adherent and competent implementation of techniques. Br J Clin Psychol. 2015;54(1):91–108. doi:10.1111/bjc.12063
  • Bartle-Haring S, Walsh L, Blalock J, Bryant A. using therapeutic alliance to predict treatment attendance among couples. Contemp Fam Ther. 2021;43(4):370–381. doi:10.1007/s10591-021-09602-9
  • Fayed C, Bartle-Haring S, VanBergen A. Interpersonal Trauma, therapeutic alliance and relationship satisfaction: a dyadic examination. Contemp Fam Ther. 2021;1–14. doi:10.1007/s10591-021-09595-5
  • Thompson SJ, Bender K, Lantry J, Flynn PM. Treatment engagement: building therapeutic alliance in home-based treatment with adolescents and their families. Contemp Fam Ther. 2007;29(1–2):39. doi:10.1007/s10591-007-9030-6
  • Lin T, Anderson T, Austin M, Mischkowski D. Early trajectories of symptom change and working alliance as predictors of treatment outcome. Psychother Res. 2023;33(2):185–197. doi:10.1080/10503307.2022.2080028
  • Doorn K A-V, Bar-Sella A, Zilcha-Mano S, et al. Within-patient perceptions of alliance and attunement: associations with progress in psychotherapy. Clin Psychol Psychother. 2022;29(5):1717–1727. doi:10.1002/cpp.2737
  • Nam SK, Chu HJ, Lee MK, Lee JH, Kim N, Lee SM. A meta-analysis of gender differences in attitudes toward seeking professional psychological help. J Am Coll Health. 2010;59(2):110–116. doi:10.1080/07448481.2010.483714
  • Saunders R, Buckman JEJ, Stott J, et al. Older adults respond better to psychological therapy than working-age adults: evidence from a large sample of mental health service attendees. J Affect Disord. 2021;294:85–93. doi:10.1016/j.jad.2021.06.084
  • Herrero R, Vara MD, Miragall M, et al. Working alliance inventory for online interventions-short form (WAI-TECH-SF): the role of the therapeutic alliance between patient and online program in therapeutic outcomes. Int J Environ Res Public Health. 2020;17(17):1–16. doi:10.3390/ijerph17176169
  • Behn A, Davanzo A, Errázuriz P. Client and therapist match on gender, age, and income: does match within the therapeutic dyad predict early growth in the therapeutic alliance? J Clin Psychol. 2018;74(9):1403–1421. doi:10.1002/jclp.22616
  • Kim HS, Munson MR, McKay MM. Engagement in mental health treatment among adolescents and young adults: a systematic review. Child Adolesc Soc Work J. 2012;29(3):241–266. doi:10.1007/s10560-012-0256-2
  • Van Der Heijden B, Mahoney CB, Xu Y. Impact of job demands and resources on nurses’ burnout and occupational turnover intention towards an age-moderated mediation model for the nursing profession. Int J Environ Res Public Heal. 2019;16(11):2011. doi:10.3390/ijerph16112011
  • Seidler ZE, Rice SM, Ogrodniczuk JS, Oliffe JL, Dhillon HM. Engaging men in psychological treatment: a scoping review. Am J Mens Health. 2018;12(6):1882–1900. doi:10.1177/1557988318792157
  • José F, Javier F, Paz M. Sistema de Información Científica A study of patients who go to a psychology clinic seeking treatment. Span J Psychol. 2012;15(1):275–285. doi:10.5209/rev_SJOP.2012.v15.n1.37334
  • Bedi RP, Richards M. What a man wants: the male perspective on therapeutic alliance formation. Psychotherapy. 2011;48(4):381–390. doi:10.1037/a0022424
  • Ribeiro NS, Colugnati FAB, Kazantzis N, Sartes LMA. Observing the working alliance in videoconferencing psychotherapy for alcohol addiction: reliability and validity of the Working Alliance Inventory short revised observer. Front Psychol. 2021;12:647814. doi:10.3389/fpsyg.2021.647814
  • Horvath AO, Greenberg LS. Development and Validation of the Working Alliance Inventory. J Couns Psychol. 1989;36(2):223–233. doi:10.1037/0022-0167.36.2.223
  • Horvath AO, Luborsky L. The role of the therapeutic alliance in psychotherapy. J Consult Clin Psychol. 1993;61(4):561–573. doi:10.1037/0022-006X.61.4.561
  • Tracey TJ, Kokotovic AM. Factor Structure of the Working Alliance Inventory. Psychol Assess. 1989;1(3):207–210. doi:10.1037/1040-3590.1.3.207
  • Paap D, Karel YH, Verhagen AP, Dijkstra PU, Geertzen JHB, Pool G. The Working Alliance Inventory’s measurement properties: a systematic review. Front Psychol. 2022;13. doi:10.3389/fpsyg.2022.945294
  • Hukkelberg S, Ogden T. General and specific factors of working alliance in parent training: a bifactor exploratory structural equation modelling approach. Psychother Res. 2019;29(2):267–276. doi:10.1080/10503307.2017.1330574
  • Milot-Lapointe F, Le Corff Y, Savard R. Factor Structure of the short version of the Working Alliance Inventory and its longitudinal measurement invariance across individual career counseling sessions. J Career Assess. 2020;28(4):693–705. doi:10.1177/1069072720925048
  • Gülüm IV, Uluç S, Soygüt G. Psychometric properties of the Turkish Working Alliance Inventory - Short form. Turk Psikiyatr Derg. 2018;29:1.
  • Prusiński T. Patients’ and psychotherapists’ combined and separate evaluations of the psychotherapeutic relationship: the structure of Working Alliance and Polish Versions of the WAI. J Contemp Psychother. 2021;51(4):323–329. doi:10.1007/s10879-021-09500-z
  • Li X, Zhao H, Wu M, Li F, Hill CE. The development of a Brief Working Alliance Inventory for clients and therapists using multilevel factor analysis and item response theory in the United States and China. J Couns Psychol. 2023;70(2). doi:10.1037/cou0000655
  • Leangsuksant T, Taephant N. Development and validation of the Working Alliance Inventory short form Thai client version. Asia Pacific J Couns Psychother. 2022;13(1):40–52.
  • Stefens M, Rondeel E, Templin J, et al. Longitudinal measurement invariance of the Working Alliance Inventory - Short form across coaching sessions. BMC Psychol. 2022;10(1):1–13. doi:10.1186/s40359-022-00968-5
  • Takasaki H, Miki T, Hall T. Development of the Working Alliance Inventory-Short Form Japanese version through factor analysis and test-retest reliability. Physiother Theory Pract. 2020;36(3):444–449. doi:10.1080/09593985.2018.1487492
  • Smits D, Luyckx K, Smits D, Stinckens N, Claes L. Structural characteristics and external correlates of the Working Alliance Inventory-Short Form. Psychol Assess. 2015;27(2):545–551. doi:10.1037/pas0000066
  • Oudshoorn CEM, Frielink N, Riper H, Embregts PJCM. Measuring working alliance and technical alliance from the perspective of healthcare professionals working with people with mild intellectual disabilities: adaptation, factor structure and reliability. J Intellect Disabil Res. 2023;67(1):49–63. doi:10.1111/jir.12986
  • Graves TA, Tabri N, Thompson-Brenner H, et al. A meta-analysis of the relation between therapeutic alliance and treatment outcome in eating disorders. Int J Eat Disord. 2017;50(4):323–340. doi:10.1002/eat.22672
  • Hsu S, Zhou RD-H, Yu -CK-C. A Hong Kong validation of Working Alliance Inventory – short form – client. Asia Pacific J Couns Psychother. 2016;7(1–2):69–81.
  • Otzen T, Manterola C. Sampling Techniques on a Population Study. Int J Morphol. 2017;35(1):227–232. doi:10.4067/S0717-95022017000100037
  • Ramos-Vera CA, Ramos-Vera CA. A sample size calculation method for a priori power analysis in structural equation models. Rev Cuerpo Med Hosp Nac Almanzor Aguinaga. 2021;14(1):104–105.
  • Andrade-González N, Fernández-Liria A. Spanish Adaptation of the Working Alliance Inventory (WAI): psychometric properties of the patient and therapist forms (WAI-P and WAI-T). An Psicol. 2015;31(2):524–533. doi:10.6018/analesps.31.2.177961
  • Mayaute LME. Cuantificación de la validez de contenido por criterio de jueces. Rev Psicol. 1988;6(1–2):103–111.
  • Pérez ER, Medrano L. Exploratory factor analysis: conceptual and methodological bases. Rev Argent Cienc Comport. 2010;2(1):58–66.
  • Dominguez-Lara S, Rodriguez A. Statistical indices of bifactor models. Interacciones Rev Av en Psicol. 2017;3(2):59–65.
  • Dueber DM. Bifactor Indices calculator: a Microsoft Excel-based tool to calculate various indices relevant to bifactor CFA models. Educ Sch Couns Psychol Res Tools. 2017;2017:1.
  • Forero CG, Maydeu-Olivares A, Gallardo-Pujol D. Factor analysis with ordinal indicators: a monte carlo study comparing DWLS and ULS estimation. Struct Equ Model a Multidiscip J. 2009;16(4):625–641. doi:10.1080/10705510903203573
  • Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equ Model a Multidiscip J. 2009;6(1):1–55.
  • Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model. 2007;14(3):464–504. doi:10.1080/10705510701301834
  • Viladrich C, Angulo-Brunet A, Doval E. A journey around alpha and omega to estimate internal consistency reliability. An Psicol. 2017;33(3):755–782. doi:10.6018/analesps.33.3.268401
  • Ramos-Vera C. Statistical relationship networks in nutrition research. Nutr Hosp. 2021;38:671–672. doi:10.20960/nh.03522
  • Ramos-Vera C, Barrientos AS, Baños-Chaparro J, Saldarriaga JV, Saintila J. Enneagram typologies and healthy personality to psychosocial stress: a network approach. Front Psychol. 2022;13:7517. doi:10.3389/fpsyg.2022.1051271
  • Borsboom D, Robinaugh DJ, Rhemtulla M, Cramer AOJ. Robustness and replicability of psychopathology networks. World Psychiatry. 2018;17:143–144. doi:10.1002/wps.20515
  • Freiberg Hoffmann A, Stover JB, De la Iglesia G, Fernández Liporace M. Development of an instrument for measuring rapport Polychoric and tetrachoric correlations in exploratory and confirmatory factorial studies. Ciencias Psicológicas. 2013;151–164. doi:10.22235/cp.v7i1.1057
  • Rodriguez A, Reise SP, Haviland MG. Applying bifactor statistical indices in the evaluation of psychological measures. J Pers Assess. 2016;98(3):223–237. doi:10.1080/00223891.2015.1089249
  • Corbière M, Bisson J, Lauzon S, Ricard N. Factorial validation of a French short-form of the Working Alliance Inventory. Int J Methods Psychiatr Res. 2006;15(1):36–45. doi:10.1002/mpr.27
  • Wintersteen MB, Mensinger JL, Diamond GS. Do gender and racial differences between patient and therapist affect therapeutic alliance and treatment retention in adolescents? Prof Psychol Res Pract. 2005;36(4):400–408. doi:10.1037/0735-7028.36.4.400
  • Wendt D, Shafer K. Gender and attitudes about mental health help seeking: results from national data. Health Soc Work. 2016;41(1):e20–8. doi:10.1093/hsw/hlv089
  • Thompson AE, Anisimowicz Y, Miedema B, Hogg W, Wodchis WP, Aubrey-Bassler K. The influence of gender and other patient characteristics on health care-seeking behaviour: a QUALICOPC study. BMC Fam Pract. 2016;17(1):1–7. doi:10.1186/s12875-016-0440-0
  • Knight BG, Poon CYM. Contextual adult life span theory for adapting psychotherapy with older adults. J Ration Cogn Ther. 2008;26(4):232–249. doi:10.1007/s10942-008-0084-7
  • Tiemens B, Kloos M, Spijker J, Ingenhoven T, Kampman M, Hendriks GJ. Lower versus higher frequency of sessions in starting outpatient mental health care and the risk of a chronic course; a naturalistic cohort study. BMC Psychiatry. 2019;19(1):228. doi:10.1186/s12888-019-2214-4
  • Kielmann K, Vidal N, Riekstina V, et al. “Treatment is of primary importance, and social assistance is secondary”: a qualitative study on the organisation of tuberculosis (TB) care and patients’ experience of starting and staying on TB treatment in Riga, Latvia. PLoS One. 2018;13(10):e0203937. doi:10.1371/journal.pone.0203937