1,538
Views
0
CrossRef citations to date
0
Altmetric
Research article

Inventory of interpersonal problems-32 (IIP-32): Psychometric properties in adolescents from Argentina

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon show all
Article: 2267590 | Received 17 Jul 2023, Accepted 29 Sep 2023, Published online: 26 Oct 2023

ABSTRACT

The Inventory of Interpersonal Problems (IIP) is a widely studied instrument in the mental health field. While there have been some applications of this tool in adolescents, the majority of research has focused on the adult population. This study aims to examine the psychometric properties of the Inventory of Interpersonal Problems-32 (IIP-32) specifically in Argentinian adolescents. A total of 557 participants completed the IIP-32 alongside an additional assessment of interpersonal traits. To evaluate reliability, we analyzed internal consistency and item homogeneity. We analyzed the construct validity of IIP-32 through confirmatory factor analysis and the concurrent validity through correlations between the IIP-32 and other measures of interpersonal traits. The findings of this study indicate adequate internal consistency and homogeneity of the items, as well as construct, concurrent and criterion validity. Overall, the results of this paper establish the IIP-32 as a reliable and valid instrument with significant clinical implications for assessing interpersonal difficulties in adolescents from Argentina.

Adolescence has been identified as a particularly demanding period of life with a variety of life challenges (Sroufe & Rutter, Citation1984; Talebi Joybari, Citation2014). Alterations encompass a range of changes, spanning from physical transformations associated with puberty to psychosocial shifts that involve the redefinition of family roles and expectations (Lacunza & Contini, Citation2016). Due to increasing independence from adults, childhood attachment patterns are redefined and new ways of relating with others start winning importance (friends, love and sexual relationships) (DiRico et al., Citation2016; Inglés et al., Citation2005). As the network of relationships outside the family widens, adolescents are exposed to a wide range of new social situations (Inglés et al., Citation2005). It is during these interactions that peer relationships play a critical role in the development of social skills and personal feelings (Hansen et al., Citation1998). Changes in interpersonal relationships may bring difficulties that often increase anxiety and social fears in adolescents (Lacunza & Contini, Citation2016). This is where the study of interpersonal problems becomes important, as many presenting problems of people are interpersonal in nature (Horowitz, Citation1979).

Interpersonal problems have been associated with psychopathology such as major depression, anxiety, maladjusted personality (Girard et al., Citation2017; Grosse Holtforth et al., Citation2014; Locke et al., Citation2018) and higher levels of symptomatology (Luo et al., Citation2018). Specifically in adolescents, Miller et al. Citation(2015) found that interpersonal difficulties predispose them to suicide-related behaviors. Similarly, Au et al. Citation2009 observed that high supportive peer relationships and family support weaken the relationship between suicidal ideation and depressive symptoms. For their part, Auerbach et al. Citation(2014) observed that interpersonal factors such as social support deficits are associated with triggering stress and depression in youth. Furthermore, two recent reviews on mediators in psychotherapy treatments with adolescents showed that both family conflicts and relationship problems are significant interpersonal mediators in the cognitive treatment of depression in adolescents (Moreno-Peral et al., Citation2020). In their meta-analysis, Taubner et al. (Citation2023) found 23 studies with relational mediators, and a total of 65% of these studies reported significant effects. Additionally, Ng et al. Citation(2020) found potential mediators such as changes in negative cognition, social engagement, family functioning, etc., in their review on change mechanisms in the treatment of youth anxiety and depression. However, the evidence was far from conclusive. The authors also pointed out that CBT researchers favor cognitive mediators over other possible mediators. Furthermore, in a meta-analysis focusing on interpersonal problems as a predictor of outcome in psychotherapy for depressive and anxiety disorders, the authors found that in adult and adolescent therapy, interpersonal problems have been shown to predict therapy outcome (Gómez Penedo & Flückiger, Citation2023). Notwithstanding the relevance of such a topic, the lack of information on interpersonal factors in psychotherapy for adolescents is reiterated. This gap becomes understandable when we acknowledge the significance of elements such as parenting styles, attachment, peer relationships, and other factors that must be taken into account when seeking to understand this developmental stage. This highlights the need to assess adolescents’ interpersonal problems as an essential area of focus for mental health professionals.

While various tools are available to evaluate difficulties in relationships, the Inventory of Interpersonal Problems (IIP; Horowitz et al., Citation1988) stands out as the most extensively utilized instrument globally. Importantly, it is associated with the interpersonal circumplex theory of personality and pathology (Pincus, Citation2005; Wiggins, Citation1991), which links it to a host of empirical and theoretical propositions, including circular structure as depicted in .

Figure 1. Subscales and dimensions of the circumplex model of the Inventory of interpersonal problems (Horowitz et al., Citation2000).

Figure 1. Subscales and dimensions of the circumplex model of the Inventory of interpersonal problems (Horowitz et al., Citation2000).

The first version of this instrument had 127 items (Horowitz et al., Citation1988). Later, Horowitz et al. Citation(2000) published a revised version of the IIP, which included 64 items (IIP-64) divided equally onto eight subscales (see ). In this way, the eight typologies of interpersonal problems are distributed around the two basic interpersonal dimensions of agency and communion (see ). The communion dimension describes the extent to which a person needs to establish close relationships with others (spanning from coldness or indifference on the negative pole to excessive dependency on the positive pole). The agency dimension reflects the extent to which a person desires to influence or be influenced by others (encompassing challenges of submission on the negative pole and challenges of excessive dominance on the positive pole). Over time, researchers have developed multiple versions of the IIP aiming to create a concise and practical measure suitable for clinical settings. One version is the IIP with 32 items (Barkham et al., Citation1996). The IIP-32 has grown globally and is available in various languages and countries (Faustino & Vasco, Citation2020; Lo Coco et al., Citation2018; Qi et al., Citation2018; Salazar et al., Citation2010; Thomas et al., Citation2011). Specifically in the Latin American context, it has been studied in a clinical adult sample in Argentina which showed the IIP-32 as a reliable (Cronbach’s alpha .63–.87) and valid instrument (CFI indices of .93, TLI of .92 and RMSEA of .076) with important clinical implications to measure interpersonal difficulties (Gómez-Penedo et al., Citation2022).

Although most of the research with this instrument was carried out with adult population, it has been widely used with adolescents (Brown & Wright, Citation2003; Carbonell et al., Citation1998; Haggerty et al., Citation2013; Khan & Kausar, Citation2020, Lau et al., Citation2019; Ness et al., Citation2018; Talebi Joybari, Citation2014; Tschiesner et al., Citation2014; Ulberg et al., Citation2012; Wright et al., Citation2005). However, all these studies were based on different versions of the instrument, where reliability was analyzed in adults only. Many previous studies suggest good reliability when administering the IIP to adolescents, but these studies did not examine the psychometric properties of the instrument itself (Fichman et al., Citation1994; Hansen & Lambert, Citation1996; Sheffield et al., Citation1995). We found only one study (Israel & Langeveld, Citation2021) which actually looked at the reliability and validity of the IIP in adolescents. This is a considerable limitation to previous research on interpersonal problems in adolescents, as the instrument may measure differently in adults and adolescents.

Based on the lack of studies that analyzed the use of IIP in adolescents, the aim of this study is to examine the psychometric characteristics of the IIP-32 in adolescents from Argentina. Specifically, focusing on assessing the inventory’s reliability (internal consistency and item homogeneity) and validity (analysis of internal structure, concurrent validity and criterion validity). Having an instrument with reliable and valid measurements would greatly benefit both research and clinical practice in the field of mental health with adolescents, considering also that there are no instruments focused on the circumplex model of interpersonal behaviour validated in adolescents in the region.

Methods

Participants

The sample consisted of 557 adolescents across Argentina. The mean age of the participants was 16.8 years (SD = 2.02). Inclusion criteria were being: 1) between 12 and 19 years old and 2) capable of understanding the written statements. Two-thirds (66.9%) of the participants identified as female, 31.7% as male, and 1.4% chose the “other” option. Considering the adolescence stages, the shares of participants’ age were: 14.7% were early adolescents (12 and 14 years old); 37.1% were middle adolescents (15–17 years old) and 48.2% were late adolescents (18 and 19 years old). All participants were students. Diagnostic data did not exist for participants. 27.4% of the participants received psychotherapy when completing the instruments, 28.6% had received psychotherapy before, and 43.5% had never received psychotherapy.

Instruments

Inventory of interpersonal problems (IIP-32; Horowitz, Citation2000)

The 32-item version of the IIP (Horowitz et al., Citation1988) presents 32 problem statements people may experience when interacting with others. The first 20 items begin with “It is hard for me to” (for example) say no to other people. The second 12 items start with “things I do too much” (for example) I fight with other people too much. Subjects indicate on a Likert scale based on agreement from 0 (Not at all) to 4 (Very much). The 32 items constitute eight subscales of interpersonal problems that are projected onto the interpersonal circumplex: domineering (PA), intrusive (NO), overly nurturing (LM), exploitable (JK), nonassertive (HI), socially inhibited (FG), cold (DE) and vindictive (BC). Additionally, the two interpersonal dimensions of agency and communion can be calculated, based on weighted combinations of the eight subscales. The IIP-64 has a Spanish adaptation in Argentina (Maristany, Citation2005) which has been adapted to the 32-item version (Gómez-Penedo et al., Citation2022). This version has reported good reliability with alpha coefficients in the range of .67–.87 and is the one used in the current study (Gómez-Penedo et al., Citation2022).

The child and adolescent interpersonal survey (CAIS; Sodano & Terence, 2006)

The CAIS is a survey of interpersonal dispositions in children and adolescents based on the Interpersonal Circumplex Model. The instrument focuses on understanding childrens’ and adolescents’ style of interacting with other people. Participants indicate how often each statement applies to them using a Likert-type response format ranging from (1) never to (5) always. Scores are calculated for each octant scale based on the eight interpersonal dispositions already presented in the IIP-32 measurement. CAIS items are as follows: “I am tough” (PA), I call people names (BC), I hurt people (DE), I am by myself a lot (FG), I am shy (HI), I am calm (JK), I am kind to others (LM), and I am fun to be around (NO). The median α across the octant scales was .70 using combined samples (Sodano, Citation2011; Sodano & Tracey, Citation2006). For this study, we used the Spanish-translated version from Areas et al. (Manuscript in preparation) which has recently been validated and reported good reliability and construct validity.

Ad hoc sociodemographic questionnaire

An ad hoc questionnaire was included to measure socio-demographic variables for the study. This included: the age of participants, gender, province of residence, and a question asking if they were undergoing psychotherapy, if they had received psychotherapy in the past year, and if they had ever received psychotherapy.

Procedures

A snowball design was used to recruit participants. As a first step, psychotherapy centres, school teachers and known individuals across the country were approached and invited to participate. If these persons were interested in collaborating in the study, they were sent an online link via the SurveyMonkey® platform to invite adolescents to participate. Adolescents accessed the link, where they first found a consent form to sign, the youngest participants (under 18 years old) needed prior parental consent. This consent was requested by the professionals involved in the research, previously to sharing the link. The consent also made clear that participation was voluntary and anonymous, and that data could be withdrawn if desired. Once accepted to participate, the adolescent completed the IIP-32, the CAIS and socio-demographic information. Participants could change their answers and go back if necessary until they pressed the end button. Moreover, it should be noted that none of the data obtained could identify the patient and that the platform complies with international security standards for the care of the data and the anonymity of the participant. This study is part of a larger study focused on interpersonal characteristics in adolescents, which received ethical approval from the Committee for Responsible Conduct in Research from the University of Buenos Aires.

Data analysis

For data analyses, the open-source software R (RStudio Team, Citation2020) and LISREL 8.8 (Jöreskog & Sörbom, Citation1993) were used. Mean item scores were used to calculate total and subscale scores. Internal consistency and item homogeneity were analyzed as reliability measures of the IIP-32. Cronbach’s alpha and McDonald’s Omega statistics were calculated for the overall scale and the eight subscales in terms of internal consistency. As several studies highlight the importance of ordinal alpha in the study of ordinal scales, it was also included (Freiberg-Hoffmann et al., Citation2013). Previous research suggests that an acceptable value of alpha ranges between .70 and .90 (Tavakol & Dennick, Citation2011). In order to analyze item homogeneity, we calculated corrected item-scale correlations. Correlations between the range of .30 to .80 are considered adequate levels of item homogeneity (Rattray & Jones, Citation2007).

For the study of the validity of the instrument, analysis of internal structure and concurrent validity were evaluated. For the analysis of internal structure, a confirmatory factor analysis was performed employing the Maximum Likelihood Robust (MLR) estimator. This method has shown superiority when studying items with an ordinal level of measurement (Li, Citation2016; Mindrila, Citation2010).To interpret the model fit, comparative fit index (CFI), Tucker-Lewis index (TLI) and root mean square error of approximation (RMSEA) were used. Values above .90 in CFI and TLI and below .08 in RMSEA were indicators of an adequate fit of the model (Schumacker & Lomax, Citation2016). Due to the nature of the instrument, a bifactor model was adjusted (Reise, Citation2012). Analyses were carried out on the totality of cases, as there was no missing data and no data imputation methods had to be applied.

For the concurrent validity study, Pearson product-moment correlations were calculated between the IIP-32 total score and the CAIS. For evidence of adequate concurrent validity, correlation values with a range of .50 to .85 are expected (Rial-Boubeta et al., Citation2006).

Evidence of criterion validity was assessed by comparing IIP-32 scores between participants undergoing psychotherapy, those who received treatment in the last year and those who never received treatment before (ANOVA). It was hypothesized that participants who were undergoing psychotherapy would present higher IIP-32 scores than those who underwent psychotherapy in the last year or who never underwent psychotherapy before (Jacobson & Truax, Citation1991).

Finally, to determine the minimum sample size needed to carry out the research, we used the number of parameters to be estimated in the instrument’s CFA. Given that the IIP-32 consists of 32 items, the number of parameters to be estimated would be 64 (32 factor loadings and 32 error terms), determining a criterion of 5 subjects per parameter, as recommended in classical studies, resulting in 320 participants (Gorsuch, Citation1983).

The pre-registration of the analysis plan was uploaded on the osf.io platform and can be accessed through the following identifier: DOI 10.17605/OSF.IO/Z6T4Q (https://osf.io/z6t4q).

Results

Descriptive analysis

presents the descriptive analyses of all the items of the IIP-32. reports the descriptive analyses of the scales and the total score of the IIP-32. Moreover, the frequencies of the benchmarks were 1.38 for the median, 1.03 for the 25th percentile, 1.38 for the 50th percentile and 1.72 for the 75% percentile.

Table 1. Descriptive analyses and corrected item-scale correlations of the IIP-32 items

Table 2. Descriptive analyses of the IIP-32 total score and scales

Reliability

Internal consistency

The items of the IIP-32 presented a Cronbach’s alpha of .84. Due to the ordinal level of measurement of the items, the ordinal alpha of the IIP-32 items was computed with a value of .86. Moreover McDonald’s Omega Coefficient (McDonald, Citation1999) obtained a value of .76. presents the Cronbach’s alphas, ordinal alphas and McDonald’s Omegas at the level of the eight subscales of the IIP-32.

Table 3. Cronbach’s alpha, ordinal alpha and McDonald’s Omega for IIP-32 scales

Item homogeneity

shows the item-scale correlations. None of the items of the IIP-32 presented correlations lower than .30 or higher than .80 with the items of its scale. The item with the lowest item-total adjusted correlation was item 3 of NO subscale.

Validity

Analysis of internal structure

A bifactor model was tested, considering its psychometric evidence in the local context. The model verified an adequate fit to the empirical data with CFI indices of .93, TLI of .91 and RMSEA [CI90%] of .068 [.064, .071]. shows the parameters of the confirmatory factor model and the coefficient of determination for each item. Then, the robustness of the model was tested by comparing it to two alternative models, unidimensional and second-order. shows that the bifactor model obtained better fit indices than alternative models. Besides, differences between Independence CAIC and Model CAIC indices were higher in the bifactor model which explains their better parsimony.

Table 4. Parameters and coefficients of determination of the confirmatory factor model

Table 5. Comparison of the CFA model indices

Concurrent validity

Pearson correlations showed significant direct associations of the IIP-32 with the CAIS. In almost all the cases correlations demonstrated a small effect size in the associations [(r =.13–.41), p < .001]. presents the details of these correlations.

Table 6. Correlations of IIP-32 subscales and CAIS subscales

Criterion validity

ANOVA for comparison of independent samples showed statistically significant differences in IIP-32 scores (F(2, 107) = 6.54, p < .01, η2=.02). Patients who were undergoing psychotherapy at the time of collection had higher scores on the IIP-32 (Mean [M] = 1.50, Standard Deviation [SD] = 0.48) than participants who never underwent therapy (M = 1.34, SD = 0.49) and those who had undergone psychotherapy in the last year (M = 1.37, SD = 0.59). When Tukey’s post hoc analysis was performed, the mean differences between the group receiving psychotherapy and those who had never received psychotherapy were significant (Mean Difference [MD]= .16, p < .01); differences between the groups receiving psychotherapy and those who had undergone psychotherapy in the last year were not significant (MD = .14, p = .23); and differences between the group who had undergone psychotherapy in the last year and those who had never received psychotherapy were not significant (MD = .03, p = .94).

Discussion

The current study aimed to examine the psychometric properties of the IIP-32 in a sample of Argentinean adolescents. Analyses included examining the model fit, reliability of the scales, the factor structure and validity. The findings of this study demonstrated satisfactory levels of instrument reliability and validity among adolescents.

The instrument showed an excellent level of internal consistency in its total score. Results showed adequate levels of internal consistency in six of the eight dimensions (Tavakol & Dennick, Citation2011). The intrusive (NO) and exploitable (JK) scales presented alphas below the expected range. However, the McDonald’s Omega coefficient for these scales showed better adjustment. This is also noticed in other studies of the IIP (Alden et al., Citation1990; Bailey et al., Citation2018; Gómez-Penedo et al., Citation2022). These findings show that our study is also susceptible to the same pattern of scale reliability as previous studies, and therefore not unusual. In addition, adequate levels of item homogeneity were observed in the instrument. This implies that there was an association between items and that items were not redundant (Rattray & Jones, Citation2007).

The confirmatory factor analysis demonstrated adequate analysis of internal structure, with all goodness-of-fit measures within the parameters suggested in the literature. We observed the presence of Heywood cases, which are characterized by negative estimated variances. These cases were not subjected to any specific statistical treatment, as their occurrence is a common outcome when dealing with tetrachoric correlations (Yuan et al., Citation2011). Additionally, previous research has demonstrated that statistical measures like the chi-square are not significantly affected by the presence of these improper solutions (Chen et al., Citation2001).

Pearson’s correlations between the IIP-32 total score and the subscales of the CAIS (Sodano & Tracey, Citation2006) showed low but significant positive correlations, which means that there is a low association between the analysis of internal structure. Such variations are common in social science research since variables are often operationalized differently. Although both instruments are based on the interpersonal circumplex model, the IIP measures interpersonal problems, while the CAIS focuses on interpersonal traits from a non-conflict perspective. Therefore, the contrasting nature of these conceptualizations contributes to the expected differences in results. This is also interesting considering the fact that we have two instruments that are related, but are measuring different things. Moreover, in a study conducted by Sodano and Tracey Citation(2006), the authors also found a weak correlation between the CAIS and other instruments (Interpersonal Adjective Sale (Wiggins, Citation1995); Big Five Questionnaire—Children (Barbaranelli et al., Citation2003)). These findings are in line with the literature and are evidence of different ways of studying interpersonal functioning. Additionally, there may be other variables such as data variability, lack of linearity, and sample characteristics that can affect the size of a Pearson correlation (Goodwin & Leech, Citation2006).

In relation to criterion validity, findings show that participants undergoing treatment had higher levels of interpersonal distress when comparing mean differences of the total IIP-32 scores. This is in line with research conducted in adults where interpersonal problems had been related to the symptomatology of different diagnoses (Girard et al., Citation2017; Grosse Holtforth et al., Citation2014; Locke et al., Citation2018).

This study focused on using the IIP-32 in adolescents. The IIP-32 facilitates a comprehensive assessment of the difficulties that people face in their interpersonal relationships. Understanding and describing these difficulties has great clinical relevance in patient evaluation, treatment design, and outcome analysis. This can be particularly useful if we consider the critical role of social skills in adolescents.

It is important to acknowledge a number of limitations of our study that will need to be addressed in future research. First, we only evaluated concurrent validity through another interpersonal instrument which showed low correlations. It would be valuable to incorporate measures completed by external sources (observers, therapists, etc.) and also choose new instruments for this type of analysis. This inclusion would allow for an examination of the concurrent validity of the IIP-32. The present study did not perform discriminant (divergent) and predictive validity analyses, which would provide more information about the IIP-32 use in adolescents. Additionally, it would be interesting to compare the IIP-32 with relevant variables such as the presence of psychopathology, socio-demographic characteristics, etc. Such comparisons would provide additional insights into the interpersonal problems experienced by adolescents. One of the big challenges when deciding on methodological design in the Latin American region is the lack of instruments available for these analyses. Second, the sample was nonprobabilistic and there was no information on the diagnoses of the participants which affects the generalization of the results. Therefore, future research should consider employing alternative methods of data collection to enhance the robustness and generalizability of findings. Also, most of the sample identified as female which also affects generalizability. Moreover, we neither have information about socio-demographic data such as socio-economic status, whether participants live in a rural or urban area, among others, nor do we know whether interpersonal problems vary at different stages of adolescence. Furthermore, the absence of prior studies on the topic poses a challenge as it hinders the ability to compare and contextualize the results with existing information. Finally, no repeated measures of the instrument were applied, which could help with the study of the instrument’s sensitivity to change as well as detect and create criteria for clinically significant change.

To conclude, the outcomes of this study establish the IIP-32 as a reliable and valid tool for its implementation with adolescents. Consequently, it is a significant resource for clinical studies and research in psychotherapy. Further research on this topic in adolescents is needed.

Acknowledgments

We would like to thank the adolescents who participated in this study.

Disclosure statement

No potential conflict of interest was reported by the author(s).

References

  • Alden, L. E., Wiggins, J. S., & Pincus, A. L. (1990). Construction of circumplex scales for the Inventory of interpersonal problems. Journal of Personality Assessment, 55(3–4), 521–18. https://doi.org/10.1080/00223891.1990.9674088
  • Auerbach, R. P., Ho, M. H. R., & Kim, J. C. (2014). Identifying cognitive and interpersonal predictors of adolescent depression. Journal of Abnormal Child Psychology, 42(6), 913–924. https://doi.org/10.1007/s10802-013-9845-6
  • Au, A. C., Lau, S., & Lee, M. T. (2009). Suicide ideation and depression: The moderation effects of family cohesion and social self-concept. Adolescence, 44(176), 851.
  • Bailey, C., Abate, A., Sharp, C., & Venta, A. (2018). Psychometric evaluation of the Inventory of interpersonal problems 32. Bulletin of the Menninger Clinic, 82(2), 93–113. https://doi.org/10.1521/bumc.2018.82.2.93
  • Barbaranelli, C., Caprara, G. V., Rabasca, A., & Pastorelli, C. (2003). A questionnaire for measuring the big five in late childhood. Personality & Individual Differences, 34(4), 645–664. https://doi.org/10.1016/S0191-8869(02)00051-X
  • Barkham, M., Hardy, G. E., & Startup, M. (1996). The IIP‐32: A short version of the Inventory of interpersonal problems. British Journal of Clinical Psychology, 35(1), 21–35. https://doi.org/10.1111/j.2044-8260.1996.tb01159.x
  • Brown, L. S., & Wright, J. (2003). The relationship between attachment strategies and psychopathology in adolescence. Psychology & Psychotherapy: Theory, Research & Practice, 76(4), 351–367. https://doi.org/10.1348/147608303770584728
  • Carbonell, D. M., Reinherz, H. Z., & Giaconia, R. M. (1998). Risk and resilience in late adolescence. Child & Adolescent Social Work Journal, 15(4), 251–272. https://doi.org/10.1023/A:1025107827111
  • Chen, F., Bollen, K., Paxton, P., Curran, P., & Kirby, J. (2001). Improper solutions in structural equation models. Sociological Methods & Research, 29(4), 468–508. https://doi.org/10.1177/0049124101029004003
  • DiRico, E., Paternain, N., Portillo, N., & Galarza, A. L. (2016). Análisis de la relación entre factores interpersonales y riesgo suicida en adolescentes de la ciudad de Necochea. Perspectivas en Psicología: Revista de Psicología y Ciencias Afines, 13(2), 95–106.
  • Faustino, B., & Vasco, A. (2020). Factor structure and convergent validity of the Portuguese version of the Inventory of interpersonal problems – 32. Journal of Relationships Research, 11, 11. https://doi.org/10.1017/jrr.2020.18
  • Fichman, L., Koestner, R., & Zuroff, D. C. (1994). Depressive styles in adolescence: Assessment, relation to social functioning, and developmental trends. Journal of Youth & Adolescence, 23(3), 315–330. https://doi.org/10.1007/BF01536722
  • Freiberg-Hoffmann, A., Stover, J. B., de la Iglesia, G., & Fernández Liporace, M. (2013). Correlaciones policóricas y tetracóricas en estudios factoriales exploratorios y confirmatorios. Ciencias Psicológicas, 7(2), 151–164. https://doi.org/10.22235/cp.v7i1.1057
  • Girard, J. M., Wright, A. G., Beeney, J. E., Lazarus, S. A., Scott, L. N., Stepp, S. D., & Pilkonis, P. A. (2017). Interpersonal problems across levels of the psychopathology hierarchy. Comprehensive Psychiatry, 79, 53–69. https://doi.org/10.1016/j.comppsych.2017.06.014
  • Gómez-Penedo, J. M., Fernández-Álvarez, J., Maristany, M., & Freiberg-Hoffmann, A. (2022). Inventory of interpersonal problems-32 (IIP-32): Psychometric properties and normative data in a clinical sample from Argentina. Revista Evaluar, 22(2), 64–75. https://doi.org/10.35670/1667-4545.v22.n2.38688
  • Gómez Penedo, J. M., & Flückiger, C. (2023). Interpersonal problems as a predictor of outcome in psychotherapy for depressive and anxiety disorders: A multilevel meta-analysis. Journal of Consulting & Clinical Psychology, 91(10), 562–573. Advance online publication. https://doi.org/10.1037/ccp0000828
  • Goodwin, L. D., & Leech, N. L. (2006). Understanding correlation: Factors that affect the size of r. The Journal of Experimental Education, 74(3), 249–266. https://doi.org/10.3200/JEXE.74.3.249-266
  • Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Lawrence Erlbaum Associates.
  • Grosse Holtforth, M., Altenstein, D., Krieger, T., Flückiger, C., Wright, A. G., & Caspar, F. (2014). Interpersonal differentiation within depression diagnosis: Relating interpersonal subgroups to symptom load and the quality of the early therapeutic alliance. Psychotherapy Research, 24(4), 429–441. https://doi.org/10.1080/10503307.2013.829253
  • Haggerty, G., Kahoud, D., Walsh, E., Forlenza, N., Ahmed, Z., & Ditkowsky, K. (2013). A brief measure of psychological health and well-being: Initial validation of the Schwartz outcome scale for an adolescent inpatient sample. Journal of Nervous & Mental Disease, 201(3), 216–221. https://doi.org/10.1097/NMD.0b013e3182848a01
  • Hansen, N. B., & Lambert, M. J. (1996). Brief report: Assessing clinical significance using the Inventory of interpersonal problems. Assessment, 3(2), 133–136. https://doi.org/10.1177/107319119600300204
  • Hansen, D. J., Nangle, D. W., & Meyer, K. A. (1998). Enhancing the effectiveness of social skills interventions with adolescents. Education & Treatment of Children, 21(4), 489–513.
  • Horowitz, L. M. (1979). On the cognitive structure of interpersonal problems treated in psychotherapy. Journal of Consulting & Clinical Psychology, 47(1), 5–15. https://doi.org/10.1037/0022-006X.47.1.5
  • Horowitz, L. M., Alden, L. E., Wiggins, J. S., & Pincus, A. L. (2000). IIP, Inventory of interpersonal problems manual. The Psychological Corporation.
  • Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureño, G., & Villaseñor, V. S. (1988). Inventory of interpersonal problems: Psychometric properties and clinical applications. Journal of Consulting & Clinical Psychology, 56(6), 885–892. https://doi.org/10.1037/0022-006X.56.6.885
  • Inglés, C. J., Hidalgo, M. D., & Méndez, F. X. (2005). Interpersonal difficulties in adolescence: A New self-report measure. European Journal of Psychological Assessment, 21(1), 11–22. https://doi.org/10.1027/1015-5759.21.1.11
  • Israel, P., & Langeveld, J. H. (2021). Psychometric properties of the Inventory of interpersonal problems (IIP-C) used with a clinical sample of adolescents: A preliminary study. Scandinavian Journal of Child and Adolescent Psychiatry and Psychology, 9(1), 87–95. https://doi.org/10.21307/sjcapp-2021-010
  • Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting & Clinical Psychology, 59(1), 12–19. https://doi.org/10.1037//0022-006x.59.1.12
  • Jöreskog, K., & Sörbom, D. (1993). LISREL 8 [computer software]. Scientific Software International, Inc. Recuperado de. https://ssicentral.com
  • Khan, S., & Kausar, R. (2020). Psychosocial factors of non-suicidal self-injury among adolescents and young adults. Pakistan Journal of Psychological Research, 35(4), 637–655. https://doi.org/10.33824/PJPR.2020.35.4.34
  • Lacunza, A. B., & Contini, E. N. (2016). Relaciones interpersonales positivas: los adolescentes como protagonistas. Revista psicodebate: psicología, cultura y sociedad, 16(2), 73–94. https://doi.org/10.18682/pd.v16i2.598
  • Li, C. H. (2016). The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables. Psychological Methods, 21(3), 369–387. https://doi.org/10.1037/met0000093
  • Locke, K. D., Sayegh, L., Weber, C., & Turecki, G. (2018). Interpersonal self-efficacy, goals, and problems of persistently depressed outpatients: Prototypical circumplex profiles and distinctive subgroups. Assessment, 25(8), 988–1000. https://doi.org/10.1177/1073191116672330
  • Lo Coco, G., Mannino, G., Salerno, L., Oieni, V., DiFratello, C., Profita, G., & Gullo, S. (2018). The Italian version of the inventory of interpersonal problems (IIP-32): Psychometric properties and factor structure in clinical and non-clinical groups. Frontiers in Psychology, 9, 341. https://doi.org/10.3389/fpsyg.2018.00341
  • Luo, X., Nuttall, A. K., Locke, K. D., & Hopwood, C. J. (2018). Dynamic longitudinal relations between binge eating symptoms and severity and style of interpersonal problems. Journal of Abnormal Psychology, 127(1), 30–42. https://doi.org/10.1037/abn0000321
  • Maristany, M. (2005). Problemas en las relaciones interpersonales y trastornos de la personalidad. Universidad de Belgrano. Recuperado de. http://repositorio.ub.edu.ar
  • McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum Associates, Inc.
  • Miller, A. B., Esposito-Smythers, C., & Leichtweis, R. N. (2015). Role of social support in adolescent suicidal ideation and suicide attempts. Journal of Adolescent Health, 56(3), 286–292. https://doi.org/10.1016/j.jadohealth.2014.10.265
  • Mindrila, D. (2010). Maximum likelihood (ML) and diagonally weighted least squares (DWLS) estimation procedures: A comparison of estimation bias with ordinal and multivariate non-normal data. International Journal of Digital Society, 1(1), 60–66. https://doi.org/10.20533/ijds.2040.2570.2010.0010
  • Moreno-Peral, P., Bellón, J. A., Huibers, M. J. H., Mestre, J. M., García-López, L. J., Taubner, S., Rodríguez-Morejón, A., Bolinski, F., Sales, C. M. D., & Conejo-Cerón, S. (2020). Mediators in psychological and psychoeducational interventions for the prevention of depression and anxiety. A systematic review. Clinical Psychology Review, 76, 101813. https://doi.org/10.1016/j.cpr.2020.101813
  • Ness, E., Dahl, H. S. J., Critchfield, K. L., & Ulberg, R. (2018). Exploring in-session process with qualitative and quantitative methods in psychotherapy with an adolescent. Journal of Infant Child, & Adolescent Psychotherapy, 17(4), 310–327. https://doi.org/10.1080/15289168.2018.1526021
  • Ng, M. Y., DiVasto, K. A., Cootner, S., & Weisz, J. R. (2020). What do 30 years of randomized trials tell us about how psychotherapy improves youth depression? A systematic review of candidate mediators. Clinical Psychology: Science & Practice. https://doi.org/10.1111/cpsp.12367
  • Pincus, A. L. (2005). A contemporary integrative interpersonal theory of personality disorders. In M. F. Lenzenweger & J. F. Clarkin (Eds.), Major theories of personality disorders (pp. 282–331). Guilford.
  • Qi, W. G., Wang, K. T., Pincus, A. L., & Wu, L. Z. (2018). Interpersonal problems and acculturative stress over time among Chinese international students from mainland China and Taiwan. Asian American Journal of Psychology, 9(3), 237. https://doi.org/10.1037/aap0000119
  • Rattray, J., & Jones, M. C. (2007). Essential elements of questionnaire design and development. Journal of Clinical Nursing, 16(2), 234–243. https://doi.org/10.1111/j.1365-2702.2006.01573.x
  • Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
  • Rial-Boubeta, A., Varela Mallou, J., Abalo Piñeiro, J., & Lévy Mangin, J. P. (2006). El análisis factorial confirmatorio. In J. P. L. M. En y J. Varela (Eds.), Modelización con estructuras de covarianzas en ciencias sociales (pp. 119–143). Netbiblo.
  • RStudio Team. (2020). Rstudio: Integrated development for R. RStudio, PBC, Retrieved July 7th, 2023 http://www.rstudio.com/
  • Salazar, J., Martí, V., Soriano, S., Beltran, M., & Adam, A. (2010). Validity of the Spanish version of the Inventory of interpersonal problems and its use for screening personality disorders in clinical practice. Journal of Personality Disorders, 24(4), 499–515. https://doi.org/10.1521/pedi.2010.24.4.499
  • Schumacker, R. E., & Lomax, R. G. (2016). A beginner’s guide to structural equation modeling (4th Edition). ed.). Psychology press. https://doi.org/10.4324/9781410610904
  • Sheffield, M., Carey, J., Patenaude, W., & Lambert, M. J. (1995). An exploration of the relationship between interpersonal problems and Psychological health. Psychological Reports, 76(3), 947–956. https://doi.org/10.2466/pr0.1995.76.3.947
  • Sodano, S. M. (2011). Integrating vocational interests, competencies, and interpersonal dispositions in middle school children. Journal of Vocational Behavior, 79(1), 110–120. https://doi.org/10.1016/j.jvb.2010.12.013
  • Sodano, S. M., & Tracey, T. J. G. (2006). Interpersonal traits in childhood: Development of the Child and adolescent interpersonal survey. Journal of Personality Assessment, 87(3), 317–329. https://doi.org/10.1207/s15327752jpa8703_12
  • Sroufe, L. A., & Rutter, M. (1984). The domain of developmental psychopathology. Child Development, 55(1), 17–29. https://doi.org/10.2307/1129832
  • Talebi Joybari, M. (2014). Depression and interpersonal problems in adolescents: Their relationship with alexithymia and coping styles. Iranian Journal of Psychiatry and Behavioral Sciences, 8(4), 38.
  • Taubner, S., Ioannou, Y., Saliba, A., Sales, C., Volkert, J., Protić, S., Adler, A., Barkauskiene, R., Conejo-Cerón, S., DiGiacomo, D., Mestre, J. M., Moreno-Peral, P., Mucha Vieira, F., Pinheiro Mota, C., Rangel Santos Henriques, M. I., Røssberg, J. I., Perdih, T. S., Schmidt, S. J. … Heinonen, E. (2023). Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: A systematic review. European Children and Adolescent Psychiatry. https://doi.org/10.1007/s00787-023-02186-9
  • Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
  • Thomas, A., Brähler, E., & Strauß, B. (2011). IIP-32: Entwicklung, validierung und normierung einer kurzform des inventars zur erfassung interpersonaler probleme. Diagnostica, 57(2), 68–83. https://doi.org/10.1026/0012-1924/a000034
  • Tschiesner, R., Tauber, S., Pastore, M., & Farneti, A. (2014). Pupils’ interpersonal problems and occupational stress in Teacher. Preliminary results. Procedia - Social & Behavioral Sciences, 140, 197–199. https://doi.org/10.1016/j.sbspro.2014.04.409
  • Ulberg, R., Hersoug, A. G., & Høglend, P. (2012). Treatment of adolescents with depression: The effect of transference interventions in a randomized controlled study of dynamic psychotherapy. Trials, 13(1), 159. https://doi.org/10.1186/1745-6215-13-159
  • Wiggins, J. S. (1991). Agency and communion as conceptual coordinates for the measurement and understanding of interpersonal behavior. In D. Cicchetti & W. M. Grove (Eds.), Essays in honor of Paul E. Meehl (pp. 89–113). University of Minnesota Press.
  • Wiggins, J. S. (1995). IAS: Professional manual. Psychological Assessment Resources.
  • Wright, J., Briggs, S., & Behringer, J. (2005). Attachment and the body in suicidal adolescents: A Pilot study. Clinical Child Psychology and Psychiatry, 10(4), 477–491. https://doi.org/10.1177/1359104505056310
  • Yuan, K. H., Wu, R., & Bentler, P. M. (2011). Ridge structural equation modelling with correlation matrices for ordinal and continuous data. The British Journal of Mathematical and Statistical Psychology, 64(Pt 1), 107–133. https://doi.org/10.1348/000711010X497442