16,618
Views
5
CrossRef citations to date
0
Altmetric
Original Articles

Automatic Sex-Liking and Sex-Failure Associations in Men With Sexual Dysfunction

, , , , &

Abstract

Current models of sexual functioning imply an important role for both automatic and controlled appraisals. Accordingly, it can be hypothesized that erectile dysfunction may be due to the automatic activation of negative appraisals at the prospect of sexual intercourse. However, previous research showed that men with sexual dysfunction exhibited relatively strong automatic sex-positive instead of sex-negative associations. This study tested the robustness of this unexpected finding and, additionally, examined the hypothesis that perhaps more specific sex-failure versus sex-success associations are relevant in explaining sexual dysfunction and distress. Male urological patients (N = 70), varying in level of sexual functioning and distress, performed two Single-Target Implicit Association Tests (ST-IATs) to assess automatic associations of visual erotic stimuli with attributes representing affective valence (“liking”; positive versus negative) and sexual success versus sexual failure. Consistent with the earlier findings, the lower the scores on sexual functioning, the stronger the automatic sex-positive associations. This association was independent of explicit associations and most prominent in the younger age group. Automatic sex-positive and sex-failure associations showed independent relationships with sexual distress. The relationship between sexual distress and sex-failure associations is consistent with the view that automatic associations with failure may contribute to sexual distress.

Research into cognitive determinants of sexual functioning and sexual dysfunction has thus far mainly focused on the role of cognitions of which individuals can be aware. Barlow (Citation1986) forwarded a model of sexual functioning in which the role of cognitive interference was specified in different feedback loops for men with and without sexual dysfunction to explain their differences in sexual functioning. The model was based on a series of experimental studies comparing men with and without sexual dysfunction. Men without sexual dysfunction are theorized to expect adequate sexual performance in this situation and to be able to focus their attention on present sexual stimuli and sexually stimulating thought content, whereas men suffering from sexual dysfunction would be distracted from processing erotic stimuli and would expect sexual failure. In a more recent series of observational studies, using self-report questionnaires, Nobre and colleagues found support for different patterns of conscious thoughts, attitudes, and sexual self-schemata in men and women with and without sexual dysfunction (Nobre, Citation2010; Nobre & Pinto-Gouveia, Citation2006). However, cognitive processing occurs at different levels of awareness and regulatory control, and suggestions have also been put forward that a relevant part of the variability in sexual behavior and sexual feelings might be explained by automatic attitudes that are not accessible for self-reflection and that may occur outside of awareness (e.g., Geer & Robertson, Citation2005; Janssen, Everaerd, Spiering, & Janssen, Citation2000). Attitudes are defined here as cognitive associations of stimuli with evaluative adjectives. They are reflections of one’s likes, dislikes, preferences, and evaluations, and they inform and shape one’s behavior (see Cooper, Blackman, & Keller, Citation2016). The information-processing theory of sexual responding (Janssen et al., Citation2000) postulates a role for both controlled and automatic cognitive processes in the causation of genital responses and subjective experiences of sexual arousal. The theory proposes that the appraisal of stimuli as sexual or nonsexual occurs both at reflective and automatic levels of processing (see ). The appraisal process involves the analysis of the affective valence of the stimulus and its personal relevance for one’s interests (Frijda, Citation1993), including the implicit associations, beliefs, and attitudes with regard to the stimulus. Thus, erotic stimuli, whether or not they are consciously perceived, may automatically initiate the physiological process that produces the genital response (Spiering & Everaerd, Citation2007). Men with sexual dysfunction and nonsymptomatic men may thus (also) differ with regard to how they automatically process erotic stimuli. Because automatic attitudes are considered to develop as a result of frequent pairings of stimuli with the same emotional state (Gawronski & Bodenhausen, Citation2006), and men with sexual dysfunction typically report repeated experiences of negative feelings in sexual situations, it seems reasonable to assume that men with sexual dysfunction would show less positive automatic evaluations of erotic stimuli than nonsymptomatic men.

Figure 1. An information-processing model of sexual arousal by Janssen et al. (Citation2000). Journal of Sex Research. Reprinted with permission.

Figure 1. An information-processing model of sexual arousal by Janssen et al. (Citation2000). Journal of Sex Research. Reprinted with permission.

Several methods are available for assessing automatic cognitions, using reaction times and choice preferences in computer-based tests, including the affective priming paradigm (Fazio, Sanbonmatsu, Powell, & Kardes, Citation1986), the Affective Simon Task (De Houwer, Crombez, Baeyens, & Hermans, Citation2001), the Extrinsic Affective Simon Task (De Houwer, Citation2003), approach and avoidance tasks (De Houwer et al., Citation2001), and the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, Citation1998). The IAT was used in the present study for its relatively high validity and reliability in assessing both individual and group differences in automatic attitudes (De Houwer & De Bruycker, Citation2007; Nosek, Greenwald, & Banaji, Citation2005; Roefs et al., Citation2011). Moreover, it has been found to have differential predictive validity for relatively automatic behaviors (e.g., Rudolph, Schröder-Abé, Riketta, & Schütz, Citation2010). The IAT is based on the premise that participants respond faster when target–attribute pairs that are closely associated in memory share one response key compared to when nonassociated target–attribute pairs are mapped on the same key. Evidence exists that implicit associations indeed capture such associations between constructs in memory. Previously unknown stimuli were found to be implicitly associated as indexed by an IAT after they became connected in a classical conditioning procedure (Olson & Fazio, Citation2001) while participants were unaware of the contingent pairing of both stimuli during the procedure. Whereas automaticity of evocation upon the mere perception of the stimulus is a quintessential aspect of the construct of interest (De Houwer, Teige-Mocigemba, Spruyt, & Moors, Citation2009), IAT performers are not necessarily unaware of the associations that are assessed during IAT performance (McNally, Citation1995; Monteith, Voils, & Ashburn-Nardo, Citation2001).

A first study of our group using a Single-Target Implicit Association Test (ST-IAT) to investigate automatic associations with erotic stimuli in men with and without sexual dysfunction (van Lankveld et al., Citation2015) unexpectedly found that men with sexual dysfunction exhibited stronger instead of weaker positive automatic associations with erotic stimuli than nonsymptomatic men, whereas explicit affective associations did not differ between men with sexual dysfunction and nonsymptomatic men. In addition, the two groups did not differ with regard to their automatic wanting associations with erotic stimuli. Wanting refers in this context to a motivational association with erotic stimuli that can be distinguished from the hedonic value of erotic stimuli (Robinson & Berridge, Citation1993, Citation2008). In the ST-IATs that were used in this earlier study, the valence/liking construct was represented using the words positive (represented by the Dutch words for humor, health, gift, and peace) and negative (represented by the Dutch words for hatred, war, disease, and pain) as attribute labels, placed in the upper-left and -right corners of the computer screen. The attribute categories for the wanting ST-IAT were “I want” and “I do not want” (represented by the same word stimuli as in the liking ST-IAT). The “erotic” target in both the liking and the wanting ST-IATs was represented by four pictures of heterosexual interaction from the International Affective Picture System (IAPS; Lang, Bradley, & Cuthbert, Citation1999). Although these findings point to the relevance of automatic affective associations with regard to sexual dysfunction, the observed direction of the association was counterintuitive, as men with sexual dysfunction were expected to harbor relatively strong negative automatic evaluations of erotic stimuli. Therefore, the first aim of the current study was to test the robustness of this unexpected co-occurrence of automatic sex-positive associations with lower levels of sexual functioning.

Based on theory and previous empirical research (Bach, Brown, & Barlow, Citation1999; Scepkowski et al., Citation2004; Weisberg, Bach, & Barlow, Citation1995), more specific automatic associations of erotic stimuli with, respectively, sexual success versus sexual failure, can also be considered candidate conceptual categories that could differentiate between men with and without sexual dysfunction. Men who have a history of sexual failure might develop an automatic association of sexual stimuli with personal failure, whereas men without such a history will be more self-confident, have stronger automatic associations of erotic stimuli with success, and expect flawless sexual performance. In his model of sexual dysfunction, Barlow (Citation1986) incorporated research showing that men with sexual dysfunction expect relatively low personal efficacy in becoming sexually aroused. Furthermore, in cross-sectional investigations, men with sexual dysfunction were found to harbor more negative sexual self-schemas (Andersen, Cyranowski, & Espindle, Citation1999), characterized by internal and stable attributions of failure and personal incompetence (Fichten, Spector, & Libman, Citation1988; Nobre & Pinto-Gouveia, Citation2009a, Citation2009b; Weisberg et al., Citation1995). When men with sexual dysfunction are repeatedly exposed to situations of sexual failure, such negative expectations can also be expected to lead to a stronger automatic association of erotic stimuli with failure, which may contribute to the persistence of sexual dysfunction.

In the current study we not only examined the relevance of automatic associations within the context of sexual functioning but also with regard to the level of sexual distress. Sexual distress is the experience of negative feelings (e.g., fear/anxiety, melancholia, irritation, anger) associated with one’s (problematic) sexual functioning. It can be subdivided into personal distress, partner distress, and relational or interpersonal distress (Hendrickx, Gijs, & Enzlin, Citation2013; Hendrickx, Gijs, Janssen, & Enzlin, Citation2016). Problematic sexual functioning and the experience of distress related to one’s sexual problems may have distinct origins and underlying cognitive mechanisms. In addition, sexual distress and sexual satisfaction may not be opposing constructs. Evidence is coming forth that sexual distress, sexual functioning, and sexual satisfaction are relatively independent constructs that merit separate scrutiny (Stephenson & Meston, Citation2010). For example, although increasing age comes with increasing impairments in male sexual functioning (Wagle, Carrejo, & Tan, Citation2012), sexual distress does not necessarily increase at the same pace, either in men or in women (Hendrickx, Gijs, & Enzlin, Citation2016; Stephenson & Meston, Citation2010, Citation2012). Automatic associations of erotic stimuli with failure might be more crucially involved in high sexual distress, which has been found to have a stronger link to help-seeking behavior than sexual dysfunction as such (Hendrickx, Gijs, & Enzlin, Citation2016). Therefore, the second aim of this study was to test whether relatively strong automatic sex-failure associations co-occur with lower levels of sexual functioning and higher levels of sexual distress.

In addition to adequate cognitive processing of sexual stimuli, it should be acknowledged that adequate biological functioning is required for the sexual response system to operate effectively, including hormonal (Bancroft, Citation2005), vascular (Jackson, Citation2009), and neurological systems (McKenna, Citation1999). Impairments of these systems can severely compromise sexual functioning (Everaerd & Laan, Citation1995). Next to more abrupt impairments due to disease and its pharmacological treatment, the functioning of several of these biological systems has been shown to decrease during the individual’s lifetime and is therefore significantly associated with age (Call, Sprecher, & Schwartz, Citation1995; Janssen, Everaerd, Van Lunsen, & Oerlemans, Citation1994; Wagle et al., Citation2012). We therefore explored potential confounding aspects of age. Individuals with a wide variety of types of psychopathology have been found to differ significantly from healthy control individuals regarding their automatic cognitive responses to stimuli related to their respective type of psychopathology (for a comprehensive review, see Roefs et al., Citation2011). To avoid confounding the present findings, men with major clinical psychopathology, assessed using the Hospital Anxiety and Depression Scale (HADS; Spinhoven et al., Citation1997; Zigmond & Snaith, Citation1983), were excluded from participation.

In brief, the current study was designed to test the following hypotheses: (1) automatic sex-liking associations are negatively correlated with level of sexual functioning and sexual distress; and (2) automatic sex-failure associations with erotic stimuli are negatively correlated with level of sexual functioning and positively associated with level of sexual distress.

Method

Participants

Eligible participants in the study were adult heterosexual men who visited an outpatient urology clinic for various urological complaints, either with or without sexual complaints. Investigation of this mixed population was considered advantageous due to the substantial variability with regard to sexual functioning among urological patients (van Lankveld & van Koeveringe, Citation2003). Mastery of the Dutch language was deemed necessary to be able to answer all relevant questions in the study and to perform the computer tasks. Higher level of psychopathology (HADS total score > 15) was used as an exclusion criterion.

Using d = 0.65 as a conservative mean effect size estimate of IAT effects (see later for a description of how the IAT index is calculated), based on group comparison studies (Nosek et al., Citation2005), at least 60 participants were required to obtain 80% statistical power, using p < .05. In total, 83 men were screened for eligibility in the study. One man was excluded due to not completing the test. In addition, 12 men were excluded due to nonheterosexual orientation (N = 2), high level of psychopathology (N = 9), or both (N = 1). Data of 70 participants (Mage = 55.7 years, SD = 14.9 years; range = 18 to 78 years) were retained for further analysis; of these, 36 men had received a sexual dysfunction diagnosis and 34 had visited the clinic for other urological conditions. Eight participants in the latter group also reported experiencing sexual problems in response to the pertinent items of the questionnaire. Characteristics of participants with and without self-reported sexual problems, including their urological diagnoses, are shown in . Of 53 men in the sample who were involved in a sexual relationship, 10 men (19%) were not sexually active. Of six men who were involved in a relationship but were not cohabiting, one man was not sexually active. Of 11 participants who were not involved in a sexual relationship, six (55%) were not sexually active. In all, 46% of the participants reporting experiencing sexual problems had sought professional help in the past, 48% were currently receiving professional help, and 26% desired such help but had not yet received help.

Table 1. Sequence of Trial Blocks in the Liking and Success-Failure ST-IAT

Table 2. Demographic, Medical, Sexual, and Psychological Functioning Characteristics of Participants (N = 70)

Instruments

Demographic, medical, and sexual health-related information

A questionnaire was administered collecting demographics (age, education level, relationship status, and relationship duration), and information on sexual functioning (self-reported sexual health, including presence of sexual problems, sexual problem subtype, help seeking, and reception of professional help for sexual problems in the past, and whether help was presently needed or being received). The urologist recorded medical problem type and whether the participant currently used medication that was known to (potentially) affect sexual functioning either positively (i.e., pro-sexual medication) or negatively (i.e., anti-sexual medication), or other medication assumed not to impact sexual functioning (i.e., neutral medication).

Sexual functioning

International Index of Erectile Functioning (IIEF)

The IIEF (Rosen et al., Citation1997) is a self-report questionnaire for assessing male sexual functioning that contains 15 items, organized into five subscales measuring, respectively, erectile function, orgasmic function, sexual desire, intercourse satisfaction, and overall sexual satisfaction. Participants provided answers on five-point and six-point scales, with higher scores indicating better sexual functioning. A sum score provides a global index of sexual functioning (IIEF total score). The internal consistency of the IIEF was found to be excellent in previous research (Cronbach’s α between 0.92 and 0.96), and test–retest reliability was high (r = .84; Rosen et al., Citation1997). In the present study, internal consistency was found to range from satisfactory for the sexual desire and overall sexual satisfaction subscales (Cronbach’s α = .88) to excellent for the erectile function subscale and the total score (α = .97).

Sexual Distress Scale (SDS)

The SDS uses the 12 items of the Female Sexual Distress Scale (Derogatis, Rosen, Leiblum, Burnett, & Heiman, Citation2002). All aspects of sexual distress that are addressed in the FSDS are applicable to both female and male sexual problems, and the wording of the items is gender neutral. The FSDS has been used in male samples (Jern et al., Citation2008; Van Lankveld et al., Citation2015). The version of the FSDS we used was validated in Dutch female samples (Ter Kuile, Brauer, & Laan, Citation2006). It contains a single dimension and was found to have good psychometric properties, with Cronbach’s α = .93. In the present male sample, the internal consistency was found to be excellent, with Cronbach’s α = .96.

Implicit associations with sexual stimuli

Single-Target Implicit Association Test

Two ST-IATs (Karpinski & Steinman, Citation2006) were employed to measure the strength of the automatic associations of a single target category (erotic stimuli) with, respectively, positive versus negative valence, and success versus failure. The erotic target in each of the ST-IATs was represented using four picturesFootnote1 of heterosexual interaction. Pictures depicted a female and a male actor couple engaging in explicit sexual activity, also showing genital areas. Participants were instructed to assign the words and pictures appearing in the center of a laptop computer screen to one of two categories using the z and m keyboard keys. The attribute categories for the liking ST-IAT were positive (represented by the Dutch words for humor, health, gift, and peace) and negative (represented by the Dutch words for hatred, war, disease, and pain), and were identical to those used in van Lankveld et al. (Citation2015). The labels of the attribute categories were continuously shown in the upper-left and -right corners of the screen. Upon a correct response, the next stimulus was presented. Following an incorrect response, error feedback was given using a red X that replaced the stimulus and remained on the screen until another key was pressed. displays the setup of the procedure that was identical in both ST-IAT versions. To familiarize participants with the procedure, they started with a practice block using only attribute stimuli. Next, there were two blocks of 64 trials, each starting with a practice phase of 16 trials in which both erotic pictures and positive and negative attribute words were randomly presented, followed by a test phase of 48 trials. Within the practice and test phases, the numbers of key presses on both response keys were kept equal to prevent the development of a response bias (see ). The target and attribute stimuli were presented in quasi-random order, making sure that each target stimulus was both preceded and followed by an attribute stimulus. No more than two attribute stimuli were presented in a row between two target stimuli. In the first block, erotic pictures and positive words were mapped on the same response key (sex-positive combination), whereas in the other block erotic pictures and negative words shared the same response key (sex-negative combination). One of the two combinations (sex-positive or sex-negative) is expected to yield briefer reaction times, based on the assumption that performance is faster when the association between target and attribute is congruent with the participant’s representational network, compared with when this association is incongruent.

The attribute categories for the success-failure ST-IAT were sexual success (represented by the Dutch words for capable, achievement, appreciation, and orgasm) and sexual failure (represented by the Dutch words for unable, fail, weak, and fall short). The selection of stimulus words was based on pilot testing using a freely accessible online survey (www.thesistools.com). Fifty-five men completed the survey, with ages ranging from 19 to 75 years (M = 44.2; SD = 14.4 years). Participants were invited to select four words from two lists (Nsuccess = 17; Nfailure = 21) of preselected words that they thought best represented the categories of, respectively, sexual success and sexual failure. The four words that were chosen most frequently were selected to use in the success-failure ST-IAT. The labels of the attribute categories were again continuously shown in the upper-left and -right corners of the screen. The liking and success-failure ST-IATs were presented in a fixed order, with the liking ST-IAT used as the first task.

Explicit associations with sexual stimuli

Explicit Evaluation Scale of Erotic Stimuli (EEES)

In addition to the automatic associations, two measures of explicit cognitive appraisals of erotic stimuli in terms of valence and sexual success-failure were created. For this purpose the erotic pictures that were used in each ST-IAT were presented on a computer screen. To obtain explicit valence ratings, participants evaluated the pictures used in the liking ST-IAT on a 5-point Likert scale ranging from Very negative to Very positive. To obtain explicit associations with success-failure, participants evaluated the pictures used in the success-failure ST-IAT on a visual analog scale (VAS) ranging from Sexual failure (0) to Sexual success (100). Per-participant mean rating scores across the four ST-IAT pictures were calculated that were termed EEES-L (liking), and EEES-SF (success-failure). Higher scores indicate that the erotic pictures were associated with positive liking and with sexual success.

Psychopathology

Hospital Anxiety and Depression Scale

The HADS was used to screen for depression and anxiety symptoms (Kjaergaard, Arfwedson Wang, Waterloo, & Jorde, Citation2014). It is a 14-item self-report questionnaire, specifically used in hospital and outpatient clinic settings (Zigmond & Snaith, Citation1983). It is organized in two subscales for the domains of, respectively, anxiety and depression. High scores represent higher levels of anxiety and depression. The HADS has been found to possess satisfactory to high internal consistency in Dutch samples, with Cronbach’s α ranging from .71 to .90 (Spinhoven et al., Citation1997). In the present study, the internal consistency was found to be satisfactory for the anxiety subscale (Cronbach’s α = .78), almost satisfactory for the depression subscale (Cronbach’s α = .65), and satisfactory for the total scale (Cronbach’s α = .83). Participants with HADS total scores of 15 and higher were excluded.

Procedure

Participants were recruited among patients visiting an outpatient urology clinic for clinical evaluation and treatment. Consecutive patients who met the inclusion and exclusion criteria were invited for participation in the study by their practitioner. Interested patients received an information leaflet and an informed consent form. If they wished to participate, the patients received also a written summary of their current urological diagnosis and sexual functioning from the practitioner. Participants could schedule their participation either immediately or a later time. Upon the start of the test session, which took place in a quiet space in the hospital, the test procedure was further explained by the researcher. After signing the informed consent form, participants handed over the doctor’s summary to the researcher. First, the ST-IAT tasks were performed. Subsequently, participants completed the online questionnaires (demographic questions, information on sexual problems, sexual-problem-related distress, sexual health care history, explicit ratings of the ST-IAT erotic pictures [EEES], and three questionnaires [IIEF, SDS, and HADS]). Data collection took 26 weeks. Ethical approval was obtained from the hospital’s ethical review board.Footnote2

Statistical Analysis

To index the automatic associations of erotic stimuli with liking and with success versus failure, the D600 algorithm of Greenwald, Nosek, and Banaji (Citation2003) was employed. Only test trial data were used to calculate the D600 ST-IAT index. Reaction times (RTs) below 400 ms were discarded and those higher than 2,500 ms were replaced with 2,500 before calculation of the mean RTs. RTs from error trials were replaced with the mean RT of the participant’s correct responses in the same block in which the error occurred plus a 600 ms penalty. The D600 index score was calculated as the difference score between the mean RTs to the sex-positive and sex-negative combination blocks (sex positive minus sex negative), divided by the standard deviation calculated across all blocks with the exception of the attribute practice block. For the sexual success-failure ST-IAT the same procedure was followed. Lower D600 index scores indicate that erotic stimuli are more strongly associated with positive (versus negative) valence and with success (versus failure).

Analyses were performed using SPSS, Version 22. Data were examined to check the assumptions for statistical analyses. The correlations between the variables used for hypotheses testing were inspected. To test hypothesis 1 and 2, hierarchical linear regression analyses were performed with age (first step), and implicit and explicit liking and success-failure indices (second step) as independent variables and, respectively, sexual functioning (IIEF total score) and sexual distress (SDS total score) as dependent variables. Effect sizes were calculated (Steiger, Citation2004).

Results

Preliminary Analyses

Participants’ sexual functioning scores and their scores indexing sexual-problem-related distress were found to show wide variation. The bivariate correlations between implicitly measured associations of erotic stimuli with liking and success-failure, the explicit ratings of erotic stimuli, the IIEF subscale and total scores, and the SDS scores are shown in . Whereas the automatic associations of erotic stimuli with liking and with success versus failure were not significantly correlated with each other or with the explicit associations, both explicit measures correlated significantly. Positive ratings of erotic stimuli in terms of liking came with higher explicit appraisal of erotic stimuli in terms of success. Sexual desire correlated positively with explicit ratings of erotic stimuli in terms of liking and of success versus failure. Satisfaction with sexual intercourse correlated positively with explicit success. Overall sexual satisfaction correlated positively with automatic liking of erotic stimuli. Finally, sexual distress correlated positively with both explicit ratings.

Table 3. Bivariate Correlations Between Automatic and Explicit Associations of Erotic Stimuli With Valence and Success versus Failure, Sexual Functioning Indexes, and Sexual Distress

Associations of Automatic and Explicit Associations With Sexual Functioning and Sexual Distress

Hierarchical linear regression analyses were performed with, respectively, level of sexual functioning (IIEF total score) and sexual distress (SDS score) as dependent variables, with standardized age as the predictor variable in the first step, and with ST-IAT liking and success-failure scores, EEES-L and EEES-SF sum scores, and the interaction terms of age with the automatic and explicit cognition variables as predictor variables in the second step. For each analysis the assumptions of normality, linearity, and collinearity, and the presence of outliers, were evaluated.

The first linear regression analysis was performed with level of sexual functioning as the dependent variable. The regression model with age as the predictor variable in the first step was significant when compared to a constant-only model, RFootnote2 = .14, F (1, 75) = 11.93, p = .001 (see ). In the second step, the model explained additional variance, RFootnote2 change = .21, F (8, 67) = 2.73, p = .012. In addition to age, automatic liking and the interaction of age and automatic liking were significant predictors of sexual functioning level (see for statistical details). Separate analyses for relatively high and relatively low age subgroups indicated that only in the lower age group did the model reach significance (F (4, 23) = 4.83, p = .006). Higher level of sexual functioning was predicted by lower automatic (Beta = .557, p = .003) and lower explicit (Beta = −.616, p = .002) liking of erotic stimuli. The automatic association of erotic stimuli with success versus failure showed no additional independent relationship with the level of sexual functioning.

Table 4. Hierarchical Linear Regressions of Automatic Liking, Automatic Sexual Success versus Sexual Failure Associations, and Explicit Ratings of Erotic Stimuli on Sexual Functioning Levela

The second linear regression analysis was performed with level of sexual distress as the dependent variable. The regression model with age in the first step was not found to be significantly different from a constant-only model, RFootnote2 = .001, F (1, 75) = 0.088, p = .77 (see ). When the other predictor variables were entered in the second step, however, a significant increase of the proportion of explained variance was found, RFootnote2 change = .28, F (8, 67) = 3.26, p = .003. Automatic liking, automatic success-failure associations, and explicit liking ratings all showed an independent relationship with sexual distress (see for statistical details). Higher sexual distress was associated with more positive automatic affective associations with erotic stimuli, by stronger automatic sex-failure associations, and by more positive explicit appraisals of erotic stimuli.

Table 5. Hierarchical Linear Regressions of Automatic Liking, Automatic Sexual Success versus Sexual Failure Associations, and Explicit Ratings of Erotic Stimuli on Sexual Distress Levela

Discussion

In this study, implicit measures of automatic associations and explicit measures of subjective associations with erotic stimuli were investigated in a sample comprising both men with and men without sexual problems. The major findings were as follows: (a) lower levels of sexual functioning came with stronger automatic sex-positive associations, most prominently in the younger age group; (b) in younger men, there was an additional independent negative relationship between explicit sex-liking associations and sexual functioning; and (c) the higher the level of sexual distress, the stronger the automatic and explicit sex-liking associations, and the stronger the automatic sex-failure associations.

The negative relationship between sexual functioning and automatic liking associations is consistent with previous findings showing that men with self-reported sexual dysfunction exhibited stronger automatic sex-liking associations than men without sexual dysfunction (van Lankveld et al., Citation2015). This link between stronger automatic liking of erotic stimuli and lower level of sexual functioning thus seems a robust phenomenon. A possible explanation of this initially counterintuitive finding might be that the strong positive affective associations in men with lower levels of sexual functioning reflect a strong positive appreciation of sexual stimuli that they, however, do not necessarily also experience with their own partner as a sexual stimulus. The erotic stimuli that were used in the implicit task depicted anonymous professional porn actors. The positive automatic association with these sexual stimuli in men with lower levels of sexual functioning might be the result of a learning process after repeated exposures to explicit pornographic images of sexual intercourse and coupling of these stimuli with the rewarding experience of experiencing orgasm through masturbation, as opposed to the negative emotional experiences with their partners. Perhaps different results would be found if pictures were used that displayed each participant’s own partner. Support for this speculative explanation is provided by previous research in our lab, in which the presence of the participant’s partner in the testing room was associated with a differential pattern of responses to erotic stimulation under conditions of self-focused versus non-self-focused attention, compared to testing without the partner’s presence (van Lankveld et al., Citation2014). In addition, it could be that the relatively strong positive associations with sex in men with a low level of sexual functioning reflect a relatively strong desire for the sexual interactions displayed in the pictures that contrasts with their actual sexual interactions, and it might be this discrepancy that drives their sexual dysfunction. To test these tentative explanations, future studies need to be conducted comparing the links between level of sexual functioning and sexual distress, on the one hand, and general versus personal automatic sex-liking associations on the other hand. For this purpose, implicit association tasks could be used that include, respectively, general/impersonal erotic stimuli versus more personalized erotic stimuli. In addition, level of experience with masturbation during pornography consumption should be controlled for.

The current findings further showed that low sexual functioning was not linked with relatively strong sex-failure associations. Interestingly, sexual distress did show a relationship with automatic sex-failure associations. This association is in line with the findings of Nobre and Pinto-Gouveia in their studies using the Sexual Modes Questionnaire (Nobre & Pinto-Gouveia, Citation2003) to compare men and women with and without sexual dysfunction (Nobre & Pinto-Gouveia, Citation2008). Feelings of sadness and disillusion were positively related in that study to negative automatic thoughts of erection concern in men and thoughts of failure and disengagement in women. Note, however, that these were cross-sectional data, and that participants were asked to what extent they recognized the presence of certain automatic thoughts during sexual interactions that were listed in the questionnaire, which does not necessarily coincide with implicit associations of which one is not aware. To further explain this apparent discrepancy, it may be useful to consider potential differences between sexual functioning and sexual distress. Although related, problems with sexual functioning and the distress associated with sexual problems may not spring from the same source. Likewise, sexual satisfaction and sexual distress may not be each other’s opposite; indeed, they are increasingly considered to be relatively independent factors that should be investigated separately (Stephenson & Meston, Citation2010). Germane to this, previous research has shown that although increasing age comes with increasing impairments in male sexual functioning (Wagle et al., Citation2012), sexual distress does not necessarily increase at the same pace (Hendrickx, Gijs, & Enzlin, Citation2016). A similar divergence was also noted in women (Stephenson & Meston, Citation2010, Citation2012). The current findings not only corroborate the relevance of differentiating between low sexual functioning and sexual distress but also provide evidence to indicate that the automatic activation of failure associations within the context of sex might be especially relevant with regard to sexual distress but not so much with low sexual functioning per se (Hendrickx, Gijs, & Enzlin, Citation2016). Before arriving at more definitive conclusions in this respect, it would be important to test the robustness of the current finding that specifically sexual distress was linked to automatic sex-failure associations.

Consistent with previous research in the same population and using the same methodology (van Lankveld et al., Citation2015), overall there was no robust relationship between explicit sex-liking associations and sexual functioning, although there was evidence that, especially in the younger age group, sexual function was associated with stronger sex-positive associations. Again, the direction of this association seems counterintuitive but is consistent with the findings with regard to automatic associations. In addition, higher sexual distress was also associated with stronger sex-positive associations. Together, this pattern of findings is in line with the testable explanation that perhaps for men with relatively high levels of distress or sexual problems there is a discrepancy between their (relatively positive) appreciation of sex in general and their actual (relatively negative) sex experience with their own sex partners.

The findings in this study may also contribute to existing theories of sexual dysfunction. The observed relationships between sexual functioning and sexual distress, on the one hand and both implicitly and explicitly measured sex-associations on the other, points to the relevance of including cognitions operating at various levels of awareness and self-control in the study of sexual functioning. The repeated finding of a significant link between automatic associations with sexual stimuli and level of sexual functioning supports the theorized claim that automatic cognitive processing may play a role in the regulation of sexual arousal (Janssen et al., Citation2000; van Lankveld et al., Citation2015). More definitive claims of the possible causal role in sexual functioning, however, must await confirmation from experimental investigation. We recommend to awaiting further experimental evidence to confirm the causal role of automatic cognitions in sexual dysfunctioning before suggesting additions to the existing therapeutic arsenal. The observed discrepancy in the present findings (automatic associations of sexual stimuli with liking are connected with sexual functioning, whereas automatic associations with success versus failure are connected with sexual distress) can be taken to support the notion that sexual functioning and sexual-problem-related distress have different sources and etiological pathways (Burri, Lachance, & Williams, Citation2014; Hendrickx et al., Citation2013; Hendrickx, Gijs, & Enzlin, Citation2016; Stephenson & Meston, Citation2010). Although distress can involve experiencing maladaptive negative emotions, it may also serve important adaptive purposes (Tooby & Cosmides, Citation2008)—among others, to alert, motivate, and prepare the individual to actively cope with distressing events (Dekker et al., Citation2017).

A limitation of the present study is self-selection bias, which is typical for sexuality research (Plaud, Gaither, Hegstad, Rowan, & Devitt, Citation1999) and may also have confounded the present data. It might have resulted in inclusion of higher numbers of men with sexual problems who harbor relatively positive automatic sex-liking associations. Another limitation is the relatively high age in our sample. This is due to the recruitment of participants in an outpatient urology clinic, which is predominantly visited by older age groups of men with urological complaints. In future studies, more representative samples should be investigated to examine if the present findings also hold true in younger men. Other potential, sample-related limitations pertain to relationship status and sexual activity. About 25% of the study participants were not living in a relationship, and an additional 15% reported not being sexually active. It is unknown how these sample characteristics may have influenced the present findings. Nevertheless, we think the present findings should be considered with caution and wish to emphasize the need for replication studies.

To conclude, the present findings corroborate the relevance for both automatic and controlled appraisals in sex research. Most importantly, the study showed that men with lower levels of sexual functioning are characterized by relatively positive automatic associations with general/nonpersonalized sex stimuli, which may reflect a discrepancy between their strong desire for positive sexual experiences and their actual sexual experiences. In addition, the current findings are consistent with the view that automatic sex-failure associations may contribute to sexual distress. It may be relevant to test in future research whether modifying these dysfunctional automatic associations would have desirable therapeutic effects (see Clerkin & Teachman, Citation2011).

Notes

1 Erotic pictures for the liking ST-IAT were selected from the IAPS (Lang et al., Citation1999), specifically IAPS numbers 4658, 4659, 4664, and 4680. These pictures were previously used in the study by van Lankveld et al. (Citation2015). The erotic pictures for the success-failure ST-IAT were used in the previous IAT research of Borg, De Jong, and Weijmar Schultz (Citation2010).

2 METC Zuyderland-Zuyd, file 16-N-32, March 2, 2016.

References

  • Andersen, B. L., Cyranowski, J. M., & Espindle, D. (1999). Men’s sexual self-schema. Journal of Personality and Social Psychology, 76, 645–661. doi:10.1037/0022-3514.76.4.645
  • Bach, A. K., Brown, T. A., & Barlow, D. H. (1999). The effects of false negative feedback on efficacy expectancies and sexual arousal in sexually functional males. Behavior Therapy, 30, 79–95. doi:10.1016/S0005-7894(99)80047-1
  • Bancroft, J. (2005). The endocrinology of sexual arousal. Journal of Endocrinology, 186, 411–427. doi:10.1677/joe.1.06233
  • Barlow, D. H. (1986). Causes of sexual dysfunction: The role of anxiety and cognitive interference. Journal of Consulting and Clinical Psychology, 54, 140–148. doi:10.1037/0022-006X.54.2.140
  • Borg, C., De Jong, P. J., & Weijmar Schultz, W. (2010). Vaginismus and dyspareunia: Automatic vs. deliberate disgust responsivity. Journal of Sexual Medicine, 7, 2149–2157. doi:10.1111/j.1743-6109.2010.01800.x
  • Burri, A., Lachance, G., & Williams, F. M. K. (2014). Prevalence and risk factors of sexual problems and sexual distress in a sample of women suffering from chronic widespread pain. Journal of Sexual Medicine, 11, 2772–2784. doi:10.1111/jsm.12651
  • Call, V., Sprecher, S., & Schwartz, P. (1995). The incidence and frequency of marital sex in a national sample. Journal of Marriage and the Family, 57, 639–652. doi:10.2307/353919
  • Clerkin, E. M., & Teachman, B. A. (2011). Training interpretation biases among individuals with symptoms of obsessive compulsive disorder. Journal of Behavior Therapy and Experimental Psychiatry, 42, 337–343. doi:10.1016/j.jbtep.2011.01.003
  • Cooper, J., Blackman, S. F., & Keller, K. T. (2016). The science of attitudes. New York, NY: Routledge/Taylor & Francis Group.
  • De Houwer, J. (2003). The Extrinsic Affective Simon Task. Experimental Psychology, 50, 77–85. doi:10.1026//1618-3169.50.2.77
  • De Houwer, J., Crombez, G., Baeyens, F., & Hermans, D. (2001). On the generality of the affective Simon effect. Cognition and Emotion, 15, 189–206. doi:10.1080/02699930125883
  • De Houwer, J., & De Bruycker, E. (2007). The Implicit Association Test outperforms the Extrinsic Affective Simon Task as an implicit measure of inter-individual differences in attitudes. British Journal of Social Psychology, 46, 401–421. doi:10.1348/014466606X130346
  • De Houwer, J., Teige-Mocigemba, S., Spruyt, A., & Moors, A. (2009). Implicit measures: A normative analysis and review. Psychological Bulletin, 135, 347–368. doi:10.1037/a0014211
  • Dekker, J., Braamse, A., Schuurhuizen, C., Beekman, A. T. F., Van Linde, M., Sprangers, M. A. G., & Verheul, H. M. (2017). Distress in patients with cancer: On the need to distinguish between adaptive and maladaptive emotional responses. Acta Oncologica, 56, 1026–1029. doi:10.1080/0284186x.2017.1280848
  • Derogatis, L. R., Rosen, R., Leiblum, S., Burnett, A., & Heiman, J. (2002). The Female Sexual Distress Scale (FSDS): Initial validation of a standardized scale for assessment of sexually related personal distress in women. Journal of Sex and Marital Therapy, 28, 317–330. doi:10.1080/00926230290001448
  • Everaerd, W., & Laan, E. (1995). Desire for passion: Energetics of sexual response. Journal of Sex and Marital Therapy, 21, 255–263. doi:10.1080/00926239508414645
  • Fazio, R. H., Sanbonmatsu, D. M., Powell, M. C., & Kardes, F. R. (1986). On the automatic activation of attitudes. Journal of Personality and Social Psychology, 50, 229–238. doi:10.1037/0022-3514.50.2.229
  • Fichten, C. S., Spector, I., & Libman, E. (1988). Client attributions for sexual dysfunction. Journal of Sex and Marital Therapy, 14, 208–224. doi:10.1080/00926238808403919
  • Frijda, N. H. (1993). The place of appraisal in emotion. Cognition and Emotion, 7, 357–387. doi:10.1080/02699939308409193
  • Gawronski, B., & Bodenhausen, G. V. (2006). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132, 692–731. doi:10.1037/0033-2909.132.5.692
  • Geer, J. H., & Robertson, G. G. (2005). Implicit attitudes in sexuality: Gender differences. Archives of Sexual Behavior, 34, 671–677. doi:10.1007/s10508-005-7923-8
  • Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. (1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74, 1464–1480. doi:10.1037/0022-3514.74.6.1464
  • Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003). Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197–216. doi:10.1037/0022-3514.85.2.197
  • Hendrickx, L., Gijs, L., & Enzlin, P. (2013). Distress, sexual dysfunctions, and DSM: Dialogue at cross purposes? Journal of Sexual Medicine, 10, 630–641. doi:10.1111/j.1743-6109.2012.02971.x
  • Hendrickx, L., Gijs, L., & Enzlin, P. (2016). Sexual difficulties and associated sexual distress in Flanders (Belgium): A representative population-based survey study. Journal of Sexual Medicine, 13, 650–668. doi:10.1016/j.jsxm.2016.01.014
  • Hendrickx, L., Gijs, L., Janssen, E., & Enzlin, P. (2016). Predictors of sexual distress in women with desire and arousal difficulties: Distinguishing between personal, partner, and interpersonal distress. Journal of Sexual Medicine, 13, 1662–1675. doi:10.1016/j.jsxm.2016.09.016
  • Jackson, G. (2009). Sexual response in cardiovascular disease. Annual Review of Sex Research, 46, 233–236. doi:10.1080/00224490902747693
  • Janssen, E., Everaerd, W., Spiering, M., & Janssen, J. (2000). Automatic processes and the appraisal of sexual stimuli: Toward an information processing model of sexual arousal. Journal of Sex Research, 37, 8–23. doi:10.1080/00224490009552016
  • Janssen, E., Everaerd, W., Van Lunsen, R. H., & Oerlemans, S. (1994). Visual stimulation facilitates penile responses to vibration in men with and without erectile disorder. Journal of Consulting and Clinical Psychology, 62, 1222–1228. doi:10.1037/0022-006X.62.6.1222
  • Jern, P., Santtila, P., Johansson, A., Varjonen, M., Witting, K., Algars, M., … Sandnabba, K. (2008). Indicators of premature ejaculation and their associations with sexual distress in a population-based sample of young twins and their siblings. Journal of Sexual Medicine, 5, 2191–2201. doi:10.1111/j.1743-6109.2008.00863.x
  • Karpinski, A., & Steinman, R. B. (2006). The Single Category Implicit Association Test as a measure of implicit social cognition. Journal of Personality and Social Pychology, 91, 16–32. doi:10.1037/0022-3514.91.1.16
  • Kjaergaard, M., Arfwedson Wang, C. E., Waterloo, K., & Jorde, R. (2014). A study of the psychometric properties of the Beck Depression Inventory—II, the Montgomery and Asberg Depression Rating Scale, and the Hospital Anxiety and Depression Scale in a sample from a healthy population. Scandinavian Journal of Psychology, 55, 83–89. doi:10.1111/sjop.12090
  • Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1999). International Affective Picture System (IAPS): Technical Manual and Affective ratings. Gainesville, FL: Center for Research in Psychophysiology, University of Florida.
  • McKenna, K. (1999). The brain is the master organ in sexual function: Central nervous system control of male and female sexual function. International Journal of Impotence Research, 11(Suppl. 1), S48–S55. doi: 10.1038/sj.ijir.3900484
  • McNally, R. J. (1995). Automaticity and the anxiety disorders. Behaviour Research and Therapy, 33, 747–754. doi:10.1016/0005-7967(95)00015-P
  • Monteith, M. J., Voils, C. I., & Ashburn-Nardo, L. (2001). Taking a look underground: Detecting, interpreting, and reacting to implicit racial biases. Social Cognition, 19, 395–417. doi:10.1521/soco.19.4.395.20759
  • Nobre, P. J. (2010). Psychological determinants of erectile dysfunction: Testing a cognitive-emotional model. Journal of Sexual Medicine, 7, 1429–1437. doi:10.1111/j.1743-6109.2009.01656.x
  • Nobre, P. J., & Pinto-Gouveia, J. (2003). Sexual Modes Questionnaire: Measure to assess the interaction among cognitions, emotions, and sexual response. Journal of Sex Research, 40, 368–382. doi:10.1080/00224490209552203
  • Nobre, P. J., & Pinto-Gouveia, J. (2006). Dysfunctional sexual beliefs as vulnerability factors for sexual dysfunction. Journal of Sex Research, 43, 68–75. doi:10.1080/00224490609552300
  • Nobre, P. J., & Pinto-Gouveia, J. (2008). Cognitions, emotions, and sexual response: Analysis of the relationship among automatic thoughts, emotional responses, and sexual arousal. Archives of Sexual Behavior, 37, 652–661. doi:10.1007/s10508-007-9258-0
  • Nobre, P. J., & Pinto-Gouveia, J. (2009a). Cognitive schemas associated with negative sexual events: A comparison of men and women with and without sexual dysfunction. Archives of Sexual Behavior, 38, 842–851. doi:10.1007/s10508-008-9450-x
  • Nobre, P. J., & Pinto-Gouveia, J. (2009b). Questionnaire of Cognitive Schema Activation in Sexual Context: A measure to assess cognitive schemas activated in unsuccessful sexual situations. Journal of Sex Research, 46, 425–437. doi:10.1080/00224490902792616
  • Nosek, B. A., Greenwald, A. G., & Banaji, M. R. (2005). Understanding and using the Implicit Association Test: II. Method variables and construct validity. Personality and Social Psychology Bulletin, 31, 166–180. doi:10.1177/0146167204271418
  • Olson, M. A., & Fazio, R. H. (2001). Implicit attitude formation through classical conditioning. Psychological Science, 12, 413–417. doi:10.1111/1467-9280.00376
  • Plaud, J. J., Gaither, G. A., Hegstad, H. J., Rowan, L., & Devitt, M. K. (1999). Volunteer bias in human psychophysiological sexual arousal research: To whom do our research results apply? Journal of Sex Research, 36, 171–179. doi:10.1080/00224499909551982
  • Robinson, T. E., & Berridge, K. C. (1993). The neural basis of drug craving: An incentive-sensitization theory of addiction. Brain Research: Brain Research Reviews, 18, 247–291. doi:10.1016/0165-0173(93)90013-P
  • Robinson, T. E., & Berridge, K. C. (2008). The incentive sensitization theory of addiction: Some current issues. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 363, 3137–3146. doi:10.1098/rstb.2008.0093
  • Roefs, A., Huijding, J., Smulders, F. T., MacLeod, C. M., De Jong, P. J., Wiers, R. W., & Jansen, A. T. (2011). Implicit measures of association in psychopathology research. Psychological Bulletin, 137, 149–193. doi:10.1037/a0021729
  • Rosen, R., Riley, A., Wagner, G., Osterloh, I. H., Kirkpatrick, J., & Mishra, A. (1997). The International Index of Erectile Function (IIEF): A multidimensional scale for assessment of erectile dysfunction. Urology, 49, 822–830. doi:10.1016/S0090-4295(97)00238-0
  • Rudolph, A., Schröder-Abé, M., Riketta, M., & Schütz, A. (2010). Easier when done than said! Implicit self-esteem predicts observed or spontaneous behavior, but not self-reported or controlled behavior. Zeitschrift Für Psychologie/Journal of Psychology, 218, 12–19. doi:10.1027/0044-3409/a000003
  • Scepkowski, L. A., Wiegel, M., Bach, A. K., Weisberg, R. B., Brown, T. A., & Barlow, D. H. (2004). Attributions for sexual situations in men with and without erectile disorder: Evidence from a sex-specific attributional style measure. Archives of Sex Behavior, 33, 559–569. doi:10.1023/B:ASEB.0000044740.72588.08
  • Spiering, M., & Everaerd, W. (2007). The sexual unconscious. In E. Janssen (Ed.), The psychophysiology of sex (pp. 166–184). Bloomington: Indiana University Press.
  • Spinhoven, P., Ormel, J., Sloekers, P. P., Kempen, G. I., Speckens, A. E., & Van Hemert, A. M. (1997). A validation study of the Hospital Anxiety and Depression Scale (HADS) in different groups of Dutch subjects. Psychological Medicine, 27, 363–370. doi:10.1017/S0033291796004382
  • Steiger, J. H. (2004). Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychological Methods, 9, 164–182. doi:10.1037/1082-989X.9.2.164
  • Stephenson, K. R., & Meston, C. M. (2010). Differentiating components of sexual well-being in women: Are sexual satisfaction and sexual distress independent constructs? Journal of Sexual Medicine, 7, 2458–2468. doi:10.1111/j.1743-6109.2010.01836.x
  • Stephenson, K. R., & Meston, C. M. (2012). The young and the restless? Age as a moderator of the association between sexual desire and sexual distress in women. Journal of Sex and Marital Therapy, 38, 445–457. doi:10.1080/0092623X.2011.613096
  • Ter Kuile, M. M., Brauer, M., & Laan, E. (2006). The Female Sexual Function Index (FSFI) and the Female Sexual Distress Scale (FSDS): Psychometric properties within a Dutch population. Journal of Sex and Marital Therapy, 32, 289–304. doi:10.1080/00926230600666261
  • Tooby, J., & Cosmides, L. (2008). The evolutionary psychology of the emotions and their relationship to internal regulatory variables. In M. Lewis, J. M. Haviland-Jones, & L. F. Barrett (Eds.), Handbook of emotions (3rd ed., pp. 114–137). New York, NY: Guilford Press.
  • van Lankveld, J., Hubben, D., Dewitte, M., Dingemans, M. E., Den Butter, C., & Grauvogl, A. (2014). The partner’s presence in the sex research lab differentially affects sexual arousal in women and men. Journal of Sexual Medicine, 11, 697–708. doi:10.1111/jsm.12406
  • van Lankveld, J., Odekerken, I., Kok-Verhoeven, L., Van Hooren, S., De Vries, P., Van Den Hout, A., & Verboon, P. (2015). Implicit and explicit associations with erotic stimuli in sexually functional and dysfunctional men. Journal of Sexual Medicine, 12, 1791–1804. doi:10.1111/jsm.12930
  • van Lankveld, J., & Van Koeveringe, G. A. (2003). Predictive validity of the Golombok Rust Inventory of Sexual Satisfaction (GRISS) for the presence of sexual dysfunctions within a Dutch urological population. International Journal of Impotence Research, 15, 110–116. doi : 10.1038/sj.ijir.3900966
  • Wagle, K. C., Carrejo, M. H., & Tan, R. S. (2012). The implications of increasing age on erectile dysfunction. American Journal of Men’s Health, 6, 273–279. doi:10.1177/1557988311431629
  • Weisberg, R. B., Bach, A. K., & Barlow, D. H. (1995, November). Sexually functional and dysfunctional males’ attributions for erectile performance during a physiological measurement session. Paper presented at the annual convention of the Association for the Advancement of Behavior Therapy, Washington, DC.
  • Zigmond, A. S., & Snaith, R. P. (1983). The Hospital Anxiety and Depression Scale. Acta Psychiatrica Scandinavica, 67, 361–370. doi:10.1111/j.1600-0447.1983.tb09716.x