1,556
Views
0
CrossRef citations to date
0
Altmetric
Articles

Suicidality in patients with post-traumatic stress disorder and its association with receipt of specific secondary mental healthcare treatments

, , , &
Pages 151-160 | Received 04 Apr 2022, Accepted 12 Oct 2022, Published online: 11 Nov 2022

Abstract

Background

Post-traumatic stress disorder (PTSD) is a risk factor for suicidality (suicidal ideation, and suicide attempt). This study described the prevalence of suicidality amongst a representative sample of individuals with PTSD and the association between suicidality and receipt of five PTSD treatments.

Methods

We analysed deidentified data for patients being treated for PTSD at Camden and Islington NHS Foundation Trust between 2009 and 2017 obtained via the Clinical Record Interactive Search tool. We described the sample’s sociodemographic and clinical characteristics and used stepwise logistic regression to investigate the association between suicidality and receipt of four, specific PTSD treatments: psychotherapy, antidepressant/antianxiety medication, antipsychotics, benzodiazepines. We used Cox proportional hazards regression to investigate the association between suicidality and hospital/crisis team admission.

Results

Of 745 patients diagnosed with PTSD, 60% received psychotherapy and 66% received psychotropic medication. Those who reported suicidality (6%) were no more likely than those who did not to be prescribed antidepressant/antianxiety medication, but were more likely to receive antipsychotics (AOR = 2.27, 95% CI 1.15 − 4.47), benzodiazepines (AOR 2.28, 95% CI 1.17 − 4.44), psychotherapy (AOR 2.60, 95% CI 1.18 − 5.73) and to be admitted to hospital/crisis team (AOR 2.84, 95% 1.82 − 4.45).

Conclusion

In this sample, patients with PTSD and suicidality were more likely to receive psychiatric medication, psychotherapy and psychiatric admission than those who were not suicidal. Overall patients were more likely to receive psychotropic medication than psychotherapy. Adherence to clinical guidelines is important in this population to improve treatment outcomes and reduce the risk of suicide.

    KEY POINTS

  • NICE guidelines recommend psychological therapy be first line treatment for PTSD, yet we identified that fewer people diagnosed with PTSD received therapy compared to psychotropic medication.

  • Patients with suicidality were more likely to receive antipsychotics and benzodiazepines, yet not antidepressant/antianxiety medication although given that suicidality is characteristic of severe depression, it might be assumed from stepped care models that antidepressant/antianxiety medication be prescribed before antipsychotics.

  • The high proportion of patients prescribed antipsychotics suggests a need for better understanding of psychosis symptoms among trauma-exposed populations.

  • Identifying which combinations of symptoms are associated with suicidal thoughts could help tailor trauma-informed approaches to discussing therapy and medication.

Introduction

Post-traumatic stress disorder (PTSD) is a debilitating psychiatric illness. Symptom burden causes levels of impairment comparable to other serious mental disorders (Kessler, Citation2000) and carries a risk of suicide attempt, suicide (Fox et al., Citation2021; Gradus et al., Citation2010, Citation2015) and suicidality (Galatzer-Levy et al., Citation2013; Hawgood & De Leo, Citation2008; Krysinska & Lester, Citation2010; Panagioti et al., Citation2009), defined as suicidal ideation and suicide attempts (Meyer et al., Citation2010). Indeed, in a meta-analysis of prospective studies quantifying the association between specific anxiety disorders and suicidality, PTSD was that with the strongest association (Bentley et al., Citation2016).

Early treatment can reduce distress, interrupt chronicity and progression and reduce the burden on healthcare services. Currently, evidence-based treatment guidelines recommend psychological interventions, such as individual trauma-focussed cognitive behavioural therapy (CBT) or eye movement desensitisation and reprocessing (EMDR), and antidepressants/antianxiety medication, such as selective serotonin reuptake inhibitors (SSRIs). Guidelines note that medication should not be used in preference to psychotherapy and that antipsychotic medication be reserved for disabling symptoms or for those who have not responded to the first-line treatments (NICE, Citation2018). Although the suicide preventive effects of psychiatric admission are unclear (Large & Kapur, Citation2018), patients with PTSD who present with suicidality or attempt suicide may be admitted to hospital or crisis teams (Hawton et al., Citation2007; Large & Kapur, Citation2018). Evidence to support the use of anti-anxiety and anti-depressant medication in reducing risk of repeat self-harm is weak (Hawton et al., Citation2016b) and the moderately strong evidence to support psychosocial interventions, such as CBT, (Hawton et al., Citation2016b) relates to the wider population of patients who self-harm, not specifically to those with PTSD.

As suicidality is a major predictor of suicide (Owens et al., Citation2002), it is important to understand the characteristics of people with PTSD who become suicidal and their treatment pathways. In this study, using routine clinical data, we aimed to describe the sociodemographic and clinical characteristics of patients in secondary mental healthcare diagnosed with PTSD and investigate the association between suicidality and five specific treatments for PTSD: psychological therapy, antidepressant/antianxiety medication (to reflect the prescription of medication for mood and anxiety disorders) (Zohar et al., Citation2014), antipsychotics, benzodiazepines and admission to hospital or admission to in-patient hospital units or to Crisis Resolution and Home Treatment Teams (CRHTT).

Methods

Setting and data collection

We analysed deidentified clinical data regarding patients who received secondary mental health services from Camden and Islington (C&I) NHS Foundation Trust; a large mental healthcare provider that offers comprehensive services to Camden and Islington, two inner-city London boroughs of approximately 440,000 residents (Werbeloff et al., Citation2018). The C&I catchment area has a slightly higher proportion of younger people (under the age of 35 years) than both London and England, a slightly higher proportion of white people than London but, a lower proportion of white people than England (Werbeloff et al., Citation2018). We obtained data via the Clinical Record Interactive Search (CRIS) tool, which extracts routinely collected electronic health records (EHR) from secondary care services (Werbeloff et al., Citation2018). It provides access to anonymised patient data for research purposes (Fernandes et al., Citation2013) using a precise deidentification process (Perera et al., Citation2016).

In 2018, the C&I research database, CRIS, contained detailed and anonymous information on more than 110,000 patients of whom 22% were receiving active care (Werbeloff et al., Citation2018).

Ethics

The NRES Committee East of England – Cambridge Central (14/EE/0177; extended in 2019: 19/EE/0210)—granted ethical approval to C&I CRIS. The C&I Research Database Oversight Committee at St Pancras Hospital, London, approved this study, and the C&I research database was accessed at this location. The CRIS security model holds that only approved researchers can access the data, which is analysed within the NHS firewall system thus adhering to NHS Information Governance rules.

Participants

Using the C&I Research Database, we identified a sample of 745 individuals meeting the following criteria:

  • Patients who had accessed secondary mental health services at C&I NHS FT between 2009 and 2017

  • Patients who were coded as having received a primary diagnosis of PTSD using the ICD-10 code F43.1 (WHO, Citation1992) regardless of secondary diagnoses.

Key covariates

Exposure variables

Suicidality was defined as suicidal ideation, behaviours and attempts (Meyer et al., Citation2010). We identified all patients with PTSD and recorded suicidality within the 6 months prior to, or 6 months after, a diagnosis of PTSD. Suicidality was measured using the Non-accidental self-injury scale (scale 2) on the Health of the Nation Outcome Scales (HoNOS) (Gowers et al., Citation1998). The HoNOS is a validated instrument (Pirkis et al., Citation2005) administered by clinicians to assess health and social functioning in individuals with mental health difficulties. The instrument includes 12 Likert-style scales rated from 0 (no problem) to 4 (severe problem) (Wing et al., Citation1998). The non-accidental self-injury scale in the HoNOS instrument reflects clinician judgement on a patient’s degree of suicidal ideation and behaviour (see Box 1).

Using clinical judgement, we derived a binary exposure variable; patients scoring three and above were defined as exhibiting suicidality, whilst patients scoring two and below were defined as not. Given that the dataset contained repeat measures of HoNOS scores (representing successive clinical encounters), we selected the measure completed closest to the time of PTSD diagnosis for our analysis.

Suicide was not included as an outcome as we did not have access to data on cause of death and it would not have held statistical power for accurate analysis. We did not exclude patients who died during the period of observation.

Box 1 Non-accidental self-injury scale (scale 2) on the Health of the Nation Outcome Scales (HoNOS)

0 = No problem of this kind during the period rated.

1 = Fleeting thoughts about ending it all but little risk during the period rated; no self-harm.

2 = Mild risk during the period rated; includes non-hazardous self-harm (e.g., wrist-scratching).

3 = Moderate to serious risk of deliberate self-harm during the period rated; includes preparatory acts (e.g., collecting tablets).

4 = Serious suicidal attempt and/or serious deliberate self-injury during the period rated.

Note that this scale does not include accidental self-injury (due e.g., to dementia or severe learning disability), and instead the cognitive problem is rated at Scale 4 and the injury at Scale 5. It also does not include illness or injury as a direct consequence of drug/alcohol use (e.g., cirrhosis of the liver or injury resulting from drink driving), which are rated in Scale 5).

Outcome variables

We identified five outcomes based on the treatments recommended for PTSD in NICE guidelines (National Collaborating Centre for Mental Health, Citation2005) and the literature describing the clinical effectiveness of treatments for suicidality (Hawton et al., Citation2016a, Citation2016b; Large & Kapur, Citation2018), capturing pharmacological treatments, psychological treatments and CRHTT.

Three of the five outcomes reflected the pharmacological treatments prescribed for patients diagnosed with PTSD including antidepressant/antianxiety medication, antipsychotics and benzodiazepines. To obtain the data as documented by the treating clinician we systematically searched all clinical notes for the terms antidepressant/antianxiety medication, antipsychotics and benzodiazepines using a simple text search, checking the text to consider the linguistic context of a word or phrase surrounding the target information before extraction, ensuring accurate data collection (Perera et al., Citation2016). For example, where a patient may have ‘refused benzodiazepines’, the data would not be extracted. Following data collection we created three binary variables to describe documented prescribing of each medication. We were unable to establish an accurate date for commencing each medication as the date recorded would correspond to a clinical note rather than initiation of medication.

The fourth treatment option reflected receipt of psychological treatment. For this we also used a simple electronic text search, searching all clinical notes for any of the following key words: psychology, therapy, psychological therapy, cognitive behavioural therapy, CBT, interpersonal therapy, IPT, dialectal behaviour therapy, DBT, mentalisation-based therapy, MBT. We created one binary variable for receipt of psychological treatment. As for medication, we were unable to establish a valid date for commencing each psychological treatment. A threshold for having received therapy was set at recorded attendances for at least three meetings with a psychologist or an equivalent practitioner delivering psychological therapy.

The fifth outcome was defined as admission to a psychiatric in-patient unit or to a CRHTT. Data on admissions were extracted from the structured fields within the C&I research database. We created one binary variable denoting admission to either location, setting the threshold at admission for at least one full day to denote adequate assessment. For this outcome we conducted a time to event analysis, as we could establish a valid recording of the date of admission and calculate exact follow-up. This allowed us to consider the differing periods of follow-up for each patient, reflecting differing periods in which to accumulate risk of admission.

Potential confounders

We selected the following socio-demographic and clinical variables a priori based on the literature and on clinical judgement identifying them as potential confounders of the association between suicidality and receipt of specific treatments in patients diagnosed with PTSD. These included: the length of time patients were known to the mental health Trust, year of suicidality assessment, gender (Klonsky et al., Citation2016; Klonsky & Muehlenkamp, Citation2007), age at PTSD diagnosis (Hawton et al., Citation2007; Katz et al., Citation2008; Nock et al., Citation2008; Zilcha-Mano et al., Citation2016), ethnicity (Curtin et al., Citation2016; Nock et al., Citation2008; Wierzbicki & Pekarik, Citation1993), marital status (Batty et al., Citation2018; Chin et al., Citation2017), area-level social deprivation (Batty et al., Citation2018; Curtis et al., Citation2006), drug and alcohol use (Driessen et al., Citation2008; Edwards et al., Citation2020; Poorolajal et al., Citation2016), depressed mood (Angst et al., Citation2002; Rytwinski et al., Citation2013) and relationship difficulties (Batty et al., Citation2018; Chin et al., Citation2017). We extracted data on these variables from the relevant structured fields within the C&I research database, or from HoNOS scales.

Time patients were known to the mental health trust was operationalised by calculating, in years, the period between 2009 to the date of PTSD diagnosis.

Age at diagnosis was based on years between date of birth and the date of PTSD diagnosis, grouped into 10-year age ranges from ≤24 to ≥65 years.

Ethnicity was grouped into six categories as operationalised previously (Werbeloff et al., Citation2018): ‘White’, ‘Asian/Asian British’, ‘Black, Black British’, ‘Mixed’, ‘Other’ and ‘Missing’ by collapsing the 18 higher order categories originally recorded in patients’ notes.

Marital status was grouped into five categories as operationalised previously (Werbeloff et al., Citation2018): ‘Single’, ‘Divorced/Separated’, ‘Widowed’, ‘Married/Civil Partner’ and ‘Missing’ by collapsing the eight higher order categories originally recorded in patients’ notes.

Index of Multiple Deprivation (IMD) measure score was calculated for each patient, as quintile values. The IMD pools information from 38 separate factors into seven spheres of deprivation (income; employment; health and disability; education, skills and training; barriers to housing and services; living environment and crime) to develop an individual score of deprivation for each of the 32,482 Lower Super Output Areas in England (LSOAs) (Werbeloff et al., Citation2016). Lower IMD scores represent lower levels of deprivation, and all scores were derived by linking the LSOA code with patients’ postcodes (as recorded in the structured fields of the C&I research database), creating quintiles based on the sample itself.

Drug and alcohol use, depressed mood, relationship difficulties are three clinical variables derived from the following scales on any HoNOS measures recorded in the six months prior to or six months after a PTSD diagnosis: problem drinking or drug-taking (scale 3); problems with depressed mood (scale 7); and problems with relationships (scale 9). Based on clinical judgment a score of three or above on each scale was defined as a positive score generating a set of three binary variables.

Statistical analysis

We conducted all analyses using STATA version15 (StataCorp. College Station, TX). Chi-squared tests were conducted to report descriptive statistics on the sociodemographic and clinical characteristics of the sample, only including cases for whom we had complete data on model covariates. We ran logistic regression models for our four binary psychotropic and psychological therapy outcomes, estimating odds ratios (OR) and 95% confidence intervals (CI), with the threshold for significance set at a p value of 0.05 to examine the association between suicidality around the time of a PTSD diagnosis and receipt of medication and/or psychological therapy. We ran a Cox proportional hazards regression model for our admission outcome, to investigate the association between suicidality and admission to hospital or CRHTT, estimating hazard ratios (HR) and 95% confidence intervals, with the threshold for significance set at a p value of 0.05.

We adjusted all multivariable models stepwise as block adjustments for (1) time known to the Trust and year in which patients were assessed for suicidality, (2) block 1 plus age, ethnicity, marital status, and IMD, and finally (3) block 1 and 2 plus the three clinical variables derived from the HoNOS measure (drug and alcohol use, depressed mood and relationship difficulties).

Cases with missing data on any of the sociodemographic variables were excluded from the main analyses (n = 131). Cases where data was missing on any one of the three clinical variables derived from the HoNOS measure (drug and alcohol use, depressed mood and relationship difficulties) were labelled as missing and not included in the final analyses (n = 6).

Results

We analysed data for an eligible sample of 745 patients who had a primary diagnosis of PTSD in the C&I research database. Their sociodemographic and clinical characteristics are summarised in . Within the sample there was a slight predominance of women (56%) and patients who were single (51%). The age group in which the highest proportion of PTSD was diagnosed was 34–44 years (28%) and the ethnicity with greatest proportion was White/White British (47%). Most individuals did not report drug or alcohol misuse (86%), however, just over half reported relationship difficulties (59%) and the majority experienced depressed mood (90%). Overall, 6% (n = 48) of individuals with PTSD reported suicidality within 6 months before or 6 months after the diagnosis. There were few demographic differences between those who reported or did not report suicidality. Two variables, younger age and drug and alcohol misuse, were associated with a higher probability of reporting suicidality.

Table 1. Socio-demographic and clinical characteristics of sample (n = 745).

Patients included in the analysis were known to the Trust for up to 7 years. The majority were known for less than 1 year (15%) but, there was no association between time known to the trust and reported suicidality.

Over half of all patients with PTSD had received psychological therapy (60%) and had been prescribed at least one psychotropic medication (66%) (). The medication most prescribed was antidepressant/antianxiety medication (61%) followed by benzodiazepines (35%) and antipsychotics (33%). In total, 25% a quarter of patients had been admitted to a psychiatric hospital or CRHTT. Amongst the individuals with suicidality, 79% three quarters received psychological therapy, over half (69%) obtained antidepressant/antianxiety medication, half (50%) obtained antipsychotic medication and 58% over half obtained benzodiazepines, whilst 65% were admitted to a psychiatric inpatient unit or CRHTT.

Table 2. PTSD treatments by reported suicidality.

Associations between suicidality and specific PTSD treatment options

As shown in , in the context of PTSD, individuals with suicidality were no more likely than those without suicidality to be prescribed any one psychotropic medication. Similarly, they were no more likely to be prescribed antidepressants/antianxiety medication. Conversely, individuals with suicidality were 2.27 times as likely to be prescribed antipsychotics (AOR = 2.27, 95% CI 1.15 − 4.47), 2.28 times as likely to be prescribed benzodiazepines (AOR 2.28, 95% CI 1.17 − 4.44), and 2.60 times as likely to be referred for psychological therapy (AOR 2.60, 95% CI 1.18 − 5.73) than those with PTSD who did not have suicidality.

Table 3. Associations between reported suicidality and PTSD treatments.

In relation to risk of psychiatric admission, patients with suicidality in the context of PTSD were 2.84 times as likely to be admitted to a CRHTT or to hospital (AOR 2.84, 95% 1.82 − 4.45) than those with PTSD who did not have suicidality.

Discussion

Main findings

We found, in a clinical sample of secondary care patients diagnosed with PTSD, a relatively low proportion of patients (6%) who reported suicidality within the 6 months before or 6 months after a PTSD diagnosis. Despite NICE recommendations regarding psychological therapy being first in line treatment for PTSD (NICE, Citation2018), only 60% of our overall sample received psychological therapy. We acknowledge that a higher proportion than this may have been offered therapy and refused or attended less than three sessions, as per our treatment definitions. Moreover, people could have received therapy in non-NHS services. Two thirds of patients had been prescribed at least one psychotropic medication, although we did not have data on the number of patients who had been offered medication and had turned this option down. We noted that over a quarter of this sample were prescribed antipsychotics and this high proportion may reflect the higher severity of PTSD in secondary care contexts. We also noted a high proportion (again over a quarter) of patients who were prescribed benzodiazepines; a class of drugs not recommended in PTSD NICE guidelines. A quarter of our sample were admitted to a psychiatric unit or CRHTT, highlighting the high symptom and healthcare cost burden of a PTSD diagnosis.

Treatments received by patients with PTSD who reported suicidality differed from those without in relation to prescription of antipsychotics and benzodiazepines, receipt of psychological therapy and psychiatric admission. Patients reporting suicidality were over twice as likely to have been prescribed antipsychotics and benzodiazepines, over two and a half times more likely to receive psychological therapy and almost three times as likely to have been admitted to a psychiatric hospital or CRHTT. It was notable that there were no differences in prescribing of antidepressant/antianxiety medication by suicidality. As suicidal thoughts and acts are characteristic of people diagnosed with a severe depressive episode, whether with or without psychotic symptoms, it might be assumed from stepped care models that such patients would be prescribed antidepressant/antianxiety medication before recourse to antipsychotics.

Findings in the context of other studies

The prevalence of suicidality in psychiatric patients with PTSD in our sample (6%) was much lower than that estimated for psychiatric patients with comorbid PTSD and major depressive disorder (MDD) sampled in ten European countries (75%) (Dold et al., Citation2017). Both samples comprised inpatients and outpatients in academic psychiatric treatment centres, but the higher prevalence of suicidality estimated is likely to reflect the severity of MDD in the European sample (relating in part to the requirement for participants to be on at least one antidepressant medication), as well as the detailed clinical interview used to ascertain outcomes. It is possible that our approach to capturing suicidality, using HoNOS data, under-ascertained suicidality in our sample. The same European study found that 40% of patients with MDD and PTSD were on antidepressant medication augmented with at least one antipsychotic medication and 34% were on antidepressant medication augmented with at least one benzodiazepine/benzodiazepine-like medication (Dold et al., Citation2017). This is in comparison to the 33% of all patients in our study prescribed antipsychotic medication and the 35% prescribed benzodiazepine medication. Again, the slightly higher prevalence of being prescribed such medications is likely to reflect clinical severity in that sample. Of note, in patients with MDD in the European sample there was an association between comorbid PTSD and treatment augmentation with low-potency antipsychotics but, no association with first-line antidepressant prescribed or treatment response (to any medication) (Dold et al., Citation2017).

Our UK-based study describes a clinical sample in which there was no excess of women diagnosed with PTSD. This is despite Danish research describing a female two-fold excess risk of PTSD, for which it is hypothesised that women are more prone to traumatic experiences than men and may have an increased vulnerability to PTSD (Christiansen & Hansen, Citation2015). Our study included only patients in secondary care, and our findings suggest that some men with PTSD may not be accessing services, or that women with PTSD may be more likely to be treated in primary rather than secondary care. The peak age group for PTSD diagnosis in our sample was 34–44 years, as consistent with previous findings, for which the explanation proposed was an escalation of stress at a point of rising mid-life responsibilities (Ditlevsen & Elklit, Citation2010; Liberzon & Knox, Citation2012).

The low proportion of those with suicidality in our sample was surprising given the consistent association of PTSD with suicidality in other studies (Bentley et al., Citation2016; Galatzer-Levy et al., Citation2013; Hawgood & De Leo, Citation2008; Krysinska & Lester, Citation2010; Panagioti et al., Citation2009), and studies describing patients with PTSD and suicidal thoughts as having more severe depression and anxiety than other patients with PTSD (Krysinska & Lester, Citation2010). We would expect patients treated in secondary care to have greater symptom severity than those in primary care. Our observation that psychiatric admission was more likely in patients with PTSD reporting suicidality is consistent with the demonstrated risk of suicidal behaviour in populations diagnosed with PTSD and with mood and anxiety comorbidities (Galatzer-Levy et al., Citation2013). Our finding that 60% of individuals overall were taking antidepressants/antianxiety medication, increasing to 68% amongst those who reported suicidality, is consistent with research describing a greater risk of suicidality amongst individuals with PTSD not taking medication compared to those who are (Tarrier & Gregg, Citation2004). It is noteworthy, however, that NICE guidelines state that for individuals with PTSD, medication should not be used in preference to trauma-focused psychological therapy (NICE, Citation2018). The prevalence of receipt of antidepressants/anti-anxiety medication compared to that of psychological therapy in this sample do not reflect adherence to these guidelines. This is particularly concerning given the weak evidence to support use of psychotropic medication reducing risk of repeat self-harm (Hawton et al., 2016).

Strengths and limitations

A key strength of this study was that it used a large routine clinical database to describe treatment patterns in a naturalistic sample of patients treated by a secondary mental healthcare provider, presenting novel findings on how treatments received by patients with PTSD differ by their suicidality. Whilst this dataset gave us access to a relatively large sample size, it remains possible that associations arose by chance. The C&I database provides reliable and accurate information, with responsibility for data input lying with treating clinicians rather than clinical coders (ONS, Citation2013). This improved the validity of diagnostic data and reduced the chances that our sample included patients with a primary diagnosis of non-affective psychotic disorders (ICD-10 F20-F29) or borderline personality disorder (ICD-10 F60.3), both of which are independently associated with risk of suicidal behaviour (Arsenault-Lapierre et al., Citation2004). Our longitudinal design ensured that we were clear about the temporal sequence of events, reducing the chances that any associations observed were explained by reverse causality.

The main limitations of the study lie in missing data. As data were collected for clinical and not research purposes, data were not available for all potential confounders, for some variables we had incomplete information (Werbeloff et al., Citation2016) and we only captured information for those individuals who attended sessions. Additionally, this routine clinical database does not record the nature and severity of the traumatic event that led to the PTSD diagnosis and research shows this can influence the course and prognosis of the disorder (Howgego et al., Citation2005). To reflect clinical reality, this study did not exclude patients with PTSD who had secondary diagnoses of other psychiatric disorders and it is possible that suicidality occurred in the context of those other psychiatric disorders. A clinical study confined to those with PTSD but, no other diagnoses would explore the relationship between PTSD and suicidality specifically but would not reflect clinical reality. We note that other studies investigating suicidality in the context of specific psychiatric disorders have also included patients with comorbid psychiatric disorders, with findings representative of naturalistic clinical populations (Dold et al., Citation2018) and therefore more useful in reflecting real-world practice. Similarly, it is possible that prescribing in our sample reflected prescribing for a secondary diagnosis of depressive disorder and the suicidality associated with this disorder, given that first-line pharmacotherapy is similar for PTSD and depression (Bandelow et al., Citation2022; Bauer et al., Citation2017). It is possible that some patients in our study had undiagnosed PTSD for longer than others and this may have influenced outcomes (Brady et al., Citation2000). Additionally, it is possible that people may have been diagnosed with a primary diagnosis of non-affective psychotic disorders at another point in time, prior to accessing C&I secondary care or prior to the period under investigation. Although we were able to conduct a time to event analysis for admission, due to valid recording of admission date, we were unable to do this for psychotropics as the date extracted by NLP for medication tends to relate to the clinical planning rather than actual receipt.

Our approach of complete case analysis led to 131 cases being dropped from the analysis, and it is possible that this introduced biases, particularly in relation to ethnicity and IMD. We did not compare the characteristics of those with and without data on all model covariates and this is a key limitation. Approximately a third of the patients in the C&I CRIS database do not have their ethnicity recorded in their EHRs (Werbeloff et al., Citation2018). It is possible that exclusion of these patients (many of whom may have been migrants with pre-migration trauma) may have biased estimates if the prevalence of suicidal ideation was higher in those who were excluded (Weberloff et al., 2016). We felt it important not to use multiple imputation for missing data, due to the biases introduced by that approach but, a shortfall of this study is not having assessed for differences between those who had missing data and those who did not.

As our data derive from only one Trust our findings may not be generalisable to clinical populations outside urban centres in the UK. Based on IMD scores obtained for 326 areas in England, Camden is the 74th most deprived area and Islington is the 14th (Werbeloff et al., Citation2016). Finally, as our study was limited to those who sought help and accessed secondary mental health services for PTSD, our findings may not be generalisable to the wider population of those with PTSD.

Clinical, policy and research outcomes

Further work is needed to investigate why a relatively low proportion of patients with PTSD (60% overall) receive psychological therapy compared to that for those who receive psychotropic medication (66% overall), apparently contradicting NICE guidelines that all individuals with a diagnosis of PTSD should receive psychological therapy as a first line treatment, rather than medication (NICE, Citation2018). Although therapy and psychotropic medication have equivalent efficacy (Bisson et al., Citation2007) psychological therapy addresses underlying pathology and may have longer-lasting effects through shifting cognitions. One explanation for this imbalance is the greater severity of PTSD treated in secondary care, including those who do not respond to first- and second-line treatments and those with comorbid conditions such as depression, for which antidepressants/antianxiety medication would also be prescribed (Rytwinski et al., Citation2013). It may also be possible that this reflects treatment preferences among secondary care patients with PTSD for medication over therapy. Trial evidence suggests that patients who choose their form of treatment, whether medication or therapy, improve more than those who receive treatment regardless of their preference (Zoellner et al., Citation2019). Qualitative research is needed to analyse the discourse between patients and clinicians in establishing treatment plans and the extent to which they might be regarded as collaborative. Our findings may also reflect the limited availability of psychological therapy within the NHS due to resource constraints, even despite economic modelling suggesting that antidepressants/antianxiety medication is less cost-effective than psychological interventions for PTSD (NICE, Citation2018). The high proportion of patients prescribed antipsychotics in this clinical setting (33% overall) reinforces the argument of a need for better recognition of psychosis symptoms as part of the broader clinical picture among trauma-exposed populations (Frost et al., Citation2019).

Future research should also focus on defining the clinical features of patients with PTSD and depression who experience suicidal thoughts, as other studies suggest that this specific comorbidity is associated with greatest risk of suicidality (Oquendo et al., Citation2003, Citation2005). Work to ascertain the relationship between specific combinations of symptoms (such as flashbacks and hopelessness) in engendering suicidal thoughts may help in tailoring trauma-informed approaches to discussing therapy and medication. Future epidemiological research should explore the timing of the onset of suicidal ideation in relation to PTSD diagnosis, and how this varies with types of trauma and specific features of PTSD, such as flashbacks (Tarrier & Gregg, Citation2004). Longer-term work in samples of this kind would ascertain the prognosis for patients with PTSD and suicidal thoughts who do not receive evidence-based treatment, whether not receiving therapy, not being prescribed anti-depressant/anti-anxiety medication, or receiving off licence antipsychotics. Such findings might also be informed by investigating the interactions with the type of index trauma. Novel trial designs that could investigate the clinical effectiveness of psychiatric admission in this patient population would also help inform revisions of treatment guidelines.

Conclusions

In this naturalistic clinical study of secondary care patients with PTSD we identified a relatively low proportion (6%) of patients who reported suicidality within the 6 months before or 6 months after a PTSD diagnosis. We also identified a lower proportion overall receiving therapy when compared with psychotropic medication, despite therapy being the first line treatment for PTSD. Patients with PTSD and suicidality in this sample were more likely than non-suicidal patients to be prescribed antipsychotics and benzodiazepines, to receive psychological therapy and to be admitted to a psychiatric ward or CRHTT but, were no more likely to receive anti-depressant/anti-anxiety medication. Whilst acknowledging the potential for under-recording of treatments received and the greater morbidity of secondary care PTSD patients, it remains possible that a high proportion of patients with PTSD do not receive evidence-based treatment, as defined in NICE guidelines.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Correction Statement

This article has been republished with minor changes. These changes do not impact the academic content of the article.

Additional information

Funding

CRIS is supported by the Noclor Joint NHS Research Office and the National Institute for Health Research (NIHR) University College London Hospital Biomedical Research Centre (BRC). J.H., D.O. and A.P. are supported by the University College London Hospitals (UCLH) National Institute of Health Research (NIHR) Biomedical Research Centre (BRC). D.O. was also part-supported by the NIHR Collaboration for Leadership in Applied Health Research and Care (CLAHRC) North Thames at Bart’s Health NHS Trust.

References

  • Angst, F., Stassen, H. H., Clayton, P. J., & Angst, J. (2002). Mortality of patients with mood disorders: Follow-up over 34–38 years. Journal of Affective Disorders, 68(2–3), 167–181. https://doi.org/10.1016/S0165-0327(01)00377-9
  • Arsenault-Lapierre, G., Kim, C., & Turecki, G. (2004). Psychiatric diagnoses in 3275 suicides: a meta-analysis. BMC Psychiatry, 4(1), 37. doi:10.1186/1471-244X-4-37
  • Bandelow, B., Allgulander, C., Baldwin, D. S., Costa, D. L. D. C., Denys, D., Dilbaz, N., Domschke, K., Hollander, E., Kasper, S., Möller, H. J., Eriksson, E., Fineberg, N. A., Hättenschwiler, J., Kaiya, H., Karavaeva, T., Katzman, M. A., Kim, Y. K., Inoue, T., Lim, L., … Zohar, J. (2022). World Federation of Societies of Biological Psychiatry (WFSBP) guidelines for treatment of anxiety, obsessive-compulsive and posttraumatic stress disorders - Version 3. Part II: OCD and PTSD. World Journal of Biological Psychiatry, 28, 1–39. https://doi.org/10.1080/15622975.2022.2086296
  • Batty, G. D., Kivimäki, M., Bell, S., Gale, C. R., Shipley, M., Whitley, E., & Gunnell, D. (2018). Psychosocial characteristics as potential predictors of suicide in adults: An overview of the evidence with new results from prospective cohort studies. Translational Psychiatry, 8(1), 22. https://doi.org/10.1038/s41398-017-0072-8
  • Bauer, M., Severus, E., Möller, H. J., & Young, A. H. (2017). Pharmacological treatment of unipolar depressive disorders: Summary of WFSBP guidelines. International Journal of Psychiatry in Clinical Practice, 21(3), 166–176. https://doi.org/10.1080/13651501.2017.1306082
  • Bentley, K. H., Franklin, J. C., Ribeiro, J. D., Kleiman, E. M., Fox, K. R., & Nock, M. K. (2016). Anxiety and its disorders as risk factors for suicidal thoughts and behaviors: A meta-analytic review. Clinical Psychology Review, 43, 30–46. https://doi.org/10.1016/j.cpr.2015.11.008
  • Bisson, J. I., Ehlers, A., Matthews, R., Pilling, S., Richards, D., & Turner, S. (2007). Psychological treatments for chronic post-traumatic stress disorder. The British Journal of Psychiatry : The Journal of Mental Science, 190(2), 97–104. https://doi.org/10.1192/bjp.bp.106.021402
  • Brady, K. T., Killeen, T. K., Brewerton, T., & Lucerini, S. (2000). Comorbidity of psychiatric disorders and posttraumatic stress disorder. The Journal of Clinical Psychiatry, 61(7), 22–32.
  • Chin, B., Murphy, M. L., Janicki-Deverts, D., & Cohen, S. (2017). Marital status as a predictor of diurnal salivary cortisol levels and slopes in a community sample of healthy adults. Psychoneuroendocrinology, 78, 68–75. https://doi.org/10.1016/j.psyneuen.2017.01.016
  • Christiansen, D. M., & Hansen, M. (2015). Accounting for sex differences in PTSD: A multi variable mediation model. European Journal of Psychotraumatology, 6(1), 26068. https://doi.org/10.3402/ejpt.v6.26068
  • Curtin, S. C., Warner, M., & Hedegaard, H. (2016). Suicide rates for females and males by race and ethnicity: United States, 1999 and 2014. NCHS Health E-Stat: National Center for Health Statistics.
  • Curtis, S., Copeland, A., Fagg, J., Congdon, P., Almog, M., & Fitzpatrick, J. (2006). The ecological relationship between deprivation, social isolation and rates of hospital admission for acute psychiatric care: a comparison of London and New York City. Health & Place, 12(1), 19–37. https://doi.org/10.1016/j.healthplace.2004.07.002
  • Ditlevsen, D. N., & Elklit, A. (2010). The combined effect of gender and age on post traumatic stress disorder: Do men and women show differences in the lifespan distribution of the disorder? Annals of General Psychiatry, 9(1), 32. https://doi.org/10.1186/1744-859X-9-32
  • Dold, M., Bartova, L., Kautzky, A., Souery, D., Mendlewicz, J., Serretti, A., Porcelli, S., Zohar, J., Montgomery, S., & Kasper, S. (2017). The impact of comorbid post-traumatic stress disorder in patients with major depressive disorder on clinical features, pharmacological treatment strategies, and treatment outcomes - results from a cross-sectional European Multicenter Study. European Neuropsychopharmacology : The Journal of the European College of Neuropsychopharmacology, 27(7), 625–632. https://doi.org/10.1016/j.euroneuro.2017.05.004
  • Dold, M., Bartova, L., Fugger, G., Kautzky, A., Souery, D., Mendlewicz, J., Papadimitriou, G. N., Dikeos, D., Ferentinos, P., Porcelli, S., Serretti, A., Zohar, J., Montgomery, S., & Kasper, S. (2018). Major depression and the degree of suicidality: Results of the European Group for the Study of Resistant Depression (GSRD). The International Journal of Neuropsychopharmacology, 21(6), 539–549. https://doi.org/10.1093/ijnp/pyy009
  • Driessen, M., Schulte, S., Luedecke, C., Schaefer, I., Sutmann, F., Ohlmeier, M., Kemper, U., Koesters, G., Chodzinski, C., Schneider, U., Broese, T., Dette, C., & Havemann-Reinicke, U. (2008). Trauma and PTSD in patients with alcohol, drug, or dual dependence: A multi‐center study. Alcoholism: Clinical and Experimental Research, 32(3), 481–488. https://doi.org/10.1186/1744-859X-9-32
  • Edwards, A. C., Ohlsson, H., Sundquist, J., Sundquist, K., & Kendler, K. S. (2020). Alcohol use disorder and risk of suicide in a Swedish population-based cohort. American Journal of Psychiatry, 177(7), 627–634. https://doi.org/10.1176/appi.ajp.2019.19070673
  • Fernandes, A. C., Cloete, D., Broadbent, M. T. M., Hayes, R. D., Chang, C.-K., Jackson, R. G., Roberts, A., Tsang, J., Soncul, M., Liebscher, J., Stewart, R., & Callard, F. (2013). Development and evaluation of a de-identification procedure for a case register sourced from mental health electronic records. BMC Medical Informatics and Decision Making, 13(1), 71. doi:10.1186/1472-6947-13-71
  • Fox, V., Dalman, C., Dal, H., Hollander, A. C., Kirkbride, J. B., & Pitman, A. (2021). Suicide risk in people with post-traumatic stress disorder: A cohort study of 3.1 million people in Sweden. Journal of Affective Disorders, 279, 609–616. https://doi.org/10.1016/j.jad.2020.10.009
  • Frost, R., Louison Vang, M., Karatzias, T., Hyland, P., & Shevlin, M. (2019). The distribution of psychosis, ICD-11 PTSD and complex PTSD symptoms among a trauma-exposed UK general population sample. Psychosis, 11(3), 187–198. https://doi.org/10.1080/17522439.2019.1626472
  • Galatzer-Levy, I. R., Nickerson, A., Litz, B. T., & Marmar, C. R. (2013). Patterns of lifetime PTSD comorbidity: a latent class analysis. Depression and Anxiety, 30(5), 489–496. https://doi.org/10.1002/da.22048
  • Gowers, S., Whitton, A., & Harrington, R. (1998). HoNOSCA: Health of the nation outcome scales-child and adolescent version. Report of Research and Development September 1995–March 1997. University of Manchester.
  • Gradus, J. L., Antonsen, S., Svensson, E., Lash, T. L., Resick, P. A., & Hansen, J. G. (2015). Trauma, comorbidity, and mortality following diagnoses of severe stress and adjustment disorders: A nationwide cohort study. American Journal of Epidemiology, 182(5), 451–458. https://doi.org/10.1093/aje/kwv066
  • Gradus, J. L., Qin, P., Lincoln, A. K., Miller, M., Lawler, E., Sørensen, H. T., & Lash, T. L. (2010). Posttraumatic stress disorder and completed suicide. American Journal of Epidemiology, 171(6), 721–727. https://doi.org/10.1093/aje/kwp456
  • Hawton, K., Bergen, H., Casey, D., Simkin, S., Palmer, B., Cooper, J., Kapur, N., Horrocks, J., House, A., Lilley, R., Noble, R., & Owens, D. (2007). Self-harm in England: A tale of three cities. Social Psychiatry and Psychiatric Epidemiology, 42(7), 513–521. https://doi.org/10.1007/s00127-007-0199-7
  • Hawton, K., Witt, K. G., Taylor Salisbury, T. L., Arensman, E., Gunnell, D., Hazell, P., Townsend, E., & Van Heeringen, K. (2016a). Pharmacological interventions for self-harm in adults. BJPsych Advances, 22(1), 2–2. https://doi.org/10.1192/apt.22.1.2
  • Hawton, K., Witt, K. G., Taylor Salisbury, T. L., Arensman, E., Gunnell, D., Hazell, P., Townsend, E., & van Heeringen, K. (2016b). Psychosocial interventions following self-harm in adults: A systematic review and meta-analysis. The Lancet. Psychiatry, 3(8), 740–750. https://doi.org/10.1016/S2215-0366(16)30070-0
  • Hawgood, J., & De Leo, D. (2008). Anxiety disorders and suicidal behaviour: An update. Current Opinion in Psychiatry, 21(1), 51–64. https://doi.org/10.1097/YCO.0b013e3282f2309d
  • Howgego, I. M., Owen, C., Meldrum, L., Yellowlees, P., Dark, F., & Parslow, R. (2005). Posttraumatic stress disorder: An exploratory study examining rates of trauma and PTSD and its effect on client outcomes in community mental health. BMC Psychiatry, 5(1), 21–17. https://doi.org/10.1186/1471-244X-5-21
  • ICD-11 (2019). ICD-11 implementation or transition guide. World Health Organization.
  • Katz, L. Y., Kozyrskyj, A. L., Prior, H. J., Enns, M. W., Cox, B. J., & Sareen, J. (2008). Effect of regulatory warnings on antidepressant prescription rates, use of health services and outcomes among children, adolescents and young adults. CMAJ: Canadian Medical Association Journal = journal de l'Association medicale canadienne, 178(8), 1005–1011. https://doi.org/10.1503/cmaj.071265
  • Kessler, R. C. (2000). Posttraumatic stress disorder: The burden to the individual and to society. Journal of Clinical Psychiatry, 61, 4–14.
  • Klonsky, E. D., May, A. M., & Saffer, B. Y. (2016). Suicide, suicide attempts, and suicidal ideation. Annual Review of Clinical Psychology, 12, 307–330. https://doi.org/10.1146/annurev-clinpsy-021815-093204
  • Klonsky, E. D., & Muehlenkamp, J. J. (2007). Self‐injury: A research review for the practitioner. Journal of Clinical Psychology, 63(11), 1045–1056. https://doi.org/10.1002/jclp.20412
  • Krysinska, K., & Lester, D. (2010). Post-traumatic stress disorder and suicide risk: A systematic review. Archives of Suicide Research : Official Journal of the International Academy for Suicide Research, 14(1), 1–23. https://doi.org/10.1002/jclp.20412
  • Large, M. M., & Kapur, N. (2018). Psychiatric hospitalisation and the risk of suicide. The British Journal of Psychiatry : The Journal of Mental Science, 212(5), 269–273. https://doi.org/10.1192/bjp.2018.22
  • Liberzon, I., & Knox, D. (2012). Expanding our understanding of neurobiological mechanisms of resilience by using animal models. Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology, 37(2), 317–318. https://doi.org/10.1038/npp.2011.259
  • Meyer, R. E., Salzman, C., Youngstrom, E. A., Clayton, P. J., Goodwin, F. K., Mann, J. J., Alphs, L. D., Broich, K., Goodman, W. K., Greden, J. F., Meltzer, H. Y., Normand, S.-L T., Posner, K., Shaffer, D., Oquendo, M. A., Stanley, B., Trivedi, M. H., Turecki, G., Beasley, C. M., … Sheehan, D. V. (2010). Suicidality and risk of suicide—definition, drug safety concerns, and a necessary target for drug development: A consensus statement. The Journal of Clinical Psychiatry, 71(08), 1040–1046. https://doi.org/10.4088/JCP.10cs06070blu
  • National Collaborating Centre for Mental Health (2005). Clinical guideline. Post traumatic stress clinical guideline. Post traumatic stress disorder: The management of PTSD in adults and children disorder: The management of PTSD in adults and children in primary and secondary care in primary and secondary care. National Institute for Clinical Excellence.
  • National Institute for Health and Care Excellence (2018). Post-traumatic Stress Disorder (NICE Guideline No. 116). National Institute for Health and Care Excellence. https://www.nice.org.uk/guidance/ng116/chapter/Recommendations#assessment-anscoordination-of-care
  • Nock, M. K., Borges, G., Bromet, E. J., Cha, C. B., Kessler, R. C., & Lee, S. (2008). Suicide and suicidal behavior. Epidemiologic Reviews, 30(1), 133–154. https://doi.org/10.1093/epirev/mxn002
  • ONS. (2013). Prescriptions dispensed in the community: statistics for England: 2002 to 2012. Office for National Statistics, London. Accessed 2022 Oct 29. https://digital.nhs.uk/data-and-information/publications/statistical/prescriptions-dispensed-in-the-community/prescriptions-dispensed-in-the-community-statistics-for-england-2002-2012#:∼:text=The%20average%20number%20of%20prescription,year%20and%2012.4%20in%202002
  • Organisation mondiale de la santé, World Health Organization, & WHO Staff (1992). The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines (Vol. 1). World Health Organization.
  • Oquendo, M. A., Friend, J. M., Halberstam, B., Brodsky, B. S., Burke, A. K., Grunebaum, M. F., Malone, K. M., & Mann, J. J. (2003). Association of comorbid posttraumatic stress disorder and major depression with greater risk for suicidal behavior. The American Journal of Psychiatry, 160(3), 580–582. https://doi.org/10.1176/appi.ajp.160.3.580
  • Oquendo, M., Brent, D. A., Birmaher, B., Greenhill, L., Kolko, D., Stanley, B., Zelazny, J., Burke, A. K., Firinciogullari, S., Ellis, S. P., & Mann, J. J. (2005). Posttraumatic stress disorder comorbid with major depression: Factors mediating the association with suicidal behavior. The American Journal of Psychiatry, 162(3), 560–566. https://doi.org/10.1176/appi.ajp.162.3.560
  • Owens, D., Horrocks, J., & House, A. (2002). Fatal and non-fatal repetition of self-harm: Systematic review. The British Journal of Psychiatry : The Journal of Mental Science, 181(3), 193–199. https://doi.org/10.1192/bjp.181.3.193
  • Panagioti, M., Gooding, P., & Tarrier, N. (2009). Post-traumatic stress disorder and suicidal behavior: A narrative review. Clinical Psychology Review, 29(6), 471–482. https://doi.org/10.1016/j.cpr.2009.05.001
  • Perera, G., Broadbent, M., Callard, F., Chang, C.-K., Downs, J., Dutta, R., Fernandes, A., Hayes, R. D., Henderson, M., Jackson, R., Jewell, A., Kadra, G., Little, R., Pritchard, M., Shetty, H., Tulloch, A., & Stewart, R. (2016). Cohort profile of the South London and Maudsley NHS Foundation Trust Biomedical Research Centre (SLaM BRC) case register: Current status and recent enhancement of an electronic mental health record-derived data resource. BMJ Open, 6(3), e008721. http://doi.org/10.1136/bmjopen-2015-008721
  • Pirkis, J. E., Burgess, P. M., Kirk, P. K., Dodson, S., Coombs, T. J., & Williamson, M. K. (2005). A review of the psychometric properties of the Health of the Nation Outcome Scales (HoNOS) family of measures. Health and Quality of Life Outcomes, 3(1), 76. https://doi.org/10.1186/1477-7525-3-76
  • Poorolajal, J., Haghtalab, T., Farhadi, M., & Darvishi, N. (2016). Substance use disorder and risk of suicidal ideation, suicide attempt and suicide death: A meta analysis. Journal of Public Health (Oxford, England), 38(3), e282–e291. https://doi.org/10.1093/pubmed/fdv148
  • Rytwinski, N. K., Scur, M. D., Feeny, N. C., & Youngstrom, E. A. (2013). The co occurrence of major depressive disorder among individuals with posttraumatic stress disorder: A meta-analysis. Journal of Traumatic Stress, 26(3), 299–309. https://doi.org/10.1002/jts.21814
  • StataCorp (2009). Stata statistical software: Release 11. StataCorp LP.
  • Tarrier, N., & Gregg, L. (2004). Suicide risk in civilian PTSD patients. Social Psychiatry and Psychiatric Epidemiology, 39(8), 655–661. https://doi.org/10.1007/s00127-004-0799-4
  • Werbeloff, N., Osborn, D. P., Patel, R., Taylor, M., Stewart, R., Broadbent, M., & Hayes, J. F. (2018). The Camden & Islington research database: Using electronic mental health records for research. PloS One, 13(1), e0190703. https://doi.org/10.1371/journal.pone.0190703
  • Werbeloff, N., Markou, M., Hayes, J. F., Pitman, A. L., & Osborn, D. P. (2016). Individual and area-level risk factors for suicidal ideation and attempt in people with severe depression. Journal of Affective Disorders, 205, 387–392. https://doi.org/10.1016/j.jad.2016.08.015
  • Wing, J. K., Beevor, A. S., Curtis, R. H., Park, S. G. B., Hadden, J., & Burns, A. (1998). Health of the Nation Outcome Scales (HoNOS): research and development. The British Journal of Psychiatry, 172(1), 11–18. doi:10.1192/bjp.172.1.11
  • Wierzbicki, M., & Pekarik, G. (1993). A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice, 24(2), 190–195. https://doi.org/10.1037/0735-7028.24.2.190
  • Zilcha-Mano, S., Keefe, J. R., Chui, H., Rubin, A., Barrett, M. S., & Barber, J. P. (2016). Reducing dropout in treatment for depression: Translating dropout predictors into individualized treatment recommendations. The Journal of Clinical Psychiatry, 77(12), e1584–e1590. https://doi.org/10.4088/JCP.15m10081
  • Zoellner, L. A., Roy-Byrne, P. P., Mavissakalian, M., & Feeny, N. C. (2019). Doubly randomized preference trial of prolonged exposure versus sertraline for treatment of PTSD. The American Journal of Psychiatry, 176(4), 287–296. https://doi.org/10.1176/appi.ajp.2018.17090995
  • Zohar, J., Nutt, D. J., Kupfer, D. J., Moller, H. J., Yamawaki, S., Spedding, M., & Stahl, S. M. (2014). A proposal for an updated neuropsychopharmacological nomenclature. European Neuropsychopharmacology : The Journal of the European College of Neuropsychopharmacology, 24(7), 1005–1014. https://doi.org/10.1016/j.euroneuro.2013.08.004