Reliability and validity of the Depression and Somatic Symptoms Scale among patients with chronic low back pain

Abstract

Background

The Depression and Somatic Symptoms Scale (DSSS), which is a free scale that includes a depression subscale (DS) and a somatic subscale (SS), was developed to evaluate depression and somatic symptoms simultaneously. This study aimed to examine the reliability and validity of the DSSS among patients with chronic low back pain (CLBP).

Methods

Two-hundred and twenty-five patients with CLBP were enrolled. Psychiatric diagnoses were made based on the Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders-IV-Text Revision. The DSSS, Oswestry Disability Index, Hospital Anxiety and Depression Scale (HADS), and Short Form 36 (SF-36) were administered. Cronbach’s alpha was used to test internal consistency. Receiver operating characteristic (ROC) analysis was used to identify cutoff scores for a major depressive episode (MDE).

Results

Subjects with an MDE (N=21) had greater severities of depression, anxiety, somatic symptoms, and disability as compared with those without an MDE. The Cronbach’s alpha values of the DS and SS were 0.90 and 0.83, respectively. The DS and SS were significantly correlated with the Oswestry Disability Index, the HADS, and the SF-36 subscales. The DS had the greatest area under the receiver operating characteristic curve (0.96) as compared with the SS and the HADS subscales. The cutoff score for an MDE was a DS score ≥15 (sensitivity and specificity: 100% and 88.7%, respectively).

Conclusion

The DSSS subscales were of acceptable reliability and validity. The DS can be used as a tool for evaluating the severity of depression and detecting an MDE in patients with CLBP.

Keywords:

• back pain
• cutoff point
• depression
• psychometrics
• somatization

Introduction

Chronic low back pain (CLBP) is a common symptom, rather than a disease, in countries worldwide.¹ Low back pain was found to have a prevalence of 11.9% and a 1-month prevalence of 23.2% in a globalized systemic review, affecting most commonly middle-aged to elderly females.² In the Global Burden of Disease 2010 Study, low back pain ranked the highest among other conditions in terms of years lived with disability, and ranked the sixth reason for disability-adjusted life years.³ As a result, CLBP attracts significant costs worldwide, estimated at an indirect cost of around US$18.5 billion to US$28.2 billion in the US⁴ and AUS$9 billion in Australia.⁵

The strong association between CLBP and depressive disorders is well-known. CLBP is a common physical complaint among patients with major depressive disorder (MDD) and is related to morbidity.⁶ On the other hand, many studies have suggested that CLBP is related to psychological distress, especially anxiety, depression, and somatization,^7–9 among which depression¹⁰ and somatization¹¹ have been identified as factors associated with a poor outcome. Several psychometric scales have been used in patients with low back pain, such as the Short Form 36 (SF-36)^12,13 and the Hospital Anxiety and Depression Scale (HADS);^14,15 however, most psychometric scales fail to measure depression and somatic symptoms simultaneously.

As somatic symptoms are common among patients with depression, the Depression and Somatic Symptoms Scale (DSSS) was designed as a free, self-assessment scale that simultaneously evaluates depression and somatic symptoms.¹⁶ Previous studies have demonstrated that the psychometric properties of the DSSS are appropriate for use in patients with MDD,^17–19 migraine,^20,21 and online gaming addiction,²² and in patients under the care of a psychiatric service.^23,24 However, the psychometric properties of the DSSS have not been established in patients with CLBP. Therefore, the aim of this study was to examine the reliability and validity of the DSSS in patients with CLBP.

Methods

Subjects

This study was conducted in the orthopedic clinic of a medical center in northern Taiwan, from August 2008 to November 2010. Patients were included if they were: 1) aged between 20 and 65 years; 2) were making a first visit to our orthopedics clinic; and 3) had suffered low back pain for more than 3 months. Patients were excluded from the study if they had taken antipsychotics or antidepressants within the past 4 weeks or had difficulty being interviewed.

Ethical considerations

This study was approved by the Institutional Review Board of Chang Gung Memorial Hospital. The study procedures were explained in detail to all participants based on the guidelines regulated in the Declaration of Helsinki prior to written informed consent being obtained.

Diagnosis of MDD

A psychiatrist, who was blind to the CLBP-related data, interviewed all the participants. MDD and a major depressive episode (MDE) were diagnosed based on the Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders-IV-Text Revision (SCID-IV-TR).²⁵

Depression and Somatic Symptoms Scale

The DSSS is composed of a 12-item depression subscale (DS) and a ten-item somatic subscale (SS), which includes a five-item pain subscale (PS).¹⁷ Each item is scored from 0 to 3 (absent, mild, moderate, and severe) according to the severity of symptoms, with the total score ranging from 0 to 36 and 0–30 for the DS and the SS, respectively. The DSSS is significantly correlated with the Hamilton Depression Rating Scale in patients with MDD,²⁶ and has been validated for use in patients with MDD in Taiwan²⁷ and the US.²⁸

Oswestry Disability Index (ODI)

The ODI is a ten-item scale used to evaluate back or leg pain-related disability in daily life.^29,30 The total score ranges from 0 to 50, and is usually multiplied by 2 to become a percentage score, indicating severe disability if the percentage score is ≥40. This is one of the most commonly used scales for evaluating disability due to low back pain.

Short Form 36 (SF–36)

The SF-36, which measures health-related quality of life (HRQoL), surveys general psychological well-being, with higher scores representing better health.³¹ It is composed of eight domains: physical functioning, role limitations-physical, bodily pain, general health perceptions, vitality, social functioning, role limitations-emotional, and mental health. Each domain score ranges from 0 (lowest well-being) to 100 (highest well-being).³² An acute version of the SF-36, which evaluates HRQoL in the past week, was used in this study to ensure that the evaluation duration was compatible with those of the other psychometric scales employed.

Hospital Anxiety and Depression Scale

The HADS is commonly used in general medical patients and psychiatric patients. The HADS is a self-assessment scale with a seven-item anxiety subscale (HADS-A) and a seven-item depression subscale (HADS-D).³³ Each item is scored from 0 to 3, with a total score ranging from 0 to 21 for each subscale. Higher scores indicate more severe distress, and the total score is categorized as follows: 0–7, normal; 8–10, mild; 11–14, moderate; and 15–21, severe.

Statistical methods

The Mann–Whitney U test and the chi-squared test were used to assess differences in demographic data and psychometric scores between the MDE group and the non-MDE group. Cronbach’s alpha was used to test the internal consistency of the DSSS. Furthermore, the associations between the DSSS subscales and other scales (HADS subscales, SF-36, and ODI) were examined using Pearson correlations. A P-value <0.05 was determined to be significant in this study. Receiver operating characteristic (ROC) analysis was used to determine the cutoff points for a current MDE on the subscales of the DSSS. The area under the ROC curve (AUC) was calculated, and ranged from 0.5 to 1, a greater AUC indicating a better ability to differentiate the two groups. The sensitivity, specificity, positive predictive value, and negative predictive value of each threshold score were also calculated. All statistical analyses were performed using SPSS 17.0 for Windows (SPSS Inc., Chicago, IL, USA).

Results

Subjects

Among 243 patients (133 males) who fulfilled the criteria for this study, 225 (122 males) agreed to participate in the study. The demographic data are presented in Table 1. Compared with the non-MDE group (n=204), the MDE group (n=21) contained significantly more female patients, subjects with a longer duration of CLBP, and patients with greater pain-related disability.

Table 1 Demographic variables and psychometric scores (mean ± SD) in patients with and without a major depressive episode

Parameters	Whole sample (n=225)	MDE (n=21)	Non-MDE (n=204)	P-value
Age (years)	40.7±11.4	40.1±10.6	40.7±11.5	0.82
Gender (% male)	54.2%	33.3%	56.4%	0.04
Married	69.3%	57.1%	70.6%	0.20
Employed	67.6%	57.1%	68.6%	0.28
Total duration of LBP (months)	60.2±81.8	98.3±87.7	56.3±80.4	0.003
Pain frequency (days per month)	19.8±10	23.4±9.0	19.5±10.1	0.137
ODI	31.4±15.3	39.3±14.4	30.6±15.2	0.011
DS	8.9±7.1	21.7±5.3	7.6±5.8	<0.001
SS	8.7±5	16.1±4.7	7.9±4.4	<0.001
HADS-D	5.8±4.1	11.2±4.1	5.3±3.7	<0.001
HADS-A	7.3±4.4	13.0±3.1	6.7±4.1	<0.001
PF	67.8±20.8	60.2±20.6	68.6±20.7	0.067
RP	31±37.9	8.3±24.2	33.3±38.3	0.001
BP	46.2±16.9	32.0±10.9	47.6±16.7	<0.001
GH	47.9±22.4	32.2±15.9	49.5±22.4	<0.001
VT	50.6±23.9	16.7±12.5	54.1±22.0	<0.001
SF	68.4±24.2	40.5±22.7	71.3±22.5	<0.001
RE	53.8±43.8	4.8±15.9	58.8±42.7	<0.001
MH	61.3±22.1	29.0±13.7	64.6±20.1	<0.001

Abbreviations: BP, bodily pain subscale; DS, depression subscale of the DSSS; DSSS, Depression and Somatic Symptoms Scale; GH, general health perceptions subscale; HADS-A, anxiety subscale of the HADS; HADS-D, depression subscale of the HADS; HADS, Hospital Anxiety and Depression Scale; LBP, low back pain; MDE, major depressive episode; MH, mental health subscale; ODI, Oswestry Disability Index; PF, physical functioning subscale; RE, role limitations-emotional subscale; RP, role limitations-physical subscale; SF, social functioning subscale; SS, somatic subscale of the DSSS; VT, vitality subscale.

Internal consistency and reliability

The Cronbach’s alpha values of the DS, SS, and DSSS were 0.90, 0.83, and 0.93, respectively.

Distinct-groups validity

Compared with patients in the non-MDE group, patients in the MDE group had significantly higher scores on all subscales of the DSSS and HADS, and significantly lower scores on all subscales of the SF-36, with the exception of the physical functioning subscale.

Convergent validity

The DS and SS were significantly correlated with the sub-scales of the HADS in patients with CLBP (Table 2). Both the DSSS and HADS subscales were significantly and negatively correlated with all domains of the SF-36 and positively correlated with the ODI (Table 2).

Table 2 Pearson correlation coefficients of the subscales of the DSSS and HADS with the subscales of the Short Form 36 and the Oswestry Disability Index

Subscales	DS	SS	HADS-A	HADS-D
PF	−0.33*	−0.26*	−0.30*	−0.39*
RP	−0.36*	−0.22*	−0.32*	−0.40*
BP	−0.43*	−0.42*	−0.34*	−0.31*
GH	−0.50*	−0.42*	−0.42*	−0.43*
VT	−0.72*	−0.52*	−0.65*	−0.69*
SF	−0.67*	−0.50*	−0.55*	−0.64*
RE	−0.58*	−0.42*	−0.41*	−0.50*
MH	−0.78*	−0.51*	−0.76*	−0.69*
ODI	0.41*	0.29*	0.32*	0.46*
HADS-A	0.76*	0.53*	N/A	N/A
HADS-D	0.74*	0.45*	N/A	N/A

Note:

* P<0.01.

Abbreviations: BP, bodily pain subscale, DS, depression subscale of the DSSS; DSSS, Depression and Somatic Symptoms Scale; GH, general health perceptions subscale; HADS-A, anxiety subscale of the HADS; HADS-D, depression subscale of the HADS; HADS, Hospital Anxiety and Depression Scale; MH, mental health subscale; N/A, not applicable; ODI, Oswestry Disability Index; PF, physical functioning subscale; RE, role limitations-emotional subscale; RP, role limitations-physical subscale; SF, social functioning subscale; SS, somatic subscale of the DSSS; VT, vitality subscale.

Cut-off scores

We found that the DS had the greatest AUC (0.962), followed by the SS (0.892) (Table 3), HADS-A (0.881), and HADS-D (0.860) subscales (not shown). At a cutoff score of ≥15, the DS showed the best diagnostic quality, with 100% sensitivity and 88.7% specificity for the detection of an MDE.

Table 3 Sensitivity, specificity, PPV, and NPV at different cutoff scores for a major depressive episode in patients with chronic low back pain

Subscales	Score	Sensitivity (%)	Specificity (%)	PPV (%)	NPV (%)	AUC
DS	≥14	1	0.863	0.880	1.000
	≥15	1	0.887	0.898	1.000	0.962
	≥16	0.857	0.926	0.921	0.866
SS	≥11	0.81	0.624	0.683	0.767
	≥12	0.81	0.838	0.833	0.815	0.892
	≥13	0.762	0.877	0.861	0.787

Abbreviations: AUC, area under curve; DS, depression subscale of the DSSS; DSSS, Depression and Somatic Symptoms Scale; NPV, negative predictive value; PPV, positive predictive value; SS, somatic subscale of the DSSS.

Discussion

This study aimed to examine the reliability and validity of the DSSS among patients with CLBP. The results showed that 1) the DSSS was of good internal consistency and reliability; 2) the scores of the DS and SS differed significantly between patients with and without an MDE (distinct-groups validity); 3) the DS and SS were significantly correlated with the ODI, all subscales of the SF-36, the HADS-D, and the HADS-A (convergent validity); 4) the DS was of good sensitivity and specificity for the detection of an MDE. These results demonstrated that the DSSS had a good reliability and validity for use in patients with CLBP. Moreover, the DS could be used as a tool to screen for an MDE.

Several points were worthy of note: 1) The DS and SS were highly-correlated with the ODI. This demonstrated that the two subscales could reflect the severity of disability due to CLBP. 2) This study found that the DS had significantly moderate to high correlations with the SF-36 and HADS. The SF-36 focuses on general psychological well-being, and has a sensitivity of 80% and specificity of 90% in detecting depressive symptoms among patients with chronic spinal pain.¹³ The HADS has been validated for use in patients with acute low back pain.¹⁵ However, it has been criticized due to conceptual issues and the combination of the two related factors of anxiety and depression.³⁴ 3) The DS had the greatest AUC as compared with the SS, the HADS-A, and the HADS-D. This demonstrated that the DS had a better diagnostic property than the other subscales for the screening of an MDE among patients with CLBP. 4) Somatic complaints in patients with chronic pain easily lead to a false-positive or over-diagnosis of depression.³⁵ Therefore, the DS is more accurate and appropriate for the detection of an MDE as compared with the SS and the full DSSS.

The HADS and the DSSS are self-assessment scales. The role of a self-assessment scale is not to serve as a diagnostic tool, but instead as a screening tool to raise the clinician’s awareness and to initiate further diagnostic evaluation.¹³ The 12-item DS has a lower respondent burden in the clinical setting than the 14-item HADS or the 36-item SF-36. The DSSS has other advantages of use in patients with CLBP: first, the DSSS can evaluate depression and somatic symptoms simultaneously; second, it is a free scale; and third, the DS was designed based on the criteria of an MDE.¹⁷ Therefore, the severity of depression as evaluated by the DS should be more compatible with an MDE in comparison with the HADS-D and the HADS-A. This might be the reason for which the AUC of the DS was greater than that of the HADS-D. This result demonstrated that the DS might be a good choice for MDE screening in patients with CLBP.

Limitations

This study had some limitations. First, the study was performed in the orthopedic clinic of a medical center. The characteristics of the patients with CLBP might differ in different clinical settings, and expansion of the results to other settings should be performed cautiously. Second, this study set several inclusion and exclusion criteria, which may have led to bias during the enrollment process. We did not collect the demographic data from those who refused to participate in our study, and the responsiveness was not recorded. Third, there are many methods by which to validate a psychometric scale, of which this study only used a limited number to test the validity of the DSSS in patients with CLBP. We have done factor analysis in our previous study, and it showed that most of items in DS and SS subscales belong to the depression and somatic factors.¹⁶ But other methods, such as test–retest reliability, to test the validity of the DSSS are indicated in future studies. Finally, there was only one psychiatrist who made all the diagnoses, and the accuracy had been questioned despite the diagnosis was made based on the SCID-IV.

Conclusion

This study demonstrated that the DSSS had good psychometric properties among patients with CLBP, especially the DS. The two subscales of the DSSS were significantly correlated with depression, anxiety, psychological well-being, and disability in patients with CLBP. Owing to its brevity and high sensitivity, the DS can be used as a screening tool for the detection of an MDE in patients with CLBP. In future studies, other methods should be used to test the validity of the DSSS.

Announcement

Our team agrees that physicians, researchers, and pain-related workers may freely use this scale in clinical practice and research. We hope that the DSSS can help physicians and patients to become more aware of the interaction of mental and physical symptoms in depression.

Author contributions

CIH and TSF designed and conducted the study. CHL and CPL analyzed the data. CHL drafted the manuscript. All authors contributed to data analysis, drafting or revising the article, gave final approval of the version to be published, and agree to be accountable for all aspects of the work.

Acknowledgments

The authors are thankful for the statistical assistance and acknowledge the support of the Maintenance Project of the Center for Big Data Analytics and Statistics (Grant CLRPG3D0045) at Chang Gung Memorial. This study was supported in part by the Chang Gung Memorial Hospital Research Program (CMRPG 371701) and National Science Council grants (NSC 102–2314-B-182A007).

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Disclosure

The authors report no conflicts of interest in this work.