The Japanese Version of the Daily Record of Severity of Problems for Premenstrual Symptoms: Reliability and Validity Among the General Japanese Population

Abstract

Purpose

The validity and reliability of the Japanese version of the Daily Record of Severity of Problems (DRSP-J) have already been confirmed in a population with premenstrual symptoms. This study aimed to assess the validity and reliability of the DRSP-J in the general population.

Patients and Methods

We analyzed data from 113 Japanese women with regular menstrual cycles who applied to participate in an ongoing study. Participants were recruited regardless of the severity of premenstrual symptoms, and their menstrual cycles were monitored using the DRSP-J for two cycles. Reliability was examined using Cronbach’s α, a measure of internal consistency, and test-retest reliability. Structural validity was assessed using a principal component analysis (PCA). The Hospital Anxiety and Depression Scale (HADS) and EuroQol-5 Dimensions-5 Levels (EQ-5D-5L) were used to examine concurrent validity. The agreement between the clinical diagnoses based on the diagnostic criteria for premenstrual syndrome/premenstrual dysphoric disorder and that based on the DRSP-J score was examined using the kappa coefficient.

Results

Cronbach’s α for DRSP-J total score was 0.96. The DRSP-J total score showed high test-retest reliability. The PCA showed a two-factor model describing “Mood” and “Behavior/Physical” symptoms. The DRSP-J total score was highly correlated with the HADS total and EQ-5D-5L scores. The classification of “moderate to severe premenstrual syndrome” and “premenstrual dysphoric disorder” by clinical methods and the criteria based on the DRSP-J were in good agreement (kappa values = 0.78).

Conclusion

The DRSP-J is a reliable and valid measure of premenstrual symptoms in the general Japanese population, including those with few or no symptoms.

Keywords:

• premenstrual syndrome
• premenstrual dysphoric disorder
• psychometric testing
• premenstrual symptom

Introduction

Premenstrual symptoms are characterized by a wide range of mood, behavioral, and physical symptoms limited to the luteal Phase^1,2 and affect the social, familial, and school lives of most women. Epidemiological studies have revealed that 80% to 90% of menstruating women exhibit premenstrual symptoms.³ Premenstrual syndrome (PMS) is a pathological state of premenstrual symptoms, and a severe form of PMS is diagnosed as premenstrual dysphoric disorder (PMDD), primarily owing to its severe psychiatric symptoms.⁴ Both the PMS diagnostic criteria of the American College of Obstetricians and Gynecologists (ACOG) and the PMDD diagnostic criteria of the American Psychiatric and Neurological Association require evaluation using a prospective symptom diary.⁵ Both PMS and PMDD are viewed as premenstrual disorders (PMDs), a series of consecutive disorders.⁶

The Daily Record of Severity of Problems (DRSP) was originally developed by Endicott to aid in the diagnosis of PMDD according to the Diagnostic and Statistical Manual of Mental Disorders (DSM) criteria.⁷ The DRSP is a prospective daily charting tool used worldwide for the strict evaluation of PMDs.^8–10 The DRSP score has been used as the primary endpoint in clinical trials to evaluate the efficacy of serotonin reuptake inhibitors and drospirenone-containing oral contraceptives, which are globally recognized as the standard treatments for PMDs.^11–14 The DRSP was translated into Japanese after linguistic validation according to a general cross-cultural adaptation process for clinical trials, and a Japanese version of the DRSP (DRSP-J) was developed.^15–17 The DRSP-J has been systematically evaluated for its reliability and validity among participants in clinical trials of treatment for PMDs.¹⁸

The psychometric characteristics of a survey instrument vary depending on the characteristics of the surveyed population. The reliability and validity of the original version of the DRSP were examined for both clinical trial participants and participants with a wide range of symptom severity, including those with few or no premenstrual symptoms.⁷ The DRSP-J was considered insufficient compared to the original DRSP, as only clinical trial participants had been examined. Therefore, examining the psychological characteristics of the DRSP-J among the general female population is necessary. This study aimed to assess the validity and reliability of the DRSP-J among the general population.

Materials and Methods

Ethics Approval and Informed Consent

This study was performed according to the principles outlined in the Declaration of Helsinki. The study protocol was approved by the Kindai University Ethics Committee (approval number: R02-081). All participants provided informed consent before participating in the study.

Settings and Participants

The study was conducted between December 2020 and October 2021. Of the 150 participants in another menstruation-related study, 113 Japanese women with regular menstrual cycles who had completed the study were used in the analysis. Generally, for a questionnaire to be considered reliable and valid, the number of respondents should be 5 to 10 times the number of items (or more than 100 in this case);¹⁹ since the DRSP-J total score consists of 21 items, this number of respondents was considered sufficient. Participants were recruited through advertisements placed in local free newspapers, posters displayed in Kindai University Hospital, and our institute’s website. Participants were recruited regardless of the severity of premenstrual symptoms, and their menstrual cycles were monitored using the DRSP-J for two cycles.

The eligibility criteria included: Age 20–45 years; regular menstrual cycles (25–38 days); no oral contraceptive pill use for four weeks before beginning the study; avoiding changes in regularly used foods, supplements, and medications as much as possible after beginning study; and providing written informed consent. No participants were withdrawn from the study after entry for violating these exclusion criteria.

The study participants completed the DRSP-J on the website daily from day 15 of the first menstrual cycle to day 10 of the third menstrual cycle. Hospital Anxiety and Depression Scale (HADS) and EuroQol-5 Dimensions-5 Levels (EQ-5D-5L) were also recorded simultaneously between day −5 and −1 before menstruation in the first and second cycles. Participants were interviewed by telephone after completion of the DRSP-J and before the start of the next menstrual period. The study schedule is outlined in Figure 1, and the details of the interviews are presented in the following “Interview” section.

Figure 1 Time course of the study design.

Abbreviations: M1, menstruation of the first cycle; M2, menstruation of the second cycle; M3, menstruation of the third cycle; DRSP-J, Japanese version of the Daily Record of Severity of Problems; CD, cycle of the day; EQ-5D-5L, EuroQol-5 Dimensions-5 Levels; HADS, Hospital anxiety and depression scale.

Questionnaire

Japanese Version of the Daily Record of Severity of Problems (DRSP-J)

The DRSP-J consists of 21 items related to emotional and physical premenstrual symptoms (listed in the note of Table 1 and three items related to impairment of social and life activities due to these symptoms (whether the premenstrual symptoms experienced interfere with (a) work efficiency or productivity, or home responsibilities; (b) social activities; or (c) relationships with coworkers or family). The severity of each symptom is rated on a 6-point scale (1, not at all; 2, extremely mild; 3, mild; 4, moderate; 5, severe; 6, extremely severe). The total DRSP-J score was calculated by summing the 21 premenstrual symptoms (21 to 126 points). The DRSP-J negative mood score was obtained by summing scores on eight core premenstrual mood symptoms (depressed/sad/blue, hopeless, worthless/guilt, anxiety/tense/on edge, mood swings, sensitivity to rejection, anger/irritability, and conflict/problems)(8 to 48 points).²⁰ The luteal phase scores were obtained by averaging the ratings of −5 to −1 day cycles. Follicular phase scores were obtained by averaging the ratings of 6 to 10 day cycles. Participants who answered the questionnaire for at least 4 days during both the follicular and luteal phases were selected.

Table 1 Factor Coefficients of the DRSP-J After Promax Rotation (N=113)

	Factor 1 (Mood)	Factor 2 (Behavior/Physical)
1a	1.01	−0.12
1b	0.97	−0.09
3a	0.94	−0.11
3b	0.93	−0.06
1c	0.93	−0.05
2	0.87	0.04
10a	0.71	0.22
7	0.69	0.26
4b	0.65	0.16
5	0.59	0.32
4a	0.56	0.18
6	0.46	0.42
11c	0.40	0.36
8b	−0.05	0.85
8a	0.07	0.78
9b	0.09	0.75
11b	0.03	0.66
11a	−0.15	0.63
11d	0.04	0.60
10b	0.33	0.59
9a	0.39	0.50
Eigenvalue	12.18	2.27
% of variance explained	51.91	40.27
Correlation between factors
Factor 1	1.00
Factor 2	0.59	1.00

Notes: Values above 0.3 are expressed in bold. 1a, Depressed/sad/blue; 1b, Hopeless; 1c, Worthless/guilty; 2, Anxious/tense/on edge; 3a, Mood swings; 3b, Sensitive to rejection; 4a, Anger/irritability; 4b, Conflict/problems; 5, Less interest, 6, Difficulty concentrating; 7, Lethargic/tired/fatigued; 8a. Increased appetite, 8b, Crave specific foods; 9a, Sleep more; 9b, Trouble sleeping; 10a, Overwhelmed, cannot cope; 10b, Out of control; 11a, Breast tenderness; 11b, Breast swelling/“bloated;” 11c, Headache; 11d, Joint/muscle pain.

Abbreviation: DRSP-J, Japanese version of the Daily Record of Severity of Problems.

Hospital Anxiety and Depression Scale (HADS)

A 14-item brief tool was used to assess participants’ risk for anxiety and depression.²¹ The Japanese version was used, which has been thoroughly reviewed for validity and reliability.²² Since anxiety and depression are central symptoms of premenstrual symptoms, this measure was used to assess concurrent validity. The HADS consists of two parts, each with seven items: HADS-A (anxiety) and HADS-D (depression). Each item is rated on a 4-point scale ranging from 0 to 3, with anxiety and depression rated according to the total score of HADS-A and HADS-D, respectively. The total of both scores was used for the overall evaluation (HADS-T) (0 to 42 points).

EuroQol-5 Dimensions-5 Levels (EQ-5D-5L)

The EQ-5D-5L measures five dimensions of health-related quality of life (HRQOL): Mobility, self-care, usual activities, pain/discomfort, and anxiety/depression.²³ Each is answered on a 5-point scale, and index values are calculated using an algorithm. The Japanese version was used, which has been thoroughly reviewed for validity and reliability.^24,25 The EQ-5D-5L is a reliable and valid general measure of health status, applicable to a wide range of populations and settings, and has been used to assess HRQOL for many conditions, including depression and anxiety.²⁶ Thus, it was used to assess concurrent validity.

Interview

After completing the DRSP-J, participants were interviewed to examine whether the severity of their premenstrual symptoms fulfilled the ACOG criteria for “moderate to severe PMS” or DSM criteria for “PMDD.”^4,5 This decision involved a consensus of two expert obstetricians and gynecologists (T.T. and S.K.) with reference to the DRSP-J data for two menstrual cycles. The DRSP-J data showed daily symptom data and menstrual periods. The evaluator visually assessed the relationship between the intensity and increase/decrease of symptoms and the menstrual cycle. In addition to the above, the classification of “moderate to severe PMS” and “PMDD” was made based on the following criteria regarding DRSP-J scores.

Criteria for “moderate to severe PMS” include the following:¹⁵

1. A follicular phase score (days 6–10) daily average ≤ 3.0 for each symptom.

2. A luteal phase score (days −5 to −1 before menstruation) daily average ≥ 3.0 for three distinct items.

3. A luteal phase daily average improvement by at least 30% compared with the corresponding follicular phase daily average for three distinct items.

4. A score ≥ 3 (mild) on functional impairment items for at least 1 day during the premenstrual phase.

“PMDD” criteria include the following:⁷

1. A follicular phase score (days 6–10) daily average ≤ 3.0 for each symptom.

2. A luteal phase (premenstrual days −5 to −1) score of ≥ 4.0 for more than 2 days on five distinct items.

3. A luteal phase daily average improvement of at least 43% compared with the corresponding follicular phase daily average for five distinct items.

4. A score of ≥ 4 (moderate) on functional impairment items for at least 2 days during the premenstrual phase.

Both criteria must be met in two consecutive menstrual cycles.

The agreement between classification based on diagnostic criteria and mechanical classification using the DRSP-J score was examined based on kappa values.

Statistical Analysis

Means and standard deviations (SD) were calculated for the age, weight, and height of the participants. The distribution of the DRSP-J total and negative mood scores were shown using the median and interquartile range (IQR).

Cronbach’s α coefficient was used to assess the internal consistency reliabilities of the DRSP-J.

Day-to-day test-retest reliability was assessed using intraclass correlation coefficients (ICC) and a two-way random-effects model. Adjacent days within the follicular and luteal phase (mid-follicular phase day 9 vs day 10 in Cycle 3 and late luteal phase day −2 vs day −1 in Cycle 2) were selected. The reliability was evaluated with a 95% confidence interval (CI), with less than 0.5 rated as poor, 0.5 to 0.75 as moderate, 0.75 to 0.9 as good, and 0.9 or greater as excellent.²⁷

The factor structure of the DRSP-J was examined using principal component analysis (PCA) with promax rotation of the luteal phase scores. The eigenvalue > 1.0 and scree plot criteria were used to determine the number of factors to be extracted.

Correlations were analyzed using Spearman’s rank correlation coefficients. Correlation coefficients were classified as low (< 0.3), moderate (0.3–0.6), and high (> 0.6).²⁸

Kappa values were categorized as poor (< 0.2), fair (0.21–0.40), moderate (0.41–0.60), good (0.61–0.80), and very good (0.81–1.00).²⁹

For the Student’s t-test, effect size was measured using r. r was calculated using the following formula . The effect sizes were judged as small (0.10), medium (0.30), or large (0.50).³⁰

Except for ICC, statistical analyses were performed using JMP Pro 16.0.2 (SAS, Cary, NC, USA). The ICC was calculated using the Excel add-in software BellCurve for Excel 4.0.5 (Social Survey Research Information Co., Ltd., Tokyo, Japan). Statistical significance was set at P < 0.05.

Results

The basic characteristics of the participants are presented in Table 2. Based on the median and IQR of the DRSP-J scores, it can be assumed that most had mild premenstrual symptoms.

Table 2 Characteristics of Study Participants (N=113)

Characteristic
Age (years), mean (SD)	34.0 (7.6)
Height (cm), mean (SD)	158.5 (5.3)
Body weight (kg), mean (SD)	53.2 (7.8)
DRSP-J total score (luteal phase, Cycle 1), median (IQR)	32.4 (24.6–45.1)
DRSP-J total score (luteal phase, Cycle 2), median (IQR)	30.2 (24.2–43.4)

Abbreviations: SD, standard deviation; DRSP-J, Japanese version of the Daily Record of Severity of Problems; IQR, interquartile range.

Cronbach’s α for the DRSP-J total score showed very good internal consistency of 0.96 in the luteal phase and 0.95 in the follicular phase (Table 3). The Cronbach’s α for the DRSP-J negative mood score also exhibited good internal consistency in the luteal and follicular phases, as in the DRSP-J total score.

Table 3 Internal Consistency (Cronbach’s α) for the Summary Scores of the DRSP-J (N=113)

	Luteal Phase Score (Cycle 2)	Follicular Phase Score (Cycle 3)
Total score	0.96	0.95
Negative mood score	0.95	0.96
Factor 1: Mood	0.96	0.95
Factor 2: Behavior/Physical	0.88	0.87

Abbreviation: DRSP-J, Japanese version of the Daily Record of Severity of Problems.

The test-retest reliability of the DRSP-J is presented in Table 4. The test-retest value of the DRSP-J total score in the luteal phase was “moderate” to “excellent” and that of the DRSP-J negative mood score was “moderate” to “good.” In the follicular phase, the DRSP-J total score was “moderate” to “good” and the DRSP-J negative mood score was “moderate.”

Table 4 Test-Retest Intraclass Correlation Coefficients of DRSP-J Total Scores and Negative Mood Score (N=113)*

	Mid Follicular Phase Day 9 vs Day 10 (Cycle 3)	Late Luteal Phase Day −2 vs Day −1 (Cycle 2)
Total score (95% CI)	0.69 (0.58–0.78)	0.84 (0.60–0.92)
Negative mood score (95% CI)	0.65 (0.53–0.74)	0.79 (0.71–0.85)

Note: *All P < 0.001.

Abbreviations: CI, confidence interval; DRSP-J, Japanese version of the Daily Record of Severity of Problems.

PCA was performed to explore the factor structure of the DRSP-J. Two factors were identified by the eigenvalue > 1.0 criterion and scree plot (Figure 2). Table 1 lists the factor coefficients of DRSP-J after promax rotation. The first factor (Factor 1) explained 51.91% of the data variance and the second factor (Factor 2) 40.27%. Factor 1 can be interpreted as a “mood” dimension and Factor 2 as a “behavior/physical” dimension. The Cronbach’s α for Factors 1 and 2 are provided in Table 3. All data were higher than 0.80, indicating good internal consistency.

Figure 2 Scree plot for the DRSP-J.

Abbreviation: DRSP-J, Japanese version of the Daily Record of Severity of Problems.

We then analyzed the consistency of the evaluation of premenstrual symptoms between the DRSP-J, HADS, and EQ-5D-5L (Table 5). The DRSP-J total score and negative mood score were highly positively correlated with the HADS total score in both Cycles 1 and 2. For the EQ-5D-5L, the DRSP-J total score and the negative mood score were found to have a high negative correlation.

Table 5 Correlation of Luteal Phase DRSP-J Score with HADS and EQ-5D-5L (N=113)

	Cycle 1				Cycle 2
	HADS			EQ-5D-5L	HADS			EQ-5D-5L
	A	D	Total		A	D	Total
Total score	0.587	0.547	0.627	−0.677	0.721	0.550	0.707	−0.659
Negative mood score	0.635	0.505	0.628	−0.719	0.741	0.476	0.671	−0.693

Abbreviations: A, anxiety scores; D, depression scores; DRSP-J, Japanese version of the Daily Record of Severity of Problems; HADS, Hospital Anxiety and Depression Scale; EQ-5D-5L, EuroQol 5 dimensions 5-level.

Additionally, we examined the consistency between conventional clinical diagnosis based on the diagnostic criteria and severity classification based on the DRSP-J score (Table 6). The kappa scores indicated good agreement.

Table 6 Consistency Between Conventional Clinical Judgement and Severity Classification by DRSP-J Score (N=113)

		DRSP-J
		No or Mild PMS	Moderate to Severe PMS	PMDD
Clinical judgement	No or mild PMS	101	1	0
	Moderate to severe PMS	4	6	0
	PMDD	0	0	1

Notes: The relevant number of participants in each table cell is presented. Weighted kappa (95% confidence interval):0.78 (0.57–1.00), P < 0.001).

Abbreviations: DRSP-J, Japanese version of the Daily Record of Severity of Problems; PMDD, premenstrual dysphoric disorder; PMS, premenstrual syndrome.

To the best of our knowledge, there are no previous EQ-5D-5L scoring studies on participants who kept prospective two-cycle diaries according to the diagnostic criteria for PMS and PMDD. Therefore, we compared the EQ-5D-5L scores in the luteal phase according to the severity of premenstrual symptoms. As only one patient had PMDD in this study, it was considered a PMD group along with a moderate-to-severe PMS group (Table 7). EQ-5D-5L scores were significantly lower in the PMD group for both Cycles 1 and 2.

Table 7 Comparison of EQ-5D-5L Scores in the Luteal Phase by Severity of Premenstrual Symptoms

Clinical Judgement	Cycle 1	P (r)	Cycle 2	P (r)
No or mild PMS, mean (SD), N=102	0.843 (0.119)	0.009^a (0.245)	0.870 (0.122)	0.003^a (0.278)
Moderate to severe PMS + PMDD, mean (SD), N=11	0.743 (0.117)		0.751 (0.127)

Note: ^aStudent’s t-test.

Abbreviations: EQ-5D-5L, EuroQol 5 dimensions 5-level; SD, standard deviation; PMS, premenstrual syndrome; PMDD, premenstrual dysphoric disorder.

Discussion

In a previous study, we examined the validity and reliability of the DRSP-J for assessing PMDs in clinical trial participants with premenstrual symptoms.¹⁶ This study was conducted on general participants with milder symptoms, and the results indicated adequate validity and reliability.

In the luteal and follicular phases, Cronbach’s α of the total DRSP-J score showed high internal consistency, which has been similarly reported in clinical trial settings.¹⁶ This value was also similar to the original DRSP value in general participants reported previously.⁷

The test-retest reliability of the total luteal DRSP-J score in this study matched that reported in clinical trial settings.¹⁶ Conversely, the results of the follicular phase data were not as good as those of the luteal phase but were still rated “moderate to good” and are considered reliable enough. This indicates that DRSP-J is sufficiently reproducible for evaluating patients with few premenstrual symptoms.

Regarding PCA, as with the clinical trial participants, we were able to categorize the items into two factors: “Mood” and “Behavior/Physical.” Most of the 21 items comprising the DRSP can be classified into these two categories; however, only 10b (out of control) and 11c (headache) differed from their original classifications. Focusing on the values of these two items, we can assume that both categories are likely related, as both “Mood” and “Behavior/Body” have values above 0.3. Among the DRSP, 1a through 4b, which comprise the negative mood score, are core symptoms that are considered particularly important. The fact that all of these items could be perfectly classified into the “Mood” category is satisfactory for the present study, which targeted the general population, the majority of whom have mild premenstrual symptoms.

The ACOG and DSM diagnostic criteria specify the diagnosis of PMS/PMDD based on a prospective two-cycle symptom diary. There was good consistency between these conventional diagnoses and those defined by the DRSP-J scores. This study was conducted on participants with premenstrual symptoms of various intensities; therefore, the results can be used for actual clinical diagnosis.

The EQ-5D-5L scores for the PMDs group in this study were 0.743 and 0.751 for Cycles 1 and 2, respectively. Considering that the standard value of the EQ-5D-5L for Japanese women aged 30–39 years is 0.944,³¹ the loss of quality-adjusted life years (QALYs) was 0.201 and 0.193 if luteal phase symptoms persisted throughout the menstrual cycle. Considering that these impairments disappeared during the follicular phase, the loss of QALYs due to PMDs would be less than half. An earlier study examining 66 patients with PMDD reported an EQ-5D-3L score 0.795 of the mean value for menstrual cycles.³² Therefore, they concluded that the loss of QALYs from PMDD was approximately 0.14 years. However, it should be noted that in this previous study, PMDD was not diagnosed using a diary of two menstrual cycles of prospective evaluation and was not strictly based on the DSM.

This study has some limitations. The first limitation was the relatively small number of participants (n = 113). These numbers are similar to those reported in previous studies targeting the general population. In the original English version, the number of participants was 27, and 126 in the Chinese version.^7,10 Keeping daily records of DRSP is very cumbersome and challenging for participants with few premenstrual symptoms who lack the motivation to describe them. This may be the reason for the difficulty in collecting data from such participants. For exploratory factor analysis, a sample size of at least five times greater than the number of items is required, and the number of people in this study met this requirement. Second, the participants were not sampled from the general population but were participants in a clinical study, which may have overestimated the premenstrual symptoms. However, the purpose of this clinical study was not to study premenstrual symptoms themselves, and there was no advantage for participants to falsely report symptoms and presumably make a correct assessment. As this clinical study was conducted during the COVID-19 pandemic, it had the advantage of covering a wide range of ages in various regions throughout Japan owing to the online enrollment process. Third, there were a small number of cases of moderate to severe PMS and PMDD (ie, PMDs). Owing to the study design involving the general population, the number of PMDs was small (11). Therefore, the results of the QALYs provide limited information. To examine a large number of participants, it is necessary to use clinical trial data of participants treated for PMS/PMDD. Currently, we are collecting EQ-5D-5L data from ongoing clinical trials. The results of this study, which will be reported in the future, will provide more reliable information.

Conclusion

This study provides evidence for the validity and reliability of the DRSP-J as a measure of premenstrual symptoms in the general Japanese female population, including those with symptoms of varying intensity.

Author Contributions

All authors made substantial contributions to the conception and design, acquisition of data, and analysis and interpretation of the data; took part in drafting the article and revising it critically for important intellectual content; agreed to submit it to the current journal; gave final approval of the version to be published; and agreed to be accountable for all aspects of the work.

Disclosure

Prof. Dr. Takashi Takeda reports grants and/or personal fees from Tsumura Co., Ltd., Otsuka Pharmaceutical Co., Ltd., and Bayer Pharma Co., Ltd., outside the submitted work. The authors report no other conflicts of interest in this work.

Acknowledgments

We would like to thank Editage for English language editing.

Data Sharing Statement

The data obtained in this study are available from the corresponding author upon request.

Additional information

Funding

This study received no external funding.