Health status in patients with coexistent COPD and heart failure: a validation and comparison between the Clinical COPD Questionnaire and the Minnesota Living with Heart Failure Questionnaire

Abstract

Background

Chronic obstructive pulmonary disease (COPD) and heart failure (HF) are both common diseases that coexist frequently. Patients with both diseases have worse stable state health status when compared with patients with one of these diseases. In many outpatient clinics, health status is monitored routinely in COPD patients using the Clinical COPD Questionnaire (CCQ) and in HF patients with the Minnesota Living with Heart Failure Questionnaire (MLHF-Q). This study validated and compared which questionnaire, ie, the CCQ or the MLHF-Q, is suited best for patients with coexistent COPD and HF.

Methods

Patients with both COPD and HF and aged ≥40 years were included. Construct validity, internal consistency, test–retest reliability, and agreement were determined. The Short-Form 36 was used as the external criterion. All questionnaires were completed at baseline. The CCQ and MLHF-Q were repeated after 2 weeks, together with a global rating of change.

Results

Fifty-eight patients were included, of whom 50 completed the study. Construct validity was acceptable. Internal consistency was adequate for CCQ and MLHF-Q total and domain scores, with a Cronbach’s alpha ≥0.70. Reliability was adequate for MLHF-Q and CCQ total and domain scores, and intraclass correlation coefficients were 0.70–0.90, except for the CCQ symptom score (intraclass correlation coefficient 0.42). The standard error of measurement on the group level was smaller than the minimal clinical important difference for both questionnaires. However, the standard error of measurement on the individual level was larger than the minimal clinical important difference. Agreement was acceptable on the group level and limited on the individual level.

Conclusion

CCQ and MLHF-Q were both valid and reliable questionnaires for assessment of health status in patients with coexistent COPD and HF on the group level, and hence for research. However, in clinical practice, on the individual level, the characteristics of both questionnaires were not as good. There is room for a questionnaire with good evaluative properties on the individual level, preferably tested in a setting of patients with COPD or HF, or both.

Keywords:

• Clinical COPD Questionnaire
• Minnesota Living with Heart Failure Questionnaire
• chronic obstructive pulmonary disease
• heart failure

Introduction

Chronic obstructive pulmonary disease (COPD) is a major worldwide cause of morbidity and mortality, and its prevalence is predicted to increase over the following decades.¹ COPD is an inflammatory disease with extrapulmonary manifestations, including an increased prevalence of cardiovascular disease in comparison with the general population.² Nine percent to 41% of COPD patients have heart failure (HF).³ Both systemic conditions have certain pathophysiologic characteristics in common, ie, the shared risk factor of smoking leading to low-grade systemic inflammation, which in turn accelerates progression of atherosclerosis in both diseases.⁴ COPD and HF also have overlapping clinical manifestations, like dyspnea, fatigue, and exercise intolerance.^5,6 Managing patients with combined COPD and HF is a challenge because it is difficult to determine whether signs and symptoms are caused by COPD, HF, or both. This can lead to delays in adequate treatment, to more severe exacerbations, and to more frequent hospital admissions.⁷ Patients hospitalized with an exacerbation of COPD and HF have more hospital days, more readmissions, and higher mortality compared with COPD patients without HF.⁸ COPD patients with combined disease also have more frequent exacerbations, leading to worse health status.⁹ Further, patients with coexistent COPD and HF have a worse health status in the stable state than patients with COPD only.¹⁰ Improving health status is a treatment goal in the follow-up of COPD patients.¹¹ Thus, it is important to monitor health status routinely in the outpatient clinic. Unfortunately, many patients have more than one chronic condition. This makes it difficult to use a single disease-specific health status questionnaire. In addition, measuring health status using several questionnaires may be troublesome for the patient. For COPD patients, the most frequently used questionnaire in the Netherlands is the Clinical COPD Questionnaire (CCQ).¹² For HF patients, the Minnesota Living with Heart Failure Questionnaire (MLHF-Q) is most frequently used.¹³ Both health status questionnaires, ie, the CCQ and the MLHF-Q, are disease-specific questionnaires. Therefore, patients with coexistent COPD and HF theoretically have to complete both questionnaires, which is time-consuming and not practical in the outpatient clinic. One questionnaire to assess health status for patients with both diseases, ie, COPD and HF, would be ideal. Unfortunately, no health status questionnaire has been constructed for patients with coexistent COPD and HF. Therefore, the aim of this study was to compare which existing questionnaire, the CCQ or the MLHF-Q, is suited best for patients with coexistent COPD and HF.

Materials and methods

Study design

This single-center, prospective, validation study was carried out at Isala Hospital, a large teaching hospital in Zwolle, the Netherlands. Stable patients with both HF and COPD were contacted by telephone and invited to participate in the study, and signed their informed consent. Approval was received from the local ethics committee (local number 11.10127).

Patients

Patients with COPD GOLD (Global Initiative for Chronic Obstructive Lung Disease) stage ≥2 (defined as a post-bronchodilator forced expiratory volume in one second [FEV₁] <80% and a ratio of FEV₁ to forced vital capacity of <70%), HF (defined clinically as a syndrome in which patients have typical signs and symptoms of HF and a reduced left ventricular ejection fraction or diastolic dysfunction¹⁴), New York Heart Association functional class ≥2, and aged 40–85 years with a smoking history of ≥5 pack years, and able to provide written informed consent were included. Patients who were not able to complete questionnaires on their own were excluded.

Data collection

Demographic characteristics, comorbidity (Charlson Comorbidity Index), post-bronchodilator spirometry, pro-B-type natriuretic peptide, and New York Heart Association classification for HF were recorded at baseline. Construct validity, internal consistency, and floor and ceiling effects were determined by administering the CCQ, MLHF-Q, and Short-Form 36 (SF-36) at baseline. To assess reliability and responsiveness, all questionnaires together with the Global Rating of Change (GRC) were administered at week 2 and week 12. Questionnaires were sent to the patients by mail, were completed at home, and were returned by mail.

Questionnaires

Clinical COPD Questionnaire

The CCQ¹² is a ten-item COPD-specific questionnaire with total, symptom, functional status, and mental status domains. A higher score indicates a worse health status. The minimal clinical important difference (MCID) of the CCQ total score is 0.4.¹⁵ The CCQ was developed without factor analysis because a discrepancy was found between factor analysis and expert opinion. After deliberation, clinicians and experts in the field of COPD management decided to forego factor analysis and to compose the domains themselves.¹²

Minnesota Living with Heart Failure Questionnaire

The MLHF-Q is a HF-specific questionnaire consisting of 21 items with a 6-point response scale from 0 to 5, leading to a total score and two domain scores, ie, physical and emotional state. A higher score indicates worse health status.¹³ The MCID was estimated at 4.8.¹⁶ The MLHF-Q was developed with factor analysis.¹³

Short-Form 36

The SF-36 is a generic health status questionnaire with eight domains, ie, physical functioning, role physical, bodily pain, general health, vitality, social function, role emotional, and mental health.^17–19 All scores are transformed to a range from 0 to 100, with higher scores indicating better health status.

Global Rating of Change

The GRC was used to assess self-perceived change in health status, “To what extent have your pulmonary and/or cardiac symptoms changed in the past weeks?”, on a 15-point scale (−7 a very great deal worse, 0 no change, +7 a very great deal better).²⁰

Statistical analysis

Data analyses were performed using Statistical Package for the Social Sciences version 20.0 software (IBM Corporation, New York, NY, USA). Baseline characteristics are presented as the mean (standard deviation) unless otherwise stated. In this study, the clinimetrics statistics definitions of the COSMIN (Consensus-based standards for the selection of health status measurement instruments) study were followed.^21,22 First, one of the authors assessed face validity, the degree to which the items of the CCQ and MLHF-Q indeed look to be an adequate reflection of the construct to be measured, namely “health status in patients with both, COPD and HF”. To assess content validity,²² the relevance and comprehensiveness of items in the CCQ and MLHF-Q were viewed and the subsequent four questions were answered, ie, “Do all items of the questionnaires refer to relevant aspects of the construct?”, “Are all items relevant for the study population?”, “Are all items relevant for the purpose of the application of the instrument?”, and “Do all items together comprehensively reflect the construct to be measured?”. To determine construct validity, Spearman rank correlation coefficients of the CCQ, MLHF-Q, and SF-36 were used, because most of the distributions were skewed. The SF-36 was used as the external criterion to assess construct validity. We predefined the hypotheses concerning the construct validity between corresponding domains: correlations <0.30 were considered as poor, correlations between 0.30–0.50 as moderate, and ≥0.50 as strong.^22,23 Corresponding domains were defined as: CCQ total and MLHF-Q total score with all SF-36 domains. We expected the CCQ functional and MLHF-Q physical domains to correspond with the SF-36 domains physical functioning, social functioning, physical, and vitality; CCQ mental and MLHF-Q emotional domain with SF-36 domain mental health, social functioning, and role emotional; and CCQ symptom domain with SF-36 domain pain and vitality, and we found that these domains did correspond with each other. Correlations of <0.1 were expected for FEV₁ with MLHF-Q and CCQ total and domain scores. Construct validity was labeled as acceptable when ≥75% of the predefined hypotheses of the corresponding domains agreed.²² Internal consistency of the CCQ, MLHF-Q, and SF-36 was assessed using Cronbach’s alpha coefficients; these were deemed adequate between 0.7 and 0.9.²⁴ Reliability, test–retest reliability, and agreement were evaluated in stable patients after 2 weeks (defined here as GRC −1, 0, and 1). Test–retest reliability was assessed with intraclass correlation coefficients (ICCs) based on the two-way random effects model and the standard error of measurement (SEM), and test–retest reliability was assumed sufficient when ICC was ≥0.7.²⁴ Agreement was assessed with a Bland–Altman plot for the CCQ and MLHF-Q total score. Agreement was defined as acceptable when the limits of agreement were smaller than the MCID.^24–26

Responsiveness would be determined with the receiver operating characteristics (ROC) and the area under the curve (AUC), an adequate AUC was declared when at least 0.70 was declared as adequate.^22,24 Floor and ceiling effects were assessed. When less than 15% of the patients achieved the highest or lowest possible score respectively, floor and ceiling effects were labeled absent and the test adequate.^22,25

Results

From October 25, 2011 to September 6, 2013, 58 patients were recruited and 50 completed the study, as shown in Figure 1. Patient demographic and clinical characteristics are presented in Table 1. All patients had COPD and HF; other common comorbidities were myocardial infarction (31, 53.4%), diabetes mellitus (12, 20.7%), and peripheral vascular disease (17, 29.3%).

Table 1 Patient characteristics

n	58
Sex, male, n (%)	43 (74.1)
Age (years), mean (SD)	73 (6)
Pack years, median (range)	37.5 (5–102)
Current smoker, n (%)	17 (29.3)
Oxygen therapy, n (%)	11 (19)
BMI, mean (SD)	27 (5)
FEV1 (post-bronchodilator % predicted), mean (SD)	51 (15)
GOLD, n (%)
2	29 (50)
3	16 (27.6)
4	13 (22.4)
Pro-BNP (pg/mL),a median (range)	3,180 (59–31,390)
NYHA, n (%)
2	41 (70.7)
3	14 (24.1)
4	3 (5.2)
Charlson Comorbidity Index, n (%)
2	12 (20.7)
3	24 (41.4)
≥4	22 (37.9)
CCQ total score, mean (SD)	2.7 (1.1)
MLHF-Q, mean (SD)	43 (22)
SF-36, general health, mean (SD)	31 (18)

Notes:

a n=57. COPD classification by post-bronchodilator spirometry according to GOLD guidelines.

Abbreviations: BMI, body mass index; FEV₁, forced expiratory volume in one second; GOLD, Global Initiative for Chronic Obstructive Lung Disease; pro-BNP, pro-B-type natriuretic peptide; NYHA, New York Heart Association; CCQ, Clinical COPD Questionnaire; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire; SF-36, Short-Form 36; SD, standard deviation.

Figure 1 Flow chart showing the recruitment and retention of the study participants.

Note: In total 58 patients were included in the study, and 50 patients completed the study.
Abbreviations: CCQ, Clinical COPD Questionnaire; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire; SF-36, Short-Form 36; GRC, Global Rating of Change.

Validity

Face validity

The CCQ and the MLHF-Q are both disease-specific questionnaires, separately designed for COPD and HF, respectively. For use in patients with both morbidities, the items of both questionnaires have to reflect the construct “health status of patients with both COPD and HF”. Health status in patients with COPD and HF will partly derive from the severity of symptoms, ie, dyspnea, edema, orthopnea, cough, and phlegm. When the questionnaires are compared, the question “Did your HF prevent you from living as you wanted during the past month by causing swelling in your ankles or legs?” is missing in the CCQ, and the questions “How much of the time did you cough?” and “How much of the time did you produce phlegm?” were missing in the MLHF-Q. Except for the question about “ankle edema”, all other questions of the MLHF-Q were comparable with the questions of the CCQ.

Content validity

1. “Do all items of the CCQ and MLHF-Q refer to relevant aspects of health status in patients with COPD and HF?” Originally, the CCQ was developed and validated in COPD patients,¹² and the MLHF-Q was developed and validated in patients with HF.¹³ Since symptoms in COPD patients and in HF patients show considerable overlap, most of the items in both questionnaires reflect health status for both diseases, ie, COPD and HF.

2. “Are all items relevant for patients with COPD and HF?” The CCQ lacks an item about ankle edema,¹² and the MLHF-Q lacks items about cough and phlegm.¹³ All other items are similar for both questionnaires.

3. “Are all items relevant for the purpose of application of the CCQ and MLHF-Q?” Ideally, a disease-specific questionnaire for patients with both COPD and HF should be developed, and should have good discriminative and evaluative properties. However, both questionnaires^12,13 are largely equal, and theoretically the authors consider therefore that both questionnaires perhaps can be used in patients with COPD and HF.

4. “Do all items together comprehensively reflect health status in patients with COPD and HF?” Based on previous validation studies,^12,27,28 the CCQ reflects health status in COPD patients but is also validated in other patient populations, including patients with laryngotracheal stenosis. The MLHF-Q reflects health status in HF patients,¹³ patients with atrial fibrillation,²⁹ and patients with heart valve surgery.³⁰ Comprehensive evaluation of health status in patients with both COPD and HF has not been assessed yet for either questionnaire.

Construct validity

The correlation coefficients between the corresponding domains of the CCQ and the MLHF-Q with the external criterion, the SF-36, are shown in Table 2. Most of the corresponding domains between the SF-36 and the CCQ and MLHF-Q show moderate to strong correlations, except for the SF-36 role emotional domain and the corresponding MLHF-Q emotional domain (−0.27) and the SF-36 role physical and the corresponding MLHF-Q physical domain (−0.29). Convergent validity is depicted in Table 3. As hypothesized, all corresponding domains of the CCQ and the MLHF-Q had strong correlations (≥0.50). Conversely, correlations between the CCQ and MLHF-Q questionnaires and FEV₁ percent predicted were indeed low, although some did slightly surpass the 0.1 boundary (Table 3). The predefined hypothesis for the corresponding domains of the CCQ, MLHF-Q, SF-36, and FEV₁ percent predicted agreed in 75% of cases.

Table 2 Construct validity (n=58)

	CCQ
	Total	Functional	Mental	Symptom
SF-36
General health	−0.57 (<0.001)	−0.53 (<0.001)	−0.30 (0.02)	−0.51 (<0.001)
Role physical	−0.32 (0.01)	−0.25 (0.06)	−0.21 (0.11)	−0.26 (0.05)
Pain	−0.44 (0.001)	−0.36 (0.006)	−0.36 (0.006)	−0.31 (0.02)
Physical functioning	−0.63 (<0.001)	−0.77 (<0.001)	−0.44 (0.001)	−0.34 (0.008)
Vitality	−0.65 (<0.001)	−0.50 (<0.001)	−0.60 (<0.001)	−0.53 (<0.001)
Social functioning	−0.62 (<0.001)	−0.60 (<0.001)	−0.59 (<0.001)	−0.38 (0.003)
Role emotional	−0.30 (0.02)	−0.23 (0.09)	−0.33 (0.01)	−0.22 (0.10)
Mental health	−0.50 (<0.001)	−0.27 (0.04)	−0.62 (<0.001)	−0.38 (0.004)
	MLHF-Q (n=58)
	Total	Physical	Emotional
SF-36
General health	−0.50 (<0.001)	−0.48 (<0.001)	−0.38 (0.004)
Role physical	−0.37 (0.005)	−0.29 (0.03)	−0.34 (0.008)
Pain	−0.40 (0.002)	−0.37 (0.004)	−0.36 (0.006)
Physical functioning	−0.51 (<0.001)	−0.63 (<0.001)	−0.29 (0.03)
Vitality	−0.64 (<0.001)	−0.61 (<0.001)	−0.53 (<0.001)
Social functioning	−0.61 (<0.001)	−0.62 (<0.001)	−0.60 (<0.001)
Role emotional	−0.33 (0.01)	−0.27 (0.04)	−0.27 (0.05)
Mental health	−0.53 (<0.001)	−0.46 (<0.001)	−0.60 (<0.001)

Notes: Construct validity is presented with Spearman rank correlations (P-value). Correlations of the corresponding domains of ≥0.5 are adequate according to the hypothesis described in the statistical section.

Abbreviations: CCQ, Clinical COPD Questionnaire; SF-36, Short Form 36; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire.

Table 3 Construct validity: convergent and divergent validity (n=58)

Convergent validitya	MLHF-Q total	MLHF-Q physical	MLHF-Q emotional
CCQ total	0.84 (<0.001)	0.82 (<0.001)	0.57 (<0.001)
CCQ symptom	0.61 (<0.001)	0.54 (<0.001)	0.43 (<0.001)
CCQ functional	0.67 (<0.001)	0.72 (<0.001)	0.35 (0.007)
CCQ mental	0.69 (<0.001)	0.68 (<0.001)	0.65 (<0.001)
Divergent validityb	CCQ total	CCQ symptom	CCQ functional	CCQ mental
FEV1 % predicted	−0.17 (0.20)	−0.16 (0.23)	−0.17 (0.20)	0.03 (0.85)
	MLHF-Q total	MLHF-Q physical	MLHF-Q emotional
FEV1 % predicted	0.04 (0.76)	0.04 (0.74)	0.10 (0.46)

Notes:

a Adequate convergent validity is present if Spearman rank correlations of the corresponding domains are ≥0.5 according to the hypothesis described in the statistical section;

b Spearman rank correlations of divergent validity were expected to be ≤0.1.

Abbreviations: CCQ, Clinical COPD Questionnaire; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire; FEV₁, forced expiratory volume in one second.

Reliability

Internal consistency

All Cronbach’s alpha values were >0.7, implying satisfactory internal consistency for the CCQ and MLHF-Q total and domain scores and most of the SF-36 domain scores, except for the domains general health (0.63) and social (0.69, see Table 4).

Table 4 Internal consistency (n=58)

	Cronbach’s α
CCQ
Total	0.87
Mental	0.80
Symptom	0.75
Functional	0.86
MLHF-Q
Total	0.91
Emotional	0.90
Physical	0.86
SF-36
General health	0.63
Mental health	0.83
Role emotional	0.86
Role physical	0.91
Physical functioning	0.88
Social functioning	0.69
Vitality	0.80
Pain	0.92

Notes: Internal consistency is assessed with the Cronbach’s α coefficient, a correlation between 0.70 and 0.95 is considered as good internal consistency.

Abbreviations: CCQ, Clinical COPD Questionnaire; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire; SF-36, Short Form 36.

Test–retest reliability

The ICC was tested in 33 patients who remained stable after 2 weeks and was adequate (≥0.7) for all questionnaires, ie, the CCQ, MLHF-Q, and SF-36, indicating good test–retest reliability (Table 5). The only exceptions that had lower ICCs were: the CCQ symptom score (0.42 [0.11, 0.66]), SF-36 physical functioning (0.64 [0.32, 0.82]), and SF-36 role emotional (0.24 [−0.13, 0.53]). The SEMs of the total and domain scores of all questionnaires were larger than the MCID on the individual level, except for the MLHF-Q emotional domain (SEM 2.02).

Table 5 Test–retest reliability (n=33)

	ICC (95% CI)	SEM
CCQ
Total	0.70 (0.48, 0.84)	0.60
Mental	0.75 (0.55, 0.87)	0.67
Symptom	0.42 (0.10, 0.66)	0.89
Functional	0.79 (0.63, 0.89)	0.69
MLHF-Q
Total	0.85 (0.71, 0.92)	8.96
Emotional	0.90 (0.80, 0.95)	2.02
Physical	0.79 (0.62, 0.89)	5.17
SF-36
General health	0.74 (0.54, 0.86)	9.35
Mental health	0.79 (0.61, 0.89)	8.74
Role emotional	0.24 (−0.13, 0.65)	36.00
Role physical	0.90 (0.80, 0.95)	8.70
Physical functioning	0.64 (0.32, 0.82)	25.75
Social functioning	0.80 (0.64, 0.90)	12.12
Vitality	0.76 (0.57, 0.88)	11.54
Pain	0.82 (0.67, 0.91)	12.19

Notes: Test–retest-reliability is presented with the ICC and 95% CI. ICC ≥0.70 gives a positive rating for test–retest reliability. Only stable patients (Global Rating of Change −1, 0, 1).

Abbreviations: CCQ, Clinical COPD Questionnaire; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire; SF-36, Short-Form 36; SEM, standard error of measurement; ICC, intraclass correlation coefficient; CI, confidence interval.

Agreement

Bland–Altman plots of the CCQ total score and MLHF-Q total score for the 33 patients who remained stable after 2 weeks are shown in Figure 2. The mean difference after 2 weeks was −0.26±0.14 for the CCQ total score and −3.64±2.15 for the MLHF-Q total score. The upper and lower limits of agreement were 1.35 and −1.87 for the CCQ total score. The MLHF-Q had an upper limit of agreement of 20.52 and a lower limit of agreement of −27.80.

Figure 2 Agreement over time of CCQ total score and MLHF-Q total score in stable COPD patients. (A) Agreement of the CCQ total score and (B) agreement of the MLHF-Q total score over 2 weeks in stable COPD patients (GRC −1, 0, 1).

Notes: The bold flat line represents the mean difference over 2 weeks for the CCQ and MLHF-Q total scores. The dashed lines are the limits of agreement, 1.96× standard deviation. (n=33).
Abbreviations: COPD, chronic obstructive pulmonary disease; CCQ, Clinical COPD Questionnaire; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire; GRC, Global Rating of Change.

Measurement of change

Responsiveness

Patients in this study were in a stable phase of their disease, ie, HF and COPD. After inclusion, patients received no change in intervention and were not expected to improve much. Therefore, responsiveness could not be assessed in this study.

Interpretability

Floor effects (lowest score) were present in the CCQ mental domain 36.2% and in the MLHF-Q emotional domain 20.7%. The SF-36 showed floor effects for the domains role emotional (25.9%) and physical functioning (75.9%) and ceiling effects (highest score) for the domains role emotional (50%) and pain (36.2%), as shown in Table 6.

Table 6 Floor and ceiling effect (n=58)

	Mean (SD)	Floor (%)	Ceiling (%)
CCQ
Total	2.7 (1.1)	1.7	0
Mental	1.3 (1.4)	36.2	0
Symptom	3.0 (1.3)	1.7	1.7
Functional	3.2 (1.4)	1.7	0
MLHF-Q
Total	43.3 (22.5)	5.2	0
Emotional	7.2 (6.5)	20.7	0
Physical	22.3 (10.9)	5.2	0
SF-36
General health	31 (18.1)	3.4	0
Mental health	72.4 (19.0)	0	5.2
Role emotional	60.3 (43.5)	25.9	50
Role physical	32.1 (25.2)	12.1	0
Physical functioning	15.1 (31.0)	75.9	8.6
Social functioning	60.3 (27.4)	3.4	19
Vitality	44.7 (31.0)	0	0
Pain	66.2 (32.0)	1.7	36.2

Abbreviations: CCQ, Clinical COPD Questionnaire; MLHF-Q, Minnesota for Living with Heart Failure Questionnaire; SF-36, Short-Form 36; SD, standard deviation.

Discussion

This is the first study comparing and validating the CCQ and MLHF-Q in patients with coexisting COPD and HF. The discriminative part of the psychometric properties, ie, validity, internal consistency, and test–retest reliability, were comparable for the CCQ and MLHF-Q. The only exception was the CCQ symptom score, in which weaker correlations were found for test–retest reliability and construct validity. The evaluative part, ie, agreement of the CCQ and MLHF-Q, was similarly limited in both. The psychometric properties of both questionnaires will be discussed separately. Because the CCQ and MLHF-Q have not been validated before in patients with both COPD and HF, we cannot compare our findings directly with similar validation studies. Therefore, to give some perspective and to quantify our findings, we compared our study with validation studies in other patient populations.

Construct validity was assessed between the external criterion, ie, the SF-36, and both questionnaires, ie, the CCQ and MLHF-Q. Most of the correlations between the corresponding domains of the SF-36 and the MLHF-Q were moderate to strong. Other validation studies^29,30 in patients with atrial fibrillation and patients undergoing heart valve surgery found similar correlations between the SF-36 and MLHF-Q. Corresponding domains of the CCQ and SF-36 achieved moderate to strong correlations as well, and were comparable with most of the correlations found in the original validation study.¹² The exception to this notion is the CCQ symptom domain, which seems to have lower correlations with SF-36 in comparison with the original validation study in patients with COPD only.¹² This might signify that the CCQ symptom domain is not a reflection of the most important symptoms of patients with combined COPD and HF. The symptoms in COPD and HF overlap partially; however, some symptoms are different, like orthopnea or edema.³¹ The CCQ symptom domain consists of four items: “Short of breath at rest?”, “Short of breath doing physical activities?”, “Did you cough?”, and “Did you produce phlegm?”. These questions reflect symptom-related health status for patients with COPD alone. Symptom-related health status for patients with both diseases, ie, COPD and HF, is probably more complex.

The test–retest reliability of the CCQ symptom domain was also limited, with an ICC of 0.42 (0.10, 0.66). Previous studies in other populations showed higher ICCs for the CCQ symptom domain; one study²⁷ in patients with COPD in primary care found an ICC of 0.74 and another study²⁸ in adults with laryngotracheal stenosis found an ICC of 0.94. We do not have an explanation for this, but have considered whether the low ICC in our study could be due to the fact that patients with both COPD and HF are a more homogeneous population than expected. In that case, the variability of scores on the CCQ symptom domain between patients is low and within patients are equally present, leading to a low ICC and hampering its use as a discriminative tool in patients with both COPD and HF.

The MLHF-Q physical domain consists of eight items, with six items containing questions about functional state and two items canvassing symptom-related health status, ie, “Did your heart failure prevent you from living as you wanted during the last month by making you short of breath?”, and “Did your heart failure prevent you from living as you wanted during the last month by making you tired, fatigued, or low on energy?”.¹³ The MLHF-Q physical domain has an adequate discriminative value in patients with COPD and HF, with an ICC of 0.79 (0.62, 0.89). Perhaps this is due to the combination of functional state and symptoms-related questions about health status in the MLHF-Q physical domain. The discriminative value in patients with COPD and HF is adequate as well, with an ICC of 0.79 (0.63, 0.89).

The degree of interrelatedness between the items of the domains of the CCQ and the MLHF-Q, internal consistency, were adequate, all Cronbach’s alpha coefficients were ≥0.70, and were comparable with previous validation studies^12,13,30 in patients with COPD, heart valve surgery, or HF.

The SEM of the CCQ and MLHF-Q total and domain scores on the individual level was larger than the MCID of both questionnaires. This suggests that neither questionnaire could differentiate between a clinical relevant change and measurement error in our study. Two studies have addressed the SEM of the CCQ total score before and found SEMs of 0.29³² and 0.21.³³ However, these SEMs were determined in COPD patients without HF. In our study, an SEM of 0.60 was found for the CCQ total score. The standard measurement error can be calculated on group level and on individual level (per patient). The SEM on individual level can be interpreted and used in clinical practice in the outpatient clinic. The SEM on group level can be interpreted and used in groups, ie clinical research. The SEMs on the group level for the CCQ total, symptom, functional, and mental scores were 0.10, 0.15, 0.12, and 0.11, respectively. The latter SEM values are all smaller than the MCID of the CCQ, 0.4 points. Thus, on the group level, the CCQ is able to differentiate a real change from measurement error. The SEMs for the MLHF-Q total, emotional, and physical score on the group level were 1.56, 0.35, and 0.90, respectively. The MCID of the MLHF-Q is 4.8. Also, the MLHF-Q was able to differentiate clinically relevant change from measurement error in patients with COPD and HF on the group level.

Similar results were found for the agreement. Both questionnaires had large limits of agreement on the individual level, ie, 1.35 and −1.87 for the CCQ total score and 20.52 and −27.80 for the MLHF-Q total score. On the group level, the limits of agreement were 0.23 and −0.32 for the CCQ total score and 3.5 and −4.84 for the MLHF-Q. On the group level, the limits of agreement are smaller or comparable with the MCID for both questionnaires, indicating that a clinically relevant change in health status can be distinguished from measurement error.

This study has some limitations that are worth discussing. One limitation is that the responsiveness, ie, the ability of the CCQ and MLHF-Q to detect changes in health status over time, could not be assessed in this study because patients received no change in intervention. Therefore, no conclusion can be drawn regarding patients who improved or deteriorated versus those who remained stable. Most of the patients remained stable because no intervention was given. Another limitation is the use of the SF-36, a generic health status questionnaire, as the reference standard; ideally, a disease-specific health status questionnaire for patients with COPD and HF would be used. Unfortunately, there is no such questionnaire for these patients. We chose generic SF-36 because it is validated for both COPD and HF.^34,35 The last limitation is the MCIDs used for the CCQ and MLHF-Q. These MCIDs were determined for patients with either COPD or HF, but not in patients with combined disease. This could underestimate or overestimate interpretation of the agreement, because agreement was acceptable when the limits of agreement were smaller than the MCID.

In conclusion, both questionnaires, the CCQ and the MLHF-Q, are valid and reliable for patients with both COPD and HF on the group level, for instance in clinical research or validation studies. However, the CCQ symptom domain does not reflect all symptoms of patients with coexistent COPD and HF, limiting its usefulness in this setting. On the individual level, ie, in clinical practice, the CCQ and MLHF-Q were not able to differentiate a real clinically relevant change from measurement error in patients with COPD and HF in this study. Ideally, a new questionnaire should be developed, whereby a more complete reflection of health status can be measured in patients with both COPD and HF.

Acknowledgments

We would like to acknowledge Stichting Astma Bestrijding for a subvention in support of this work. We also thank the Isala Hospital for a health innovation science grant.

Disclosure

The authors report no conflicts of interest in this work.