91
Views
8
CrossRef citations to date
0
Altmetric
Original Research

Symptoms and impact of COPD assessed by an electronic diary in patients with moderate-to-severe COPD: psychometric results from the SHINE study

, , &
Pages 79-94 | Published online: 07 Jan 2015

Abstract

Background

Symptoms, particularly dyspnea, and activity limitation, have an impact on the health status and the ability to function normally in patients with chronic obstructive pulmonary disease (COPD).

Methods

To develop an electronic patient diary (eDiary), qualitative patient interviews were conducted from 2009 to 2010 to identify relevant symptoms and degree of bother due to symptoms. The eDiary was completed by a subset of 209 patients with moderate-to-severe COPD in the 26-week QVA149 SHINE study. Two morning assessments (since awakening and since the last assessment) and one evening assessment were made each day. Assessments covered five symptoms (“shortness of breath,” “phlegm/mucus,” “chest tightness,” “wheezing,” and “coughing”) and two impact items (“bothered by COPD” and “difficulty with activities”) and were scored on a 10-point numeric scale.

Results

Patient compliance with the eDiary was 90.4% at baseline and 81.3% at week 26. Correlations between shortness of breath and impact items were >0.95. Regression analysis showed that shortness of breath was a highly significant (P<0.0001) predictor of impact items. Exploratory factor analysis gave a single factor comprising all eDiary items, including both symptoms and impact items. Shortness of breath, the total score (including five symptoms and two impact items), and the five-item symptom score from the eDiary performed well, with good consistency and reliability. The eDiary showed good sensitivity to change, with a 0.6 points reduction in the symptoms scores (on a 0–10 point scale) representing a meaningful change.

Conclusion

The eDiary was found to be valid, reliable, and responsive. The high correlations obtained between “shortness of breath” and the ratings of “bother” and “difficulty with activities” confirmed the relevance of this symptom in patients with COPD. Future studies will be required to explore further psychometric properties and their ability to differentiate between COPD treatments.

Introduction

Symptoms, particularly dyspnea and activity limitation, have a profound impact on the activities of daily life and health status in patients with COPD.Citation1 The prevention and control of symptoms are important elements in the management of COPD as the goals have shifted towards optimizing symptom control and reducing future risks such as exacerbations, hospital admissions, and deaths.Citation1

These symptoms are frequently collected as a patient-reported outcome (PRO) from either a questionnaire, diary, or clinical questionnaire.Citation2,Citation3 PROs are recognized as important outcomes in clinical research, and particularly in respiratory indications such as asthma and COPD, where specific treatment outcomes can only be captured from the patient.Citation4 PROs are increasingly being collected by electronic means (electronic PROs or ePROs).Citation5Citation7 The electronic collection of data is particularly helpful in unsupervised settings, where paper-based diaries may be less valid because of suboptimal patient adherence to diary completion.Citation8,Citation9

PRO instruments, either paper or electronic based, need to be validated in order to be reliable and responsive to clinically meaningful treatment effects. PRO instruments should also facilitate easy understanding and usage to the patients and physicians and be relevant and acceptable to the healthcare providers and regulatory authorities, respectively.Citation10

The guidelines published by the US Food and Drug Administration provide a useful framework for collection of adequate psychometric data in order to document that PRO measures are fit for purpose.Citation11 Here, we present the results of psychometric assessment data from a COPD eDiary developed by Novartis to provide a more detailed assessment of the symptoms and their impact on patients with COPD.

Qualitative patient interviews were conducted from 2009 to 2010 to elicit concepts from patients in the US, identifying relevant symptoms as well as degree of bother because of symptoms. The COPD eDiary was administered to a subset of patients in the 26-week SHINE study,Citation12 which was a part of the Phase III clinical trial program on QVA149, a once-daily dual bronchodilator containing a fixed-dose combination of the long-acting β2 agonist indacaterol and the long-acting muscarinic antagonist glycopyrronium.Citation12Citation15

Methods

Study design and treatments

The COPD eDiary was completed twice a day (morning and evening) for 26 weeks by a subset of patients in the SHINE study. (See Supplementary materials for more details of the SHINE study, including institutional review and consent procedures). Data for the following visits were used for psychometric validation: baseline (the day treatment started), week 1 (7 days after baseline), week 12, and week 26 (end of the study). In each case, the eDiary data were used from the 7-day period preceding the visit. The site-based PRO assessments (St George’s Respiratory Questionnaire [SGRQ], baseline dyspnea index [BDI], and transitional dyspnea index [TDI]) were made at baseline, week 12, and week 26.

Patient population

The SHINE study included male and female patients aged ≥40 years with moderate-to-severe stable COPD (stage II or III according to the Global Initiative for Chronic Obstructive Lung Disease 2008 criteria), a smoking history of ≥10 pack-years, and a postbronchodilator forced expiratory volume in 1 second (FEV1) ≥30% and <80% of the predicted normal and postbronchodilator FEV1 to forced vital capacity ratio of <0.70 at screening.Citation12

Objectives

The objectives of the current analysis were to determine the frequency of occurrence and the severity of COPD symptoms in this patient group; to determine how bothersome and difficult patients find their COPD symptoms; and to establish the measurement properties of the COPD eDiary.

Assessments/measures

COPD eDiary

The morning assessment of the COPD eDiary had two components: M1, from waking up until completing the morning assessment, and M2, from the last scheduled diary entry (the evening before) until completing the morning assessment. The evening assessment (E) covered the period from the last scheduled diary entry (morning of the current day) until completing the evening assessment.

Each assessment included five symptom items: “shortness of breath”, “phlegm/mucus”, “chest tightness”, “wheezing”, and “coughing”. Two impact items, “bothered by COPD” and “difficulty with activities” were also captured, with the latter being evaluated in M2 and E only. “Bothersomeness” was included in all the three eDiary time frames as part of exploring the impact of symptoms on patients’ lives. It has been reported that the health-related quality of life in patients with COPD correlates more strongly with the ratings of dyspnea or symptoms than does the spirometry.Citation18,Citation19 All the items were rated on an eleven-point numeric scale from 0 (none) to 10 (worst possible). (For further details, please refer to Supplementary materials.)

Clinic-based instruments

The SGRQ was used to assess the health status of patients in the study.Citation3 Dyspnea was measured at baseline using BDI and during the treatment period using TDI, which captured changes from baseline as interviewed by a trained assessor. A TDI focal score of 1 is considered to be a clinically significant improvement from baseline.Citation20

Statistical analysis

The analysis used the available data from all patients who completed the COPD eDiary. Compliance rates were assessed as percentage of scheduled entries over each assessment period.

Frequencies of occurrence for individual symptoms (score >0) are presented, and an overall mean symptom score was calculated for the five symptom items over the baseline and week 26 periods. Correlations were calculated for the baseline scores using the mean item scores over the 7-day baseline period.

The exploratory factor analysis was performed on the baseline 7-day mean scores (by time frame) using principal components analysis. Parallel analysis was used to determine the optimal number of factors to extract.Citation21

The internal consistency of the eDiary was evaluated using Cronbach’s coefficient alpha (α). Test–retest reliability was assessed using the mean of the 7-day baseline scores as the test and the mean of the 7-day week 1 scores as the retest in patients who rated themselves unchanged from baseline in the weekly assessment of change in the eDiary. Reliability was calculated using the intraclass correlation coefficient (ICC), form 2,1.Citation22

Sensitivity to change for eDiary was evaluated using the change from baseline to week 26. Patients were classified into three groups, “improved,” “worse,” or “uncertain/no change,” based on FEV1 and ratings on the global items of the diary at week 26. The change scores were then compared for these three improvement groups.

Results

Patient demographics

Two hundred and nine patients were allocated to the COPD eDiary, of whom 140 (67.0%) were male and 69 (33.0%) were female. Ages ranged from 44 to 86 years; 92 patients (44.0%) were under 65 years, 80 (38.3%) were ≥65 years to <75 years, and 37 (17.7%) were ≥75 years.

eDiary assessment schedule compliance

The mean compliance rates over the study were 90.1% for baseline, 88.9% for week 1, 84.6% for week 12, and 80.0% for week 26. The mean compliance rates for the M1 and M2 compared to E were 86.5% and 84.5%, respectively, over the 26-week study period.

Frequency and severity of reporting of COPD symptoms

All five symptoms in the eDiary were present in ≥50% of entries, with shortness of breath, phlegm/mucus, and cough occurring in more than 70% of entries over the study period. Overall, slightly lower frequencies for M1 were observed compared with M2 or E (). The mean symptom score severity ranged between 1.6 and 3.2 (on a 0–10 point scale), with severity being greater at baseline than at the end of the study (). The severity of mean “bother” and “difficulty with activities” scores occurred in the range of 2.0–2.6 over the course of the study.

Figure 1 Frequency of occurrence (A) and severity of COPD symptoms (B) over the study period.

Abbreviations: COPD, chronic obstructive pulmonary disease; E, evening diary; M1, morning diary: symptoms since awakening; M2, morning diary: symptoms since the last assessment.
Figure 1 Frequency of occurrence (A) and severity of COPD symptoms (B) over the study period.

Distribution properties

The mean scores for all items (five symptoms and two impact items) were in the range of 2.12–3.20 for baseline and 1.68–2.60 for week 26, with the scores being positively skewed.

Correlations between symptom severity and bother/difficulty with activities scores

The correlations between the scores for the five diary symptoms and impact items at baseline were high, with >0.7 for bother and >0.6 for difficulty with activities across all assessments (). A very high correlation was observed between shortness of breath and impact items (>0.95 across all assessments).

Table 1 Correlations (Pearson’s r) between individual symptoms and overall bother/difficulty with activities caused by COPD symptoms at baseline

For other symptoms, correlations with impact items were lower but still substantial (0.64–0.86). Regression modeling showed that shortness of breath was a highly significant (P<0.0001) predictor of bother ratings, with no other symptom showing a significant association once shortness of breath had been taken into account.

eDiary factor structure

The exploratory factor analysis gave a single factor comprising all seven eDiary items (five symptoms and two impact items), and this was found when the three time frames (M1, M2, and E) were combined or when the time frames were assessed separately (). At least 75% of the variance was accounted for by the first factor in all cases.

Table 2 Factor loadings for the single factor identified by exploratory factor analysis (EFA) using baseline data

Internal consistency of eDiary

A very high internal consistency, evaluated using all seven diary items, was found with Cronbach’s coefficient α, with all values being >0.95 for all three assessment time points (baseline, week 12, and week 26) and for all three eDiary time frames ().

Table 3 Internal consistency estimates for eDiary items

Test–retest reliability of eDiary

A total of 44 patients reported no change in their condition between baseline and week 1. As a single factor was found, the mean of all seven eDiary items was used as the total score. The ICC for the combined scores for all the measures assessed (individual eDiary items, five-item symptom mean, seven-item overall mean) from the three assessment time frames (M1, M2, and E) was >0.94, with the lower confidence limit being >0.90. The ICC was >0.95 for the two summary means (symptom mean of five items and total mean of seven items), for all the three assessment time frames. A high reliability was also observed for the individual seven diary items, with ICC ranging between 0.95 and 0.98.

Validity of eDiary

shows the correlations among the various PRO measures at baseline. For the BDI, the highest correlation with the eDiary items was found for the magnitude of effort item and the lowest for functional impairment, with the magnitude of task being intermediate. This pattern was found also for all the individual eDiary items, with the partial exception of phlegm/mucus (magnitude of task > functional impairment) as well as for the summary scores. The correlations of the individual items with BDI were generally in the following order: difficulty with activities > bother > shortness of breath > chest tightness > wheezing > phlegm/mucus ≅ coughing.

Table 4 Spearman’s correlation between eDiary (overall) and the SGRQ and BDI scores at baseline

For SGRQ, the correlation pattern for the activity and impact subscales was similar to that of BDI, with difficulty with activities, bother, and shortness of breath showing the highest correlations. Two of the three highest values within columns were as predicted, whereas the third, that is, the correlation between eDiary difficulty with activities and SGRQ symptoms was not as predicted. Thus, the observed pattern only partly fulfilled the predictions. (For further details, please refer to results in the Supplementary materials.)

Sensitivity to change

Patients were classified as improved (n=33) or uncertain/no change (n=135) using both the clinical and patient global measures as discussed earlier in the Statistical analysis section. The eDiary was sensitive to change, as determined by the observed change in the eDiary scores. The Cohen’s effect size for the change over the 26-week study period was large (0.79) in the improved patient group (corresponding to a reduction of 1.23 points in the total mean score) compared with a minimal change (0.16) in the uncertain/no change patient group (corresponding to a reduction of 0.29 points).

The SGRQ data gave less clear-cut discrimination between the improved and nonimproved patient groups (). This clinic-based measure showed Cohen’s effect sizes of 0.60 and 0.24 for the improved and uncertain/no change patient groups, respectively. The evaluation of change over various periods suggested that the 26-week study period was appropriate for assessing the improvement in this population of patients with COPD.

Figure 2 Sensitivity to change of the eDiary at week 26.

Abbreviations: eDiary, electronic patient diary; SGRQ, St George’s Respiratory Questionnaire.
Figure 2 Sensitivity to change of the eDiary at week 26.

Clinically meaningful change in the scores

shows the changes in the eDiary scores for overall impact and severity of COPD from baseline to week 26 that are associated with a rating of “a little better.” Changes in TDI scores associated with “minor improvement” on functional impairment, magnitude of task, and magnitude of effort items are also included in . In all cases, the change scores were 0.5–0.6, suggesting that an improvement of 0.6 points on the eDiary overall mean score could be considered as a meaningful change for the patient.

Table 5 Reductions in the overall eDiary mean total score with the lowest level of improvement on each scale at week 26

Discussion

The results clearly emphasize the importance of shortness of breath as a key symptom of COPD.

Management of COPD in an optimal manner is key, as it is progressive and complex in nature. PROs allow objective assessment of the patients’ condition and might lead to informed decision by the physician for effective management of COPD in patients. Results from previously conducted interviews in patients with COPD provided an insight to frame appropriate content in this COPD eDiary. In our analysis, we found that shortness of breath showed the highest correlation with the impact items (bother and difficulty with activities) of the eDiary items. Regression analysis showed that no other symptom was a predictor of the bother scores once shortness of breath had been accounted for. Shortness of breath, together with the bother and difficulty with activities items, showed the highest loading on the single factor identified by the exploratory factor analysis; this was substantially higher than those found with other eDiary items. Thus, shortness of breath is the most important symptom in determining the impact of COPD on the patient. The results also indicate the strong connection between COPD symptoms and impacts. These scores (on a 0–10 point scale) are comparable with those of the symptoms themselves and indicate that bothersomeness and difficulty with activities are broadly in line with the levels of symptoms experienced (). In some therapeutic areas, such as pain, there are only modest correlations between measures of symptom severity and indicators of impact, or the data indicate that severity and impact items load onto distinct factors.Citation26,Citation27 This appears not to be the case here, with a single factor including all symptoms and impact items, and high correlations among symptom and impact items.

In the current analysis, there was a predominance of male over female patients and a mean age of approximately 65 years, which is typical of populations recruited into clinical research of COPD.Citation23,Citation24 The compliance rate of patients with the eDiary ranged from approximately 90% at the beginning of the study to approximately 80% over 26 weeks. Although these compliance rates were not as high as those achieved in some previous eDiary studies,Citation7,Citation8 the completion rates of ≥80% are considered good for eDiary assessments.Citation27 This suggests that the eDiary was not unduly arduous for patients to capture the information. No symptoms were considered for exclusion from the eDiary because of either too low frequency or severity.

However, both frequency and severity of symptoms were somewhat less for the M1 assessment (symptoms since awakening) than for the M2 and E, both of which measured symptoms since the previous assessment. This can be expected as the M1 assessment covered a shorter interval than the M2 or E entry. The severity and frequency of the symptoms decreased somewhat over the study period as expected. The two items in the eDiary that assessed impact (bother and difficulty with activities) showed similar values and patterns to the symptom items. All items showed a degree of skewness and marked floor effects, although these were not extreme. The correlation and factor structure of the eDiary showed that it behaved as a single one-dimensional measure.

The exploratory factor analysis showed a single factor solution, with particularly high factor loadings for bother and shortness of breath. Taken together with the high internal consistency of the eDiary ratings, these results showed that the seven-item overall diary mean, including impact and symptoms, can be used as a single summary measure.

The COPD eDiary demonstrated a robust reliability with an ICC of >0.95 for the two eDiary mean scores (five-item symptom mean score and total score comprising all seven eDiary items) and >0.93 for shortness of breath symptom. For comparison, ICCs obtained from PRO measures from a clinic-based study in COPD were in the range of 0.82–0.95.Citation28

Evaluations of validity used correlations between eDiary assessments and other PRO measures in the study. The initial prediction was that correlations for related items would be higher than those for unrelated items.

However, as noted above, the eDiary showed a single-factor structure, with a strong link between the symptom and impact items. Thus, it is not surprising that the findings related to the correlation of eDiary symptoms and the symptom mean with SGRQ and TDI were weaker and less consistent than initially predicted, although the expected patterns were apparent to a substantial degree. These patterns overall supported the validity of the eDiary as a measure of PRO severity and impact. The eDiary was sensitive to change, as determined by the observed change in the eDiary scores in a group of patients identified as having improved on both the clinical and patient global measures. The effect size for the change over the 26-week study period was large in this group compared with a minimal change in patients classified as uncertain/no change. These results are consistent with the Cohen’s classification of effect sizes, with 0.2 being small, 0.5 medium, and 0.8 large,Citation29 and showed that the eDiary is capable of demonstrating change in COPD severity and discriminating between patients showing important change and those who do not. The effect sizes for the eDiary gave a greater discrimination between the improved and uncertain/no change patients than those for the SGRQ, suggesting that the eDiary had advantages over this clinic-based measure in terms of sensitivity to change.

Anchor-based comparison using the patient global ratings of change suggested that a change of 0.6 on the total mean score of the eDiary represented a meaningful change for patients.

The main limitation of this study was that the sample was not large enough to make more than preliminary assessment of the ability of the eDiary to discriminate between treatment effects. This will require the use of the eDiary in larger comparative studies. The number included was, however, adequate to address the main objectives relating to the measurement properties of the instrument.

In conclusion, the results from the analysis indicated that the new eDiary contents and time frames were appropriate. Strong correlations with the clinic-based PRO measures supported the validity of the eDiary, and these were also found to be internally consistent, reliable, and sensitive to change. Future studies will be required to explore further psychometric properties and their ability to differentiate between novel COPD treatments.

Results

Correlations between symptom severity and bother/difficulty with activities scores

For other symptoms, correlations with impact items were lower but still substantial (0.64–0.86). Regression modeling showed that “shortness of breath” was a highly significant (p<0.0001) predictor of bother ratings, with no other symptom showing a significant association once shortness of breath had been taken into account.

Validity of eDiary

For SGRQ, the correlation pattern for the activity and impact subscales was similar to that of baseline dyspnea index, with difficulty with activities, “bother”, and shortness of breath showing the highest correlations. Two of the three highest values within columns were as predicted, whereas the third, that is, the correlation between eDiary difficulty with activities and SGRQ symptoms was not as predicted. Thus, the observed pattern only partly fulfilled the predictions (Table S1).

Consistency of treatment response over the severity range

If an improvement of 0.6 points on the mean total score was considered as the criterion for defining responders, it was found that the QVA149 treatment was associated with approximately a 50% response rate compared with a 30% response rate in placebo (Figure S2).

Figure S1 COPD exploratory eDiary (English for UK version).

Figure S1 COPD exploratory eDiary (English for UK version).
Figure S1 COPD exploratory eDiary (English for UK version).
Figure S1 COPD exploratory eDiary (English for UK version).
Figure S1 COPD exploratory eDiary (English for UK version).
Figure S1 COPD exploratory eDiary (English for UK version).

Figure S2 Cumulative distribution curves (point change) for the eDiary mean total score over all three time frames.

Abbreviation: eDiary, electronic patient diary.

Figure S2 Cumulative distribution curves (point change) for the eDiary mean total score over all three time frames.Abbreviation: eDiary, electronic patient diary.

Table S1 Correlations of eDiary items and summary scores against BDI and SGRQ score

References

  • BatemanEDFergusonGTBarnesNDual bronchodilation with QVA149 versus single bronchodilator therapy: the SHINE studyEur Respir J20134261484149423722616
  • BaldwinMJKulichKTipladyBGwaltneyCClineJEvaluation of an electronic daily diary for measuring morning symptoms in chronic obstructive pulmonary diseaseAm J Respir Crit Care Med2013187A2517
  • BaldwinMKulichKTipladyBGwaltneyCClineJSymptoms and impact of COPD assessed by a handheld electronic diaryPoster presented at: 2013 Meeting of the European Respiratory SocietySeptember 7–11, 2013Barcelona, Spain Poster P4903

Acknowledgments

The authors were assisted in the preparation of this manuscript by Saurabh Aggarwal and Kevin Roche (Novartis).

Supplementary materials

COPD patient eDiary

There were two diaries used in the SHINE study: main and exploratory. The main diary was completed by the majority of patients in the study and was reported previously.Citation1 Chronic obstructive pulmonary disease (COPD) exploratory electronic patient diary (eDiary), the subject of the present analysis, was used in a subset of 209 patients.Citation2,Citation3 The COPD exploratory eDiary was completed twice a day (morning and evening) throughout the study period where patients were randomized through Interactive Voice Response System. The exploratory eDiary, unlike the main diary, did not trigger alarm when symptoms worsened, and patients were instructed to contact the site when needed.

The severity and frequency of symptoms may not be the same as bothersomeness. Some symptoms might be frequent and severe but not as bothersome as others, even less frequent or severe. “Bothersomeness” and “difficulty with activities” were included in the eDiary to increase the ability to pick up these distinctions, which are likely to be important from the patient’s perspective. In addition, there were questions on the use of rescue medication (salbutamol/albuterol), awakenings, and a weekly assessment of change from baseline, rating symptoms, and impact on daily life. The SHINE study was approved by the independent ethics committee or the institutional review boards of each participating center and was conducted in accordance with the International Conference on Harmonization Guidelines for Good Clinical Practice and the Declaration of Helsinki. All patients provided written and signed informed consent before enrollment. The version of the eDiary used is shown below (Figure S1).

Statistical analysis

A multiple regression analysis approach was used to assess the relationship between the individual symptoms rated in the COPD eDiary and the assessment of bothersomeness. Validation used correlations between the eDiary assessments and other patient-reported outcome measures in the study at baseline, with a priori predictions concerning the convergence of items/subscales on the basis of content, specifically activities, impacts, and symptoms. The primary analysis used the St George’s Respiratory Questionnaire (SGRQ), which had a structure (symptoms, activities, and impacts) similar to that of the exploratory diary. A Spearman’s correlation matrix was presented for all the individual diary item scores, the total symptom score against the three factor scores, and the total from the SGRQ. Patients were classified as “improved” if they showed improvements of at least 120 mL in forced expiratory volume in 1 second (FEV1) and had rated improvement on both global items in the week 26 diary (ie, “a little better,” “moderately better,” or “a great deal better” for both items).

They were considered “worse” if FEV1 decreased by at least 120 mL between baseline and week 26 and ratings on the global change items of the diary on the week 26 rating indicate worsening (ie, “a little worse”, “moderately worse”, or “a great deal worse” for both items). The remaining patients were classified as “uncertain/no change”. Anchor-based methods used an external criterion to categorize patients into groups reflecting an a priori determined change grouping (eg, “no change”, “large improvement”, and “large deterioration”). The method used was similar to that for sensitivity, but used only the global change item.

To evaluate the consistency of treatment response across the severity range, cumulative distribution curves, using unblinded data for the five treatment groups, were produced using the change scores of the COPD eDiary total scores (both actual point change and percentage change).

Disclosure

Brian Tiplady is an employee of eResearch Technologies Ltd. He also works independently as a research consultant in the area of cognitive testing, and holds shares in AstraZeneca. Donald Banerji and Dorothy L Keininger are employees of Novartis. Károly Kulich was an employee of Novartis at the time of manuscript preparation. The SHINE study was sponsored by Novartis Pharma AG and is registered at ClinicalTrials.gov with the clinical trial identifier number NCT1202188. The authors report no other conflicts of interest in this work.

References

  • Global Initiative for Chronic Obstructive Lung Disease (GOLD)Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Pulmonary Disease2014 update [webpage on the Internet]Global Initiative for Chronic Obstructive Lung Disease, Inc2014 Available from: http://www.goldcopd.org/guidelines-global-strategy-for-diagnosis-management.htmlAccessed July 11, 2014
  • WedzichaJADonaldsonGCExacerbations of chronic obstructive pulmonary diseaseRespir Care200348121204121314651761
  • JonesPWQuirkFHBaveystockCMThe St George’s Respiratory QuestionnaireRespir Med199185Suppl B25311759018
  • DeshpandePRRajanSSudeepthiBLAbdul NazirCPPatient-reported outcomes: A new era in clinical researchPerspect Clin Res20112413714422145124
  • ByromBTipladyBePRO: Electronic Solutions for Patient-Reported DataSurreyGower2010
  • IrelandAMWiklundIHsiehRDalePO’RourkeEAn electronic diary is shown to be more reliable than a paper diary: results from a randomized crossover study in patients with persistent asthmaJ Asthma201249995296023033885
  • BjornerJBRoseMGandekBStoneAAJunghaenelDUWareJEMethod of administration of PROMIS scales did not significantly impact score level, reliability, or validityJ Clin Epidemiol201467110811324262772
  • StoneAAShiffmanSSchwartzJEBroderickJEHuffordMRPatient non-compliance with paper diariesBMJ200232473471193119412016186
  • StullDELeidyNKParasuramanBChassanyOOptimal recall periods for patient-reported outcomes: challenges and potential solutionsCurr Med Res Opin200925492994219257798
  • JonesPMiravitllesMvan der MolenTKulichKBeyond FEV1 in COPD: a review of patient-reported outcomes and their measurementInt J Chron Obstruct Pulmon Dis2012769770923093901
  • US Department of Health and Human Services Food and Drug AdministrationGuidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims2009Silver Spring, MDFDA Available from: www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM193282.pdfAccessed February 18, 2014
  • BatemanEDFergusonGTBarnesNDual bronchodilation with QVA149 versus single bronchodilator therapy: the SHINE studyEur Respir J20134261484149423722616
  • VogelmeierCFBatemanEDPallanteJEfficacy and safety of once-daily QVA149 compared with twice-daily salmeterol-fluticasone in patients with chronic obstructive pulmonary disease (ILLUMINATE): a randomised, double-blind, parallel group studyLancet Respir Med201311516024321804
  • DahlRChapmanKRRudolfMSafety and efficacy of dual bronchodilation with QVA149 in COPD patients: the ENLIGHTEN studyRespir Med2013107101558156723867808
  • WedzichaJADecramerMFickerJHAnalysis of chronic obstructive pulmonary disease exacerbations with the dual bronchodilator QVA149 compared with glycopyrronium and tiotropium (SPARK): a randomised, double-blind, parallel-group studyLancet Respir Med20131319920924429126
  • BaldwinMJKulichKTipladyBGwaltneyCClineJEvaluation of an electronic daily diary for measuring morning symptoms in chronic obstructive pulmonary diseaseAm J Respir Crit Care Med2013187A2517
  • BaldwinMKulichKTipladyBGwaltneyCClineJSymptoms and impact of COPD assessed by a handheld electronic diaryPoster presented at: 2013 Meeting of the European Respiratory SocietySeptember 7–11, 2013Barcelona, Spain Poster P4903
  • MahlerDAFaryniarzKTomlinsonDImpact of dyspnea and physiologic function on general health status in patients with chronic obstructive pulmonary diseaseChest199210223954011643921
  • TsiligianniIKocksJTzanakisNSiafakasNvan der MolenTFactors that influence disease-specific quality of life or health status in patients with COPD: a review and meta-analysis of Pearson correlationsPrim Care Respir J201120325726821472192
  • MahlerDAWeinbergDHWellsCKFeinsteinARThe measurement of dyspnea. Contents, interobserver agreement, and physiologic correlates of two new clinical indexesChest19848567517586723384
  • O’ConnorBPSPSS and SAS programs for determining the number of components using parallel analysis and velicer’s MAP testBehav Res Methods Instrum Comput200032339640211029811
  • ShroutPEFleissJLIntraclass correlations: uses in assessing rater reliabilityPsychol Bull197986242042818839484
  • HillemanDEDewanNMaleskerMFriedmanMPharmacoeconomic evaluation of COPDChest200011851278128511083675
  • JonesPWDonohueJFNedelmanJPascoeSPinaultGLassenCCorrelating changes in lung function with patient outcomes in chronic obstructive pulmonary disease: a pooled analysisRespir Res20111216122206353
  • KernsKDeckerSNMultifactorial assessment of reading disability: identifying the best predictorsPercept Mot Skills19856037477534022726
  • FraenkelLFalzerPFriedTMeasuring pain impact versus pain severity using a numeric rating scaleJ Gen Intern Med201227555556022081365
  • MorrenMvan DulmenSOuwerkerkJBensingJCompliance with momentary pain measurement using electronic diaries: a systematic reviewEur J Pain200913435436518603458
  • MahlerDAWardJWatermanLAMcCuskerCZuwallackRBairdJCPatient-reported dyspnea in COPD reliability and association with stage of diseaseChest200913661473147919696126
  • CohenJStatistical Power Analysis for the Behavioral SciencesNew York, NYAcademic Press1977