Abstract
Purpose: To evaluate the use of utility-based generic quality of life measures for establishing the minimally clinically important difference (MCID). Background: Utility-based quality of life measures place levels of wellness on a continuum anchored by death (0.00) and optimum function (1.00). Preference measurement studies are used to define the meaning of points along the continuum. Health states that differ by less than 0.03 units cannot be discriminated by panels of judges as different from one another. Thus, 0.03 is a reasonable MCID for these measures. Method: Three published studies of patients with Chronic Obstructive Pulmonary Disease (COPD) reported data on the Quality of Well-being Scale (QWB) before and after pulmonary rehabilitation. One of the studies also randomly assigned patients to lung volume reduction surgery or to maximal medical therapy. These patients were followed for an average of 29 months. Results: All three evaluations of pulmonary rehabilitation showed changes on the QWB in excess of the proposed 0.03 MCID. QWB changes for patients assigned to lung volume reduction surgery were close to the MCID threshold at one year but grew stronger in subsequent years. Using Norman's 0.50 standard deviation method, all three estimates of rehabilitation effectiveness and the outcomes one year following surgery fall below the MCID. Conclusion: Different methods for estimating MCID lead to different conclusions about the meaning of quality of life changes following pulmonary rehabilitation and lung volume reduction surgery. The preference scaling system in generic utility-based quality of life measures provides a metric that is directly interpretable and avoids many of the criticisms of MCID measures. The method is sensitive enough to suggest clinically meaningful benefits of rehabilitation and surgery. Further, quality adjusted life years offer a valuable metric for policy analysis. Utility-based measures of health related quality of life should gain greater use in COPD outcomes research.
Introduction
Clinical medicine has access to a remarkable array of measures. Patients with chronic obstructive pulmonary disease (COPD) are likely to be monitored using measures of arterial blood gases, diffusing capacities, and pulmonary function tests. Although these measures are crucial in charting the clinical course of disease, they are often poorly correlated with outcomes of importance to the patient Citation[[1]]. Increasingly common are measures of exercise capacity, endurance, and quality of life. Although these measures are directly relevant to the daily lives of patients, the scores yielded by the measures are often difficult to interpret. Estimating the clinical importance of differences on functional and quality of life measurements has been elusive Citation[[2]].
The minimally clinically important difference (MCID) has emerged as an important guide to the interpretation of clinical measures. MCID is defined as the smallest change or difference in an outcome measure that is perceived as beneficial Citation[[3]]. Scaling MCID has proven to be challenging and confusing Citation[4-6]. However, discussions of the methodological challenges of finding MCIDs, however overlook thepotential of utility-based generic measures of health related quality of life (HRQOL). These measures are constructed and scaled using units of patient preference. The interpretation of the measures is straightforward and the application of these approaches avoids many of the methodological complications and controversies.
The purpose of this paper is to propose the use of utility-based measures for outcome studies in COPD and to illustrate why the measures produce outcomes that are easily interpreted in units that are meaningful to patients, providers, and policy makers. We begin by introducing the concept of a quality adjusted life year (QALY). Then, the pitfalls in other approaches to the MCID will be discussed. Several lines of evidence will be used to illustrate the benefits of QALYs as outcome measures for studies in COPD.
The Quality-Adjusted Life Year
Traditional measures of health outcome are very general. They include life expectancy, infant mortality, and disability days. The difficulty with these indicators is that they do not reflect most of the benefits of health care. For example, life expectancy and infant mortality are good measures because they allow for comparisons between programs with different specific objectives. In addition, a year of life has clear intuitive meaning. There is little debate about the value of a program that extends the life expectancy by 10 years or a program that significantly reduces infant mortality. The difficulty is that neither life expectance nor infant mortality is sensitive to minor variations in health status. Treatment of most common illnesses may have relatively little effect on life expectancy. Infant mortality, although sensitive to socioeconomic variations, does not register the effect of health services delivered to people who are older than one year.
Survival analysis is an attractive generic measure of health status. Survival analysis gives a unit of credit for each year of survival. Suppose, for example, that a person has a life expectancy of eighty years and dies prematurely at age fifty. In survival analysis, they are scored as 1.0 for each of the first fifty years and zero each year there after. The problem is that years with disability are scored the same as those years in perfect health. For example, a person with severe COPD who is alive is scored exactly the same as someone in perfect health. To address this problem, we have proposed adjusted survival analysis. Using this method, we can summarize outcomes in terms of QALY's. In quality adjusted survival analysis, years of wellness are scored on a continuum ranging from 0 for death to 1.0 for optimum function Citation[[7]].
QALYs are measures of life expectancy with adjustments for quality of life Citation[7-9]. QALYs integrate mortality and morbidity to express health status in terms of equivalents of well-years of life. If a woman dies of COPD at age 50 and one would have expected her to live to age 75, the disease was associated with 25 lost life years. If 100 women died at age 50 (who also had a life expectancies of 75 years) 2,500 (100 women × 25 years) life years would be lost.
Death is not the only outcome of concern in COPD. Many adults suffer from the disease leaving them somewhat disabled over long periods of time. Although still alive, the quality of their lives has diminished. QALYs take into consideration the quality of life consequences of these illnesses. For example, a disease that reduces quality of life by one half will take away 0.5 QALYs over the course of one year. If it affects two people, it will take away 1 year (equal 2 × 0.5) over a one year period. A pharmaceutical treatment that improves quality of life by 0.2 for each of five individuals will result in the equivalent of one QALY if the benefit is maintained over a one-year period. The basic assumption is that two years scored as 0.5 add up to the equivalent of one year of complete wellness. Similarly, four years scored as 0.25 are equivalent to one completely well year of life. A treatment that boosts a patient's health from 0.5 to 0.75 produces the equivalent of 0.25 QALYs. If applied to four individuals and the duration of the treatment effect is one year, the effect of the treatment would be equivalent to one completely well year of life. This system has the advantage of considering both benefits and side-effects of programs in terms of the common QALY units.
An important aspect of these methodologies is the placement of health states on the continuum between death and wellness. This is illustrated with reference to the Quality of Well-being Scale (QWB-SA 1.04), a self-administered version of a previously validated and widely used measure of preference-based general health status Citation[[10]]. The QWB is a comprehensive measure of health-related quality of life that includes several components. First, it obtains observable levels of functioning from three separate scales: Mobility, Physical Activity, and Social Activity. Second, each patient identifies symptoms or problems that may have affected him or her over the past three days from a list of 58 items. Second the observed level of function and the subjective symptomatic complaint are weighted by preference, or the utility for the state, on a scale ranging from 0 (for dead) to 1.0 (for optimum function). The weights have been obtained from independent samples of judges who rated the desirability of observable health states. Several studies have shown that the weights do not vary significantly as a function of demographic variables, including race, income, and gender Citation[[11]]. Although the evidence is mixed, most evidence indicates that the weights do not vary dramatically as a function of prior experience with the rated health state Citation[[11]]. Using this system, it is possible to place the general health status of any individual on the continuum between death and optimal functioning for any specified time. Thus, the score for the QWB results in a summary score, a single number, which ranges from 0 (death) to 1.0 (optimal health).
Current Knowledge Relevant to COPD
Guyatt Citation[[12]] and Deyo et al. Citation[[13]] argue that measures must be evaluated in terms of their responsiveness. Responsiveness is defined as the ability of a measure to detect small but important clinical changes. The term sensitivity is also used asa synonym for responsiveness. However, we prefer the term responsiveness because its meaning is distinct from other meanings in the epidemiological literature. The MCID, which may be larger than a statistically detectable change between populations, has not been established or even evaluated for most HRQOL measures.
Guyatt and et al. Citation[[12]] suggested that the responsiveness of generic measures is related to treatment effect size. Responsiveness can be evaluated using three different methods: effect size (ES), standardized response mean (SRM), and the responsiveness statistic (RS) Citation[[14]]. All three indices characterize strength of change in response to random error. In each case, the numerator is the mean change. The methods differ in the denominator. The ES method uses the standard deviation at baseline, the SRM method uses the standard deviation of change from baseline, and the RS uses the standard deviation of change only for those people deemed not to show clinical response. The magnitude of change in response to the clinical intervention can be evaluated using guidelines originally proposed by Cohen Citation[[15]]. An effect size of 0.20 is considered a small clinical effect, 0.50 is a medium clinical effect, while 0.80 or larger is considered to be a large clinical effect size. Studies typically show that the effect size is smaller for generic measures in comparison to disease-targeted measures.
In contrast to statistical approaches, such as the standard error of measurement or the half standard deviation Citation[[16]], several authors propose that clinical changes be scaled for importance using human judgments. Wells et al. argued that the MCID should be scaled using the clinical judgments of patients Citation[[6]]. Wyrich used a nine person expert panel to suggest meaningful differences on the chronic respiratory questionnaire (CRQ) and the Medical Outcome Study 36 Item Short Form (SF-36) Citation[[17]]. Guyatt et al. made the distinction between population-focused and individual-focused measures Citation[[4]]. Population-focused approaches define the response of an individual in relation to an entire population. For example, a patient with a decline in FEV1.0 from one liter to 70 ml might have a significant probability of QOL loss. Individual-focused approaches require judgments about the smallest changes that patients perceive to be important. These approaches might also consider the proportion of patients who have achieved this MCID.
The poor reliability of clinical judgments has been challenged in a variety of ways Citation[[18]]. There are obvious biases depending on perspective, there are measurement problems, and the conclusions are often based on small samples of judges. Further, the meanings of changes in a particular disease domain are often difficult to interpret in the context of overall health. Policy makers, for example, struggle with the comparison of an MCID for patients with COPD in relation to an MCID for patients with arthritis, heart failure, or other significant chronic illness.
The following section proposes that the QALY be used to define the MCID. This has several advantages. First, QALYs scale clinical changes on a well-defined continuum ranging from 0 for death to 1.0 for full functioning without symptoms. Second, QALYs are constructed using community-based preference studies. Thus, problems of small samples, biased participants and non-representative judges are avoided. A third advantage of QALYs is that they can be readily used for public policy analysis.
Development of MCID for QWB
The original studies that validated the QWB submitted hundreds of case descriptions to judges in order to find values for health states along the 0.0 to 1.0 continuum Citation[[19]]. These studies demonstrated that cases with values closer together than 0.03 units on the 0.0 to 1.0 continuum could not be reliably rated as “different” by the judges. Thus, we believe a difference must be at least 0.03 units on this scale to be clinically meaningful and that the MCID for the QWB is about 0.03 units Citation[[20]]. The remainder of this paper offers evidence that the 0.03 difference on the QWB is a meaningful MCID for clinical and policy studies. We illustrate the point using data from three published studies of COPD patients.
Method
Measure
The self-administered version of the Quality of Well-Being Scale (QWB-SA) is a comprehensive measure of health-related quality of life that includes five sections: acute symptoms, chronic symptoms, self care, mobility, and social activity Citation[[1]]Citation[[10]]Citation[[19]]Citation[[21]]. The observed level of function and the subjective symptomatic complaints are weighted by preference, or the utility for the state, on a scale ranging from 0 (for dead) to 1.0 (for optimum function. The QWB-SA has been used in a wide variety of clinical and population studies Citation[21-24] to evaluate therapeutic interventions in a range of medical and surgical conditions.
Subjects
We report pre and post rehabilitation QWB scores from three published clinical trials. The first trial, reported by Ries and colleagues Citation[[25]], included 119 COPD patients participating in a randomized clinical trial of rehabilitation in COPD. The rehabilitation program consisted of 12 four hour sessions spread over eight weeks. The program emphasized education, physical and respiratory care instruction, psychosocial support, and supervised exercise.
The second trial, also from the Ries group, evaluated 164 female moderate to severe COPD patients participating in a randomized clinical trial of maintenance of rehabilitation benefits Citation[[26]]. The rehabilitation program was essentially the same as in the first Ries et al. study. However all patients participated in rehabilitation and the randomization occurred after pulmonary rehabilitation. We used QWB scores taken before and after the rehabilitation phase.
The third trial was the National Emphysema Treatment Trial (NETT) Citation[[27]]. The NETT trial included 1,218 participants. For the analyses reported here, we deleted three cases with missing QOL data, leaving 1,215 cases for analysis. Participants came from all 17 NETT sites. A more detailed description of the NETT methodology is available. Following screening all participants completed comprehensive pulmonary rehabilitation. A second assessment was completed no more than 21 days prior to randomization. The NETT rehabilitation program was similar to that described by Ries and colleagues Citation[[26]]. In this paper we focus on previously reported pre-post rehabilitation change.
Surgery Effect (NETT)
The major intervention evaluated in the NETT was Lung Volume Reduction Surgery (LVRS). Patients were randomly assigned to either maximal medical therapy or to LVRS. Those assigned to LVRS received the procedure using one of two approaches: video assisted thoracoscopy (VATS) and median sternotomy. Details of the study and its outcomes have been published Citation[[28]].
Results
summarizes the changes on the QOL measures following the rehabilitation phase for the three studies. The table gives the pre-rehabilitation score, the post-rehabilitation score, change scores (pre post), standard deviation for change, and one-half standard deviation values. The NETT study used the QWB-SA while the two Ries studies used the original QWB. QWB and QWB-SA are highly correlated but mean QWB-SA scores are typically 0.10 lower than QWB scores Citation[[29]]. The change in QWB across the three studies was remarkably similar (range − 0.031 to − 0.034). This suggests that, on average, participants improved about 0.03 units on the 0 to 1.0 scales. The final column in gives one-half standard deviation change, which is the value for the MCID recommended by Norman Citation[[16]]. For the QWB, Norman's proposed MCID ranged from 0.058 to 0.079. Using Norman's criterion, the effects of rehabilitation, although statistically significant, fall below the MCID for each of the three studies.
The QWB methodology uses ratings of health states by independent judges to estimate levels of wellness or severity of disease impact. In a series of studies we have observed the median standard deviation for ratings for case descriptions to be 0.201 Citation[[11]]Citation[[30]]. Assuming this constant standard deviation, we estimated the MCID using three methods: 0.5 standard deviation for change, standard error of the mean, and 95% confidence interval. In this analysis, we used the pre-post rehabilitation change in the NETT trial as the standard deviation of change and we did not vary the estimate by sample size. We use the NETT in this example because it is the largest and best controlled among the three studies. As a result, we used a constant estimate of the Standard Deviation of 0.117 and we repeat in the MCID of 0.058. The MCID as estimated by the standard error of the mean and confidence interval methods are also shown in . Using the confidence interval method, the MCID for the utility-based QWB would be estimated to be less than 0.01 if the sample size was greater than 2,000. Although studies vary in sample size, we picked a base case with a sample size of 200. This yields a confidence interval based MCID of 0.0278. For these discussions, we rounded that number up to 0.03.
The NETT trial also combined morbidity and mortality outcomes using the QWB measure. In May of 2001, enrollment in the NETT was halted for a subgroup that the Data Safety and Monitoring Board (DSMB) determined to be at high risk Citation[[31]]. Patients with FEV1.0 levels equal to or less than 20 percent of predicted and either a homogeneous emphysema distribution or less than or equal to 20 percent of the predicted carbon monoxide diffusing capacity were excluded from enrollment. summarizes characteristics of the remaining 1078 lung reduction surgery patients at baseline.Of particular importance is that the QWB scores were almost identical. summarizes the cumulative mean QALYs per person in the surgery and the medical arms of the trial at one, two, and three years of follow-up. At year one, the mean difference is right on the borderline of the 0.03 criterion for an MCID with the QWB. It is noteworthy that the benefit of surgery is less than the observed benefit of rehabilitation. However, rehabilitation was not evaluated in the RCT component of the study. As time from randomization accumulates, differences between the LVRS and medical arm grow larger. Some of this gain is due to differences in mortality while the other component is associated with improvements in quality of life.
Discussion
Interpretation and Recommendations
Defining a meaningful clinical difference for patients with COPD has been difficult and elusive. A variety of authors have proposed statistical approaches, such as the standard error of measurement or one-half standard deviation of a change score Citation[[16]]. Others have argued that judgment about the meaning of clinical differences must be assessed from patients or from clinicians Citation[[4]]Citation[[6]]. All of these approaches have encountered significant methodological challenges.
One approach that has not been widely advocated requires the use of utility-based measures of health-related quality of life. These measures are widely advocated for policy analysis and are in common use in clinical research settings Citation[[8]]. An important feature of these methods is that they scale health outcomes on a continuum ranging from death (0.0) through full functioning without symptoms (1.0). Further, the preferences are typically obtained from representative samples of the general population. A component of scale construction considers the smallest difference in health states that can be judged as distinct by human observers. For the Quality of Well-being Scale, this difference is about 0.03 units. Thus, 0.03 units along the continuum between death and optimum function might be considered the MCID. There have been only a few other attempts to estimate MCID for utility-based measures. Walters and Brazier Citation[[32]] estimated MCID anchored by SF-36 global rating scores for a variety of medical conditions. For COPD patients, they estimated that the MCID for the EQ-5D was 0.011 while the MCID for the SF-6D was 0.37. Although many different conditions were considered, the MCID for the SF-6D ranged from 0.011 to 0.097, with a mean of 0.043. Thus, the median MCID is similar to our estimate MCID of 0.03 for the QWB. The analyses summarized in this paper suggest that changes following pulmonary rehabilitation exceed the MCID in three separate evaluations when using the proposed threshold. However, using other MCID methods, each study would fail to meet the MCID criterion. The authors believe the preference based MCID is both clinically justifiable and sensitive.
The generic nature of the QWB and related scales offers many advantages for clinical research. First, these measures offer a meaningful metric that is anchored at one end by death and at the other end by wellness. The difference of 0.03 units is a small but significant difference along this continuum. A second advantage is that the measures scale outcomes in relation to death. In fact, mortality is combined with morbidity in the calculation of the index. This offers a distinct advantage in clinical trials that have mixtures of mortality and non-mortality outcomes. The third advantage is that utility-based outcome measures can be used to estimate the benefits of interventions in terms of equivalents of life years. A patient would need to achieve an MCID of 0.03 units for about 33 years for the treatment to produce a benefit equal to a full year of healthy life. Thirty-three patients who achieved the MCID benefit over the course of one year would collectively experience the benefit of one full year of life.
In addition to these features, QALYs offer significant advantages for public policy analysis. Since outcomes are expressed in generic meaningful units, comparisons can be made between very different investments in health care. Typically, these analyses consider costs in addition to QALY benefits. summarizes the cost per QALY for a variety of interventions. Coronary artery bypass graft surgery in comparison to medication, for example, produces a QALY at a relatively low cost. LVRS on the other hand, produces QALYs but does so at a cost higher than other interventions.
In criticizing disease-specific approaches, many investigators believe that all diseases and disabilities affect overall quality of life by affecting functioning and self-perceptions of health status. In fact, the purpose of quality of life measurement is not to identify clinical information limited to the disease. Instead, it seeks to determine the impact of the disease on general function. For example, a low FEV1.0 may be associated with shortness of breath, weakness, and increased risk of mortality. Medications used to control COPD might cause headaches, irritability, and general confusion Citation[[33]]. By focusing too specifically on clinical correlates of disease, it is argued, the general impact is overlooked. Even though some disease-targeted measures cover a fairly wide range of domains and include items that are important to patients, the measures might still fail to capture unanticipated effects of the disease or its treatment. Conversely, general quality of life measures adequately capture a wide variety of dysfunctions associated with pulmonary diseases. This dysfunction might be in many different systems and be reflected in symptoms such as confusion, tiredness, sexual impotence, and depression, or others. These outcomes may not be specific to the disease or condition. Thus, the question of whether disease specific questionnaires are required for each condition remains open Citation[34&35].
The method for estimating the MCID proposed here is fundamentally different than methods proposed by other authors. As Norman (post conference correspondence) argues, placing two health states side by side and asking judges to estimate whether they are different from one another is a fundamentally different task than asking patients or clinicians how much clinical change has occurred. Indeed, it is likely that the side-by-side comparisons will yield smaller MCIDs. That was the case with data we presented here. Since there is no standard methodology for estimating MCID, the future standard must emerge from continuing research and debate.
In summary, QALYs may offer a neglected opportunity to estimate the clinical value of interventions. Estimating the MCID from QALYs can be derived directly from the methodology. We encourage greater use of these methods for outcomes research involving COPD patients.
REFERENCES
- Kaplan R M, Atkins C J, Timms R. Validity of a quality of well-being scale as an outcome measure in chronic obstructive pulmonary disease. J Chronic Dis 1984; 37(2):85–95. [PUBMED], [INFOTRIEVE]
- Prutkin J M, Feinstein A R. Quality-of-life measurements: origin and pathogenesis. Yale J Biol Med Mar–Apr 2002; 75(2):79–93. [CSA]
- Jaeschke R, Singer J, Guyatt G H. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials Dec 1989; 10(4):407–415. [PUBMED], [INFOTRIEVE], [CROSSREF]
- Guyatt G H, Osoba D, Wu A W, Wyrwich K W, Norman G R. Methods to explain the clinical significance of health status measures. Mayo Clin Proc Apr 2002; 77(4):371–383. [PUBMED], [INFOTRIEVE], [CSA]
- Beaton D E, Boers M, Wells G A. Many faces of the minimal clinically important difference (MCID): a literature review and directions for future research. Curr Opin Rheumatol Mar 2002; 14(2):109–114. [PUBMED], [INFOTRIEVE], [CSA], [CROSSREF]
- Wells G, Beaton D, Shea B, Boers M, Simon L, Strand V, Brooks P, Tugwell P. Minimal clinically important differences: review of methods. J Rheumatol Feb 2001; 28(2):406–412. [PUBMED], [INFOTRIEVE]
- Kaplan R, Anderson J. The general health policy model: an integrated approach. In: Spilker B. ed. Quality of Life and Pharmacoeconomics in Clinical Trials. New York: Raven, 1996:309–322.
- Gold M R. Cost-Effectiveness in Health and Medicine. New York: Oxford University Press, 1996.
- Russell L B. The methodologic partnership of effectiveness reviews and cost-effectiveness analysis. Am J Prev Med Apr 2001; 20(3 suppl):10–12. [PUBMED], [INFOTRIEVE], [CSA], [CROSSREF]
- Kaplan R M, Ganiats T G, Sieber W J, Anderson J P. The Quality of Well-Being Scale: critical similarities and differences with SF-36 [see comments]. Int J Qual Health Care 1998; 10(6):509–520. [PUBMED], [INFOTRIEVE], [CSA], [CROSSREF]
- Kaplan R M. Value judgment in the Oregon Medicaid experiment. Med Care 1994; 32(10):975–988. [PUBMED], [INFOTRIEVE]
- Guyatt G H, King D R, Feeny D H, Stubbing D, Goldstein R S. Generic and specific measurement of health-related quality of life in a clinical trial of respiratory rehabilitation. J Clin Epidemiol 1999; 52(3):187–192. [PUBMED], [INFOTRIEVE], [CSA], [CROSSREF]
- Deyo R A, Diehr P, Patrick D L. Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials 1991; 12(4 suppl):142S–158S. [PUBMED], [INFOTRIEVE]
- Hays R D, Anderson R, Revicki D. Assessing reliability and validity of measurement in clinical trials. In:. In: Staquet M, Hays R D, Fayers P, eds. Quality of Life Assessment in Clinicial Trials: Methods and Practice.. Oxford: Oxford University Press, 1998:169–182.
- Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. In:Hillsdale N J, ed. 2nd ed. L. Erlbaum Associates, 1988.
- Norman G R, Sloan J A, Wyrwich K W. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care May 2003; 41(5):582–592. [PUBMED], [INFOTRIEVE], [CROSSREF]
- Wyrwich K W, Fihn S D, Tierney W M, Kroenke K, Babu A N, Wolinsky F D. Clinically important changes in health-related quality of life for patients with chronic obstructive pulmonary disease: an expert consensus panel report. J Gen Intern Med Mar 2003; 18(3):196–202. [PUBMED], [INFOTRIEVE], [CSA], [CROSSREF]
- Norman G R, Stratford P, Regehr G. Methodological problems in the retrospective computation of responsiveness to change: the lesson of Cronbach. J Clin Epidemiol 1997; 50(8):869–879. [PUBMED], [INFOTRIEVE], [CSA], [CROSSREF]
- Kaplan R M, Bush J W, Berry C C. Health status: types of validity for an index of well-being. Health Serv Res 1976; 11(4):478–507. [PUBMED], [INFOTRIEVE]
- Kaplan R M, Feeny D, Revicki D A. Methods for assessing relative importance in preference based outcome measures. In Joyce C RBE, Hannah M, McGee E, et al., (eds). Individual Quality of Life: Approaches to Conceptualisation and Assessment. Amsterdam, 1999:135–149.
- Kaplan R M, Anderson J P, Patterson T L, McCutchan J A, Weinrich J D, Heaton R K, Atkinson J H, Thal L, Chandler J, Grant I. Validity of the quality of well-being scale for persons with human immunodeficiency virus infection. HNRC group. HIV neurobehavioral research center. Psychosom Med 1995; 57(2):138–147. [PUBMED], [INFOTRIEVE], [CSA]
- Kaplan R M, Alcaraz J E, Anderson J P, Weisman M. Quality-adjusted life years lost to arthritis: effects of gender, race, and social class. Arthritis Care Res 1996; 9(6):473–482. [PUBMED], [INFOTRIEVE], [CSA]
- Pyne J M, Patterson T L, Kaplan R M, Gillin J C, Koch W L, Grant I. Assessment of the quality of life of patients with major depression. Psychiatr Serv 1997; 48(2):224–230. [PUBMED], [INFOTRIEVE], [CSA]
- Rocco M V, Gassman J J, Wang S R, Kaplan R M. Cross-sectional study of quality of life and symptoms in chronic renal disease patients: the modification of diet in renal disease study. Am J Kidney Dis 1997; 29(6):888–896. [PUBMED], [INFOTRIEVE], [CSA]
- Ries A L, Kaplan R M, Limberg T M, Prewitt L M. Effects of pulmonary rehabilitation on physiologic and psychosocial outcomes in patients with chronic obstructive pulmonary disease. Ann Intern Med 1995; 122(11):823–832. [PUBMED], [INFOTRIEVE], [CSA]
- Ries A L, Kaplan R M, Myers R, Prewitt L M. Maintenance after pulmonary rehabilitation in chronic lung disease: a randomized trial. Am J Respir Crit Care Med Mar 15 2003; 167(6):880–888. [CSA], [CROSSREF]
- The National Emphysema Treatment Trial Research Group. Rationale and design of the national emphysema treatment trial: a prospective randomized trial of lung volume reduction surgery. Chest Dec 1999; 116(6):1750–1761. [CROSSREF]
- Fishman A, Martinez F, Naunheim K, Piantadosi S, Wise R, Ries A, Weinmann G E, Wood D E. A randomized trial comparing lung-volume-reduction surgery with medical therapy for severe emphysema. N Engl J Med May 22 2003; 348(21):2059–2073. [PUBMED], [INFOTRIEVE]
- Kaplan R M, Sieber W J, Ganiats T G. The quality of well-being scale: comparison of the interviewer-administered version with a self-administered questionnaire. Psychol Health 1997; 12(6):783–791.
- Kaplan R M, Bush J W, Berry C C. Health status index: category rating versus magnitude estimation for measuring levels of well-being. Med Care May 1979; 17(5):501–525. [PUBMED], [INFOTRIEVE]
- Patients at high risk of death after lung-volume-reduction surgery. N Engl J Med Oct 11 2001; 345(15):1075–1083. [CSA], [CROSSREF]
- Walters S, Brazier J. Is there a constant relationship between the minimally importnat difference and health state utility values? Qual Life Res 2003; 12(7):797.
- Cohn J N, Tognoni G, Glazer R D, Spormann D, Hester A. Rationale and design of the valsartan heart failure trial: a large multinational trial to assess the effects of valsartan, an angiotensin-receptor blocker, on morbidity and mortality in chronic congestive heart failure. J Card Fail Jun 1999; 5(2):155–160. [PUBMED], [INFOTRIEVE], [CSA], [CROSSREF]
- Drossman D A, Patrick D L, Whitehead W E, Toner B B, Diamant N E, Hu Y, Jia H, Bangdiwala S I. Further validation of the IBS-QOL: a disease-specific quality-of-life questionnaire. Am J Gastroenterol 2000; 95(4):999–1007. [PUBMED], [INFOTRIEVE], [CROSSREF]
- Borstlap M, Zant J L, van Soesbergen R M, van der Korst J K. Quality of life assessment: a comparison of four questionnaires: for measuring improvements after total hip replacement. Clin Rheumatol 1995; 14(1):15–20. [PUBMED], [INFOTRIEVE], [CSA]
- Kaplan R M, Ries A L, Reilly J, Mohsenifar Z. Measurement of health-related quality of life in the national emphysema treatment trial. Chest Sep 2004; 126(3):781–789. [PUBMED], [INFOTRIEVE], [CROSSREF]
- Ramsey S D, Patrick D L, Albert R K, Larson E B, Wood D E, Raghu G. The cost-effectiveness of lung transplantation. A pilot study. University of Washington medical center lung transplant study group. Chest Dec 1995; 108(6):1594–1601. [PUBMED], [INFOTRIEVE]
- Ramsey S D, Berry K, Etzioni R, Kaplan R M, Sullivan S D, Wood D E. Cost effectiveness of lung-volume-reduction surgery for patients with severe emphysema. N Engl J Med May 22, 2003; 348(21):2092–2102. [PUBMED], [INFOTRIEVE]
- Smith K J, Pesce R R. Pulmonary artery catheterization in exacerbations of COPD requiring mechanical ventilation: a cost-effectiveness analysis. Respir Care Oct 1994; 39(10):961–967. [PUBMED], [INFOTRIEVE], [CSA]
- Griffiths T L, Phillips C J, Davies S, Burr M L, Campbell I A. Cost effectiveness of an outpatient multidisciplinary pulmonary rehabilitation programme. Thorax Oct 2001; 56(10):779–784. [PUBMED], [INFOTRIEVE], [CROSSREF]