112
Views
1
CrossRef citations to date
0
Altmetric
Original Research

Mapping of Multiple Sclerosis Walking Scale (MSWS-12) to five-dimension EuroQol (EQ-5D) health outcomes: an independent validation in a randomized control cohort

, &
Pages 13-18 | Published online: 03 Feb 2016

Abstract

Background

Mapping of patient-reported outcomes to the five-dimension EuroQol (EQ-5D) health index is increasingly being used for understanding the relationship of outcomes to health states and for predicting utilities that have application in economic evaluations. The 12-item Multiple Sclerosis Walking Scale (MSWS-12) is a patient-reported outcome that assesses the impact of walking impairment in people with MS. An equation for mapping the MSWS-12 to the EQ-5D was previously developed and validated using a North American Research Committee on MS (NARCOMS) registry cohort.

Materials and methods

This analysis retested the validity of the equation mapping the MSWS-12 to the three-level EQ-5D (EQ-5D-3L) by using an independent cohort of patients with MS enrolled in a randomized controlled trial. Mapping was evaluated at two separate time points (baseline and week 4) during the clinical trial. The mapping equation’s performance was subsequently assessed with mean absolute error (MAE) and root-mean-square error (RMSE) by comparing equation-based estimates to values elicited in the trial using the actual EQ-5D-3L questionnaire.

Results

The mapping equation predicted EQ-5D-3L values in this external cohort with reasonable precision at both time points (MAE 0.116 and RMSE 0.155 at baseline; MAE 0.105 and RMSE 0.138 at week 4), and was similar to that reported in the original NARCOMS cohort (MAE 0.109 and RMSE 0.145). Also as observed in the original NARCOMS cohort, the mapping equation performed best in patients with EQ-5D-3L values between 0.50 and 0.75, and poorly in patients with values <0.50.

Conclusion

The mapping equation performed similarly in this external cohort as in the original derivation cohort, including a poorer performance in MS patients with more severe health-state severity.

Introduction

Multiple sclerosis (MS) is a progressive neurologic disease that is characterized by axonal demyelination in the central nervous system, resulting in action-potential-conduction deficits that are believed to contribute to the clinical symptoms experienced by people with MS.Citation1,Citation2 While these symptoms include visual deficits, weakness, paralysis, numbness, and other sensory disturbances, walking impairment is the most visible symptom, and is considered a hallmark of MS. MS has a profound impact on patient function and quality of life (QoL), with walking impairment and its effects on mobility in particular substantially contributing to the patient burden.Citation3Citation5

The 12-item MS Walking Scale (MSWS-12) is a patient-reported measure that was developed to facilitate assessment of the impact of MS on walking impairment from the patient’s perspective. While the MSWS-12 is increasingly being used in clinical trials, observational studies, and clinical practice, it lacks the ability to measure health utilities that are generally used in economic evaluations. A commonly used technique for adapting such outcomes for economic evaluations is regression-based mapping, which maps the outcome measure of interest to a health-utility index,Citation6 such as the five-dimension, three-level EuroQol (EQ-5D-3L).Citation6 The EQ-5D-3L is a widely used generic patient-reported measure that enables both evaluation of health-related QoL (HRQoL) and generation of health-utility scores for use in economic analyses.Citation7

An equation to map the MSWS-12 onto the EQ-5D-3L health-utility index in North American patients with MS has been developed.Citation8 This equation, which was derived and validated in >3,500 MS patients from the North American Research Committee on MS (NARCOMS) registry, has been shown to predict EQ-5D-3L scores using individual MSWS-12 item scores with reasonable precision, especially in patients with moderate disease severity. Unfortunately, due to a lack of availability of another independent North American or US data set for MS patients that contains both the MSWS-12 and the EQ-5D-3L, the equation has never been further validated.

A randomized controlled trial (DER-401) was conducted to evaluate the safety and efficacy of 5 mg and 10 mg doses of dalfampridine extended-release tablets versus placebo in patients with MS.Citation9 While the primary objective of this trial was to evaluate change in walking speed as measured by the Timed 25-Foot [7.62 m] Walk, both the MSWS-12 and the EQ-5D-3L health-status questionnaire were administered. Therefore, DER-401 provided an opportunity to independently validate the MSWS-12 to the EQ-5D-3L mapping equation in an external cohort of MS patients.

Materials and methods

Data for the additional validation of the original mapping equation were taken from DER-401 (clinicaltrials.gov registration: NCT01328379), a multicenter (65 centers in the US), randomized, parallel-group trial designed to assess the safety and efficacy of two doses of dalfampridine extended release and placebo in patients with MS.Citation9 Eligibility was determined during an initial screening visit; qualifying participants returned 1 week later (visit 1, baseline) and were randomized in a 1:1:1 ratio to twice-daily treatment with dalfampridine 5 mg, 10 mg, or placebo. At 4 weeks after initiating treatment, study participants returned for their final safety and efficacy assessments (visit 3). As part of DER-401, the MSWS-12 and the EQ-5D-3L were both assessed at baseline and week 4.

The EQ-5D-3L is a validated, generic, preference-based, health-status measure consisting of five descriptive questions encompassing five domains of HRQoL (mobility, self-care, usual activities, pain/discomfort, anxiety/depression).Citation10 Each question is answered based on three response options (1= “no problems”, 2= “moderate problems”, 3= “severe problems”), with the 243 potential patterns of responses enabling classification of a participant into a distinct health state associated with a specific index score. For the US general population, the possible EQ-5D-3L index scores range from −0.11 (ie, 3-3-3-3-3) to 1.0 (ie, 1-1-1-1-1) on a scale where 0.0= death and 1.0= perfect health.Citation11 The EQ-5D-3L was scored using the US scoring algorithm in both the original NARCOMS validation study and DER-401.

The MSWS-12 is a validated, patient-reported outcome measure assessing the extent to which MS impacts an individual’s walking ability.Citation12 The MSWS-12 comprises 12 questions concerning different aspects of walking function and quality that are rated on a scale ranging between 1 (not at all) and 5 (extremely) (see Table S1). Individual item scores are summed to achieve a total score that ranges from 12 to 60. This total score is then transformed to achieve a range of 0–100, with higher scores reflecting a greater impact of MS on walking.

Participants in the DER-401 study who completed both the EQ-5D-3L and MSWS-12 outcome measures at baseline and week 4 were included in this analysis. MSWS-12 data at both time points of DER-401 were applied to the previously derived mapping equation to elicit predicted EQ-5D-3L values. This mapping equation was derived using over 3,500 participants (mean EQ-5D-3L and MSWS-12 scores 0.74±0.18 and 50.8±33.5, respectively) in the NARCOMS registry using ordinary least squares regression.Citation8 The equation EQ-5D-3L = 0.002× (item 1) −0.009× (item 2) −0.01× (item 3) −0.029× (item 4) −0.019× (item 5) −0.0000881× (item 6) −0.008× (item 7) −0.002× (item 8) +0.013× (item 9) −0.011× (item 10) +0.001× (item 11) −0.008× (item 12) +0.983 uses all of the individual MSWS-12 item scores to estimate EQ-5D-3L index scores with a mean absolute error (MAE) of 0.109±0.096. These predicted EQ-5D-3L values were then compared to observed EQ-5D-3L values from DER-401 using the actual EQ-5D-3L health-status index questionnaire.

The precision of our original mapping equation was assessed in the DER-401 cohorts by calculating the MAE (the average of the absolute difference between observed EQ-5D-3L and predicted EQ-5D-3L values) and root-mean-square error (RMSE; the positive square root of the average squared prediction error), which attaches greater weight to larger errors. In addition, the percentage of EQ-5D-3L estimates within various absolute errors of the actual value was calculated, along with goodness-of-fit statistics when the sample was stratified by different levels of EQ-5D-3L health-state severity (EQ-5D-3L score <0.50, 0.50–0.75, and ≥0.75). Finally, scatterplots of predicted versus observed EQ-5D-3L values at baseline and week 4 were constructed.

Descriptive statistics are reported as means ± standard deviations for continuous data and percentages for categorical data. All analyses and reporting are consistent with the National Institute for Health and Clinical Excellence Decision Support Unit’s technical support document for using mapping methods to estimate health-state utility values.Citation13

Results

As shown in , there were some differences in the NARCOMS and DER-401 populations, including a higher proportion of females in the NARCOMS population, which was also older and reported a likely clinically relevant lesser impact of MS on walking ability. In the DER-401 population, total MSWS-12 score and scores for all individual items were consistently lower at week 4 than at baseline, reflecting an improvement in patient-reported walking ability, and the EQ-5D-3L score was higher, suggesting an improvement in the health index.

Table 1 Characteristics of the NARCOMS and DER-401 cohorts

Statistics depicting the mapping equation’s precision at both the baseline (n=429) and week 4 time points in DER-401 (n=398) are provided in and . The mapping equation was most accurate in the DER-401 cohort at week 4, as indicated by the slightly lower values for both the MAE and RMSE (), although precision was not markedly different than that seen at baseline. High accuracy was consistently observed at both baseline and week 4 for EQ-5D-3L scores 0.50–<0.75, as indicated by the lowest MAE and RMSE values (); the lowest accuracy was observed for EQ-5D-3L scores <0.50 at both time points.

Table 2 Precision of the NARCOMS ordinary least squares mapping equation applied to data from study DER-401Table Footnotea

Table 3 Percentage of predicted EQ-5D-3L values within ranges of absolute error of observed value in DER-401 relative to data from the original validation study

More than half of the EQ-5D-3L estimates in DER-401 were within 10% of the observed value at both the baseline (56.3%) and week 4 (58.7%) time points (). These estimates of precision were generally similar to those observed in the initial NARCOMS cohort, which showed that 49.4% of the estimates were within 10% of the observed value ().

and depict scatterplots of observed versus predicted EQ-5D-3L values for the DER-401 cohort at baseline and week 4. These plots show that at EQ-5D-3L scores <0.50, the mapping equation overestimated the observed health-state utility. Conversely, the mapping equation underestimated health-state utility in cases of perfect health (EQ-5D-3L score of 1.0).

Figure 1 Scatterplot of observed versus predicted EQ-5D-3L scores for the DER-401 cohort at baseline.

Note: Data points lying closest to the diagonal line (representing the line of perfect fit) illustrate more precise estimates of observed EQ-5D-3L scores.
Abbreviations: DER, dalfampridine extended release; EQ-5D-3L, EuroQol 5-dimension 3-level version.
Figure 1 Scatterplot of observed versus predicted EQ-5D-3L scores for the DER-401 cohort at baseline.

Figure 2 Scatterplot of observed versus predicted EQ-5D-3L scores for the DER-401 cohort at week 4.

Note: Data points lying closest to the diagonal line (representing the line of perfect fit) illustrate more precise estimates of observed EQ-5D-3L scores.
Abbreviations: DER, dalfampridine extended release; EQ-5D-3L, EuroQol 5-dimension 3-level version.
Figure 2 Scatterplot of observed versus predicted EQ-5D-3L scores for the DER-401 cohort at week 4.

Discussion

Results of this analysis suggest that the previously derived and validated mapping equation using each individual item of the MSWS-12 predicted EQ-5D-3L values in the DER-401 cohort with similar precision as in the original NARCOMS cohort.Citation8 Notably, the differences between MAE and RMSE values were small, indicating only low variance for the individual errors in the sample. Moreover, visual inspection of the MAE and RMSE values combined with the subgroup analysis that stratified patients by observed EQ-5D-3L values suggested that the mapping equation performed best among patients with moderate EQ-5D-3L health-state values (ie, EQ-5D-3L scores 0.50–0.75) and performed less optimally in patients with more severe health states (ie, EQ-5D-3L scores <0.50). The overestimation for more severe EQ-5D-3L health states is also consistent with other studies.Citation14

In addition to the validation study in the NARCOMS population,Citation8 two other studies have been published that mapped MSWS-12 to EQ-5D-3L.Citation15,Citation16 Hawton et alCitation15 developed a mapping equation from a sample of MS patients in the UK and using the UK scoring algorithm for the EQ-5D. The UK and NARCOMS scoring equations performed similarly in their distinct populations, with MAEs approximating 0.10. However, while this degree of error in EQ-5D-3L prediction may not be optimal, it is not unexpected, as the MSWS-12 measures self-reported walking limitations due to MS while the EQ-5D-3L is a generic measure of health status. The other study used data from a clinical trial to map the MSWS-12 to the EQ-5D-3L using both the NARCOMS-based equation and the one derived from the UK to evaluate the relationship between change in MSWS-12 and health utilities.Citation16 The results of that study, which showed that improvements in MSWS-12 with treatment translated into improvements in health-utility scores regardless of which mapping equation was used, suggest the use of mapping for potentially understanding the relationship between specific disease-related outcomes and overall health status.

While mapping equations are useful for attempting to predict how changes in a measure for a specific outcome may impact generic HRQoL measures, it is likely that targeted, disease-specific measures, such as the MSWS-12, capture only a portion of information contained in broader measures of HRQoL or general health. In this instance, the equation was less precise at predicting health-state values at extreme ends of the range. It is important to note that mobility is a single domain of the multidimensional EQ-5D-3L, while the MSWS-12 is used to assess walking. Therefore, the use of mapping equations, such as the one described here, to estimate EQ-5D-3L health-state index values may be less than ideal, and should only be used when directly measured EQ-5D-3L values are not available. Despite these caveats associated with this technique, the National Institute for Health and Clinical Excellence’s Decision Support Unit endorses the use of mapping equations in these instances, and provides guidance to aid in the development and validation of mapping equations.Citation13 These recommendations support the use of an external sample to validate mapping equations. At the time of the original mapping study,Citation8 no external population was available. Instead, the NARCOMS cohort was randomly split into derivation and validation cohorts, with the final equation refined using the entire cohort. With the emergence of the DER-401 study that collected both MSWS-12 and EQ-5D-3L data in a North American population, it was prudent to validate MSWS-12 to EQ-5D-3L mapping further using the derived equation.

In summary, independent evaluation in an external population is an important step in confirming the validity of mapping equations to estimate health-state index values. The NARCOMS-based mapping equation performed in a consistent manner in this external randomized trial cohort to the original cohort, including a poorer performance in MS patients with more severe health-state severity. For this reason, additional efforts to improve the existing equations would be helpful. This may be achieved by recalibrating the equation in a study population consisting of a larger proportion of patients with severe disability. Of note, revisions to the MSWS-12 questionnaire are ongoing,Citation17 and it is possible that as improvements to the MSWS-12 are made, more accurate mapping equations may arise, although they too will need to undergo external validation. The availability of accurate and reliable mapping can enhance the evaluation of health status in these individuals when HRQoL assessments have not directly been made, and the results of such mapping have the additional potential for use in economic analyses.

Supplementary material

Table S1 The 12-item Multiple Sclerosis Walking Scale (MSWS-12)

• These questions ask about limitations to your walking due to MS during the past 2 weeks.

• For each statement, please circle the one number that best describes your degree of limitation.

• Please answer all questions even if some seem rather similar to others, or seem irrelevant to you.

• If you cannot walk at all, please tick this box.□

References

  • HobartJCRiaziALampingDLFitzpatrickRThompsonAJMeasuring the impact of MS on walking ability: the 12-item MS Walking Scale (MSWS-12)Neurology2003601313612525714

Disclosure

Dr Coleman received a grant from Acorda Therapeutics and fees from Acorda Therapeutics for board membership and consultancy. Dr Sidovar is an employee of Acorda Therapeutics, Inc. and recieves compensation and securities from the firm. The authors have no other conflicts of interest in this work.

References

  • WaxmanSGConduction in myelinated, unmyelinated, and demyelinated fibersArch Neurol19773410585589907529
  • SmithKJMcDonaldWIThe pathophysiology of multiple sclerosis: the mechanisms underlying the production of symptoms and the natural history of the diseasePhilos Trans R Soc Lond B Biol Sci199935413901649167310603618
  • SutliffMContribution of impaired mobility to patient burden in multiple sclerosisCurr Med Res Opin201026110911919916707
  • SalterARCutterGRTyryTMarrieRAVollmerTImpact of loss of mobility on instrumental activities of daily living and socioeconomic status in patients with MSCurr Med Res Opin201026249350020014979
  • LaRoccaNImpact of walking impairment in multiple sclerosis: perspectives of patients and care partnersPatient20114318920121766914
  • DakinHReview of studies mapping from quality of life or clinical measures to EQ-5D: an online databaseHealth Qual Life Outcomes20131115124010873
  • EuroQol GroupEuroQol – a new facility for the measurement of health-related quality of lifeHealth Policy199016319920810109801
  • SidovarMFLimoneBLLeeSColemanCIMapping the 12-item multiple sclerosis walking scale to the EuroQol 5-dimension index measure in North American multiple sclerosis patientsBMJ Open201335e002798
  • YapundichRApplebeeABethouxFEvaluation of dalfampridine extended release 5 and 10 mg in MS; a randomized, controlled trialInt J MS Care201517313814526052259
  • BrooksREuroQol: the current state of playHealth Policy1996371537210158943
  • ShawJWJohnsonJACoonsSJUS valuation of the EQ-5D health states: development and testing of the D1 valuation modelMed Care200543320322015725977
  • HobartJCRiaziALampingDLFitzpatrickRThompsonAJMeasuring the impact of MS on walking ability: the 12-item MS Walking Scale (MSWS-12)Neurology2003601313612525714
  • LongworthLRowenDNational Institute for Health and Clinical Excellence (NICE) Decision Support Unit (DSU)Technical Support Document 10: The use of mapping methods to estimate health state utility values Available from: http://www.nicedsu.org.uk/TSD%2010%20mapping%20FINAL.pdfAccessed September 5, 2015
  • RowenDBrazierJRobertsJMapping SF-36 onto the EQ-5D index: how reliable is the relationship?Health Qual Life Outcomes200972719335878
  • HawtonAGreenCTelfordCWrightDZajicekJThe use of multiple sclerosis condition-specific measures to inform health policy decision-making: mapping from the MSWS-12 to the EQ-5DMult Scler201218685386122108867
  • LimoneBLSidovarMFColemanCIEstimation of the effect of dalfampridine on health utility by mapping the MSWS-12 to the EQ-5D in multiple sclerosis patientsHealth Qual Life Outcomes20131110523799913
  • HobartJCanoSIngramWZajicekJA new path for the MS Walking Scale: MSWS-12 version 2Mult Scler2012184334335