2,442
Views
2
CrossRef citations to date
0
Altmetric
Original Article

The psychometric properties of the Evaluation of Daily Activity Questionnaire in seven musculoskeletal conditions

ORCID Icon, ORCID Icon, , & ORCID Icon
Pages 2070-2080 | Received 12 Nov 2016, Accepted 21 Apr 2017, Published online: 08 May 2017

Abstract

Purpose: The purpose of this study is to psychometrically test the Evaluation of Daily Activity Questionnaire in seven musculoskeletal conditions.

Materials and methods: One thousand and two hundred people with ankylosing spondylitis; osteoarthritis; systemic lupus erythematosus; systemic sclerosis; chronic pain; chronic upper limb disorders; or Primary Sjögren’s syndrome completed the Evaluation of Daily Activity Questionnaire, Health Assessment Questionnaire and Short-Form Health Survey v2. We examined internal construct validity using Rasch analysis, internal consistency, concurrent validity with the Health Assessment Questionnaire and Short-Form Health Survey v2. Participants repeated the Evaluation of Daily Activity Questionnaire to assess test–retest reliability.

Results: The 12 domains satisfied Rasch model expectations for fit, local dependency, unidimensionality and invariance by age and gender, in each musculoskeletal condition. Internal consistency was consistent with individual use (Cronbach’s α > 0.90); concurrent validity was strong (Health Assessment Questionnaire: rs = 0.60–0.92; Short-Form Health Survey v2 Physical Function: rs = −0.61 to −0.91) and test–retest reliability excellent (Intra-Class Correlation Coefficient(2,1) = 0.77–0.96).

Conclusion: The Evaluation of Daily Activity Questionnaire satisfied Rasch model requirements for construct validity and has good reliability and validity in each MSC. The Evaluation of Daily Activity Questionnaire can be used as a measure of everyday activity in practice and research with people with musculoskeletal conditions.

    Implications for rehabilitation

  • The Evaluation of Daily Activity Questionnaire evaluates users’ ability to perform common daily activities (in 12 domains) that were identified as problematic by people with seven musculoskeletal conditions (i.e., osteoarthritis, systemic lupus, ankylosing spondylitis, chronic pain, chronic upper limb conditions, systemic sclerosis, Sjogren’s syndrome).

  • Most patients considered the Evaluation of Daily Activity Questionnaire was the right length and would be helpful for discussing everyday problems with an occupational therapist.

  • The 12 domains have good reliability and validity and can be combined into two components: Self-Care and Mobility.

  • The Evaluation of Daily Activity Questionnaire is suitable for use both in clinical practice and research and a User Manual is available for therapists and researchers.

Introduction

A fifth of adults have long-term musculoskeletal conditions; a third of whom experience activity limitations [Citation1]. In the UK, over 3 million adults with musculoskeletal conditions are disabled by pain, fatigue, reduced hand function, and/or mobility restrictions [Citation2]. Thorough assessment is needed to effectively identify activity abilities and participation but few rheumatology occupational therapists in the United Kingdom (UK) use standardised measurement tools during their assessments. This is because measurement tools commonly used in rheumatology out-patient clinics and research (e.g., the Health Assessment Questionnaire [Citation3] and the Arthritis Impact Measurement Scales 2 [Citation4]) include too few activities to be of use for treatment planning. Many occupational therapy departments have, therefore, devised their own non-standardised checklists, with differing activities and rating scales [Citation5,Citation6]. Unfortunately, such checklists cannot be used for research and audit, or within clinical practice to evaluate changes in clients’ abilities, as they lack validity and reliability.

The Evaluation of Daily Activity Questionnaire was developed in the early 1990s in Sweden to address these problems. It is a patient-reported outcome measure evaluating common symptoms and measuring, in depth, activity limitations in rheumatoid arthritis [Citation7,Citation8]. Patients normally complete it at home, allowing them time to reflect on their abilities and activity limitations. It normally takes between 25 and 35 min to complete [Citation6]. During appointments, therapists can then quickly focus on the problems identified, reducing the need for detailed interviews. We have already developed an English Evaluation of Daily Activity Questionnaire, which has recently been linguistically and culturally validated for use in the UK (from the original Swedish version) [Citation9,Citation10] and shown to be psychometrically robust for use with patients with rheumatoid arthritis [Citation11]. Each of the 12 Evaluation of Daily Activity Questionnaire domains is unidimensional and these domains cluster into two components: Self-Care and Mobility (see ; and Supplementary Document S2).

Table 1. Domains within the self-care and mobility components of the evaluation of daily activity questionnaire.

The Evaluation of Daily Activity Questionnaire has also been used in other musculoskeletal conditions in Sweden [Citation12–14] but has not been psychometrically tested. Thus, the aim of this paper is to assess the psychometric properties of the Evaluation of Daily Activity Questionnaire with other musculoskeletal conditions to assess its suitability for use in clinical practice and research. As a first step we demonstrated content validity of the Evaluation of Daily Activity Questionnaire to ensure it reflects the symptoms, condition impact and activity limitations experienced by people with other musculoskeletal conditions, as these could differ from rheumatoid arthritis [Citation15]. The musculoskeletal conditions were ankylosing spondylitis; osteoarthritis; systemic lupus erythematosus; systemic sclerosis [scleroderma]; chronic (i.e., >3 months) pain (i.e., fibromyalgia; widespread, back or neck pain); chronic hand/upper limb disorders; and Primary Sjögren’s Syndrome [Citation15]. The conditions included are those most frequently referred to Rheumatology occupational therapists. While other musculoskeletal conditions are prevalent, these are either less often referred to occupational therapy (e.g., polymyositis) or have similar impacts on daily activities as rheumatoid arthritis (e.g., psoriatic arthritis). During the study, although a condition infrequently referred to occupational therapy, the opportunity arose to include people with Primary Sjögren’s Syndrome. We now report the internal construct validity; internal consistency; concurrent validity and test–retest reliability.

Materials and methods

Participants and data collection

Ethical approval was obtained from the Greater Manchester West Research Ethics Committee (11/H1014/5) and the University of Salford Research Ethics Panel. To ensure as representative as sample as possible we used a range of recruitment strategies: from National Health Service (NHS) out-patient departments (19 Rheumatology, three Orthopaedic/Hand clinics); four General Practices; the UK Primary Sjögren’s Syndrome Registry; and randomly selected members of 10 patient organisations: the National Ankylosing Spondylitis Society; Lupus UK; Raynaud’s and Scleroderma Society; Scleroderma Society; Back Care; Fibroaction; the Fibromyalgia Association; the British Sjögren’s Syndrome Association; RSI Action (a repetitive strain injury organisation); and a private physiotherapy practice linked with RSI Action.

Potential participants were invited to participate by research nurses or occupational therapists in the NHS sites, and by staff in the patient organisations, in person, by mail or via the organisations’ websites. Those recruited via patient organisations completed telephone screening and consent procedures with a member of the research team (Y. P.).

Participants meeting the following criteria were eligible: a confirmed diagnosis of one of the seven musculoskeletal conditions; ability to read, write and understand English; no change in any disease-modifying medication (which could affect test-retest reliability) in the last three months (and not about to); and no other medical condition(s) limiting their activities of daily living. Other medical conditions associated with that musculoskeletal condition were acceptable, e.g., people with systemic lupus erythematosus could also have secondary osteoarthritis, fibromyalgia or internal organ involvement.

After providing informed written consent, participants were given or mailed a questionnaire booklet to complete at home and return by mail. The booklet included: questions to describe the recruited population: age, gender, marital, educational and employment status, disease duration and medication regimen, as well as the measures described below. Two to three weeks later, participants were mailed the Evaluation of Daily Activity Questionnaire to complete at home a second time (to evaluate test–retest reliability). Two reminders were sent if necessary.

Measurement instruments

The English Evaluation of Daily Activity Questionnaire includes two parts: Part 1 comprises 10 numerical rating scales, scored on a 0 (no) to 10 (severe) scale, to assess symptom severity, mood and life satisfaction. Part 2 comprises 120 activities in 12 domains, scored on a 3-point (0 = no difficulty, 3 = unable to do) scale which assesses ability to perform daily activities. If the person would not normally perform that activity, there is a “not applicable” option. For example, if they had never learnt to drive then “drive a car, e.g., holding a steering wheel, turning car keys or changing gear” would be “not applicable”. Each item is answered twice on the same page by rating performance without (Section A) and then with (Section B) ergonomic solutions (e.g., alternative methods, assistive devices, environmental modifications). Items are summed to produce total scores for Sections A and B within each domain, with any score reductions between Sections A and B denoting the impact of ergonomic solutions on improving activity ability. If there are missing items within a domain, a total domain score cannot be calculated. Higher scores indicate greater activity limitations [Citation8,Citation10,Citation11]. The EDAQ and EDAQ Manual are available for download [Citation9,Citation10].

The comparator health measures selected are those widely used in Rheumatology, validated in a range of musculoskeletal conditions and pragmatic choice as the same questionnaire was used across all conditions [Citation16].

The Medical Outcomes Survey 36 item Short-Form Health Survey version 2 (known as the SF36v2) includes 36 items from which sub-scales of Physical Function, Bodily Pain, Vitality and Mental Health can be calculated using Quality Metric Health Outcomes™ Scoring Software 4.5 [Citation17–20]. Lower scores denote worse health states.

The Health Assessment Questionnaire includes ability to perform 20 daily activities rated on a 0–3 scale (0 = not at all difficult, 3 = unable to do) [Citation3] using the Health Assessment Questionnaire 20 method, in which the total score is obtained by summing all 20 items (0–20 = mild; 21 = 40 = moderate; and 41–60 = severe disability). This method was used as the Health Assessment Questionnaire 20 does not weight items worse if an assistive device is used, as occurs when normally scoring the Health Assessment Questionnaire [Citation21,Citation22]. Higher scores denote greater activity limitations.

Hand pain was measured using a numeric rating scale of pain in the hand and wrists during moderate activities (e.g., cooking a meal, doing housework, doing light gardening) in the past week on a 0 (no) to 10 (severe) scale.

The Quality of Life Scale measures satisfaction with participation (e.g., work, relationships, health) in 16 items on a 7-point scale (1 = terrible to 7 = delighted) [Citation23]. Lower scores denote worse quality of life.

Perceived health status was measured using a 5-point numeric rating scale asking “Considering all the ways that your condition affects you, how have you been over the past month?” (1 = very good: no symptoms and no limitations to normal daily activities to 5 very poor: very severe symptoms and inability to carry out most activities).

Perceived change in health status: At Test 2 only, this was measured using a 5-point numeric rating scale by asking “Overall, how much is your arthritis troubling you now compared to when you last completed this questionnaire a few weeks ago?”: (1 = much less; 2 = somewhat less; 3 = about the same; 4 = somewhat more; 5 = much more).

Acceptability of the Evaluation of Daily Activity Questionnaire: Closed questions were included to identify participants’ views about whether the Evaluation of Daily Activity Questionnaire would be helpful in discussions with occupational therapists (not at all, a little, moderately, very); and the number of activities included in the Evaluation of Daily Activity Questionnaire (too many, about right, too few).

Sample size

As Rasch analysis was used to assess the construct validity of the Evaluation of Daily Activity Questionnaire Part 2, a sample size of at least 150 in each musculoskeletal condition was recruited. This number was determined from the need to ensure that a uniform distribution of patients was obtained across the construct of activity limitation, so that the precision of the estimate of both persons and items, across the construct, remains similar and a sufficient number of cases were collected within each musculoskeletal condition group to test for invariance across groups [Citation24]. The sample does not need to be representative of the selected population, as the mathematical model is independent of distribution, but it should have a good distribution across the activity limitation domain, as well as sufficient cases within each diagnostic group [Citation24]. At least, 79 sets of repeated responses were required in each musculoskeletal condition to demonstrate that a test–retest correlation of 0.7 differs from a background correlation (constant) of 0.45, with 90% power at the 1% significance level. A test re-test correlation of 0.7 is deemed a minimum acceptable level [Citation25].

Statistical analyses

For Part 2 Evaluation of Daily Activity Questionnaire domains, total scores for each domain were summed from the raw scores for Sections A and B. Domain scores were summed to form the two component (Self-Care and Mobility) scores (see ). Non-parametric statistics were used for classical psychometric testing as scores are ordinal.

Internal construct validity of the Evaluation of Daily Activity Questionnaire was tested through fit of data to the Rasch measurement model [Citation26]. This process of Rasch analysis involves a series of tests of various assumptions such as stochastic ordering, local independence and unidimensionality [Citation27]. Following an iterative process, the scale is assessed and, (if necessary) revised. The process is described in detail elsewhere [Citation28,Citation29]. Briefly, the stochastic ordering is assessed through fit statistics. Given perfect fit to the Rasch model, the (z-standardised) item and person residuals would have a mean value of 0 and a SD of 1. If the SD >1.4 then, broadly speaking, this is an indicator that there may be issues at the individual item level. If the mean value is positive, then this indicates that, on an average, the items are under-discriminating, and if the mean value is negative, then this indicates that, on an average, the items are over-discriminating. The Chi-square p values for each item (domain) should be non-significant (Bonferroni adjusted), indicating no deviation from model expectations. Unidimensionality is tested in a post-hoc procedure introduced by Smith [Citation30]. Two independent sets of items were selected to derive two separate estimates of the trait for each individual. Under the assumption of unidimensionality, no difference in these estimates is expected. This was tested by a series of t-tests (one for each individual) [Citation30], and the proportion of significant t-tests should be <5% to indicate unidimensionality. The property of invariance across groups (Differential Item Functioning), is tested for by age, gender and condition groups [Citation24,Citation26,Citation27,Citation31]. Ideal Fit and other indicators are shown at the bottom of the fit table. The unrestricted partial-credit model was used [Citation32] using RUMM 2030 software [Citation33].

In the current study, the Rasch analysis was used to test the 12 domain, two component model of the Evaluation of Daily Activity Questionnaire Part 2 (developed in our previous study in rheumatoid arthritis [Citation11]) in each of the seven musculoskeletal conditions. (As the domain level approach was utilized in the RA validation, this same approach was retained for practicality and consistency). That is, the items within each domain (e.g., Eating) were summated into a domain score which was then entered into the analysis as 12 “super items” or testlets [Citation34]. These were also subsequently grouped into the two components of Self Care and Mobility. If data are found to satisfy Rasch model assumptions, data can be transformed from an ordinal to an interval scale using Rasch transformation tables, if required [Citation35,Citation36]. Normally, summed (ordinal) total scores are calculated for Evaluation of Daily Activity Questionnaire domains. However, Rasch transformation to an interval scale allows for reliability testing using intra-class correlation coefficients (ICC(2,1)) and calculation of sensitivity to change statistics.

Internal consistency was tested using the Person Separation Index, obtained in the Rasch analysis, and Cronbach’s alpha. Results of ≥0.8 are seen as good to excellent [Citation37]. Both should be interpreted in the same way, with a value ≥0.85 consistent with individual-level use, and a value >0.7 consistent with group-level use.

Concurrent validity was tested in each musculoskeletal condition using Spearman’s correlations by comparing the numeric rating scale scores in the Evaluation of Daily Activity Questionnaire Part 1 for pain, fatigue and mood with the SF36v2 Bodily Pain, Vitality (fatigue) and Mental Health scales, and the scores for each Part 2 domain were compared with: the Health Assessment Questionnaire 20; SF-36v2; hand pain numeric rating scale; Quality of Life Scale; and differing perceived health status question (as detailed above). Correlations are interpreted as: very strong (0.8–1.00); strong (0.6–0.79); moderate (0.4–0.59); weak (0.20–0.39); and very weak (0.00–0.19) [Citation37]. We hypothesised that there would be strong positive correlations between Evaluation of Daily Activity Questionnaire domain scores and Health Assessment Questionnaire 20 scores and strong negative correlations with the SF36v2 Physical Function scale, as these measures also assess activity limitations. We hypothesised that there would be moderate negative correlations with SF36v2 Bodily Pain, SF36v2 Vitality and Quality of Life scale measures, and moderate positive correlations with hand pain and perceived health as these factors are known to influence or are influenced by activity limitations.

Discriminant validity was tested using Kruskal–Wallis tests to evaluate differences in Part 2 domain scores for each musculoskeletal condition in the different perceived health status groups.

Test–retest reliability was assessed for those stating they were “about the same” at Test 2, using linear weighted kappa for numeric rating scales of Part 1 and each activity in Part 2 [Citation38]. Levels of agreement are interpreted as <0.20 = poor; 0.21–0.40 = fair; 0.41–0.60 = moderate; 0.61–0.80 = good; 0.81–1.00 = very good [Citation39]. Intra-class correlation coefficients (ICC(2,1: two-way random, consistency, average measures model in SPSS) for Rasch transformed Evaluation of Daily Activity Questionnaire domain scores (see below) were also calculated with a 95% confidence interval. An intra-class correlation coefficient ≥0.75 was considered to be excellent [Citation40].

Sensitivity to change was assessed with the Standard Error of Measurement and the Minimal Detectable Change95 score (i.e. a statistical estimate of the smallest detectable change corresponding to change in ability) [Citation41,Citation42]. These cannot be calculated from Evaluation of Daily Activity Questionnaire domain scores which are summed from ordinal data [Citation43]. Accordingly, Rasch transformed scores for the 12 Evaluation of Daily Activity Questionnaire domains, conditional upon fit to the model, for each condition, were first created [Citation10]. Raw scores for each Evaluation of Daily Activity Questionnaire domain were first transformed to the metric (in logits) then linearly transformed to produce an interval-level scale of the same range for each domain for each condition. Rasch transformed scores were then used to calculate the Standard Error of Measurement and the Minimal Detectable Change95.

Floor and ceiling effects were considered present if >15% of participants achieved either the lowest (floor, i.e., at, or close to, zero) or highest (ceiling, i.e., at, or close to, the maximum) scores in any domain [Citation44,Citation45]. For the EDAQ, lower scores represent fewer difficulties, and higher scores represent more difficulties.

Acceptability was assessed by calculating the percentages of optional responses for the number of activities in the Evaluation of Daily Activity Questionnaire and its helpfulness in discussing daily activity problems with an occupational therapist.

The Statistical Package for Social Science v20 [Citation46] was used for validity and reliability analyses and MedCalc [Citation47] for linear weighted kappa for Part 1 numeric rating scales and Part 2 individual item reliability testing.

Results

Participants

Overall, 1231 NHS patients were screened, of whom 908 (74%) were eligible and willing to take part. About 3365 letters were mailed via patient organisation and 615 (18%) members responded. Of these 1523 people, 1414 (93%) consented and 1205 (85%) returned the Test 1 questionnaires. Participants recruited from the NHS or patient organisations within each musculoskeletal condition were not significantly different in age, gender or condition duration. However, groups were different for educational level in ankylosing spondylitis, chronic pain and chronic hand/upper limb disorders, with patient organisation members having higher educational attainment (data not shown). Five were withdrawn from the Chronic Upper Limb Disorders group as they did not have eligible conditions, meaning 1200 (84.5%) participated: 691 (58%) from the NHS and 509 (42%) from patient organisations. Test 2 was returned by 943 (79%) participants. Median time between Test 1 and Test 2 was 49 (inter-quartile range 42–64) days. Participant descriptors are detailed in .

Table 2. Demographic and health status characteristics of participants for each musculoskeletal condition (n = 1200).

Internal construct validity

Rasch analyses of the seven domains of the Self-Care Component indicated good fit to the model within each musculoskeletal condition (), items (domains) were free from Differential Item Functioning apart from Differential Item Functioning -by-gender in Cooking (Chronic Upper Limb Conditions) and Cleaning the House (Ankylosing Spondylitis). For the five domains of the Mobility component (), the overall fit statistics were also good within each musculoskeletal condition. Items (domains) within all musculoskeletal conditions were free from Differential Item Functioning, apart from Differential Item Functioning-by-gender in Moving and Transfers (Osteoarthritis). Both components were shown to be unidimensional with the exception of Chronic Pain in Self Care. Further detailed Rasch analysis of the items sets within each domain (i.e., summating to the domain level) can be found in the Supplementary Tables S1–S7.

Table 3. Rasch analysis summary for the self-care component for each musculoskeletal condition.

Table 4. Rasch analysis summary for the mobility component for each musculoskeletal condition.

Additionally, all conditions were pooled to assess Differential Item Functioning by condition. If Evaluation of Daily Activity Questionnaire domain-items work in the same way across conditions, Evaluation of Daily Activity Questionnaire scores could be directly compared between them. A random, similarly sized sample of data from the previous rheumatoid arthritis study [Citation11] was also included in this analysis. In the Self-Care component, only Personal Care and Laundry/Clothes Care were free from Differential Item Functioning. In the Mobility component, only Moving around Outdoors/Shopping was free from Differential Item Functioning. Consequently, post-hoc Tukey tests were conducted to determine which domains were different across conditions, with pairwise tests for each between-condition comparison. Following DIF identification, domain-item splitting then accounted for any cross-conditional Differential Item Functioning present and the analysis calibration remains linked by the common items. Differential Item Functioning-splitting was done on an iterative basis, with the item displaying the largest Differential Item Functioning resolved first. This analysis identified a calibrated common metric for each of the Self-Care and Mobility components, where all cross-conditional Differential Item Functioning has been accounted for. Supplementary Tables 10 and 11 show the breakdown of where Differential Item Functioning splitting was necessary to obtain an unbiased calibration. As a result, Rasch transformation tables were also developed to allow comparison of Evaluation of Daily Activity Questionnaire domain scores between conditions [Citation10].

Internal consistency

In all musculoskeletal conditions, internal consistency (Person Separation Index) for the Self-Care and Mobility components was consistent with group-level use (i.e., >0.7) ( and ) and Cronbach’s alpha was good to excellent (i.e., ≥0.85, consistent with individual level use) in almost all 12 Evaluation of Daily Activity Questionnaire domains (apart from Communication in systemic sclerosis ((α = 0.83), indicating the components and individual domains could be used individually as well as collectively ().

Table 5. Reliability and validity testing of the EDAQ Part 2 for each musculoskeletal condition (n = 1200).

Concurrent validity

In Part 1, there were moderate to very strong correlations between comparable numeric rating scales from Part 1 and SF36v2 Mental Health, Vitality and Bodily Pain scales (rs = −0.53 to −0.84; Supplementary Table S8). In Part 2, most (i.e., 75% or more) Evaluation of Daily Activity Questionnaire domains correlated:

  • very strongly/strongly with Health Assessment Questionnaire20 (rs: 0.60 to 0.92) and SF36v2 Physical Function (rs: −0.61 to −0.91) ();

  • moderately/strongly with SF36v2 Bodily Pain (rs: −0.40 to −0.75), Hand Pain (rs: 0.40–0.67) () and Perceived Health status (rs:0.40–0.75) (Supplementary Table S9);

  • moderately with SF36v2 Vitality (rs:−0.40 to −0.59) and the Quality of Life Scale (rs:−0.40 to −0.56) (Supplementary Table S9).

Discriminant validity

Parts 1 and 2 showed very good discriminant validity. In all seven musculoskeletal conditions, all the Part 1 numeric rating scales and each Part 2 domain showed significant differences (p < 0.001) between those who perceived their health status to be good/very good; fair; or poor/very poor (data not shown).

Test–retest reliability

Test–retest reliability for Part 1 was moderate to good (Supplementary Table S8) and for Rasch transformed data for Part 2 domains were excellent (ICC(2,1 ≥ 0.9 for most tests) (). Linear weighted kappa scores for individual items in Part 2 showed moderate to very good test-retest reliability across most domains for most conditions (data not shown).

Sensitivity to change

Most Minimal Detectable Change95 scores ranged from 0.27 to 6.00, although some were higher (Supplementary Table S9).

Floor and ceiling effects

All Part 2 domains across most conditions demonstrated some floor effects, with the highest floor effects observed in the ankylosing spondylitis and Primary Sjögrens Syndrome groups in the following domains: Eating, Personal Care, Cooking, Laundry and Communication. No ceiling effects were seen in the domains.

Acceptability

There was a slightly lower response rate for the Acceptability questions. Most (986/1120: 88%) considered that the Evaluation of Daily Activity Questionnaire included about the right amount of activities, or could have been longer; and most (869/1147:76%) considered it would be helpful or very helpful for discussing everyday problems with an occupational therapist.

Discussion

The Evaluation of Daily Activity Questionnaire is a robustly constructed, acceptable, valid, reliable measure of daily activity in these seven musculoskeletal conditions, as well as in rheumatoid arthritis [Citation11]. It includes the commonest activity limitations people with these conditions experience. It thus meets the needs of occupational therapists and physiotherapists for a comprehensive patient reported outcome measure of activity ability for use across the commonest conditions referred to rheumatology and musculoskeletal rehabilitation services. This overcomes therapists’ perceived limitations of physical function measures widely used in Rheumatology (such as the Health Assessment Questionnaire), i.e., as being too short to aid treatment planning, insufficient to show change following rehabilitation and inappropriately worsening scores if assistive devices are used [Citation5,Citation6]. It could also be particularly helpful for junior staff to use, to aid their assessment and treatment planning, who may be less aware of these client groups’ potential problems.

The Evaluation of Daily Activity Questionnaire differs from other measures of activity ability, used in musculoskeletal conditions, in that it distinguishes between intrinsic disability (i.e., without ergonomic and environmental modifications, i.e., Part 2, Section A) and actual disability (i.e., with such modifications, i.e., Part 2, Section B). Furthermore, the Evaluation of Daily Activity Questionnaire aims to engage people in the process of identifying their own problems (Part 2, Section A), reflecting on effectiveness of their existing solutions (Part 2, Section B) and empowering them to problem solve, with the aid of a therapist, when necessary. As one participant in the development phase stated: “At first you think a lot doesn’t apply to me…but it does when you think about it…it helped me a lot to see there could be solutions… the questionnaire makes you think about your arthritis” [Citation15]. The content was generated by people with rheumatoid arthritis and musculoskeletal conditions [Citation6,Citation7,Citation15], as opposed to other physical function assessments commonly used in musculoskeletal research and practice, in which items were generated by health professionals [Citation3,Citation4]. This contributed to the Evaluation of Daily Activity Questionnaire’s high levels of acceptability by respondents, despite its length.

There is increasing pressure on rehabilitation services to make appointments more efficient. This patient reported outcome measure, completed at home in advance of appointments, can speed up assessment (as it reduces the timed needed to interview clients), increasing the time available to collaboratively problem-solve, discuss and try out treatment options and thus potentially improve the effectiveness of and clients’ satisfaction with therapy services.

The Evaluation of Daily Activity Questionnaire meets most of the recommendations for patient reported outcome measures of the United States Food and Drug Administration [Citation48] and the COnsensus‐based Standards for the selection of health Measurement INstruments (COSMIN) checklist [Citation49], apart from responsiveness which requires evaluation within a clinical trial or clinical setting. Consequently, the Evaluation of Daily Activity Questionnaire can be used in research and audit, as well as clinical practice. In future, domains could be used as item banks to support computer adaptive testing.

The results show that the 12 domain, two component structure (Self-Care and Mobility), developed for people with rheumatoid arthritis [Citation11], also fits for these other seven musculoskeletal conditions. The results were also similar to the findings in the rheumatoid arthritis study [Citation11]. There were minor differences between genders (Differential Item Functioning) but this was probably affected by the nature of items in some domains and smaller numbers of male participants for some musculoskeletal conditions. For example, men may be more likely to climb ladders (in the House and Garden Maintenance domain). As this structure is robust and satisfies Rasch model expectations, raw scores for items in each domain and component, in each musculoskeletal condition, can be summed to create both total domain and the two component scores. Consequently, individual domains or components can be used in practice or research to meet the needs of the client or research being conducted. Rasch transformation tables for each condition can be used if parametric analyses are required which convert the ordinal total score to an interval scale. These can be found in the Evaluation of Daily Activity Questionnaire manual [Citation10]. As we identified Differential Item Functioning by condition, this indicates that the raw Evaluation of Daily Activity Questionnaire scores are not directly comparable between different conditions. However, if comparison between conditions is required, cross-conditional Rasch transformation tables are available for this purpose [Citation10].

The limitations of the Evaluation of Daily Activity Questionnaire for these musculoskeletal conditions are that floor effects were evident across most domains and conditions. The highest floor effects were observed in the ankylosing spondylitis and Primary Sjögrens Syndrome groups in the Eating, Personal Care, Cooking, Laundry and Communication domains, as participants had few limitations in these activities. Most ankylosing spondylitis participants were men and we identified during the content validity phase that many men did not have limitations in these domains as their hands were unaffected. However, women with ankylosing spondylitis did experience hand problems and found these domains problematic [Citation15]. Thus the items were retained. For the Primary Sjögrens Syndrome group, activity limitations are more often influenced by fatigue than hand function limitations. Furthermore, while test–retest reliability results were moderate to excellent overall, the retest period was longer than planned. Although we analysed data only for those perceiving themselves “about the same” as when completing Test 1, participants’ status may not have been stable. In particular, this may account for why Part 1 scales had moderate reliability.

Over a third of respondents were recruited from patient organisations, which potentially could affect the representativeness of the findings, as such groups are often thought to be better educated than clinic populations. This was the case in our samples in three condition groups. However, the key demographic and condition duration factors were very similar in people recruited from the different sources. We consider our wide recruitment strategies to be a strength rather than a weakness as it meant we were able to recruit a broader swathe of the population, than just those who attended clinic during the recruitment period.

Conclusion

The Evaluation of Daily Activity Questionnaire is a psychometrically robust, comprehensive measure of activity limitations which can now be used with a wide range of musculoskeletal conditions. Either the whole Evaluation of Daily Activity Questionnaire, either component or the individual domains can be used in clinical practice to identify clients’ daily activity problems and help find solutions, or as an outcome measure in research and audit. Further work is needed to assess the responsiveness of the Evaluation of Daily Activity Questionnaire and its implementation into clinical practice. The Evaluation of Daily Activity Questionnaire also has the potential to be relevant for other client groups (e.g., other musculoskeletal conditions, neurological conditions, such as multiple sclerosis), although further research would be needed to establish content validity in these.

The Evaluation of Daily Activity Questionnaire, a user manual and support materials are available for use by patients, clinicians and researchers [Citation9,Citation10,Citation50].

Supplemental material

Alison_Hammond_et_al_supplemental_content.zip

Download Zip (51.5 KB)

Acknowledgements

The authors wish to thank: all the study participants for their time in completing questionnaires; Ulla Nordenskiöld (Institute of Neuroscience and Physiology, Rehabilitation Medicine, Sahlgrenska Academy, Göteborg University, Sweden and original developer of the Evaluation of Daily Activity Questionnaire) for advice in conducting the Evaluation of Daily Activity Questionnaire projects; Rachel Shuttleworth, Kate Woodward-Nutt, Evangeline Aparna Amanna, Rob Peet, Centre for Health Sciences, University of Salford, for assistance with data collection and data entry; and participating NHS, health care and patient organisation staff for assistance with recruitment (see Supplementary Document S1).

Disclosure statement

The authors report no conflict of interest.

Additional information

Funding

This study was funded by the United Kingdom Occupational Therapy Research Foundation.

References

  • European Commission. Special Eurobarometer: Health in the European Union Report; 2007 [cited 2016 Sep 26]. http://ec.europa.eu/public_opinion/archives/ebs/ebs_272e_en.pdf.
  • Parsons S, Ingram M, Clarke-Cornwell AM, et al. A Heavy Burden: the occurrence and impact of musculoskeletal conditions in the United Kingdom today. Arthritis Research UK; 2011 [cited 2016 Sep 26]. http://www.arthritisresearchuk.org/external-resources/2012/09/17/15/12/heavy-burden-the-occurrence-and-impact-of-musculoskeletal-conditions-in-the-united-kingdom-today.aspx.
  • Kirwan JR, Reeback JS. Stanford Health Assessment Questionnaire modified to assess disability in British patients with rheumatoid arthritis. Br J Rheumatol. 1986;25:206–209.
  • Meenan RF, Mason JH, Anderson JJ, et al. The content and properties of a revised and expanded Arthritis Impact Measurement Scales Health Status Questionnaire. Arthr Rheum. 1992;35:1–10.
  • Hammond A. Functional and health assessments used in rheumatology occupational therapy: a review and United Kingdom survey. Br J Occup Ther. 1996;59:254–259.
  • Hammond A, Tyson S, Prior Y, et al. Linguistic validation and cultural adaptation of an English version of the Evaluation of Daily Activity Questionnaire in rheumatoid arthritis. Health Qual Life Outcomes. 2014;12:143.
  • Nordenskiöld U, Grimby G, Hedberg M, et al. The structure of an instrument for assessing the effect of assistive devices and altered working methods in women with rheumatoid arthritis. Arthr Care Res. 1996;9:21–30.
  • Nordenskiöld U, Grimby G, Dahlin-Ivanoff S. Questionnaire to evaluate the effects of assistive devices and altered working methods in women with rheumatoid arthritis. Clin Rheumatol. 1998;17:6–16.
  • Hammond A, Tennant A, Tyson S, et al. The Evaluation of Daily Activity Questionnaire: Part 1 and 2 (English) v. 1.2. University of Salford 2016 [cited 2016 Sep 26]. Available at http://usir.salford.ac.uk/30755/.
  • Hammond A, Tennant A, Tyson S, et al. The Evaluation of Daily Activity Questionnaire: User Manual v2 (English). University of Salford; 2016 [cited 2016 Sep 26]. Available at http://usir.salford.ac.uk/30752/.
  • Hammond A, Tennant A, Tyson S, et al. The Reliability and Validity of the English version of the Evaluation of Daily Activity Questionnaire for people with rheumatoid arthritis. Rheumatology. 2015;54:1605–1615.
  • Cederlund R, Nordenskiöld U, Lundborg G. Hand-arm vibration exposure influences performance of daily activities. Disabil Rehabil. 2001;23:570–577.
  • Cederlund R, Iwarsson S, Lundborg G. Quality of life in Swedish workers exposed to hand-arm vibration syndrome. Occup Ther Int. 2007;14:156–169.
  • Sandqvist G, Eklund MA, Akesson A, et al. Daily activities and hand function in women with scleroderma. Scand J Rheumatol. 2004;33:102–107.
  • Hammond A, Prior Y, Tennant A, et al. The content validity and acceptability of the Evaluation of Daily Activity Questionnaire in musculoskeletal conditions. Br J Occ Ther. 2015;78:144–157.
  • European League Against Rheumatism Outcome Measures Library [cited 2017 Feb 26]. Available at http://oml.eular.org/index.cfm.
  • Ware JE, Sherbourne CD. The MOS 36-item Short-Form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473–483.
  • Ware JE. SF-36 health survey update. Spine. 2000;25:3130–3139.
  • White DK, Wilson JC, Keysor JJ. Measures of adult general functional status. Arthritis Care Res. 2011;63:S297–S307.
  • Quality Metric Incorporated Solutions. QualityMetric Health Outcomes™ Scoring Software 4.5. Lincoln (RI): QualityMetric, Incorporated; 2010 [cited 2016 Sep 26]. Now Optum Insight Life Sciences Inc. Available at https://www.optum.com/optum-outcomes/what-we-do/health-surveys/sf-36v2-health-survey.html.
  • Tennant A, Hillman M, Fear J, et al. Are we making the most of the Stanford Health Assessment Questionnaire?. Br J Rheumatol. 1996;35:574–578.
  • Wolfe F. Which HAQ is best? A comparison of the HAQ, MHAQ and RA-HAQ, a difficult 8 item HAQ (DHAQ), and a rescored 20 item HAQ (HAQ20): analyses in 2491 Rheumatoid Arthritis patients following leflunomide initiation. J Rheumatol. 2001;28:982–989.
  • Burckhardt CS, Anderson KL. The Quality of Life Scale (QOLS): reliability, validity and utilization. Health Qual Life Outcomes. 2003;1:60.
  • Teresi JA, Kleinman M, Ocepek-Welikson K. Modern psychometric methods for detection of differential item functioning: application to cognitive assessment measures. Statist Med. 2000;19:1651–1683.
  • Nunnally JC. Psychometric theory. New York: McGraw-Hill; 1978.
  • Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago (IL): University Chicago Press.1960.
  • Gustafson JE. Testing and obtaining fit of data to the Rasch model. Brit J Math Stat Psy 1980; 33:205–233.
  • Tennant A, Conaghan PG. The Rasch Measurement Model in Rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper?. Arthritis Rheum. 2007; 57:1358–1362.
  • Pallant JF, Tennant A. An introduction to the Rasch measurement model: an example using the Hospital Anxiety and Depression Scale (HADS). Br J Clin Psychol. 2007;46:1–18.
  • Smith EV. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3:205–231.
  • Marais I, Andrich D. Formalising dimension and response violations of local independence in the unidimensional Rasch model. J Appl Meas. 2008;9:200–215.
  • Masters G. A Rasch model for partial credit scoring. Psychometrika. 1982;47:149–174.
  • Andrich D, Sheridan BED, Luo G. RUMM2030: Rasch unidimensional models for measurement. Perth, Western Australia: RUMM Laboratory; 2009.
  • Wainer H, Kiely G. Item clusters and computer adaptive testing: a case for testlets. J Educational Measurement. 1987;24:185–202.
  • Fischer GH, Molenaar IW, editors. Rasch models: foundations, recent developments, and applications. New York: Springer. 1995.
  • Van Newby A, Conner GR, Bunderson CV. The Rasch model and additive conjoint measurement. J Appl Meas. 2009;10:348–354.
  • Evans JD. Straightforward statistics for the behavioral sciences. Pacific Grove (CA): Brooks/Cole Publishing; 1996.
  • Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.
  • Altman DG. (1991) Practical statistics for medical research. London: Chapman and Hall; 1991.
  • Cichetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardised assessment instruments in psychology. Psychol Assessment. 1994;6:284–290.
  • Stratford PW. Getting more from the literature: estimating the standard error of measurement from reliability studies. Physiother Can. 2004;56:27–30.
  • Donoghue D. PROP Group and Stokes E. How much change is true change? The minimum detectable change of the Berg Balance Scale in elderly people. J Rehabil Med. 2009;41:343–346.
  • Erdogan BD, Leung YY, Pohl C, et al. Minimal clinically important difference as applied in rheumatology: an OMERACT Rasch working group systematic review and critique. J Rheumatol. 2016;43:194–202.
  • Fitzpatrick R, Davey C, Buxton MJ, et al. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2:NHS R&D HTA Programme [cited 2016 Sep 26]. http://www.journalslibrary.nihr.ac.uk/hta/volume-2/issue-14.
  • Terwee CB, Bot SDM, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.
  • IBM Corp. IBM SPSS statistics for windows, version 20.0. Armonk (NY): IBM Corp. Released 2011.
  • MedCalc for Windows, Version 16.2.1 (MedCalc Software, Ostend, Belgium); 2016.
  • US Department of Health and Human Services Food and Drug Administration. Guidance for industry: patient-reported outcome measures: use in medical product development to support labelling claims; 2009 [cited 2016 Sep 26]. http://www.fda.gov/downloads/Drugs/Guidances/UCM193282.pdf.
  • Mokkink LB, Terwee CB, Patrick DL, et al. COSMIN Checklist manual v1; 2012 [cited 2016 Sep 26]. http://www.cosmin.nl/cosmin_checklist.html.
  • Hammond A. 2016, Evaluation of Daily Activity Questionnaire (EDAQ) client information leaflet v1, University of Salford [cited 2016 Sep 26]. Available at http://usir.salford.ac.uk/39447/.