Administering the Routine Activities domain of the Oxford Participation and Activities Questionnaire as a stand-alone scale: the Oxford Routine Activities Measure

Abstract

Background

The recently validated Oxford Participation and Activities Questionnaire (Ox-PAQ) is a 23-item patient-reported outcome measure, theoretically grounded in the World Health Organization International Classification of Functioning, Disability and Health. The measure is specifically designed to assess participation and activity in people experiencing a range of health conditions. Initial validation of the Ox-PAQ identified three domains: Routine Activities (14 items), Emotional Well-Being (5 items), and Social Engagement (4 items). The purpose of the analysis reported here was to assess whether the Routine Activities domain of Ox-PAQ could be validated for use as a stand-alone measure without compromising its psychometric integrity.

Methods

Three hundred and seventy-three patients with a diagnosis of either chronic obstructive pulmonary disease, multiple sclerosis, or Parkinson’s disease were administered the Ox-PAQ in an online survey. The 14 items of the Routine Activities domain of the Ox-PAQ were subject to factor analytic techniques and assessed for reliability and validity.

Results

Three hundred and forty-one patients fully completed the survey, a completion rate of 91.4%. The 14 items loaded onto one single factor with an eigenvalue of 9.29 explaining 66.35% of variance. Reliability was confirmed through corrected item-total correlations ranging from 0.880 to 0.594 and a Cronbach’s alpha value of 0.96. Validity was demonstrated through significant differences in scores between the three disease groups assessed.

Conclusion

Results indicate that the Ox-PAQ Routine Activities domain can be legitimately adopted as a stand-alone measure, the Oxford Routine Activities Measure, where researchers wish to focus primarily on the activity component of the Ox-PAQ. It should, however, be emphasized that where a full assessment of all areas of activity and participation highlighted as important during the development of the Ox-PAQ is required, all three domains of the full measure should be administered.

Keywords:

• routine activities
• factor structure
• reliability
• validity

Introduction

The recently validated Oxford Participation and Activities Questionnaire (Ox-PAQ) is a 23-item patient-reported outcome measure, theoretically grounded in the World Health Organization International Classification of Functioning, Disability and Health.¹ The measure is specifically designed to assess participation and activity in people experiencing a range of health conditions. Its intended primary use is in clinical trials, as well as in the evaluation of interventions targeted at improving and/or maintaining participation and activity.

The development of the Ox-PAQ has been extensively reported elsewhere, which readers may wish to refer to.^2–4 A key feature of the development process is its compliance with current best practice guidelines, such as those provided by the US Food and Drug Administration and European Medicines Agency.^5,6 Subsequent validation of the measure^7–9 identified three domains: Routine Activities (14 items), Emotional Well-Being (5 items), and Social Engagement (4 items). Analyses indicated that the measure demonstrates sound reliability (internal and external) and validity (concurrent and known-groups).

The Ox-PAQ provides a broad assessment of health and well-being in terms of activities and participation. It is likely, however, that for many trials the Routine Activities domain will be an important or primary endpoint on which they may be powered. As is evident from current literature, the purpose of many interventions is to maximize the ability of participants to engage in routine activities for as long as possible, or to restore them to a level of functional ability that permits greater engagement in routine activities.^10–13

The omission of domains when administering previously validated multidomain instruments is generally discouraged in survey research. Doing so has the potential to disrupt their measurement properties, and thereby produce misleading or inaccurate results. A potential solution, however, is to assess the psychometric properties of a given domain as a stand-alone scale in its own right. Therefore, the purpose of the analysis reported here was to assess whether the Routine Activities domain of Ox-PAQ can be utilized as a stand-alone measure without compromising its psychometric integrity. From the responses of a sample independent of the initial validation survey, it was hypothesized that the 14 items would load onto one single factor and would demonstrate acceptable reliability and validity.

Methods

Ethical approval and consent

Ethical approval for the data collected in the analyses reported here was granted by the Medical Sciences Inter Divisional Research Ethics Committee of the University of Oxford (reference: R44281/RE001). Informed consent was gained electronically from all participants prior to their completion of the e-based survey detailed in this report.

Participants

Three hundred seventy-three people with a diagnosis of either chronic obstructive pulmonary disease (COPD), multiple sclerosis (MS), or Parkinson’s disease (PD) were recruited via their respective support organizations in the UK – the British Lung Foundation, MS Society, and Parkinson’s UK.

Materials

An e-based version of the Ox-PAQ was administered via Qualtrics survey software¹⁴ as part of a wider study assessing the responsiveness of the measure. Having been migrated from its paper-based equivalent, the e-based Ox-PAQ has been shown to be both usable and acceptable to respondents.¹⁵ Higher Ox-PAQ scores indicate greater problems with participation and activity.

Procedure

In response to advertisements placed by the support organizations identified above, participants contacted a member of the research team via email and were subsequently forwarded a unique link to the survey. Demographic information (gender, age, primary condition, age at diagnosis, marital status, employment status, and ethnicity) was collected prior to completion of the Ox-PAQ.

Statistical analysis

As is required with psychometric analyses, respondents with missing Ox-PAQ data were removed from the analysis. The 14 items of the Routine Activities domain were subject to factor analytic techniques using IBM SPSS Statistics Version 24.¹⁶ The Kaiser–Meyer–Olkin (KMO)^17,18 measure of sampling adequacy and Bartlett’s test of sphericity¹⁹ were calculated to ensure that the use of principal components analysis (PCA) was acceptable. PCA was subsequently performed, alongside calculation of eigenvalues and explained variance, in order to confirm the factor structure of the 14 items. Reliability was assessed through calculation of item-total correlations (ITCs) and Cronbach’s alpha value.²⁰ Validity was assessed through analysis of variance (ANOVA) and Tukey’s post-hoc tests²¹ as an assessment of known-groups validity.

Results

Three hundred and forty-one people fully completed the Ox-PAQ, a completion rate of 91.4%. The sample comprised 141 males and 200 females, had a combined mean age of 61.52, a mean age at diagnosis of 52.51 and mean disease duration of 9.01 years. Detailed sample characteristics by disease group can be viewed in Table 1.

Table 1 Sample characteristics by disease group and total sample

Condition	Participants (n)	Male: female (n)	Mean (SD) age (years)	Mean (SD) age at diagnosis (years)	Mean (SD) disease duration (years)
COPD	47	16:31	65.47 (6.55)	58.26 (8.30)	7.21 (5.48)
MS	111	28:83	54.10 (11.44)	39.24 (10.97)	14.85 (11.67)
PD	183	97:86	65.01 (8.99)	59.07 (9.40)	5.93 (4.44)
Total sample	341	141:200	61.52 (10.87)	52.51 (13.45)	9.01 (8.68)

Abbreviations: COPD, chronic obstructive pulmonary disease; MS, multiple sclerosis; PD, Parkinson’s disease; SD, standard deviation.

Factor structure

The data met the criteria for the use of PCA. Sampling adequacy was high (KMO=0.962), and Bartlett’s test of sphericity calculated the model (PCA) to be appropriate (c²=4368.97, df=91, P=0.00). PCA confirmed that the 14 items loaded onto one single factor with an eigenvalue of 9.29 explaining 66.35% of variance. Factor loadings ranged from 0.902 to 0.635, with full details available in Table 2.

Table 2 Factor loadings and item-total correlations of the Ox-PAQ Routine Activities domain by item (presented by size)

Ox-PAQ item numbera	Item (abridged wording)	Factor loading	Corrected item-total correlation
5	Going to shops	0.902	0.880
6	Daily activities for enjoyment	0.899	0.874
8	Social life	0.892	0.868
4	Doing household chores	0.890	0.864
14	Being as independent as would like	0.862	0.834
3	Getting around home	0.851	0.821
7	Doing work, paid or unpaid	0.848	0.817
9	Leisure activities	0.828	0.797
10	Physical activities for enjoyment	0.799	0.760
2	Getting dressed	0.780	0.744
17	Using public transport	0.762	0.724
16	Using own transport	0.723	0.684
1	Getting up in the morning	0.675	0.629
13	Engaging in community life	0.635	0.594

Notes:

a Item numbers correspond with the 23-item Ox-PAQ. Adapted from Morley D, Dummett S, Kelly L, Dawson J, Fitzpatrick R, Jenkinson C. Validation of the Oxford Participation and Activities Questionnaire. Patient Relat Outcome Meas. 2016;7:73–80. Copyright © 2016 Morley et al.⁷

Abreviation: Ox-PAQ, Oxford Participation and Activities Questionnaire.

Reliability

Corrected ITCs ranged from 0.880 to 0.594, with full details available in Table 2. Cronbach’s alpha value was calculated at 0.96.

Validity

Mean scores and standard deviations of the Ox-PAQ Routine Activities domain by disease group are given in Table 3. ANOVA results indicate statistically significant differences between the three conditions; F(2, 338)=41.90, P<0.001; Post-hoc tests (Tukey’s HSD) at the 0.05 level of significance confirm significantly inferior scores for people with COPD when compared with those with PD (P<0.001), alongside significantly inferior scores for people with MS when compared with those with PD (P<0.001).

Table 3 Mean scores and standard deviations of the Ox-PAQ Routine Activities domain by disease group

Disease group	Mean score	SD
COPD	59.92	27.75
MS	59.56	25.15
PD	34.73	24.32

Abbreviations: COPD, chronic obstructive pulmonary disease; MS, multiple sclerosis; Ox-PAQ, Oxford Participation and Activities Questionnaire; PD, Parkinson’s disease.

Discussion

Results presented indicate that where researchers wish to focus primarily on the Routine Activities component of the Ox-PAQ, the Oxford Routine Activities Measure (Ox-RAM) can be legitimately incorporated as a stand-alone scale. As hypothesized, all 14 items loaded onto a single factor, explaining 66.35% of variance, a level typically seen when validating instruments through the use of PCA.^22,23 Additionally, all factor loadings are above the level of 0.6 and therefore regarded as high.²⁴

Reliability of the Ox-RAM is confirmed through ITCs that are in excess of previously defined criteria,²⁵ confirming that individual item scores are related to the overall Ox-RAM score. Cronbach’s alpha value was calculated at 0.96, thereby indicating strong internal consistency reliability.²⁶

The validity of the Ox-RAM is demonstrated through assessment of known-groups validity. Such an assessment is made where there are good reasons to hypothesize that scores on a measure of interest will differ between groups,²⁷ as has been incorporated in previous research.^28–31 ANOVA results confirm previously reported differences between people with Parkinson’s and those with MS.^7,31,32 No previous comparisons between neurological conditions and COPD exist, but it is evident that the Ox-RAM identifies highly significant differences between people with PD and those with COPD.

While results confirm the legitimate use of the Ox-RAM, it should be emphasized that where a detailed assessment of all areas of activity and participation highlighted as important during the development of the Ox-PAQ is required, all three domains of the full measure should be administered. The testing of further psychometric properties is required for both the Ox-RAM and the Ox-PAQ, with analysis of sensitivity to change currently being undertaken. Information regarding the use of the Ox-RAM and Ox-PAQ can be obtained from DM or CJ.

Author contributions

All authors contributed toward data analysis, drafting and critically revising the paper, gave final approval of the version to be published, and agree to be accountable for all aspects of the work.

Acknowledgments

Development and validation of the Ox-PAQ were funded by the European Brain Council. We would also like to thank Actelion Pharmaceuticals Ltd for an unrestricted educational research grant, which was used to support part of this work.

The analysis reported here was presented at the 23rd Annual Conference of the International Society for Quality of Life Research, Copenhagen, Denmark, October 19–22, 2016 and was published in Quality of Life Research, Volume 25, Supplement 1.

Disclosure

All authors are developers of the Ox-PAQ and will receive royalties from its use in commercial contexts. All authors have also undertaken consultancy work for Oxford Univer sity Innovation Ltd which holds the license for the Ox-PAQ. The authors report no other conflicts of interest in this work.