63
Views
4
CrossRef citations to date
0
Altmetric
Original Research

Cross-cultural validation of the educational needs assessment tool into Chinese for use in severe knee osteoarthritis

, , , , , , & show all
Pages 695-705 | Published online: 03 May 2018

Abstract

Background

Patient education is an integral part of the management of osteoarthritis. The educational needs assessment tool (ENAT) was developed in the UK to help direct needs-based patient education in rheumatic diseases.

Aim

The aim of the study was to adapt and validate the ENAT into Chinese, for use in severe knee osteoarthritis (KOA).

Methods

This cross-cultural validation study took two phases: 1) adaptation of the ENAT into Chinese (CENAT) and 2) validation of the CENAT. The Construct validity was determined using factor analysis and criterion-related validity by comparing data from CENAT with data from different self-efficacy scales: patient–physician interactions scale (PEPPI-10), self-efficacy for rehabilitation outcome scale (SER), and the self-efficacy for exercise scale (SEE).

Results

The sample comprised 196 patients, with mean age 63.6±8.7 years, disease duration was11.5 years, and 57.1% were female. The CENAT was found to have high internal consistency. The CENAT had weak correlations with the Chinese versions of PEPPI r=0.40, SER r=0.40, and SEE r=0.39. There were no correlations with age r=−0.03 or disease duration r=−0.11.

Conclusion

The ENAT translated well into Chinese and has evidence of validity in KOA. Future studies will further inform its usefulness in clinics, community, and online settings.

Introduction

Knee osteoarthritis (KOA) is a common disease of the knee joint, which leads to long-term joint pain, limited movement, and poor quality of life in the affected patients.Citation1 In the US, >27 million adults suffer from KOA.Citation2 It is estimated that 10% of people older than 55 years have disabling knee symptoms due to KOA in the UK.Citation3 In China, the incidence of KOA is 13.2% in 40–70-year age group.Citation4

Patient education is an important aspect of the management of osteoarthritis. The management guidelines for patients with osteoarthritis point out that “patients should receive patient education on their first consultation with health providers”.Citation5Citation7 The purpose of patient education is to help patients manage their diseases and improve their life quality.Citation6Citation8 However, research findings have shown that routine patient education struggles to achieve long-term impact on patients;Citation9 therefore, individualized, needs-based educational programs that put the patient at the center are advocated.Citation10 Understanding the patients’ needs for education is a prerequisite in the development of an effective patient-centered education, and some studies have proposed the development of individualized self-management programs for people with osteoarthritis to improve their health status.Citation11,Citation12 The European League Against Rheumatism has developed evidence-based recommendations, which provide guidance on the delivery of nonpharmacologic interventions of people with hip or KOA.Citation13 These include individualized treatment and patient education regarding lifestyle changes, exercise, and other aspects of disease management.

Research on patients’ educational needs in patients with arthritis is lacking in China. In the UK, the educational needs assessment tool (ENAT) was developed over 10 years agoCitation14 and has been validated in various disease groups.Citation15 The ENAT has been shown to help nurses’ direct needs-based patient education for people with rheumatoid arthritis (RA).Citation16 The ENAT is a simple 39-item questionnaire used to assess educational needs of people with arthritis. It consists of seven domains: pain management (six items), activity (five items), feeling (four items), arthritis course (seven items), treatment (seven items), self-care measure (six items), and support system (four items). Each item has a five-point Likert scale, scored as 0 =not important, 1 =a little important, 2 =fairly important, 3 =very important, and 4 =extremely important, thus directly reflecting the patients’ educational needs.Citation14 In the Netherlands, the Dutch version ENAT has been used to determine educational needs of patients with RA, systemic lupus erythematosus, and systemic scleroderma (SSc).Citation17Citation19 In Poland, the Polish version of the tool was validated and used to summarize the educational needs of patients with RA and SSc.Citation20Citation22 The ENAT has been validated for use in osteoarthritis in Austria, the Netherlands, Norway, Portugal, and the UK.Citation15,Citation23

Nurses spend a lot of time in patient education, and providing needs-based patient education ensures that this important activity is effective.Citation6,Citation7 The ENAT is the tool with which this can be achieved. In China, research on educational needs of patients with arthritis is at an infancy stage and no tools are available for assessment of patients’ educational needs. The aim of this study was to adapt the ENAT into Chinese (CENAT) and validate it for use in KOA.

Methods

Study design

This was a cross-sectional study that involved two phases: 1) adaptation of the original (English) ENAT into Chinese by researchers from two hospitals in Beijing and Tianjin, between January and February 2016; and 2) testing the validity of the CENAT in patients with KOA.

In Phase II, we included patients who were hospitalized for KOA of Kellgren–Lawrence grade IV by X-rayCitation22 and had the ability to complete the questionnaire independently. We excluded patients who were not able to complete the questionnaire, such as those who were unconscious, with severe mental disorders, cognitive dysfunction, or other serious illnesses. Two family doctors oversaw the integrity of the study and three orthopedic surgeons supervised patient recruitment.

The adaptation of the ENAT into Chinese

The ENAT was translated into Chinese according to an established cross-cultural adaptation methodology described by Beaton et al,Citation24 which consists of five stages: initial translation, synthesis of these translations, back-translation, expert committee assessment, and field testing. First, the ENAT was first translated into Chinese by two senior translators, one is a professional bilingual translator and the other is a bilingual translator with medical educational background. Each translator worked out a report (T1 and T2). Second, two translators with medical educational background joined the team to discuss T1 and T2, and then they revised, edited, and summarized the third translation report (T3). Third, translation report (T3) was back-translated by two translators who lived and studied in America for a long time generating two back-translated versions, respectively (BT1 and BT2). Fourth, the expert committee comprising all translators, clinicians, and a methodologist met for discussion and reached a consensus on all translated items. Following this meeting, five patients with severe KOA were recruited to help in a preliminary test to determine the readability and feasibility of the CENAT. The patients evaluated the specific contents of the scale, and in discussion with the staff, they produced a draft CENAT ready for psychometric testing ().

Validation of the CENAT

Following the cross-cultural adaptation, the CENAT was given to patients with KOA, and the data were used to test for different types of validity: 1) construct validity using factor analysis; 2) internal consistency; and 3) concurrent validity, assessed by comparing the CENAT data with self-efficacy data (the self-efficacy for exercise, the self-efficacy for rehabilitation, and perceived efficacy in patient–physician interactions [PEPPI]).

While the CENAT data were used for testing its construct validity (using factor analysis) and internal consistency, the concurrent validity testing involved data from other questionnaires, namely the self-efficacy for exercise scale (SEE), the self-efficacy for rehabilitation outcome scale (SER), and the PEPPI scale (PEPPI-10). Patients who consented were given the CENAT and the other questionnaires to complete independently and return to the investigators.

The SEE is used to measure self-efficacy for exercise.Citation25 The English version has a high internal consistency (Cronbach’s α coefficient=0.92). The Chinese version SEE is validated and used in clinical studies.Citation26 The Cronbach’s α coefficient of the Chinese version SEE is 0.75. The SER is validated for measuring the patients’ confidence in functional exercise after hip and knee replacement surgery.Citation27 The Chinese version SER is validated and used in clinical research.Citation28 The tool consists of 12 items, and the Cronbach’s α coefficient of the Chinese version SER is 0.94. The 10-item PEPPI-10 is used to test patients’ confidence level in patient–physician interactions.Citation29 The Chinese version of the PEPPI-10 is validated and has been shown to have Cronbach’s α coefficient of 0.91.Citation30 The ENAT has been validated in seven rheumatic diseases including osteoarthritisCitation31 and this study validated its Chinese version (CENAT).

Once returned, the data from the questionnaires were anonymized and entered into a spreadsheet for data cleaning and analysis. The senior author (WL) who was not involved in the data collection undertook the statistical analysis. The statistical tests are detailed in the next section.

Statistical analysis

In this study, factor analysis was used to validate the Chinese version of ENAT, that is, to find representative factors of the scale.Citation32 Kaiser–Meyer–Olkin test assesses the adequacy of the sample for factor analysis, and a value between 0.8 and 1 suggests that the sample is adequate. Principal component analysis and maximum variance method were adopted in this study to extract the main factors that met the requirements (Eigen value component matrix was rotated by maximum variance method, and the rotated matrix variable score was >0.60, which was within the factor’s range). Cronbach’s α coefficient was used to evaluate the internal consistency of the Chinese ENAT. Cronbach’s α coefficient of >0.7 indicates that the measured scale has good internal consistency.Citation33

The correlations between the CENAT and SER, SEE, and PEPPI were also measured to assess the criterion-related validity of the CENAT. If the data had been normally distributed, the correlations of the three variables were determined by Pearson’s correlation coefficient; otherwise, the Spearman’s correlation coefficient was used with values of 0.20–0.39, 0.40–0.59, 0.60–0.79, and 0.80–1.0 representing weak, moderate, strong, and very strong correlations, respectively.Citation34 In RA population, needs-based patient education had an effect on self-efficacy;Citation15 therefore, it is plausible to expect that the educational needs would be correlated with self-efficacy (convergent validity) and not correlated with age or disease duration (divergent validity).

Statistical analyses were performed using SPSS 19.0, IBM Corporation, Armonk, NY, USA; 2010. Structural validity was assessed using confirmatory factor analysis with LISREL 8.7, Scientific Software International, Lincolnwood, IL, USA.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. All patients signed an informed consent form and the study was approved by Tianjin Hospital ethics committee.

Results

Patient characteristics

Overall, 200 participants were recruited and four were excluded from the analysis because of missing responses to items in the CENAT. The evaluable population comprised 196 patients with mean age 63.6±8.7 years, mean disease duration was 11.5 years, and 57.1% were women. Other patient characteristics are summarized in .

Table 1 Patient characteristics (N=196)

Results of the adaptation phase

During the adaptation process of the ENAT, the researchers encountered unclear concepts, grammar, and idioms that were influenced by an English cultural background. Through discussion, the members of the expert committee reached a consensus on the most appropriate terminology to help Chinese participants understand the items. presents the results of the back-translation, issues, and agreements for each ENAT item. These results demonstrate that different cultural backgrounds, national conditions, and social systems were taken into account in the adaptation to enable patients’ understanding of the items (). The Expert Committee believes that the aim of developing an accurate Chinese version of the ENAT has been achieved.

Figure 1 The process of cross-cultural adaptation of the ENAT into Chinese.

Abbreviations: BT1, back-translation 1; BT2, back-translation 2; ENAT, educational needs assessment tool.
Figure 1 The process of cross-cultural adaptation of the ENAT into Chinese.

Internal consistency

The study results showed that the Cronbach’s α coefficient of the CENAT was 0.74. Kaiser–Meyer–Olkin measure was 0.9, suggesting that this dataset was adequate for factor analysis. Common factors with the characteristic value ≥1 were extracted by using principal component analysis and maximum variance rotation method. The results showed that the characteristic values of factor 1, factor 2, factor 3, factor 4, and factor 5 were ≥1, and the contribution rate was 67.9%, including all 39 items (). The confirmatory factor analysis showed good-fit indices for a five-factor model of the CENAT (df=692, p-value<0.01, root mean square error of approximation=0.08). The correlation coefficient between the five factors ranged between 0.65 and 0.91 ().

Figure 2 Standardized factor loading and residuals for the items of the Chinese version of educational needs assessment tool.

Figure 2 Standardized factor loading and residuals for the items of the Chinese version of educational needs assessment tool.

Table 2 Factor analysis of the CENAT rotating element matrixTable Footnotea

Criterion-related validity

presents the Spearman’s correlations between the CENAT and other measures. The results showed that the CENAT had weak but significant correlations with the measures of self-efficacy (PEPPI r=0.40, p<0.001; SER r=0.40, p<0.001; and SEE r=0.39; p<0.001). There were no correlations between the CENAT and age (r=−0.03, p=0.69) nor disease duration (r=−0.11, p=0.11).

Table 3 Spearman’s correlations between the CENAT and other measures

Discussion

In the present study, a standard adaptation methodCitation24 was used to adapt the ENAT into Chinese, and this process was useful in ensuring the conceptual equivalence between the original (English) ENAT and the Chinese version. Simplistic translation of a questionnaire into another language without cross-cultural adaptation and validation is inadequate.Citation22,Citation35 Due to different cultural background, national conditions, and other factors, some items of the Chinese ENAT could not be directly translated into Chinese; therefore, the adaptation process took account of culture to ensure that the concepts contained in the items were meaningful to Chinese patients.

As our purpose was to adapt the ENAT into Chinese and test its validity, the results have confirmed that the CENAT is a valid tool for assessing the educational needs of patients with severe KOA in China. Factor analysis and results of the internal consistency have demonstrated that the ENAT has retained its construct validity after being adapted into Chinese. In chronic disease, self-efficacy has been shown to mediate the effect of patient education.Citation16 The presence of correlation between the CENAT and measures of self-efficacy implies a degree of convergent validity, although these were only weak correlations. Care needs to be taken in interpreting these results as the CENAT assesses patient educational need, and this was a noninterventional cross-sectional study, and the level of patients’ need does not necessarily correspond to self-efficacy. Conversely, the lack of significant correlation with age and disease duration implies a divergent validity, both of which provide further evidence of the validity of the CENAT in KOA.

The ENAT was designed to assess educational needs of patients with arthritis, and in this study,Citation14 we have now demonstrated its validity in Chinese population of patients with KOA. The CENAT can, therefore, be used to direct needs-based education and to develop the health educational programs in patients with KOA in China.

The limitations of this study are that 1) as the sample was selected from hospitalized patients, the risk of selection bias cannot be excluded; 2) we could not undertake more powerful analyses such as item-response theory or exploration of differential item functioning. While those analyses can be carried out in the future, we believe that the current analysis provides preliminary evidence of the validity of the CENAT; 3) being a noninterventional cross-sectional study, the evidence of criterion-related validity was limited and sensitivity to change was not assessed; 4) the CENAT was used in hard copy (paper) form and as the technology of questionnaire moved into electronic forms, its response in online and app forms will need to be assessed; 5) this study validates the CENAT in KOA; therefore, further evidence will be required before the tool is used in other types of osteoarthritis. Despite the abovementioned limitations, we believe that our conclusions are well supportive of the validity of the CENAT in this patient population.

Conclusion

This is the first study to adapt and validate the ENAT into Chinese for use in severe KOA. We systematically investigated the validity of the Chinese version ENAT, showing that the Chinese version ENAT has a good construct validity, internal consistency, and satisfactory criterion-related validity. Therefore, this tool can help nurses to assess the educational needs of patients with severe KOA and provide effective needs-based patient education. Although the scale has demonstrated validity in this study, further research will be required to provide the evidence for other psychometric properties including sensitivity to change.

Supplementary material

Table S1 Back-translation, issues, and agreements for each educational needs assessment tool item

Disclosure

The authors report no conflicts of interest in this work.

References

  • KandamUCroftPClinical co morbidity in osteoarthritis: associations with physical function in older patients in family practicesJ Rheumatol20073491899190417659751
  • LawrenceRCFelsonDTHelmickCGNational Arthritis Data WorkgroupEstimates of the prevalence of arthritis and other rheumatic conditions in the United States. Part IIArthritis Rheum200858263518163497
  • JordanKMArdenNKDohertyMStanding Committee for International Clinical Studies Including Therapeutic Trials ESCISITRecommendations 2003: an evidence based approach to the management of knee osteoarthritis: report of a task force of the Standing Committee for International Clinical Studies Including Therapeutic Trials (ESCISIT)Ann Rheum Dis2003621145115514644851
  • TallonDChardJDieppePExploring the priorities of patients with osteoarthritis of the kneeArthritis Care Res200013531231914635301
  • LorigKRRitterPLLawrentDDFriesJFLong-term randomized controlled trials of tailored-print and small-group arthritis self-management interventionsMedical Care20044234635415076811
  • ZangiHANdosiMAdamsJEuropean League Against Rheumatism (EULAR)EULAR recommendations for patient education for people with inflammatory arthritisAnn Rheum Dis201574695496225735643
  • AckermanINBuchinderROsborneRHFactors limiting participation in arthritis self-management programmers: an exploration of barriers and patient preference within a randomized controlled trialRheumatology (Oxford)201352347247923148089
  • WarsiALaValleyMPWangPSAvornJSolomonDHArthritis self-management education programs: a meta-analysis of the effect on pain and disabilityArthritis Rheum20034882207221312905474
  • CoulterAEllinsJEffectiveness of strategies for informing educating and involving patientsBMJ2007335242717615222
  • ClaymanMLPanditAUBergeronARCameronKARossEWolfMSAsk, understand, remember: a brief measure of patient communication self-efficacy within clinical encountersJ Health Commun201015Suppl 2727920845194
  • HurleyMVWalshNEMitchellHLClinical effectiveness of a rehabilitation program integrating exercise, self-management, and active coping strategies for chronic knee pain: a cluster randomized trialArthritis Rheum20075771211121917907147
  • ColemanSBriffaNKCarrollGInderjeethCCookNMcQuadeJA randomized controlled trial of a self-management education program for osteoarthritis of the knee delivered by health care professionalsArthritis Res Ther201214R2122284848
  • FemandesLHagenKBBijlsmaWJEuropean League Against Rheumatism (EULAR)EULAR recommendations for the non-pharmacological core management of hip and knee osteoarthritisAnn Rheum Dis2013721125113523595142
  • HardwareBLaceyEShewanJTowards the development of a tool to assess educational needs in patients with arthritisClinical Efficacy Nursing20048111117
  • NdosiMBremanderAHamnesBValidation of the educational needs assessment tool as a generic instrument for rheumatic diseases in seven European countriesAnn Rheum Dis201473122122212923921996
  • NdosiMJohnsonDYoungTEffects of needs-based patient education on self-efficacy and health outcomes in people with rheumatoid arthritis: a multicentre, single blind, randomised controlled trialAnn Rheum Dis20167561126113226162769
  • MeestersJJVliet VlielandTPHillJNdosiMEMeasuring educational needs among patients with rheumatoid arthritis using the Dutch version of the educational needs assessment tool (DENAT)Clin Rheumatol2009281073107719449083
  • SchouffoerANdosiMEVliet VlielandTPMeestersJJThe educational needs of people with systemic sclerosis: a cross-sectional study using the Dutch version of the Educational Needs Assessment Tool (D-ENAT)Rheumatol Int201636228929426321625
  • ZirkzeeEJNdosiMEVliet VlielandTPMeestersJJMeasuring educational needs among patients with systemic lupus erythematosus (SLE) using the Dutch version of the Educational Needs Assessment Tool (D-ENAT)Lupus201423131370137625059487
  • SierakowskaMSierakowskiSSierakowskaJHortonMNdosiMDeveloping the Polish educational needs assessment tool (Pol-ENAT) in rheumatoid arthritis and systemic sclerosis: a cross-cultural validation study using Rasch analysisQual Life Res20152472173325231203
  • SierakowskaMKlepackaMSierakowskiSJAssessment of education requirements for patients with rheumatoid arthritis, based on the Polish version of the Educational Needs Assessment Tool (Pol-ENAT), in the light of some health problems – A cross-sectional studyAnn Agric Environ Med201623236136727294648
  • MaiottiMMonteleone TarantoinUFarsciglioneGFMariniSColettaMCorrelation between osteoarthritis cartilage damage and levels of proteinases and proteinase inhibitors in synovial fluid from the knee jointAnhroscopy2000165522526
  • DrăgoiRGNdosiMSadlonovaMPatient education, disease activity and physical function: can we be more targeted? A cross sectional study among people with rheumatoid arthritis, psoriatic arthritis and hand osteoarthritisArthritis Res Ther2013155R15624286444
  • BeatonDEBombardierCGuilleminFFerrazMBGuidelines for the process of cross-cultural adaptation of self-report measuresSpine (Phila Pa 1976)200025243186319111124735
  • ResnickBJenkinsLSTesting the reliability and validity of the self-efficacy for exercise scaleNurs Res200049315415910882320
  • LeeLLOerngSJHoCCHsuH-MLauS-CArthurAA preliminary reliability and validity studying of the Chinese version of the self-efficacy for exercise scale for older adultsInt J Nurs Stud200941230238
  • WaldropDLightseyOREthingtonCACokeALSelf-efficacy, optimism, health competence and recovery from orthopedic surgeryJ Couns Psychol200748233238
  • WangHYHuYLHuSLZhouLQianYQianHJThe reliability and validity assessment of the Chinese version rehabilitation self-efficacy scaleChinese Journal of Modern Nursing2014203268270
  • MalyRCFrankJCMarsballGNDiMatteoMRReubenDBPerceived efficacy in Patient-Physician Interactions (PEPPI): validation of an instrument in older personsJ Am Geriatr Soc1998468898949670878
  • ZhaoHLuoWMalyRCLiuJLeeJCuiYValidation of the Chinese version 10-item perceived Efficacy in patient–physician interactions scale in patients with osteoarthritisPatient Preference and Adherence2016102189219527822020
  • NdosiMTennantABergstenUCross-cultural validation of the educational needs assessment tool in RA in 7 European countriesBMC Musculoskeletal Disorders20111211021609481
  • MonticoneMGiorgiIBaiardiPBarbieriMRoccaBBonezziCDevelopment of the Italian version of the tampa scale of kinesiophobia (TSK-I): cross-cultural adaptation, factor analysis, reliability, and validitySpine2010351241124620216338
  • CrotinaJMWhat is coefficient alpha? an examination of theory and applicationsJ Appl Psychol19937898104
  • ZarJHSignificance testing of the Spearman rank correlation coefficientJ Am Stat Assoc197267339578580
  • AcquadroCConwayKHareenlranAAaronsonNEuropean regulatory issues and quality of life assessment (ERIQA) group: literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trialsValue Health200811350952118179659