115
Views
8
CrossRef citations to date
0
Altmetric
Original Research

The Chinese version of the Coronary Artery Disease Education Questionnaire-II (CADEQ-II): translation and validation

, , , , &
Pages 1587-1596 | Published online: 27 Aug 2018

Abstract

Objectives

It is necessary to assess disease-related knowledge in patients with coronary artery disease (CAD) for tailored patient education; however there is a lack of a well-validated measurement in China. The objective of this study was to translate and validate a Chinese version of the Coronary Artery Disease Education Questionnaire-II (CADEQ-II).

Methods

The Chinese version of CADEQ-II was translated and culturally adapted. Then, it was tested for psychometric properties through a convenient sampling. Content validity was examined based on a panel of five experts. The item difficulty index and item discrimination index were calculated to assess the item difficulty and item discrimination. Internal consistency reliability was measured with the Cronbach’s alpha coefficient. Criterion-related validity was established through comparing scores in patients with different education levels. Construct validity was assessed through confirmatory factor analysis (CFA).

Results

The Chinese version of the CADEQ-II was finalized after deleting three items and modifying two items from the original version. Three hundred and sixteen participants completed the whole questionnaire. Content validity index of the whole questionnaire was 0.87. The Cronbach’s alpha coefficient of the overall questionnaire was 0.907. The significant difference of the knowledge scores among patients with different education levels supported criterion-related validity. CFA confirmed the proposed four-factorial structure of the questionnaire.

Conclusion

The Chinese version of CADEQ-II had an acceptable reliability and validity among Chinese patients with CAD. It could be used to develop individualized health education for Chinese patients with CAD. Also, it could serve as a suitable outcome measurement to evaluate the effectiveness of education interventions related to CAD.

Introduction

As global burden of diseases shifted, cardiovascular disease (CVD) became a major cause of mortality and disability worldwide.Citation1 It is estimated that CVD would cause ~25 million deaths by 2020.Citation2 In China, the prevalence of CVD is on the rise with the development of economy and the change in lifestyle.Citation3 Among all the CVD, coronary artery disease (CAD) is a leading cause of morbidity and mortality in China.Citation4 According to the statistics, the mortality rate of CAD in China was 107.5/100,000 and 105.37/100,000 in the city and countryside, respectively, in 2014.Citation4

Individuals with CAD often suffer from chronic conditions in a long term, which lead to a dire need of adequate and correct disease-related knowledge for disease management.Citation5,Citation6 Disease-related knowledge refers to the basic understanding of the disease and relevant information about self-management, such as exercise, risk factor management, and dietary.Citation7 Previous studies have proven that adequate disease-related knowledge can enhance patients’ awareness of existing risk factors and improve their adherence to healthy lifestyle, which may lead to better cardiovascular health.Citation8,Citation9

Health education is a cost-effective approach to improve disease-related knowledge of patients with CAD.Citation10 It serves as a significant part of disease management and secondary prevention, which can help patients understand the therapies and comply with the recommended health behaviors.Citation11,Citation12 Findings from recent studies presented the benefits of patient education in improving self-management abilities and quality of life while reducing healthcare costs.Citation12,Citation13

Disease-related knowledge is a primary and sensitive outcome of health education programs. By assessing disease-related knowledge of patients with CAD, healthcare professionals can develop tailored health education and evaluate the effectiveness of the intervention.Citation14 Therefore, it is essential to have a suitable tool to measure disease-related knowledge for patients with CAD. However, there lacks a reliable and valid instrument for assessing disease-related knowledge among individuals living with CAD in China.Citation15,Citation16 Currently, the commonly used instrument was a questionnaire developed by Meilian and Tao.Citation17 However, such a 54-item questionnaire has not been rigorously validated yet, also it does not include contents regarding the psychological factors related to CAD, which fails to comprehensively reflect patients’ knowledge regarding CAD.Citation16,Citation18,Citation19

The Coronary Artery Disease Education Questionnaire-II (CADEQ-II), developed by Ghisi et alCitation20 in 2015, is used to measure disease-related knowledge related to CAD (Figure S1). It contains 31 items involving five domains including medical condition, risk factors, exercise, nutrition, and psychological risks. Each item has four response options indicating “complete knowledge” (3 points), “incomplete knowledge” (1 point), “wrong knowledge” (0 point), and “lack of knowledge” (0 point). The total score of CADEQ-II ranges from 0 to 93, with a higher score suggesting better CAD-related knowledge.

CADEQ-II is the second version of the CADEQ.Citation20 This instrument is developed based on a series of empirical researches conducted by Ghisi et al.Citation21Citation23 The scope of CADEQ-II covers almost all components of the cardiac care, including the psychosocial risks of CAD.Citation20 Unlike other similar tools using yes (true) or no (false) options, CADEQ-II consists of items with multiple choices, which can better reflect patients’ awareness of the disease.Citation14 Also, it applies the “I do not know” option to avoid guessing.Citation24 As a newly developed measurement, CADEQ-II has been validated in Canadian patients with CAD and has shown good reliability and validity.Citation20 The Cronbach’s alpha was 0.91 for the whole questionnaire and was ranged from 0.65 to 0.77 for each domain. To date, CADEQ-II has been translated into many languages other than ChineseCitation25 and no evidence about the psychometric properties of CADEQ-II in diverse cultural backgrounds has been published.

This study aimed to translate the CADEQ-II into Chinese and test its psychometric properties in Chinese patients with CAD in clinical settings, which would help health professionals to evaluate disease-related knowledge of Chinese patients with CAD.

Methods

Design and procedure

This study was conducted with two phases. In the first phase, forward-translation, back-translation, and cultural adaptation were conducted to finalize the draft Chinese version of CADEQ-II for further psychometric test. In the second phase, the psychometric properties of CADEQ-II were tested using a cross-sectional survey. The study was approved by the Institutional Review Board of Wuhan University.

Phase I: forward-translation, back-translation, and cultural adaptation

Step 1: forward-translation

After getting the permission of the original author, two translators who are proficient in both English and Chinese have independently translated the CADEQ-II from English into Chinese as per Guillemin et al’sCitation26 recommendation. One of the translators has a doctorate in cardiovascular nursing and is familiar with the CAD-related terms. The other translator is a postgraduate student majored in nursing. After obtaining two Chinese versions, a professional translator and the first author checked the translations and synthesized them into one. Discussions were held among the translators to achieve consensus when controversy in statements and ambiguity in wording had occurred.

Step 2: back-translation

A bilingual professor without the background in CVD and nursing was invited to back translate the synthesized Chinese version of the CADEQ-II into English. This professor is a Chinese American who has lived in the USA for more than a decade. Then, the back-translated version and original English version were reviewed by the professional translator to ensure the equivalence and consistency. Further revision was made to solve the disparities and formed a semifinished Chinese version.

Step 3: cultural adaptation (an expert panel and pilot testing)

A panel of five experts (including a cardiologist, a nursing professor, and three senior nurses engaged in cardiac caring) reviewed the items of the Chinese version and provided suggestions to improve the accuracy, clarity, suitability, and significance of each item. The content validity was evaluated by this panel.

Then, the Chinese version of CADEQ-II was preliminarily tested in 40 Chinese patients with CAD to evaluate its readability and clarity. The sample size of the pilot test was determined according to the recommendation from Beaton et al.Citation27 After completing the questionnaire, participants were interviewed for the clarity of the instructions and items. The feedback was used for further revision. The draft Chinese version of CADEQ-II was finalized after the above steps.

Phase II: the psychometric testing of the Chinese version of the CADEQ-II

The draft Chinese version was administered to a convenience sample of Chinese patients hospitalized with CAD. The aim was to establish the psychometric properties of this translated questionnaire.

Participants

Participants were recruited from three large tertiary general hospitals in Wuhan, China. The inclusion criteria were as follows: 1) patients had confirmed the diagnoses of CAD based on the medical record; 2) patients being able to read and understand Mandarin; and 3) patients aged older than 18 years. The exclusion criteria were as follows: 1) patients with any cognitive disorders or mental illness, which may jeopardize the understanding and answering the questionnaire and 2) patients with severe dysfunction of main organs or having serious medical complications.

All patients hospitalized with CAD who fulfilled the inclusion criteria received the written description about this research. Then, participants were asked to complete the demographic questionnaire and the Chinese version of CADEQ-II after they agreed to participate and signed the written informed consent. In this study, the sample size for psychometric analysis was determined based on the recommendation that 10 cases for each item and at least 100 cases for the total instrument.Citation28

Statistical analysis

The demographic data and knowledge scores were described using descriptive statistics. Continuous variables were presented as mean values and standard deviation (SD), while categorical/nominal variables were presented as frequencies and percentages. Before data analysis, all relevant data were tested for normality distribution by checking skewness and kurtosis values, with a P-value of <0.05 considered a violation of the normality assumption.Citation29

Content validity was evaluated by the expert panel, which comprised a cardiologist, a nursing professor, and three senior cardiology nurses. Experts were asked to rate each item on a 4-point Likert scale (1= completely uncorrelated to 4= strongly correlated) based on the content applicability and the clarity of the phrasing.Citation30 Content validity was assessed by the content validity index (CVI).Citation30,Citation31 CVI of each item (I-CVI) was calculated as the number of the score >3 divided by the total number of the experts. The value >0.7 was regarded as acceptable.Citation32 The CVI of the whole questionnaire was estimated by calculating the average content validity indices of all the items.Citation33 Items with unacceptable CVI value were reevaluated and revised.

The item analysis was conducted to do the item selection and assess item difficulty and discrimination. The item-total correlation and the Cronbach’s alpha coefficient were calculated to identify the problematic items of the questionnaire. Item difficulty referred to how frequently respondents responding to each item of a measurement correctly.Citation34 In this study, the item difficulty index was applied to assess the difficulty of this questionnaire. The index for each item was calculated by the ratio of the number of correct responses to the total number of responses, the higher value indicating the lower difficulty of this item.Citation34 If the value of an item was <20% or >80%, this item should be considered to remove.Citation34,Citation35 Item discrimination indicated whether the questionnaire was capable to differentiate the participants’ knowledge level according to the score they achieved.Citation34 In this study, item discrimination index was calculated by the formula: PUPL, where PU was the percentage of respondents who obtained a correct answer in the top 27% scorers and PL was the percentage of those who provided a correct response in the upper 27% scores.Citation34 A value of ≥0.4 was regarded as high.Citation36

The internal consistency reliability was measured with Cronbach’s alpha coefficients.Citation28 The value >0.6 was generally considered to be acceptable.Citation37 Since previous studies have shown that education is closely related to patients’ disease-related knowledge,Citation20,Citation38Citation40 the criterion validity in this study was calculated, in accordance with the original validation study, by comparing the total scores of patients with different educational levels.

The construct validity was examined through confirmatory factor analysis (CFA). CFA was a modeling technique to confirm whether a proposed factorial structure could manifest the correlation or covariance of observable variables.Citation41 The factorial structure of the original English version of CADEQ-II was established through exploratory factor analysis (EFA).Citation20 EFA revealed a four-factor structure, which explained 62% of the total variance.Citation20 Therefore, in this study, CFA was conducted to test this four-factor model. In order to prevent multivariate non-normal distribution, robust maximum likelihood (MLR) estimation was used to perform CFA,Citation42 The following indices, including chi square by df ratio (χ2/df), goodness-of-fit index (GFI), comparative fit index (CFI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR), were used to perform the goodness-of-fit assessment.Citation43 In this study, 1≤χ2/df≤3, GFI >0.90, CFI >0.90, RMSEA ≤0.08, and SRMR <0.08 were considered to be acceptable.Citation44,Citation45

The scores of patients with different demographic characteristics were also analyzed. The SPSS 22.0 (IBM Corporation, Armonk, NY, USA) and Mplus v.7.0 (Muthén and Muthén, Los Angeles, CA, USA) were used for the statistical analysis. An alpha level of ≤0.05 was considered to be statisticaly significant (two-tailed test).

Results

Demographic characteristics

A total of 330 eligible subjects were recruited for the psychometric analysis. Of these 330 participants, 10 patients refused to participate in this research and four patients did not complete the whole questionnaire. The reason for those who refused to participate included the lack of time or interest. Finally, a total of 316 patients completed the questionnaire. The age of subjects ranged from 21 to 86 years, with a mean age of 60.84±11.75 years. Over half of the participants (179) were aged >60 years. The demographic characteristics of participants are listed in .

Table 1 Demographic characteristics of participants

Results of the cultural adaptation

Through discussion of the expert panel, two items were modified and one item was deleted. The second option “frozen dinners” of item 4 in the nutrition domain was modified as “quick-frozen food”. The statement “blood pressure” of item 1 in the risk factors’ domain was revised as “hypertension”. Item 4 of the exercise domain was deleted because most Chinese people were not familiar with the wind chill.

Forty patients hospitalized with CAD participated in the pilot test. The average time of completion was 28.2±5.7 minutes. The feedback indicated that there was no ambiguous or unclear item in this translated version. After cultural adaptation, a draft Chinese version of the CADEQ-II, with 30 items retained, was prepared for the next formal psychometric test.

As for the content validity, I-CVIs ranged from 0.80 to 1.00, all >0.70. CVI for the whole questionnaire was 0.87. The results indicated an adequate content validity of the questionnaire.

Item analysis

Item exclusion

Item 5 in the medical condition domain “The best resources available to help someone understand his/her medications are ()” was omitted due to the unacceptable item-total correlation coefficient (r=−0.074, P=0.651). Item 4 in the risk factors domain “The first step toward controlling a risk factor (such as blood pressure or cholesterol) is ()” was deleted due to its negative impact on the Cronbach’s alpha coefficient of the risk factors domain (substantially increased to 0.687 when it was deleted).

Item difficulty and item discrimination

Item difficulty index and item discrimination index are shown in . The mean value of item difficulty index was 0.54±0.14, which reflected a moderate level of difficulty.Citation34 Item difficulty indices of all items ranged from 0.20 to 0.74. The mean value of item discrimination index was 0.48±0.09. All discrimination indices were >0.30, with 86% of which were >0.4, indicating a good item discrimination of the Chinese version of CADEQ-II.

Table 2 Item difficulty and item discrimination

Finally, three items were deleted and two items were modified from the original version. A total of 28 items were included in the final Chinese version of CADEQ-II (Figure S2), with six items in the medical domain, four items in the risk factor domain, six items in the exercise domain, seven items in the nutrition domain, and seven items in the psychological risk domain. The total score of the Chinese version of CADEQ-II ranged from 0 to 84.

Reliability

The Cronbach’s alpha coefficients were 0.907 for the overall questionnaire, 0.692 for the medication condition domain, 0.687 for the risk factors’ domain, 0.714 for the exercise domain, 0.705 for the nutrition domain, and 0.701 for the psychological risk domain (). The internal consistency reliability for the whole questionnaire and each domain was acceptable.

Table 3 The score of CADEQ-II and Cronbach’s alpha coefficients

Criterion-related validity

The result showed that patients with different educational levels had different knowledge scores (F=42.064, P<0.001). Pairwise comparison using the least significant difference method found that the patients with higher educational background scored higher (P<0.001), which indicated an acceptable criterion-related validity of the questionnaire.

Construct validity

The present study performed CFA to test a proposed four-factor model established in Ghisi et al’sCitation20 study. Results showed that the proposed model fitted data well (χ2/df=1.651; RMSEA =0.045; CFI =0.922; GFI =0.914; SRMR =0.049). All items had significant parameters on the designated factor (P<0.001). Factor loading coefficients ranged from 0.470 to 0.663 (), which were above the acceptable level.Citation46 The results of CFA provided evidence that the Chinese version of CADEQ-II with a four-factorial structure had sound construct validity.

Table 4 Factor loadings for the four factorial structure

Patient knowledge

The mean total score of the Chinese version of the CADEQ-II was 45.74±18.94 (the full score is 84). Patients scored highest in the domain of medical condition and exercise (10.86±4.72, 10.76±4.90) but lowest in the domain of risk factors (6.82±3.55). As for individual items, the first and second items in the nutrition domain got the lowest scores (0.68±1.12, 0.59±1.03). Details are presented in .

Scores of patients with different demographic characteristics were examined to explore the influencing factors of their knowledge level. The result showed that the living areas (F=14.220, P<0.001), insurance type (F=28.372, P<0.001), education level (F=42.064, P<0.001), and comorbidities (F=7.413, P<0.001) significantly impacted the patients’ disease-related knowledge. Pairwise comparison indicated that patients who live in cities and suburbs (P<0.001, P=0.032), hold the health insurance for urban citizens (P<0.001), have higher education level (P<0.001) and have two (P<0.001) or more (P=0.001) comorbidities achieved higher knowledge scores than their counterparts. Although statistically significant (r=−0.015, P=0.010), the correlation between knowledge scores and the age was feeble. Details are listed in .

Discussion

The aim of this study was to translate and validate the Chinese version of the CADEQ-II among patients hospitalized with CAD in China. The Chinese version of the CADEQ-II was formed after deleting three items and modifying two items from the original version. Psychometric analysis showed that this 28-item questionnaire had acceptable reliability and validity. Therefore, it could be considered as an ideal measurement for assessing disease-related knowledge of Chinese patients with CAD.

Item difficulty and item discrimination were the parts of the item analysis in the context of the classical test theory.Citation47 Item difficulty, also called item severity, referred to the ratio of those who obtain correct responses.Citation34 For an instrument, especially the knowledge measurement, very difficult or very easy items were not sufficient to distinguish well or poorly performed respondents. Therefore, the level of difficulty for most items should be in a moderate level.Citation34 As shown in , the overall item difficulty of this questionnaire was in a moderate level. Although two items in the nutrition domain were relatively difficult, the value of the item difficulty index was still acceptable. Also, nutrition knowledge measured by these two items was the essential information of CAD management. The low score of these two items revealed an insufficiency of nutrition knowledge in Chinese patients hospitalized with CAD as well as a deficiency of current health education, which was also discussed in previous studies.Citation48,Citation49 Item discrimination reflected the discriminatory effectiveness of a particular item to distinguish respondents who were knowledgeable about the measure and those who were not.Citation34 Results showed that the item discrimination of this knowledge questionnaire was adequate, which indicated that this measurement could effectively distinguish respondents who were knowledgeable related to CAD with those who were not. To date, no published research reported item difficulty and item discrimination of this questionnaire. The analysis of item difficulty and discrimination in present study filled this gap.

The internal consistency reliability manifested the internal correlation between items and dimensions.Citation50 The overall Cronbach’s alpha coefficient of the questionnaire was highly acceptable, and the Cronbach’s alpha coefficient for each domain also met the acceptable level, which supported the acceptable internal consistency reliability of this translated version.

Since previous studies have demonstrated that patients who received higher education had more knowledge about disease,Citation20,Citation38Citation40 the education level was served as the criterion to examine the criterion-related validity of this questionnaire, which is the same approach used in the original validation study.Citation20 The result showed that patients with higher education background were more knowledgeable about CAD, which established a good criterion-related validity of this questionnaire.

In the previous study, the English version of CADEQ-II was shown as a four-factorial structure through EFA, namely the factors of medical conditions, risk factors and exercise, nutrition, and psychological risks.Citation20 Therefore, this study performed CFA to confirm this four-factor model. The model fit indices of CFA illustrated that this four-factor model fitted the data well. Factor loadings for all items were significant and exceeded the acceptable criterion. The result of CFA illustrated that the Chinese version of CADEQ-II had satisfactory construct validity when applied into the target sample in the present study.

The overall disease-related knowledge of the participants was at a moderate level (45.74±18.94), similar to the previous investigations.Citation51,Citation52 However, it was lower than the result (64.2±18.1) of the study conducted in Canada using the English version of the CADEQ-II (the total score is 93),Citation20 indicating the lack of patient education in China.Citation48,Citation49,Citation53,Citation54 Whereas the Canadian study did not include patients with low education level,Citation20 this may partly explained the higher scores among its participants. Moreover, over half of the participants included in the present study were diagnosed with CAD within 3 months, which might cause the low level of disease-related knowledge among them. Similar to the results of Ghisi et al’sCitation20 study, patients with CAD had better knowledge regarding the medical condition and exercise but poorer knowledge related to risk factors, which indicated that health care providers should pay more attention to delivering the knowledge about risk factors of CAD to the patients.

In this study, the knowledge scores of patients with different characteristics were also explored. The results, similar to the previous studies, illustrated that patients living in the urban areas, holding the health insurance for citizens, having received higher education levels, and having two or more complications (ie, hypertension, diabetes, and hyperlipidemia) would have better knowledge related to CAD.Citation20,Citation55 Comparing with those living in the rural areas, the patients living in the cities have access to better health care resources and public health insurance, which help them acquire CAD-related knowledge more easier.Citation55 Consistent with the previous study, patients who have two or three complications showed better CAD-related knowledge than those without complication.Citation20 The possible reason was that these complications were also the risk factors of CAD.

Limitations

This study had some limitations. First, the convenient sampling limited the representativeness of the target population with CAD, which might restrict the generalization of the findings. Second, the participants in this study were recruited from a single city in China. Future studies needed to be conducted throughout different geographic locations in China. Considering the four-factor model of the questionnaire was established by the original author via EFA, this study only tested the hypothetical model through CFA, and EFA was not conducted. Further study could perform EFA to explore the internal factorial structure of the Chinese version of the CADEQ-II and compared with this four-factor structure. Finally, the test–retest reliability and convergent validity were not evaluated in this study, which needed to be considered in future studies.

Conclusion

This study translated and validated the Chinese version of CADEQ-II in Chinese patients hospitalized with CAD. The results confirmed that the Chinese version of CADEQ-II was a valid tool to measure the disease-related knowledge among Chinese patients hospitalized with CAD. It also provided an appropriate reference for developing individualized education plan related to CAD and an accurate measurement for evaluating the effectiveness of the education program in future research.

Acknowledgments

The authors would like to thank all the participants. We are grateful for the permission from Dr Gabriela Lima de Melo Ghisi for using the instrument and her kind help.

Disclosure

The authors report no conflicts of interest in this work.

References