Adaptation and validation of a questionnaire assessing patient satisfaction with pharmacy services in general hospitals

Abstract

Objective

The aim of this study was to cross-culturally adapt the Armando Patient Satisfaction Questionnaire into Arabic and validate its use in the general population.

Methods

The translation was conducted based on the principles of the most widely used model in questionnaire translation, namely Brisling’s back-translation model. A written authorization allowing translation into Arabic was obtained from the original author. The Arabic version of the questionnaire was distributed to 480 participants to evaluate construct validity. Statistical Package for Social Sciences version 17.0 for Windows was used for the statistical analysis.

Results

The response rate of this study was 96%; most of the respondents (52.5%) were female. Internal consistency was assessed using Cronbach’s α, which showed that this questionnaire provides a high reliability coefficient (reaching 0.9299) and a high degree of consistency and thus can be relied upon in future patient satisfaction research.

Keywords:

• cross-cultural
• Arabic
• survey

Introduction

The role of pharmacists in the health care system has grown in the last decade to encompass areas beyond the dispensing function; it has now extended to pharmaceutical care.¹ These new roles are based on the concept of changing the pharmacist’s focus from drug providing and distributing services to more patient-oriented approaches, including providing certain interventions after interpretation and assessment of prescription and providing information regarding usage, potential side effects, and how to manage drug-related problems.^2,3 Pharmacists provide this care through patient assessment, disease management, continuing follow-up, and collaboration with other health care providers.^2,3 The available literature regarding pharmacist services shows a positive impact of this care on patient outcome.^4,5 In Saudi Arabia, health organizations took an official position towards patient oriented pharmacy practice when clinical pharmacy was adopted as a strategy in national drug use in the late 1970s. Since then, pharmacy practice in the hospital setting became more patient oriented. The concept of pharmaceutical care is now widely applied by pharmacists.

Obviously, there is a need to evaluate patient satisfaction with regard to these services to ensure continual improvement in pharmacist services. Service structure, processes, and outcomes are some examples of targets that can be used to evaluate the quality of pharmacist services.^6,7 However, a search of the literature revealed that service outcome is not always included as a main criterion for evaluation. Pharmacist service evaluation criteria should not be restricted to evaluating only how well the services are delivered but should also focus on how well the services match patients’ needs. Accordingly, patient satisfaction outcomes should be integrated into all future plans for evaluation of pharmacist services.^7,8

The evidence shows that satisfaction positively affects the likelihood that patients will continue use of health care services and maintain a good relationship with health care providers.^9,10 Moreover, patient adherence to medication has been reported to be significantly improved as a result of increased patient satisfaction.^9,11,12 Patient satisfaction evaluation may help detect patients’ needs, perceptions, and concerns and any shortcomings associated with the health care system.¹³ It is also an important indicator for stakeholders to continue monitoring and improving the quality of the health care system.¹³

However, it is difficult to determine patient satisfaction and identify a single factor that is directly associated with a low or high level of patient satisfaction. A variety of factors might be involved in the patient satisfaction process. These include the patient demographics and educational level.¹⁴ Furthermore, patient satisfaction level is directly associated with patient expectation.^15,16 As such, patient satisfaction can be defined as the sum of the patient perceptions and expectations about the pharmacy service provided to them.¹⁷ If the perceived expectations are met, the patient will be satisfied. Otherwise, patients report a low satisfaction level when there is a clear discrepancy between their high expectations and a low perception of the services received.¹⁷

By performing a literature review, we found that there is no instrument available in Arabic that is specifically designed to evaluate patient satisfaction with pharmacy services. Therefore, the development and validation of such an instrument or translation and adaptation of a validated instrument is necessary to help researchers who are interested in exploring the quality of health care systems and patient satisfaction with services provided by pharmacists in Arabic countries.

The Armando Patient Satisfaction Questionnaire has been adapted and validated in various cultures and has been used in several countries in different settings for pharmacy services^18,19 and is characterized by simplicity and practicality. Thus far, no cross-cultural adaptation of this questionnaire into Arabic has been performed. Therefore, the aim of this study is to cross-culturally adapt and validate the Armando Patient Satisfaction Questionnaire into Arabic for use by the general population.

Methods

Cultural adaptation

The Patient Satisfaction Questionnaire has been validated and used in various cultures.¹⁸ The questionnaire consists of ten closed questions using a 5-point Likert scale from 1 (total disagreement) to 5 (strong agreement) and an open section to express comments. The evidence supports the translation of an existing questionnaire for the investigation of phenomena in situations where the language of the questionnaire is not the first language of the population under study.

A written authorization to translate the original English version of the patient satisfaction questionnaire into Arabic was obtained from Professor Pedro Armando at the Faculty of Chemical Sciences, National University of Córdoba.

The translation process was conducted based on the principles of the most widely used models in questionnaire translation, namely Brisling’s back-translation model, which consists of four techniques: 1) back-translation, 2) bilingual technique, 3) committee approach, and 4) pre-test procedure.²⁰

Two bilingual pharmacists, who are fluent in both Arabic and English, translated the patient satisfaction questionnaire into Arabic, and the content of the translated questionnaire was then reviewed by a group of researchers (committee approach) also fluent in Arabic and English. The goal was to convey the conceptual meaning of the original while rendering it culturally explicable for the Arabic context, rather than seeking linguistic equivalence. The work of Al-Muhtaseb and Mellish²¹ was followed to produce a natural Arabic text. Once the translation was completed, a professional translator and a health care professional reviewed it for clarity and for cultural appropriateness.

A pilot study with 20 patients was conducted using a test-pretest technique to measure the validity of the Arabic version. The initial group reviewed the comments by members of the pilot sample and adapted the Arabic version accordingly.

A back-translation of the Arabic version to English was performed by a professional translator, with the original version of the questionnaire concealed. The back-translated and the original version of the questionnaire were compared by the original author, and subsequent discrepancies were resolved via email correspondence between the Arabic research team and the original author.

Ethical consideration

Ethical approval was obtained from the training and research committee in King Saud Medical City. Furthermore, the research protocol was approved by the ethics committee at the Ministry of Health.

Participants and recruitment

The study was conducted at King Saud Medical City in Riyadh, Saudi Arabia (1,400 beds) from August through September 2013.

Patients in the pharmacy’s waiting area were invited randomly by a member of the research team to participate in the study. Informed written consent was obtained from patients who agreed to participate, and all subjects were able to read the content included in the study.

The sample size was calculated based on a minimum subject/item ratio of 20:1 (20×10=200).^22,23 However, the Arabic version of the patient satisfaction questionnaire was distributed to a sample of 500 participants because it is known that increases in sample size tend to produce more accurate results.²⁴ All patients who agreed to participate were informed that the results of the study would be kept confidential and anonymous and would not be viewed by health care providers, to reduce the risk of bias and to ensure a good relationship with health care providers.

Demographic data such as sex, age, level of education, and occupation were collected.

Data analysis

Statistical Package for Social Sciences version 17.0 for Windows (SPSS Inc., Chicago, IL, USA) was used for the statistical analysis. A descriptive analysis was performed on demographic variables by calculation of the means and standard deviations for each of the items related to satisfaction and the corresponding frequencies of each of the response scale points.

To evaluate the construct validity, a factor analysis was performed using principal component extraction and calculation of the Pearson correlation coefficient. To determine the validity of the Arabic version of the questionnaire, a correlation coefficient was calculated between each statement utilizing inter-item and item-total mean correlation.

Results

A total of 500 questionnaires were collected from patients; of these, 20 were excluded because of incompletion. A total of 252 participants, representing 52.5% of the total study sample, were female, while the remaining 228 (47.5%) were male; participant ages ranged from 15 to 60 years. The majority of the participants (52.8%) had a high school education level, 52.4% of the sample received three medications or more per visit from the ambulatory care pharmacy in King Saud Medical City in Riyadh, and 56.2% received medications from the pharmacy three or more times per year. The final Arabic version of the patient satisfaction questionnaire consisted of three parts. The first part explained the aim of the study and the expected time it would take to complete the questionnaire. The second part concerned demographic characteristics of the participants (including age, sex, education level, occupation, annual number of pharmacy visits, and number of drugs dispensed per visit). The third part contained ten questions using a 5-point Likert scale from 1 (total disagreement) to 5 (strong agreement). During pilot testing, patients did not report finding any of the statements unclear or having had any difficulty understanding the questionnaire, so the translated questionnaire was adapted without any modifications.

A correlation coefficient was calculated between each statement utilizing inter-item and item-total mean correlation using a Pearson correlation coefficient test; a positive correlation was shown between all statements and was statistically significant at P≤0.01, as shown in Table 1.

Table 1 Responses of the study sample to questionnaire statements (in descending order according to the average percentage agreeing)

Statement	Totally disagree	Disagree	Either agree or disagree	Agree	Strongly agree	Mean	SD	Correlation coefficient with axis
When attending this pharmacy to acquire drugs
1. I received adequate information about how I should use my drugs	25 (5.2%)	33 (6.9%)	58 (12.1%)	281 (58.4%)	84 (17.5%)	3.76	0.996	0.879**
2. The staff appear interested in helping me with the use of my drugs	33 (6.9%)	35 (7.3%)	69 (14.3%)	264 (54.9%)	80 (16.6%)	3.67	1.057	0.846**
3. Staff were diligent during my visit	45 (9.4%)	63 (13.1%)	74 (15.4%)	223 (46.4%)	76 (15.8%)	3.46	1.176	0.882**
As a consequence of the service received in this pharmacy
4. I learnt about the need to carry out the treatment prescribed by my doctors	27 (5.6%)	37 (7.7%)	95 (19.8%)	251 (52.2%)	71 (14.8%)	3.63	1.011	0.780**
5. I would keep the staff of this pharmacy informed about any change in my drugs	34 (7.1%)	31 (6.4%)	107 (22.2%)	238 (49.5%)	71 (14.8%)	3.58	1.046	0.785**
6. I improved my knowledge about the drugs I use	26 (5.4%)	45 (9.4%)	100 (20.8%)	255 (53.0%)	55 (11.4%)	3.56	0.994	0.782**
7. I am satisfied with the service received	63 (13.1%)	55 (11.4%)	76 (15.8%)	198 (41.2%)	89 (18.5%)	3.41	1.276	0.878**
8. I would recommend my friends and family to attend this pharmacy to receive its service	53 (11%)	61 (12.7%)	127 (26.4%)	183 (38.0%)	57 (11.9%)	3.27	1.163	0.868**
9. I would keep attending this pharmacy which has given me advice about my drugs	48 (10%)	71 (14.8%)	129 (26.4%)	173 (36.0%)	60 (12.5%)	3.26	1.157	0.838**
10. I learnt to understand about the side effects of the drugs I use	60 (12.5%)	82 (17%)	118 (24.5%)	168 (34.9%)	53 (11.0%)	3.15	1.200	0.878**

Note:

** P≤0.01.

Abbreviation: SD, standard deviation.

Internal consistency was assessed using Cronbach’s α, which showed a high reliability coefficient (reaching 0.9299; Table 2) and a high degree of consistency and suitability for the application in future study.

Table 2 Cronbach’s α

Axes	Number of statements	Stability
When attending this pharmacy to acquire drugs	3	0.8360
As a consequence of the service received in this pharmacy	7	0.9122
General reliability coefficient	10	0.9299

From the results shown in Table 1, it is clear that the study sample is in good agreement on axis one (“When attending this pharmacy to acquire drugs …”), with a range of 3.63–5.00. Similarly, the results from axis two (“As a consequence of the services received in this pharmacy …”) showed that the subjects were also in good agreement, on average, with scores ranging from 4.41 to 5.00 (“agree strongly”).

Discussion

The aim of this study was to translate and adapt a patient satisfaction questionnaire into Arabic. The results show evidence of validity and reliability in evaluating patient satisfaction with dispensing services in a general hospital setting.

To the best of our knowledge, this is the first study describing cross-cultural adaptation in the Arabic version of the patient satisfaction questionnaire.

The results provide evidence for confirming reliability of the Arabic version of the patient satisfaction questionnaire. The Cronbach’s α for axis one, axis two, and total scales (0.8360, 0.9122, and 0.9299, respectively) are comparable to those of the original questionnaire (0.91)¹⁸ and the Spanish version (0.75).²⁵ The inter-item correlations also tend to suggest that the items were measuring the same concept, ie, patient satisfaction, and are indicative of construct validity.^26,27

One of the advantages of this study is the use of a sample from one of the largest general hospitals in Saudi Arabia for the validation of the Arabic version of a patient satisfaction questionnaire. This sample may overcome any cultural and environmental factors that could lead to differences in the instrument’s ability to measure an object of interest. The high response rate to the questionnaire can be explained by its design, which takes into consideration the deficiencies observed in other questionnaires, such as a large number of questions, including all the activities performed by dispensing pharmacists, which may discourage participants from completing the questionnaire.

One of limitations of this study was that certain differences between the two languages made translation and back-translation difficult. The general structure of the English sentence is subject + verb + object, which differs from the Arabic verb + subject + object.²¹

This questionnaire showed good internal consistency and a component structure identical to the original English version. It will be a suitable instrument to assist patient satisfaction in Arabic speaking countries, and will help pharmacists in Saudi Arabia to predict the quality and availability of pharmaceutical care services in their practice.

Further work to investigate patient satisfaction with drug dispensing in different settings is necessary.

Conclusion

We cross-culturally adapted an Arabic version of the Armando Patient Satisfaction Questionnaire for use among the general population. The Arabic version presented good internal consistency and a component structure identical to the original English version.

Disclosure

The authors report no conflicts of interest in this work.