0
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Patient’s satisfaction level with community pharmacies services in Romania: a questionnaire-based study

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon show all
Article: 2381104 | Received 19 Feb 2024, Accepted 10 Jul 2024, Published online: 29 Jul 2024

ABSTRACT

Introduction

The patient satisfaction questionnaires in literature are according to the community pharmacies services in the authors’ countries and not all have psychometric reports to support the results. We designed a questionnaire specific to the services of community pharmacies in Romania to evaluate the level of patient satisfaction.

Methods

We carried out a cross-sectional study on voluntary patients. The questionnaire consisted of 22 items, grouped into three domains corresponding to patient satisfaction with pharmacies, pharmaceutical staff and medication availability, and four subdomains related to pharmaceutical staff skills. The 5-point Likert scale was used. Statistical analysis was done in SPSS 27.0.

Results

The Cronbach’s Alpha was 0.861. The Inter-rater Agreement was 72.0%, the Item Content Validity was 97.6% and the completeness index was 100%. The factor analysis indicated 6 factors (Eigen values >1.0). The 809 patients had a median of overall satisfaction score of 3.77; the median was 4.0 regarding satisfaction score with pharmaceutical staff skills. Respondents characteristics varied the patient’s satisfaction level (p ≤ 0.05).

Conclusions

The reliability and validity of the questionnaire have been demonstrated. Overall patient satisfaction with community pharmacy services had a moderate level, but the attitude and confidence in the pharmacist had a high level of satisfaction.

Introduction

Community pharmacies offer easily accessible pharmaceutical care services to patients by providing medicines or other health products, medicine preparation and counselling, called essential services. Community pharmacy services have developed greatly since the introduction of Hepler and Strand’s (Citation1990) concept of ‘pharmaceutical care’. Thus, a number of advanced services have emerged, patient-centred and treatment outcome-oriented, such as, reproductive health services, mental health, oral healthcare services, chronic patients’ management, polypharmacy monitoring and counselling on smoking cessation (Eldooma et al., Citation2023; Sepp et al., Citation2021; Zuckerman et al., Citation2022). Also, advanced services have extended from the measurement of biological parameters and vital functions (blood pressure, cholesterol and glucose), to diagnostic screening (rapid testing) and vaccination in the pharmacy (PGEU, Citation2019). Over time, the pharmacist’s responsibilities have become wider through the pharmaceutical care of the patient, requiring the building of a stronger relationship between the pharmacist and the patient (Alghurair et al., Citation2012; Cipolle et al., Citation2012). The International Pharmaceutical Federation (FIP) recommends prescribing, dispensing, administering and reviewing medicines to achieve the professional standards of pharmacists in community pharmacies by the year 2025 (FIP, Citation2020).

The public health system in Romania is organised on three levels of healthcare: primary care (community and family health care), secondary care (hospital care) and tertiary care (hospital care in specialised medical institutions) (The Parliament of Romania, Citation2015a). The Romanian Constitution guarantees the right to health for all citizens (The Romanian Constitution, Citation2024). The central administrative authority of the public health system is the Ministry of Health, under which there are other institutions and specialised structures at a national, regional, county and local level (The Government of Romania, Citation2018). Romania is not among the countries in the world with the best public health care systems (Johnson, Citation2023). The pyramid of medical assistance services in the public health system (community, family, specialist and hospital) is reversed (Vladescu et al., Citation2016), there is an oversizing and overloading of hospital services compared to community medical assistance services. The financing of the public health system in Romania is done through social and private health insurance, based on the Bismarck model (based on state social insurance budget financing) and the Beveridge model (based on financing from the payment of taxes and fees) (Cichon & Normand, Citation1994). Almost 80% of the total health funds in Romania come from public sources: 64.5% from the National Health Insurance Fund and 13.5% from government sources (Pop et al., Citation2020). 6.5% are health expenses as a share of the gross national product, lower than the European Union average (11%). 44% of all health funding goes to hospital services. A quarter of the direct expenditure fund (21% out-of-pocket expenditure) is intended for medicines (The European Commission, Citation2023). The National Health Quality Management Authority standardises and evaluates health services, monitors health facilities and grants qualifications in order to continuously improve the quality of health services and to ensure patient safety (The Parliament of Romania, Citation2017), following the recommendations of international forums (The International Organization for Standardization, Citation2015; The International Society for Quality in Health Care, Citation2015; The World Health Organization, Citation2018).

Pharmaceutical assistance in Romania is regulated by the pharmacy law (The Parliament of Romania, Citation2015b) and is carried out in community pharmacies, hospital pharmacies and drugstores in the public and private system (The Parliament of Romania, Citation2020; The Romanian Ministry of Health, Citation2019), authorised annually by the territorial Association of Pharmacists through a certificate attesting specific, efficient and patient-oriented pharmaceutical services (The Romanian Pharmacists Association, Citation2021). Pharmaceutical practice is carried out according to the rules of ‘Good pharmaceutical practice’ in Romania (The Romanian Ministry of Health, Citation2010), recommended by the FIP (FIP, Citation1997, Citation2011), being authorised annually by a certificate of free practice from the Romanian Pharmacists Association, for pharmacists who have accumulated 40 points of continuous pharmaceutical education (The Romanian Pharmacists Association, Citation2019) and from the Order of General Medical Assistants, Midwives and Medical Assistants from Romania for pharmacy nurses who have achieved 30 points of continuous pharmaceutical education (MediJobs, Citation2024). The National Agency for Medicines and Medical Devices, subordinate to the Ministry of Health, authorises medicines for human use, supervises production units (manufacturing, control, clinical and toxicological testing), import, wholesale and retail distribution of medicines in Romania, inspects the activity from community pharmacies, controls pharmacovigilance activity, drug advertising and updates the Nomenclature of authorised human medicines (The National Agency of Medicines and Medical Devices from Romania, Citation2024; The Romanian Ministry of Health, Citation2022).

In Romania, the main activities of the pharmaceutical staff in the community pharmacies are the supply of medicines (generic and over-the-counter) or other health products, informing and advising patients, measuring some biological parameters, performing diagnostic tests and administering vaccines (The Parliament of Romania, Citation2015b, Citation2020). The notion of ‘pharmaceutical services’ appeared quite late, only in 2021, three essential (the service of dispensing medicines based on medical prescription; the service of preparing master and officinal medicines or other health products; the service of supporting and conducting public health campaigns) and eleven advanced services being allowed. These advanced pharmaceutical services can be provided by qualified pharmacists (graduates of courses and training for each advanced service) in authorised facilities (The Romanian Ministry of Health, Citation2021). During the Covid-19 pandemic, the diagnostic screening (rapid testing) and the vaccination services in the pharmacy were implemented. Later, the authorised advanced services expanded in some community pharmacies, so that from 2023, the flu vaccination started. Also, from May 2023, a pilot project was initiated to assess the risk of type 2 diabetes, contributing to the prevention and early detection of this condition (Hancu, Citation2023). The concept of ‘pharmaceutical care’ is limited in Romania, because it is the decision of the managers of the community pharmacies, mostly private, to make special rooms for consultations, to bring pharmacists with adequate training and to remunerate them additionally.

The quality of pharmaceutical services perceived by patients focuses in particular on accessibility, costs and qualifications of pharmaceutical staff. If in developed countries patient’s satisfaction is an indicator of quality, in developing countries the interest is growing regarding the evaluation of community pharmacy services (Alanazi et al., Citation2023). The best information about the quality of pharmaceutical services is obtained from patients, through questionnaires and interviews. Among the first standardised questionnaires used are the Donabedian model of healthcare service evaluation, with three components of quality (organisational structure, process indicators and outcome measures) (Donabedian, Citation1988) and ‘ServQual’ model from the marketing literature, structured on five quality attributes (tangibility, reliability, responsiveness, assurance and empathy) (Parasuraman et al., Citation1985).

Patient satisfaction with community pharmacy services is a multidimensional concept, a performance indicator and a complex issue, being influenced by personal characteristics, health status, and health systems (Traverso & MacKeigan, Citation2005). The countries with advanced pharmaceutical services report many studies assessing patient satisfaction with community pharmacy services using validated multidimensional questionnaires (Carpenter et al., Citation2021; Hindi et al., Citation2019; Policarpo et al., Citation2019). In low-and middle-income countries, there are few studies that have developed and validated patient satisfaction questionnaires and have been applied in primary healthcare settings (Huang et al., Citation2023), among which is Romania (Birsan et al., Citation2023; Druica et al., Citation2021).

The aim of this study is to evaluate patient satisfaction with Romanian pharmaceutical services, based on a questionnaire designed starting from the specifics of community pharmacy services provided to the Romanian population.

Material and methods

Study design

This study was carried out in two phases: (1) the development and validation of the questionnaire and (2) the evaluation of the level of satisfaction of patients with community pharmacy services. In the first phase, an exploratory-sequential study using mixed method (qualitative-quantitative) was carried out to validate the questionnaire designed, between July and December 2022. In the second phase, an observational cross-sectional study using a qualitative-descriptive approach was carried out. This study was conducted in Romania between January and June 2023, using the online questionnaire entered in Google Form to collect patient responses.

Study population and sampling method

The sample consisted of patients who visited community pharmacies to purchase medication, aged 18 years or older, through convenience and snowball sampling. The questionnaire was distributed via e-mail and WhatsApp deliberately to 1530 potential participants using convenience sampling, which is a simple and effective way of recruiting participants, saving time and resources, but by which the subsequent results of the study cannot be generalised to the entire population. Participants who completed the questionnaire selected themselves into the study group. To increase the diversity and representativeness of the participants, each participant distributed the questionnaire link to other accessible participants (snowball sampling), in order to attract more participants from the entire territory of Romania, which were difficult to identify and access directly. The recruitment period of the participants coincided with the Covid-19 pandemic that took place between 2020 and 2023 (The National Emergency Committee for Emergency Situations, Citation2023; The President of Romania, Citation2020) and the state of epidemiological alert in Romania from January 2023 and June 2023 (The Romanian Ministry of Health, Citation2023), when there were certain restrictions imposed on the population and health facilities to prevent the spread of the coronavirus SARS-CoV-2 and influenza. Sampling ended when no new data were recorded on Google Form, being an information redundancy approach to snowball sampling saturation. The questionnaire was completed by 809 eligible participants, being sufficient to provide information necessary for the studied phenomenon. The minimum size of a representative sample for the population of Romania is 385 participants, in an adult population of 15,100,047 in the year 2022 (The National Institute of Statistics, Citation2024) for a confidence interval of 95% and an error of 5%.

Study tool

The new study instrument was designed because no reliable and valid questionnaire was found that was in agreement with the services provided by community pharmacies in Romania after a review of previous literature (Aziz et al., Citation2018; Ismail et al., Citation2020; Larson & MacKeigan, Citation1994).

The questionnaire in Romanian consisted of 22 simple, short, closed-ended and positive items, structured on three domains corresponding to patient satisfaction with (A) community pharmacies (6 items), (B) pharmaceutical staff (13 items) and (C) medication availability (3 items) and four subdomains for the skills of the pharmaceutical staff regarding (1) overall satisfaction, (2) pharmacist’s attitude, (3) confidence in the pharmacist, and (4) counselling. The content validity of the questionnaire was carried out through a pre-test with a panel of 25 evaluators consisting of teachers, experienced pharmacists and pharmacy assistants, public health specialists and doctors. The standard validity form was designed with several components for clarity, relevance and completeness, with a 4-point response scale for professional judgment of the items. The own conception questionnaire in Romanian did not need forward and backward translation of the items.

The feasibility of using the questionnaire, its reliability and factor analysis was carried out through a pilot test with 29 conveniently selected patients, aged over 18, who had experiences related to community pharmacies and gave their verbal consent for participation. The pilot sample size was determined using a subject-to-item ratio of 1.3:1. Most researchers reported factor analyses on small samples and subject-to-item ratios of only 2:1 or less. Rules for pilot sample size do not exist in literature. But the more uniform the factor analysis data performed on small samples was, the more accurate the analysis was (Costello & Osborne, Citation2005). Therefore, we consider the pilot group to be representative of the study group and the results of the pilot study can be validated.

The 5-point Likert scale was used. The level of patient satisfaction was measured according to the median values of the calculated scores, using a scale from 1 to 5, to quantify dissatisfaction (1 = strongly disagree and 2 = disagree), moderate satisfaction (3 = neutral) and high satisfaction (4 = agree and 5 = strongly agree).

The last section of the questionnaire included the respondents’ socio-demographic features (gender, age, urban/rural areas, regions, education, marital status, occupation and income), their self-reported health status (member of a patient association, chronic patient and patient with co-morbidities), the visited pharmacies and the purchased medicines (frequency of visits, type of pharmacy and the way of purchase) and if they have ever responded before to a satisfaction questionnaire.

Statistical analysis

Patient responses were downloaded from Google Docs as a Microsoft Excel file and transferred to the Statistical Package for the Social Sciences (SPSS) version 27.0 (SPSS Inc., Chicago, IL, USA) for statistical analysis.

The reliability of the questionnaire was assessed using the alpha-Cronbach coefficient. The questionnaire was validated by calculating the content validity items for clarity, relevance (Inter-rater Agreement – IRA, Item Content Validity – ICV, Scale Content Validity – SCV) and completeness. The factor analysis used the ‘Principal axis factoring’ method.

The descriptive statistics parameters of item scores were calculated: mean, standard deviation (SD), standard error of the mean (SEM), minimum, maximum, median and interquartile range (IQR). Statistically significant differences between median scores according to the characteristics of the respondents were calculated by the non-parametric Mann–Whitney and Kruskall–Wallis tests, because by applying the Kolmogorov–Smirnov fitting test the distributions of the calculated scores did not follow the normal distribution law. Statistically significant results were considered for values of the coefficient of significance p ≤ 0.05.

Ethical considerations

The study received approval from the Ethics Commission of U.M.F. ‘Grigore T. Popa’ Iași (No. 237/19.11.2022). On the Google Form, before the questionnaire there was ‘the informed consent’, where all participants were invited to participate in this study and were informed about the purpose of the study, the procedure, the time to complete it, the voluntary participation, the non-granting of material benefits in exchange for their participation and about the anonymity of their identity and responses. All participants gave their consent before answering the online questionnaire, to enrol in this study.

Results

The first phase of the study

Questionnaire development and validation

The participants of the pilot test positively evaluated the items regarding the feasibility of the questionnaire and the group of evaluators revised 7 items that were not clear to the respondents, keeping the 22 items of the questionnaire. The time required to answer the questionnaire items was approximately 10 min.

The Cronbach’s alpha is 0.861, indicating a good internal consistency of the questionnaire.

IRA and ICV have an acceptable level. SCV for clarity is 97.6% and for relevance 96.2%, which represent very good values (). IRA is acceptable, being 72.0%. The completeness index of 100% is very good. The questionnaire is validated after this statistical analysis.

Table 1. The validity of questionnaire’s content.

Bartlett’s test of sphericity is 476.077 with 231 degrees of freedom and significant statistically at p-value of 0.000, which shows that the questionnaire items are correlated with each other. The Kaiser-Meyer-Olkin statistic of 0.601 close to 1 is adequate for factor analysis.

Initial communalities indicate increased values, showing that the items are well correlated, with one exception (item 4). The extracted communalities indicate increased values of more than 50%, which shows that items are covered by the factorial solution; the only items that do not correlate very well with the others are items 17, 20 and 22.

The factor analysis reveals 6 factors (with Eigen values >1.0) responsible for 79.1% of the variation of the 22 investigated items, which represents a good percentage. The variance explained by the extracted factors drops to 71.1% after their rotation, recording a loss of approx. 8% which is due to unique latent factors and is not covered by the model ().

Table 2. Total variance explained by the factors.

The presence of these 6 factors is visible in . The highlighted factors constituted three important domains and four subdomains related to the context of the domain, and the items with weaker correlations (below 0.2) were grouped according to the relevance of the context.

Figure 1. Scree plot of the investigated factors.

Figure 1. Scree plot of the investigated factors.

The second phase of the study

Characteristics of respondents

809 respondents are enrolled in this study, of which 190 (23.5%) men and 619 (76.5%) women, aged between 18 and 20 years 57 (7.0%) respondents, between 21 and 30 years 301 (37.2) respondents, between 31 and 40 years 188 (23.2) respondents, between 41 and 50 years 147 (18.2%) respondents, between 51 and 60 years 73 (9.0%) respondents and over 60 years 43 (5.3%) respondents. 629 (77.8%) respondents live in urban areas and 625 (77.3%) respondents in the north-eastern region of Romania. 165 (20.4%) respondents have secondary education, 435 (53.8%) respondents have undergraduate education and 209 (25.8%) respondents have postgraduate education. 374 (46.2%) respondents are married, 380 (47.8%) are unmarried respondents, 37 (4.6%) are divorced respondents, and 18 (2.2%) are widowed respondents. 531 (65.6%) respondents are employed, 213 (26.3%) are students respondents, 49 (6.1%) are retired respondents and 16 (2.0%) are unemployed respondents. 172 (21.3%) respondents have no income, 92 (11.4%) respondents have a minimal income (under 4254 RON ≈ 856 EUR), 351 (43.4%) respondents have a medium income (4254 RON ≈ 856 EUR) and 194 (24.0%) respondents have an above average income (over 4254 RON ≈ 856 EUR) (The National Institute of Statistics, Citation2023).

695 (85.9%) respondents are not members of a patient association, 567 (70.1%) respondents did not self-report chronically ill and 565 (69.8%) respondents did not self-report with co-morbidities.

61 (7.5%) respondents go to the pharmacy weekly, 247 (30.5%) respondents go to the pharmacy monthly, and 501 (61.9%) respondents visit the pharmacy occasionally. 588 (72.7%) respondents go to the pharmacy closest to their home, 196 (24.2%) respondents go to the corporate pharmacy, and 25 (3.1%) respondents go to the pharmacy in large shopping centres. Purchased medicines were paid for by 417 (51.5%) respondents, compensated to 27 (3.3%) respondents, and 365 (45.1%) respondents used both payment methods.

626 (77.4) respondents completed a satisfaction questionnaire for community pharmacy services for the first time.

Satisfaction with community pharmacy services

Patient satisfaction with community pharmacy services is measured with the 22 items distributed across three domains regarding location, staff and medication availability. Median scores of the overall patient satisfaction is 3.77 with IQR 3.45÷4.13, indicating a moderate level of satisfaction with the services received in the community pharmacy. Also, the median scores of the domains are relatively the same , reflecting the same moderate level of patient satisfaction with pharmacies (median of 3.83 and IQR 3.33÷4.16), pharmaceutical staff (median of 3.84 and IQR 3.46÷4.23) and medication availability (median of 3.66 and IQR 3.00÷4.00) ().

Table 3. Descriptive statistics parameters of the questionnaire scores.

The level of satisfaction according to the characteristics of the respondents

The comparative analysis between the median scores shows statistical significant differences according to the age groups, urban/rural area, education level, marital status, occupation, income, and the way medicines are purchased (p ≤ 0.05). No statistically significant differences were found between the median scores according to gender, regions, self-reported health status and the frequency and type of pharmacy visited ().

Table 4. The satisfaction scores comparative study according to the patients’ general features.

Satisfaction with pharmaceutical staff

Patients self-reports a high level of general satisfaction with the pharmaceutical staff, the median scores being 4.0 with IQR 4.00÷5.00; satisfaction about the pharmacist’s attitude shows median scores of 4.0 with IQR 4.00÷4.33; and satisfaction about trusting the pharmacist indicate median scores of 4.0 with IQR 3.50÷4.50. The median scores of 3.71 with IQR 3.28÷4.14 indicate a moderate level of satisfaction regarding the received counselling ().

Discussion

In this study, the level of patient satisfaction with the services of the community pharmacy in Romania was identified, through a questionnaire in Romanian language, designed and validated, composed of domains corresponding to the organisational aspects, the pharmaceutical staff skills (with four subfields) and the availability of medicines. Our questionnaire is multidimensional, developed on the first two components of the Donabedian model, structure (the space in which the activity with patients is carried out) and process (pharmaceutical care, interactions with patients and drugs) (Donabedian, Citation1988).

The previous literature and the competent institutions in Romania have not yet provided a standardised tool to measure patient satisfaction with the quality of community pharmacy services. In literature there are satisfaction questionnaires specific to pharmaceutical services from different countries, such as the ‘Community Pharmacy Patient Questionnaire’ (CPPQ). The Pharmacy Center, Citation2023) in United Kingdom and the ‘Quality Index Consumer Questionnaire (CQI) Pharmaceutical Care’ (Koster et al., Citation2016) in Netherlands. But, most of the questionnaires are in English, such as the ‘Public Health Care Patient Satisfaction Questionnaire’ (PHC-PSQ (Figshare, Citation2022)), ‘Patient Satisfaction Questionnaire Satisfaction with Pharmacist Services Questionnaire’ (PSPSQ 2.0) (Shrestha et al., Citation2020) and ‘Pharmacy Encounter Survey’ (PES) (Briesacher & Corer, Citation1997). The lack of questionnaires appropriate to pharmaceutical services in different countries in their own language is a problem for researchers in terms of translation and linguistic and cultural suitability. The Romanian language is spoken by 28 million people in the world, of which 24 million people speak it as their mother tongue (Wikipedia, Citation2022).

In our study, patients’ expectations from pharmaceutical services of the community pharmacy were higher, general satisfaction being moderate and the level of satisfaction was influenced by some socio-demographic characteristics (age, urban/rural area, education level, marital status, occupation and income) and method of medicines acquisition.

Other studies conducted in other countries report varying levels of satisfaction from dissatisfaction to very high satisfaction (Alhomoud et al., Citation2016; Alomi et al., Citation2016; Larasanty et al., Citation2019; Naser & Sbeat, Citation2022). Naser and Sbeat (Citation2022) explored Jordanian patient satisfaction with community pharmacies and the services provided by pharmacy staff through a questionnaire and found moderate overall satisfaction, which varied by age, marital status, employment status and history of chronic diseases. Larasanty et al. (Citation2019) conducted a survey of satisfaction at primary and secondary health facilities in Indonesia’s health system through a questionnaire and found out that patient satisfaction ranged from high to very high with pharmaceutical care services at primary level, while satisfaction with pharmaceutical care services at secondary level ranged from low to very high. Alhomoud et al. (Citation2016) assessed patient satisfaction with essential services provided by community pharmacies in the United Arab Emirates through a questionnaire and showed that satisfaction was good regarding the quality of the service and communication quality. Alomi et al. (Citation2016) examined patient satisfaction with pharmaceutical care in Saudi Arabia and found that satisfaction was very good with drug availability, patient counselling and pharmacist-patient relationships in primary care center pharmacies and also satisfaction was less good with pharmacy communication and medication reconciliation. Most studies reported positive patient’s expectations of community pharmacy services, especially in countries with advanced services (Bishop et al., Citation2015; Melton & Lai, Citation2017). Also, the studies have shown that socio-demographic variables, cost and availability of medicines affect patient satisfaction level (Alotaibi et al., Citation2021; Ismail et al., Citation2020; Saffaei et al., Citation2021).

In the present study, patients were not fully satisfied with some administrative aspects of community pharmacies, such as location, opening hours, time and waiting area. These aspects can influence patients’ confidence and loyalty towards the visited pharmacy (Dhital et al., Citation2022). The most satisfied with the administrative aspects of pharmacies were patients in the 31–40 and over 60 age groups, pensioners and unemployed patients, who bought medicine weekly. The other categories of patients were less satisfied with these aspects of community pharmacies. The level of satisfaction was not affected by the gender of the participants, residence in developing regions, self-reported health status, frequency and visited pharmacy.

In Romania, the number of community pharmacies increased from year to year reaching 9885 pharmacies in 2022. Their territorial distribution is uneven, most community pharmacies being found in the urban environment and in the north-eastern region of Romania where the population is larger (The National Institute of Statistics, Citation2024). In order to satisfy all patients, it would be necessary for the decision-makers to achieve a uniform territorial distribution of community pharmacies and in areas far from urban or communal centres. Also, pharmacy managers should be responsive to patients’ wishes regarding opening hours, time and waiting area and improve these aspects.

In our study, patient satisfaction with the services provided by the pharmaceutical staff was moderate, but it is noted that the pharmaceutical staff in community pharmacies had an important role in promoting the health of patients. Thus, patients were satisfied with the advice given and the attitude of the pharmacists, and they trusted the recommendations and information received about the medicines. However, patients had higher expectations regarding counselling about the importance and administration of their medications, adverse effects, and drug-food interactions. The most satisfied with the services provided by the pharmaceutical staff were patients over 50 years old, with a secondary level of education, pensioners and widowed patients, who bought medicines weekly, in contrast to the other categories of less satisfied patients. Gender, urban/rural environment, and region of residence, marital status, self-reported health status, frequency and the visited pharmacy did not affect patient satisfaction.

The results of the studies are controversial. Some results are in agreement with ours, others report a lack of confidence in the qualification and professionalism of pharmacists and in the confidentiality of counselling (Ali et al., Citation2019; Chen et al., Citation2018). Multiple time-consuming professional activities of pharmacists lead to insufficient counselling of patients, and therefore the pharmacy assistant helps the pharmacist in all his activities (Bradley et al., Citation2016). This is also true in Romania, because in community pharmacies there is a pharmacist on each shift, which is not enough for the counselling part, as a pharmaceutical service.

In Romania, the number of community pharmacists increased, reaching 22,661 pharmacists in 2022. The ratio of pharmacists per population is average compared to European countries, with one pharmacist providing medicines to 840 inhabitants (The National Institute of Statistics, Citation2023). During the Covid-19 pandemic, there was an overload of community pharmacists, due to the increased requests for medicines from the population. Patient-centred pharmacy practice requires sufficient time for counselling regarding the administration of purchased medications, so pharmacy managers should supplement the number of pharmacists in community pharmacies to increase patient satisfaction. The introduction of advanced services in community pharmacies would improve the public perception of pharmacists, if managers would create the appropriate spaces and separate them from the rest of the pharmacy, facilitate the professional development of pharmacists and regulate the reimbursement of these services.

In our study, patients’ accessibility to medicines was moderate, in terms of finding medicines, substituting them with other cheaper products or ordering them from warehouses by pharmacists. The most satisfied patients with the availability of medicines were patients aged between 51 and 60 years, who bought medicines weekly, the other categories of patients being less satisfied. Patient satisfaction was not influenced by gender, residence, level of education and self-reported health status.

Supplying community pharmacies with medicines is done rhythmically and constantly in Romania, if found at the medicines suppliers. Discontinuity in the supply of medicines is not a new phenomenon in our country, but it is a big problem for patients who need health care. It seems that there is a problem with the availability of medicines, as a number of generic medicines have been withdrawn from the Romanian market (The Romanian Ministry of Health, Citation2017). A more effective collaboration between the Romanian Ministry of Health and the European Medicines Agency would solve this discontinuity in the supply of medicines to the population, which represents a significant risk to public health. Also, there is another problem with the financial accessibility of patients, due to the different indexation of the prices of medicines (Pana, Citation2022). Although many of the medicines are almost fully covered by the social health insurance system and others only partially, 12% of Romanians were not insured in 2022. Although two-thirds of the adult population declared themselves to be healthy (73.3%) in 2022, far exceeding the European average (68%), the average life expectancy at birth in Romania was 75.3 years, being the third lowest in the European Union. The authority of the public health system in Romania in collaboration with other competent institutions should solve these undesirable situations.

In our questionnaire, an item was introduced to the general characteristics of patients about the past completion of such a questionnaire sent by community pharmacies, to identify if there is a feed-back between the pharmacists’ perceptions of the services provided to the population and the patients’ expectations of the services received and we found out that most of the patients in our study did not complete such a questionnaire., Therefore there is no feed-back between pharmacists’ perceptions and patients’ expectations, which is counterproductive to the improvement of the quality of pharmaceutical services (Mehralian et al., Citation2014).

Our study has practical applicability in identifying aspects that should be improved in community pharmacies, in accordance with patient expectations. In the future, strategies should be introduced to optimise the roles of pharmacists in community pharmacies through health system reforms, so that the quality of pharmaceutical care meets the increasing health needs of patients.

Our study has several limitations. Our results require cautious interpretations, as they may not be transferable to another study population or pharmaceutical system. Firstly, the recruitment and sampling of participants was conditioned by the context of pandemic population restrictions, which meant that only people with online skills enrolled in this study. The most available participants were women, aged between 21 and 40 years, which represent a limit of the structure of the studied group. Secondly, the questionnaire items reflected the essential services provided by most of our pharmacies, while the other validated questionnaires also included advanced services, but self-reported responses based on participants’ past experiences of pharmacy visits may have been overestimated or underestimated, which represents some limitations. Thirdly, we quantified the level of satisfaction of patients according to the median values of the calculated scores, whereas previous studies used quantitative (percentage) or qualitative (arithmetic mean of score) assessments.

Conclusions

The patient satisfaction questionnaire towards pharmaceutical services in community pharmacies in Romania was developed and validated. Overall patient satisfaction with pharmaceutical services in community pharmacies was moderate, as well as satisfaction with pharmacies, pharmaceutical staff and medicines availability. The level of satisfaction was influenced by age groups, urban/rural environment, level of education, marital status, occupation, income and the method of purchasing medicines. Patients were satisfied with the attitude of the pharmaceutical staff. Patients trusted the recommendations they received, but they were less satisfied with the advice they received regarding the administration and side effects of the purchased medicines.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

The datasets used and analysed during the current study are available from the corresponding author on reasonable request. The questionnaire may be available after the defence of the doctoral thesis.

Additional information

Funding

This work was partially supported by ‘Grigore T. Popa’ University of Medicine and Pharmacy Iasi (Universitatea de Medicina și Farmacie Grigore T. Popa – Iasi), Romania, under Etidal-Mihaela Manoliu-Hamwi PhD-student [grant number 1818/2021].

References

  • Alanazi, A. S., Shah, S., Abbas, G., Husein, M., Saleem, A., Khurram, H., Chand, U. R., Mallhi, T. H., Khan, Y. H., Ilyas, K., Triq, S., Jamil, A., Alzarea, A. I., & Alzarea, S. I. (2023). Assessing patient satisfaction with community pharmacy services: A large regional study at Punjab, Pakistan. Patient Preference and Adherence, 17, 13–22. https://doi.org/10.2147/PPA.S389053
  • Alghurair, S. A., Simpson, S. H., & Guirguis, L. M. (2012). What elements of the patient–pharmacist relationship are associated with patient satisfaction? Patient Preference and Adherence, 6, 663–676. https://doi.org/10.2147/PPA.S35688
  • Alhomoud, F. K., Kunbus, A., Ameer, A., & Alhomoud, F. (2016). Quality assessment of community pharmacy services provided in the United Arab Emirates: Patient experience and satisfaction. Journal of Applied Pharmaceutical Science, 6(3), 17–23. https://doi.org/10.7324/JAPS.2016.60303
  • Ali, H. S., Aldahab, A. S., Mohamed, E. B., Prajapati, S. K., Badulla, W. F., Alshakka, M., & Baig, M. R. (2019). Patients’ perspectives on services provided by community pharmacies in terms of patients’ perception and satisfaction. Journal of Young Pharmacists, 11(3), 279–284. https://doi.org/10.5530/jyp.2019.11.56
  • Alomi, Y., Kurdy, L., Aljarad, Z., & Basudan, H. (2016). Patient satisfaction of pharmaceutical care of primary care centers at Ministry of Health in Saudi Arabia. Journal of Pharmacy Practice and Community Medicine, 2(3), 79–87. https://doi.org/10.5530/jppcm.2016.3.4
  • Alotaibi, N. H., Alzarea, A. I., Alotaibi, A. M., Khan, Y. H., Mallhi, T. H., Alhabi, K. S., Alruwaili, N. K., Alanazi, A. S., Hassan, A., & Alotaub, B. S. (2021). Exploring satisfaction level among outpatients regarding pharmacy facilities and services in the Kingdom of Saudi Arabia; a large regional analysis. PLoS One, 16(4), e0247912. https://doi.org/10.1371/journal.pone.0247912
  • Aziz, M. M., Ji, W., Masood, I., Farooq, M., Malik, M. Z., Chang, J., Jiang, M., Atif, N., & Fang, Y. (2018). Patient satisfaction with community pharmacies services: A cross-sectional survey from Punjab; Pakistan. International Journal of Environmental Research and Public Health, 15(12), 2914. https://doi.org/10.3390/ijerph15122914
  • Birsan, M., Focsa, A. V., Cristofor, A. C., Cristofor, A. C., Scripcariu, S. I., Antonoaea, P., Vlad, R. A., Todoran, N., Ciurba, A., Stan, C. I., Apostol, M. M., & Stan, C. D. (2023). Healthcare service quality evaluated using the degree of satisfaction of patients in Romanian community pharmacies. Healthcare, 11(23), 3038. https://doi.org/10.3390/healthcare11233038
  • Bishop, A. C., Boyle, T. A., Morrison, B., Barker, J. R., Zwicker, B., Mahaffey, T., & Murphy, A. (2015). Public perceptions of pharmacist expanded scope of practice services in Nova Scotia. Canadian Pharmacists Journal / Revue des Pharmaciens du Canada, 148(5), 274–283. https://doi.org/10.1177/1715163515596757
  • Bradley, F., Willis, S. C., Noyce, P. R., & Schafheutle, E. I. (2016). Restructuring supervision and reconfiguration of skill mix in community pharmacy: Classification of perceived safety and risk. Research in Social and Administrative Pharmacy, 12(5), 733–746. https://doi.org/10.1016/j.sapharm.2015.10.009
  • Briesacher, B., & Corer, R. (1997). Patient satisfaction with pharmaceutical services at independent and chain pharmacies. American Journal of Health-System Pharmacy, 54(5), 531–536. https://doi.org/10.1093/ajhp/54.5.531
  • Carpenter, D. M., Roberts, C. A., & Farley, J. F. (2021). Measuring patient perspectives on community pharmacy quality: Psychometric evaluation of a brief survey. Journal of Managed Care & Specialty Pharmacy, 27(1), 105–111. https://doi.org/10.18553/jmcp.2021.27.1.105
  • Chen, H., Ung, C. O. L., Chi, P., Wu, J., Tang, D., & Hu, H. (2018). Consumers’ perceptions about pharmaceutical care provided by community pharmacists in China in relation to over-the-counter drugs: A qualitative study. INQUIRY: The Journal of Health Care Organization, Provision, and Financing, 55, 46958018793292. https://doi.org/10.1177/0046958018793292
  • Cichon, M., & Normand, C. (1994). Between Bismarck and Beveridge: options for health care financing in central and eastern Europe. World Health Organization, 15(4), 323–328. https://iris.who.int/handle/10665/45367
  • Cipolle, R. J., Strand, L. M., & Morley, P. C. (2012). Pharmaceutical care practice: The patient-centered approach to medication management services (3rd ed.). McGraw-Hill Companies.
  • Costello, A. B., & Osborne, W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9. https://doi.org/10.7275/jyj1-4868
  • Dhital, R., Sakulwach, S., Robert, G., Vasilikou, C., & Sin, J. (2022). Systematic review on the effects of the physical and social aspects of the community pharmacy environment on pharmacy patients’ and staffs’ engagement with pharmacy health services. Perspectives in Public Health, 142(2), 77–93. https://doi.org/10.1177/17579139221080608
  • Donabedian, A. (1988). The quality of care. How can it be assessed? JAMA, 260(12), 1743–1748. https://doi.org/10.1001/jama.1988.03410120089033
  • Druica, E., Ianole-Calin, R., Baicus, C., & Dinescu, R. (2021). Determinants of satisfaction with services, and trust in the information received in community pharmacies: A comparative analysis to foster pharmaceutical care adoption. Healthcare (Basel), 9(5), 562. https://doi.org/10.3390/healthcare9050562
  • Eldooma, I., Maatoug, M., & Yousif, M. (2023). Outcomes of pharmacist-led pharmaceutical care interventions within community pharmacies: Narrative review. Integrated Pharmacy Research and Practice, 12, 113–126. https://doi.org/10.2147/IPRP.S408340
  • The European Commission. (2023). State of health in the EU – România. Profil de țară din 2023 în ceea ce privește sănătatea [Romania – 2023 Country Profile on Health]. https://health.ec.europa.eu/system/files/2024-01/2023_chp_ro_romanian.pdf
  • Figshare. (2022). Supporting information. Questionnaire tool – Public Health Care Patient Satisfaction Questionnaire (PHC-PSQ). Retrieved March 10, 2022, from https://figshare.com/articles/journal_contribution/Public_Health_Clinic-Patient_Satisfaction_Questionnaire_PHC-PSQ_/13216624
  • FIP-The International Pharmaceutical Federation. (1997). Standard for quality of pharmacy services – Good pharmacy practice. https://www.fip.org/files/fip/Statements/latest/Dossier%20004%20total.PDF
  • FIP-The International Pharmaceutical Federation. (2011). Joint FIP/WHO guidelines on good pharmacy practice: Standards for quality of pharmacy services. https://www.fip.org/files/fip/WHO/GPP%20guidelines%20FIP%20publication_final.pdf
  • FIP-The International Pharmaceutical Federation. (2020). Community pharmacy section – Vision 2020-2025 Pharmacist at the heart of the communities. https://www.fip.org/files/CPS_vision_FINAL.pdf
  • The Government of Romania. (2018). Ordonanța de urgență nr. 8/2018 privind reglementarea unor măsuri în domeniul sănătății [Emergency ordinance no. 8/2018 on the regulation of some measures in the field of health]. Monitorul Oficial, 190. http://legislatie.just.ro/Public/DetaliiDocumentAfis/198225
  • Hancu, G. (2023). Despre serviciile farmaceutice [About pharmaceutical services]. Univers Farmaceutic. https://www.universfarmaceutic.ro/farmacie/despre-serviciile-farmaceutice-20230609
  • Hepler, C. D., & Strand, L. M. (1990). Opportunities and responsibilities in pharmaceutical care. American Journal of Hospital Pharmacy, 47(3), 533–543.
  • Hindi, A. M. K., Schafheutle, E. I., & Jacobs, S. (2019). Community pharmacy integration within the primary care pathway for people with long-term conditions: A focus group study of patients’, pharmacists’ and GPs’ experiences and expectations. BMC Family Practice, 20(1), 26. https://doi.org/10.1186/s12875-019-0912-0
  • Huang, R., Ding, S., Xiao, Y., Jiang, F., Chen, Y., Zhang, J., & Zhou, J. (2023). Development and validation of a patient satisfaction survey for pharmaceutical service at primary care settings. International Journal for Quality in Health Care, 35(3), mzad053. https://doi.org/10.1093/intqhc/mzad053
  • The International Organization for Standardization. (2015). Quality management principles. https://www.iso.org/files/live/sites/isoorg/files/store/en/PUB100080.pdf
  • The International Society for Quality in Health Care. (2015). Guidelines and principles for the development of health and social care standards. 4th edition. version 1.2. https://isqua.org/media/attachments/2018/03/20/guidelines_and_principles_for_the_development_of_health_and_social_care_standards__4th_edition_v1.2.pdf
  • Ismail, A., Gan, I. N., & Ahmad, N. (2020). Factors associated with patient satisfaction towards pharmacy services among outpatients attending public health clinics: Questionnaire development and its application. PLoS One, 15(11), e0241082. https://doi.org/10.1371/journal.pone.0241082
  • Johnson, S. R. (2023). 10 Countries with the best public health care systems. News & World Report. https://www.usnews.com/news/best-countries/slideshows/countries-with-the-most-well-developed-public-health-care-system
  • Koster, E. S., Blom, L., Overbeeke, M. R., Phibert, D., Vevloet, M., Koopman, L., & van Dijk, L. (2016). Quality of pharmaceutical care at the pharmacy counter: Patients’ experiences versus video observation. Patient Preference and Adherence, 10, 363–369. https://doi.org/10.2147/PPA.S102032
  • Larasanty, L. P. F., Cahyadi, M. F., Sudarni, N. M. R., & Wirasuta, M. A. G. (2019). Patient satisfaction with pharmaceutical care services provided at primary-level and secondary-level health facilities in Indonesia’s health coverage system. Journal of Health Research, 33(1), 80–88. https://doi.org/10.1108/JHR-06-2018-0033
  • Larson, L. N., & MacKeigan, L. D. (1994). Further validation of an instrument to measure patient satisfaction with pharmacy services. Journal of Pharmaceutical Marketing & Management, 8(1), 125–139. https://doi.org/10.3109/J058v08n01_08
  • MediJobs. (n.d.). Punctele EFC pentru farmaciști și asistenți farmaciști. Ce sunt și cum le poți obține? [EFC points for pharmacists and pharmacist assistants. What are they and how can you get them?]. Retrieved June 16, 2024, from https://medijobs.ro/blog/puncte-efc-pentru-farmacisti-si-asistenti-farmacisti
  • Mehralian, G., Rangchian, M., & Rasekh, H. R. (2014). Client priorities and satisfaction with community pharmacies: The situation in Tehran. International Journal of Clinical Pharmacy, 36(4), 707–715. https://doi.org/10.1007/s11096-014-9928-7
  • Melton, B. L., & Lai, Z. (2017). Review of community pharmacy services: What is being performed, and where are the opportunities for improvement? Integrated Pharmacy Research and Practice, 6, 79–89. https://doi.org/10.2147/IPRP.S107612
  • Naser, A., & Sbeat, B. S. A. (2022). Satisfaction with community pharmacies services in Jordan: A cross-sectional study. Saudi Pharmaceutical Journal, 30(11), 1646–1651. https://doi.org/10.1016/j.jsps.2022.09.007
  • The National Agency of Medicines and Medical Devices from Romania. (2024). Nomenclatorul medicamentelor pentru uz uman [Nomenclature of medicines for human use]. Retrieved June 18, 2024, from https://nomenclator.anm.ro/medicamente
  • The National Emergency Committee for Emergency Situations. (2023). Hotărâre nr. 20/2023 privind constatarea încetării stării de risc epidemiologic și biologic generate de pandemia de COVID-19 [Decision no. 20/2023 regarding the finding that the state of epidemiological and biological risk generated by the COVID-19 pandemic has ceased]. Monitorul Oficial, 595. https://legislatie.just.ro/Public/DetaliiDocument/271771
  • The National Institute of Statistics. (2023). Câştigul salarial mediu brut pe economie în luna Ianuarie 2023 a fost 6831 lei şi cel net 4254 lei [The average economy gross salary gain per month January 2023 was 6831 lei and the net 4254 lei]. https://insse.ro/cms/sites/default/files/com_presa/com_pdf/cs01r23.pdf
  • The National Institute of Statistics. (n. d.). Statistical databases, Tempo-online. Retrieved June 16, 2024, from http://statistici.insse.ro:8077/tempo-online/#/pages/tables/insse-table
  • NPA-National Pharmacy Association The Pharmacy Center. (2023). Community Pharmacy Patient Questionnaire (CPPQ). Retrieved March 10, 2023, from https://www.thepharmacycentre.com/page/cppq
  • Pana, M. (2022). SOS – despre prețurile medicamentelor. [SOS - about drug prices]. Univers Farmaceutic. https://www.universfarmaceutic.ro/farmacie/sos-despre-preturile-medicamentelor
  • Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1985). A conceptual model of service quality and its implications for future research. Journal of Marketing, 49(4), 41–50. https://doi.org/10.1177/002224298504900403
  • The Parliament of Romania. (2015a). Lege nr. 95/2006 (republicată) privind reforma în domeniul sănătății [Law no. 95/2006 (republished) on health reform]. Monitorul Oficial, 652. https://legislatie.just.ro/Public/DetaliiDocument/71139#id_ttlA4931_ttl
  • The Parliament of Romania. (2015b). Legea Farmaciei nr. 266/2008 (republicată) [Pharmacy Law no. 266/2008 (republished)]. Monitorul Oficial, 85. https://legislatie.just.ro/Public/DetaliiDocument/109030
  • The Parliament of Romania. (2017). Legea nr. 185/2017 privind asigurarea calității în sistemul de sănătate [Law no. 185/2017 regarding quality assurance in the health system]. Monitorul Oficial, 599. http://legislatie.just.ro/Public/DetaliiDocument/191668
  • The Parliament of Romania. (2020). Legea nr. 243/2020 privind aprobarea Ordonanței Guvernului nr. 4/2018 pentru modificarea și completarea Legii farmaciei nr. 266/2008 [Law no. 243/2020 regarding the approval of Government Ordinance no. 4/2018 for amendment and completion Pharmacy Law no. 266/2008]. Monitorul Oficial, 1042. https://legislatie.just.ro/Public/DetaliiDocumentAfis//232728
  • PGEU-Pharmaceutical Group of European Union. (2019). Pharmacy 2023: a vision for community pharmacy in Europe. https://www.pgeu.eu/wp-content/uploads/2019/03/Pharmacy-2030_-A-Vision-for-Community-Pharmacy-in-Europe.pdf
  • Policarpo, V., Romano, S., Antonio, J. H. C., Correia, T. S., & Costa, S. (2019). A new model for pharmacies? Insights from a quantitative study regarding the public’s perceptions. BMC Health Services Research, 9, 186. https://doi.org/10.1186/s12913-019-3987-3
  • Pop, T. L., Burlea, M., Falup-Pecurariu, O., Borzan, C., Gabor-Harosa, F., Herdea, V., Pop, C. F., Rajka, D., Ognean, M. L., & Cainap, S. S. (2020). Overview of the pediatric healthcare system in Romania. Türk Pediatri Arşivi, 55(Suppl 1), 69–84. https://doi.org/10.14744/TurkPediatriArs.2020.77775
  • The President of Romania. (2020). Decret nr. 195/2020 privind instituirea stării de urgență pe teritoriul României [Decree no. 195/2020 regarding the establishment of the state of emergency on the territory of Romania]. Monitorul Oficial, 212, 1–11. https://legislatie.just.ro/Public/DetaliiDocumentAfis/223831.
  • The Romanian Constitution. (n.d.). Art. 34 – Dreptul la ocrotirea sănătății [Art. 34 – The right to health protection]. Retrieved June 16, 2024, from https://www.constitutiaromaniei.ro/art-34-dreptul-la-ocrotirea-sanatatii/
  • The Romanian Ministry of Health. (2010). Ordin nr. 75/2010 pentru aprobarea Regulilor de bună practică farmaceutică [Order no. 75/2010 for the approval of the Rules of good pharmaceutical practice]. Monitorul Oficial, 91. https://legislatie.just.ro/Public/DetaliiDocumentAfis/115957
  • The Romanian Ministry of Health. (2017). Ordin nr. 368/2017 pentru aprobarea Normelor privind modul de calcul și procedura de aprobare a prețurilor maximale ale medicamentelor [Order no. 368/2017 for the approval of the Norms regarding the method of calculation and the procedure for approving the maximum prices of medicines]. Monitorul Oficial, 215. https://legislatie.just.ro/Public/DetaliiDocument/187803
  • The Romanian Ministry of Health. (2019). Norme din 2019 privind înființarea, organizarea și funcționarea unităților farmaceutice [Rules of 2019 on the establishment, organization and operation of pharmaceutical establishments]. Monitorul Oficial, 270. https://legislatie.just.ro/Public/DetaliiDocumentAfis/246935
  • The Romanian Ministry of Health. (2021). Ordin nr. 2382/2021 pentru aprobarea Metodologiei de realizare şi implementare a serviciilor farmaceutice și a Nomenclatorului de servicii farmaceutice [Order no. 2382/2021 the approval of the Methodology for the realization and implementation of pharmaceutical services and the Nomenclature of pharmaceutical services]. Monitorul Oficial, 1061. https://legislatie.just.ro/Public/DetaliiDocument/248262
  • The Romanian Ministry of Health. (2022). Regulament de organizare și funcționare al Agenţiei Naţionale a Medicamentului şi a Dispozitivelor Medicale din Români [Regulation of organization and operation of the National Agency of Medicines and Medical Devices from Romanians]. Monitorul Oficial, 283. https://legislatie.just.ro/Public/DetaliiDocument/253170
  • The Romanian Ministry of Health. (2023). Instrucțiune nr. 161/2023privind instituirea stării de alertă epidemiologică determinate de gripă [Instruction no. 161/2023 regarding the establishment of the state of epidemiological alert determined by the flu]. Monitorul Oficial, 5. https://legislatie.just.ro/Public/DetaliiDocument/263711
  • The Romanian Pharmacists Association. (2019). Decizie privind stabilirea numărului de credite EFC [Decision regarding the establishment of the number of EFC credits]. https://www.colegfarm.ro/userfiles/file/Decizie%204_20219%20privind%20stabilirea%20nr.%20de%20credite%20EFC.pdf
  • The Romanian Pharmacists Association. (2021). Decizie nr. 5/2021 privind aprobarea procedurii de control şi evaluare a unităţilor farmaceutice cu privire la Regulile de bună practică farmaceutică [A decision no. 5/2021 regarding the approval of the control and evaluation procedure of pharmaceutical units regarding the Rules of good pharmaceutical practice]. Monitorul Oficial, 1195. https://legislatie.just.ro/Public/DetaliiDocument/249309
  • Saffaei, A., Moghaddas, A., & Sabzghaabaee, A. M. (2021). Patients’ satisfaction with the community pharmacy services in Iran. Journal of Research in Pharmacy Practice, 10(3), 133–137. https://doi.org/10.4103/jrpp.JRPP_21_21
  • Sepp, K., Cavaco, A. M., Raal, A., & Volmer, D. (2021). Profession driven improvement of the quality of pharmacy practice – implementation of Community Pharmacy Services Quality Guidelines in Estonia. Healthcare (Basel), 9(7), 804. https://doi.org/10.3390/healthcare9070804
  • Shrestha, S., Sapkota, B., Thapa, S., Bhuvan, K., & Khanal, S. (2020.Translation). Cross-cultural adaptation and validation of Patient Satisfaction with Pharmacist Services Questionnaire (PSPSQ 2.0) into the Nepalese version in a community settings. PLoS One, 15(10), e0240488. https://doi.org/10.1371/journal.pone.0240488
  • Traverso, M. L., & MacKeigan, L. D. (2005). Instruments for measuring patient satisfaction with pharmacy services in the Spanish language. Pharmacy World & Science, 27(4), 281–284. https://doi.org/10.1007/s11096-005-7114-7
  • Vladescu, C., Scintee, S. G., Olsavszky, V., Hernandez-Quevedo, C., & Sagan, A. (2016). Romania: Health system review. Health Syst Tranzit, 18(4), 1–170.
  • Wikipedia. (n. d.). Romanian language. Retrieved June 16, 2022, from https://en.wikipedia.org/wiki/Romanian_language
  • The World Health Organization. (2018). Handbook for national quality policy and strategy: A practical approach for developing policy and strategy to improve quality of care. https://apps.who.int/iris/handle/10665/272357
  • Zuckerman, A. D., Whelchel, K., Kozlicki, M., Simonyan, A. R., Donovan, J. L., Gazda, N. P., Mourani, J., Smith, A. M., Young, L., Ortega, M., & Kelley, T. N. (2022). Health-system specialty pharmacy role and outcomes: A review of current literature. American Journal of Health-System Pharmacy, 79(21), 1906–1918. https://doi.org/10.1093/ajhp/zxac212