1,506
Views
15
CrossRef citations to date
0
Altmetric
Original Article

Influence of patient characteristics on preventive service delivery and general practitioners’ preventive performance indicators: A study in patients with hypertension or diabetes mellitus from Hungary

, , , , , , , , , , , & show all
Pages 183-191 | Received 25 May 2016, Accepted 05 Jun 2018, Published online: 02 Aug 2018

Abstract

Background: Regular primary healthcare (PHC) performance monitoring to produce a set of performance indicators for provider effectiveness is a fundamental method for improving guideline adherence but there are potential negative impacts of the inadequate application of this approach. Since performance indicators can reflect patient characteristics and working environments, as well as PHC team contributions, inadequate monitoring practices can reduce their effectiveness in the prevention of cardiometabolic disorders.

Objectives: To describe the influence of patients’ characteristics on performance indicators of PHC preventive practices in patients with hypertension or diabetes mellitus.

Methods: This cross-sectional analysis was based on a network of 165 collaborating GPs. A random sample of 4320 adults was selected from GP’s patient lists. The response rate was 97.3% in this survey. Sociodemographic status, lifestyle, health attitudes and the use of recommended preventive PHC services were surveyed by questionnaire. The relationship between the use of preventive services and patient characteristics were analysed using hierarchical regression models in a subsample of 1659 survey participants with a known diagnosis of hypertension or diabetes mellitus.

Results: Rates of PHC service utilization varied from 18.0% to 97.9%, and less than half (median: 44.4%; IQR: 30.8–62.5) of necessary services were used by patients. Patient attitude was as strong of an influencing factor as demographic properties but was remarkably weaker than patient socioeconomic status.

Conclusion: These findings emphasize that PHC performance indicators have to be evaluated concerning patient characteristics.

KEY MESSAGES

  • In Hungarian primary care, less than half of necessary preventive services for adult patients with hypertension or diabetes mellitus are delivered.

  • Patients’ sociodemographic characteristics and health attitude significantly affect the utilization rates.

  • Interventions for improving utilization rates have to be based on general practice level performance indicators adjusted for patients’ characteristics.

Introduction

The exploitation of primary healthcare (PHC) opportunities is essential in tackling the most critical public health problems beyond just extending the range of services available at the PHC level [Citation1]. This requires improving the quality of services provided, which depends on high rates of guideline adherence. It is widely accepted that the application of PHC performance monitoring is a fundamental method for achieving high adherence to guidelines since this approach can be used to assess the relative effectiveness and to make regular comparative evaluations of PHC practices [Citation2,Citation3]. This assertion has been demonstrated by the PHC performance monitoring systems that operate in many countries [Citation4–7].

Although the usefulness of general practitioner (GP) performance monitoring is apparent, there are well-known problems with this approach [Citation8–13]. These potential negative impacts and difficulties with implementation emphasize that only reliable provider indicators are useful in managing PHC problems and highlights the necessity of refraining from monitoring if the set of indicators is not complete.

Based on PHC monitoring experience, only a small proportion of the variability in provider indicators can be explained by the quality of the PHC team’s professional contribution. The main determining factors are patient characteristics and the parameters of the institutional environment [Citation14–17]. Therefore, systems that utilize monitoring results should primarily consider essential provider indicators as a reflection of the critical working environment (where an above-average professional effort can achieve target performance because of a working environment of above-average difficulty). Accepting that both disadvantageous patient characteristics and an unfavourable institutional environment can be the base cause of difficulties, the explanation for the critical indicator value is rarely a low level of professional contribution by the PHC team [Citation18,Citation19].

Consequently, the preparation of an intervention based on an alarming indicator value requires an understanding of the causes of low performance.

If the main contribution of monitoring is not the identification of outlier providers but rather the understanding of the causes of performance variability, then there is a need to extend monitoring by incorporating as many patient characteristics as possible. This task is more difficult than using data related to the processes and outcomes that are registered somewhere in the usual health documentation of patients.

Our study on patients with hypertension or diabetes mellitus aimed to describe the influence of the patient characteristics (sociodemographics, lifestyles, and health attitudes) on performance indicators for recommended PHC preventive services and to demonstrate the constraints of using performance indicators without adjusting for patient characteristics.

Methods

Study design

This study used a questionnaire-based survey involving a network of 165 GPs, who were organized for participation in a primary care model-programme in Hungary. The programme aimed to develop or improve the preventive services available at the PHC level [Citation20].

Setting and study population

The network consists of a group of GPs involved in developing new services and another group providing reference data to evaluate the effectiveness of these efforts. Data analysed in the present study came from a random sample of adults collected using a baseline survey before service development.

The ‘new services developing group’ consisted of 34 GPs. A list of adults aged 18 or older compiled by these GPs was used as a sampling frame. Fifty adults from each practice were randomly selected, resulting in a sample of 1700 people. The General Practitioners Morbidity Monitoring System (GPMMS) [Citation21] organized the ‘reference data producing group’. The sampling frame of adults aged 18 or older and registered within one of the 131 GPMMS practices was used to select randomly 20 subjects from each practice. This sample consisted of 2620 people.

Thus, 4320 subjects were selected for the study; of these, 4202 signed the informed consent (97.3%). Adults with hypertension or diabetes mellitus known by GP irrespective of their treatment status were identified in the two parts of the sample, and the data obtained for these patients were analysed in the present study (1659 patients; see ).

Figure 1. Selection of study patients from participants of the baseline survey of a primary healthcare service development programme.

Figure 1. Selection of study patients from participants of the baseline survey of a primary healthcare service development programme.

Data collection

The questionnaire surveyed the cardiometabolic risk status and use of preventive PHC services by subjects. The nurses employed in the participating medical practices were the interviewers. They visited personally (many times if it was needed) the selected subjects if they did not respond to the invitation. The data collection started in December 2012 and finished in July 2013.

Variables

Assessment of sociodemographic characteristics and lifestyle variables

Questions were taken from the Hungarian implementation of the first wave of the European Health Interview Survey [Citation22].

  • Sociodemographic factors: age (in 15–44, 45–64, 65–X year groups), sex, education level (primary or less, vocational, high school, and tertiary), ethnicity (the only ethnic minority in Hungary is Roma, who have a disadvantageous health status in general; self-declaration classified a Roma ethnicity), and eligibility for a prescription exemption certificate (which ensures free of charge access to medicines and medical devices for patients living in deprivation).

  • Lifestyle: smoking behaviour (regular, every day smoker or not), alcohol misuse (CAGE classification), body mass index (underweight < 20; 20 ≤ normal <25, 25 ≤ overweight < 30, obese ≥ 30; patient-reported data), and central obesity (measuring waist circumference; healthy thresholds: men ≤ 94, women ≤ 80).

Health attitudes

Assessed using eight questions (see ) from the Health Education Monitoring Survey (UK) of the Office for National Statistics [Citation23], which had been used in a nationwide representative survey for WHO European Regional Office to describe the health attitude of Hungarian adults (unpublished report). Respondents were asked to rate their answers on a scale of agreement (strongly agree, agree, neither agree nor disagree, disagree, strongly disagree). The frequency of strong agreement was calculated for all statements.

Table 1. Proportion of adult patients with hypertension or diabetes mellitus, who strongly agreed with statements related to health attitudes, and the factors identified in the principal component analysis (n = 1659).

Use of preventive services (as prescribed for patients with a cardiometabolic disease by Decree no. 51/1997 of the Minister of Welfare)

Investigated by collecting the following variables: measurement of blood pressure, serum glucose, serum lipid parameters, urinary creatinine and urinary protein (in 12 months); assessment (in 24 months) of family history, dietary habit, smoking habit; measurement (in 24 months) of body weight and waist circumference); atherosclerosis evaluation over 40 years of age (in 24 months); screening (in 24 months) for alcohol misuse and oral cavity disorders; visual acuity and hearing loss over 65 years of age (in 36 months); participation (motivated by GPs) in screening for breast cancer (women 45–65 years, in 24 months), cervical cancer (women 25–65 years, in 36 months), prostate cancer (men 65+ years, in 36 months), and colorectal cancer (50–75 years, in 36 months).

Performance indicators

The counselling by GP (CGP) and physical examination by GP (PGP) indicators summarize family history, alcohol use, smoking and nutrition-related counselling activities of GPs, and body weight, waist circumference, blood pressure, oral cavity status, vision loss and hearing loss examinations by GPs, respectively. CGP and PGP indicators were aggregated into a counselling and physical examination by GP (CPGP) indicator. Referral to laboratory investigations (LAB) and referral to organized cancer screening (SCR) indicators combine serum glucose, serum lipid, urinary creatinine, and urinary protein measurements and cervical, breast, prostate, and colorectal cancer screening, respectively. The referral to secondary care (SEC) indicator summarizes the LAB and SCR indicators. The use of preventive services (UPS) indicator covers all of the preventive activities.

Statistical analysis

The rate of PHC service utilization (proportion of adults who used preventive services) was calculated for each service, along with 95% confidence intervals 95%CIs). Summary measures, aggregated ratios (CGP, PGP, CPGP, LAB, SCR, SEC and UPS) were computed as the number of services utilized and the number of services that should have been used considering the age and sex of the patient. Medians with their corresponding interquartile ranges were calculated for these aggregated ratios.

Attitude-related variables were processed using principal component analysis with PROMAX rotation to reduce the number of explanatory variables introduced into the statistical models. The relationships between the use of preventive services and patient characteristics were analysed using hierarchical multivariate logistic regression models for each summary indicator of service use with general medical practice effects, separately. Median values of patients’ service use in the whole sample were applied to dichotomize the use of recommended preventive service outcome indicators to make a distinction between patients with higher than median and not higher than median service use. The dichotomized indicators were used as outcome variables in the regression models. The results are presented as odds ratios with 95%CIs. Analyses were performed using PASW Statistics version 18 (Armonk, New York, United States).

Results

The participants’ characteristics are summarized in .

Table 2. Distribution of patients’ characteristics in the study sample (1659 adult patients with hypertension or diabetes mellitus).

Health attitudes of patients

The distribution of opinions regarding health attitude statements is summarized in . The opinions were useful for factor analysis (Kaiser–Meyer–Olkin measure (KMO) 0.645); Bartlett’s test P < 0.001). Three factors had an eigenvalue greater than 1 and were responsible for 54.03% of the total variance. This analysis yielded three factors. Statements with a loading value higher than 0.5 were considered as main factor components. Factors 1, 2, and 3 were primarily determined by the 3rd, 4th, 5th, and 6th; the 1st, and 2nd; the 7th, and 8th statements, respectively. After evaluating the contents of factor-building statements, factors 1, 2, and 3 were referred to as responsibility averting, dedicated to health, and faithful attitudes, respectively. The resulting factor scores with a standard normal distribution were introduced into regression models as continuous explanatory variables.

Preventive service use and performance indicators

Service use varied considerably (median: 38.6%; IQR: 30.63–62.1), from 18.0% for colorectal cancer screening to 97.9% for hypertension screening ().

Table 3. Unadjusted service utilization frequencies for the investigated preventive services among adult patients with hypertension or diabetes mellitus (n = 1659).

The medians of summary performance indicators varied between 0% (the median subject was not referred to organized cancer screening by the GP at all) and 75% (the median subject was referred to 75% of necessary laboratory investigations by the GP) ().

Table 4. Preventive service utilization in the studied sample of adult patients with hypertension or diabetes mellitus, and the median ratioTable Footnotea of patients’ preventive service utilization within groups of preventive services (n = 1659).

Patient factors influencing preventive service use

The nature of the associations between the patient characteristics and service utilization rates are shown in .

Table 5. Patient characteristics influencing the utilization of preventive services by GPs according to hierarchical multivariate logistic regression models with general practice effects (ORs with 95%CIs; n = 1659).

Sociodemographic factors

The female sex was positively associated with SCR (and consequently with SEC) and inversely related to the direct actions of GP (CGP, PGP, CPGP). Older age was less frequently associated with CGP, PGP, CPGP, and SCR. LAB was strongly associated with older subjects. A higher level of education was a decisive factor for each indicator. The Roma ethnicity showed association with CGP (and consequently with CPGP) and SCR. The patients with eligibility for prescription exemption certificates were more likely to be provided with both CGP and PGP (and consequently with CPGP), as well as with LAB (and thus with SEC).

Lifestyle factors

The only indicator that had a severity-dependent association with BMI was LAB. SCR alone showed a positive association with central obesity. CGP was more strongly associated with smoking assessment, and SEC was less frequent among regular smokers. Alcohol misuse was a negative factor for SCR, but a positive one for CGP (and consequently for CPGP).

Health attitudes

The responsibility-averting attitude was a factor in reducing the rate of PHC service utilization rates for all indicators apart from the PGP. The dedicated to health (for CGP, CPGP) and the faithful attitude (for CGP, CPGP, LAB, and SEC) proved to be significant influencing factors for more intensive service usage.

In general, the UPS was negatively associated with female sex, an older age, and a responsibility-averting attitude and positively with higher education, eligibility for a prescription exemption certificate, and dedicated to health, and faithful attitudes.

Discussion

Main findings

Our investigation demonstrated that the observed 44.4% median use of PHC related preventive services varied significantly by the patients’ age, sex, education, deprivation (indicated by the eligibility for prescription exemption certificates), and attitude.

Although there were considerable differences among the rates at which the investigated services were utilized, most rates were quite low. The socio-economic status indicated by education and eligibility for prescription exemption certificates proved to be the strongest and most consequential factor influencing preventive service use.

Regarding the summary indicator of UPS, patients’ health attitudes had a significant influence, but this effect was not observable for each studied performance indicator. Altogether, attitude had an impact similar to that of sex and age (taking into account that the age range in the studied population was 90 years).

Our results demonstrate that a disadvantageous health behaviour (indicated by regular smoking, alcohol misuse, central obesity, and a high BMI in our investigation) does not have similar importance in the provision of preventive services relative to its importance in determining the long-term outcomes of their cardiometabolic disorders.

Strengths and limitations

The studied sample was selected at random, and the response rate was high, which prevented the patient level selection bias.

GP participation was voluntary, and it is likely that participants represent the GPs who are more committed to the quality of care. Consequently, the observed rates at which services were provided in the present study may be overestimated. This bias only limits the external validity of our research but does not limit the internal validity.

Because nurses who were involved in the care of the survey participants collected data on service use, it is probably well registered. However, there may be a small number of investigations carried out by secondary care providers that remained hidden due to incomplete reporting to the GP or inaccurate recall by the patients. Altogether, there is likely a small probability of an absent registration or the miscoding of service use.

However, services were not strictly defined in the study beyond the standard definitions, and the reported services could vary by content and quality (especially in the case of checks for arteriosclerosis). Our study could not evaluate the association between quality of preventive services and patient characteristics.

The study model did not cover the PHC organizational environment. For example, availability of laboratories and diagnostic facilities at secondary care providers, support of municipalities for PHC providers) were not covered by the data collection. Since all the patients of a particular GP are exposed to the same organizational environment, the lack of the control for these availability factors cannot influence the observed association between patient characteristics and preventive service use.

Since the attitudes were not assessed in a detailed way, and the study design precluded the evaluation of causality, further investigations are needed to clarify the mechanisms by which the patients’ attitudes and the preventive service utilization are associated. Our observations do not suggest that the patients’ limited willingness to cooperate with GPs is the only cause of preventive service failure, and do not exclude that the GPs’ attitude towards patients with certain attitude results in variability in service provided. The distribution of responsibility between patients and GPs in the failure of service use needs additional research.

Results in relation to existing literature

The weak adherence to recommendations for primary care level preventive services observed in our investigation is in concordance with the general weakness of the Hungarian PHC system [Citation24], and it suggests that Hungarian PHC teams do not strictly follow guidelines, which may contribute to the tenth highest hypertension and hyperglycaemia related mortality of the world [Citation25]. Furthermore, the less than recommended level utilization of preventive services among patients with hypertension or diabetes mellitus is similar to that observed among adults without hypertension or diabetes mellitus observed in Hungary [Citation26].

Our study confirmed formerly published results from Spain [Citation14], Canada [Citation15], and the US [Citation16] on the significant role of patient characteristics on PHC service utilization rates. Our observations are in line with the conclusion from a review that the non-patient related factors are responsible for not more than 20% of the variability of healthcare quality indicators [Citation27]. Furthermore, the better quality of hypertension or diabetes mellitus care for male and more aged patients was observed not only in our study but also in the UK [Citation28] and in the US [Citation29].

Implications

These findings emphasize that to be useful in assessing PHC services, performance monitoring (which needs to recognize performance deviations and to detect the causes of performance deviations) has to identify patient characteristics (high-risk groups) associated with low-quality preventive care. Its goal should be to determine target groups of intervention in addition to identifying problems in the provision of preventive services for patients with hypertension or diabetes mellitus.

Conclusion

Our results demonstrate that those patient characteristics, such as sociodemographic properties and health attitude are associated with the utilization of PHC preventive services. It suggests that variability in how PHC providers’ performance in providing preventive services is significantly associated with patient characteristics.

Ethics

The study protocol has been approved by the Ethics Committee of the Hungarian National Scientific Council on Health. (TUKEB-57097/2012/EKU and TUKEB-2213-6/2013/EKU).

Acknowledgements

The authors thank the support of János Szabó, István Völgyi, Gábor Benkő, János Cséki in the data collection fieldwork.

Disclosure statement

The authors report no conflicts of interest. The authors alone are responsible for the content and writing of the paper.

Additional information

Funding

This study was funded by the Swiss Contribution Programme (SH/8/1), and by the TÁMOP-4.2.2.AA-11/1/KONV-2012-0031 (IGEN-HUNGARIAN) project, which was co-financed by the European Union and the European Social Fund, and by the Hungarian Academy of Sciences (MTA 11003, 2006TKI227).

References

  • Jakab Z. Public health, primary care and the ‘cluster’ model. Eur J Public Health. 2013;23:528.
  • Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–1230.
  • Unverzagt S, Oemler M, Braun K. Strategies for guideline implementation in primary care focusing on patients with cardiovascular disease: a systematic review. Fam Pract. 2014;31:247–266.
  • Rushforth B, Stokes T, Andrews E, et al. Developing ‘high impact’ guideline-based quality indicators for UK primary care: a multi-stage consensus process. BMC Fam Pract. 2015;16:156.
  • Dowd B, Li CH, Swenson T. Medicare’s Physician Quality Reporting System (PQRS): quality measurement and beneficiary attribution. Medicare Medicaid Res Rev. 2014;4:E1–E14.
  • Mainz J, Krog BR, Bjørnshave B. Nationwide continuous quality improvement using clinical indicators: the Danish National Indicators Project. Int J Qual Health Care. 2004;16:45–50.
  • Williams J. The continuing quest for primary healthcare reform: measuring performance. Healthc Policy. 2011;7:8–11.
  • Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes (review). The Cochrane Collaboration, The Cochrane Library. 2012, Issue 7. New Jersey: JohnWiley & Sons, Ltd.
  • Ofri D. Quality measures and the individual physician. N Engl J Med. 2010;363:606–607.
  • Mercuri M, Gafni A. Medical practice variations: What the literature tells us (or does not) about what are warranted and unwarranted variations. J Eval Clin Pract. 2011;17:671–677.
  • Rosen AK, Reid R, Broemeling A-M, et al. Applying a risk-adjustment framework to primary care: can we improve on existing measures? Ann Fam Med. 2003;1:44–51.
  • Adams JL, McGlynn EA, Thomas JW, Mehrotra A. Incorporating statistical uncertainty in the use of physician cost profiles. BMC Health Services Research. 2010;10:57.
  • Eijkenaar F, Van Vliet RCJA. Performance profiling in primary care: Does the choice of statistical model matter? Med Decis Making. 2014;34:192–205.
  • Orueta JF, Garcia-Alvarez A, Grandes G, et al. The origin of variation in primary care process and outcome indicators—patients, professionals, centers, and health districts. Medicine. 2015;94:e1314.
  • Beaulieu M-D, Haggerty J, Tousignant P, et al. Characteristics of primary care practices associated with high quality of care. CMAJ. 2013;185:E590–E596.
  • Hofer TP, Hayward RA, Greenfield S, et al. The unreliability of individual physician “report cards” for assessing the costs and quality of care of a chronic disease. J Am Med Assoc. 1999;281:2098–2105.
  • Singh S, Lin Y-L, Kuo Y-F, et al. Variation in the risk of readmission among hospitals: the relative contribution of patient, hospital and inpatient provider characteristics. J Gen Intern Med. 2014;29:572–578.
  • Fung CH, Lim YW, Mattke S. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148:111–123.
  • Werner RM, Asch DA. The unintended consequences of publicly reporting quality information. J Am Med Assoc. 2005;293:1239–1244.
  • Adany R, Kosa K, Sandor J. General practitioners’ cluster: a model to reorient primary health care to public health services. Eur J Public Health. 2013;23:529–530.
  • Széles G, Vokó Z, Jenei T, et al. A preliminary evaluation of a health monitoring programme in Hungary. Eur J Public Health. 2005;15:26–32.
  • The European Parliament and the Council of the European Union. Regulation No 1338/2008 of the European Parliament and of the Council on Community statistics on public health and health and safety at work. OJEU. 2008;51:70–81.
  • Office for National Statistics. Social Survey Division. Health Education Monitoring Survey (HEMS), 1998. [data collection]. UK Data Service. SN: 4137, Available from: http://dx.doi.org/10.5255/UKDA-SN-4137-1
  • Kringos D, Boerma W, Bourgueil Y, et al. The strength of primary care in Europe: an international comparative study. Br J Gen Pract. 2013;63:e742–e750.
  • Institute for Health Metrics and Evaluation (IHME). GBD Compare Data Visualization. Seattle, WA: IHME, University of Washington; 2017. [cited 2018 April 22]. Available from: http://vizhub.healthdata.org/gbd-compare.
  • Sándor J, Nagy A, Földvári A, et al. Delivery of cardio-metabolic preventive services to Hungarian Roma of different socio-economic strata. Fam Pract. 2017;34:83.
  • Fung V, Schmittdiel JA, Fireman B, et al. Meaningful variation in performance: A systematic literature review. Med Care. 2010;48:140–148.
  • Willis TA, West R, Rushforth B, et al. Variations in achievement of evidence-based, high-impact quality indicators in general practice: An observational study. PLoS One. 2017;12:e0177949.
  • O’Connor P, Rush WA, Solberg LI, et al. Variation in quality of diabetes care at the levels of patient, physician, and clinic. Prev Chronic Dis. 2008;5:A15.