1,260
Views
1
CrossRef citations to date
0
Altmetric
Research Articles

The influence of electronic reminders on recording diagnoses in a primary health care emergency department: a register-based study in a Finnish town

, , , , &
Pages 113-122 | Received 24 Jan 2021, Published online: 14 Apr 2021

Abstract

Objective

This study examines whether implementation of electronic reminders is associated with a change in the amount and content of diagnostic data recorded in primary health care emergency departments (ED).

Design

A register-based 12-year follow-up study with a before-and-after design.

Setting

This study was performed in a primary health care ED in Finland. An electronic reminder was installed in the health record system to remind physicians to include the diagnosis code of the visit to the health record.

Subjects and main outcome measures

The report generator of the electronic health record-system provided monthly figures for the number of different recorded diagnoses by using the International Classification of Diagnoses (ICD-10th edition) and the total number of ED physician visits, thus allowing the calculation of the recording rate of diagnoses on a monthly basis and the comparison of diagnoses before and after implementing electronic reminders.

Results

The most commonly recorded diagnoses in the ED were acute upper respiratory infections of various and unspecified sites (5.8%), abdominal and pelvic pain (4.8%), suppurative and unspecified otitis media (4.5%) and dorsalgia (4.0%). The diagnosis recording rate in the ED doubled from 41.2 to 86.3% (p < 0.001) after the application of electronic reminders. The intervention especially enhanced the recording rate of symptomatic diagnoses (ICD-10 group-R) and alcohol abuse-related diagnoses (ICD-10 code F10). Mental and behavioural disorders (group F) and injuries (groups S-Y) were also better recorded after this intervention.

Conclusion

Electronic reminders may alter the documentation habits of physicians and recording of clinical data, such as diagnoses, in the EDs. This may be of use when planning resource managing in EDs and planning their actions.

    KEY POINTS

  • Electronic reminders enhance recording of diagnoses in primary care but what happens in emergency departments (EDs) is not known.

  • Electronic reminders enhance recording of diagnoses in primary care ED.

  • Especially recording of symptomatic diagnoses and alcohol abuse-related diagnoses increased.

Introduction

Electronic reminders have been reported to have some effects when modifying the clinical practice of physicians in primary care [Citation1]. In order to alter physicians’ clinical habits in emergency departments (EDs), electronic reminders have been used for decreasing inappropriate antibiotic [Citation2] and opioid prescription [Citation3]. They have been reported to be useful in promoting the use of an HIV screening program [Citation4] and in enhancing adherence to HIV treatment guidelines [Citation5]. In order to enhance preventive work in EDs, electronic reminders s have been introduced to promote the administration of pneumococci vaccination to patients meeting predetermined criteria for its use [Citation6]. Not all interventions with ERs have been successful, or their impact has been marginal (reviewed in [Citation7]).

One important function of electronic reminders is the improvement of the quality of documentation in EDs [Citation8]. Having recently observed that electronic reminders are effective in increasing the recording rate of diagnoses in ordinary visits of primary care physicians [Citation9,Citation10], it is important to study the association of electronic reminders with documentation in an ED setting. We studied changes in the diagnosis recording rate in a primary health care ED which provides care for unscreened emergency patients in its service area [Citation11,Citation12]. The primary aim of this study was to evaluate whether implementation of electronic reminders altered the rate of recording diagnoses or the content of diagnostic data recorded in a primary health care ED setting.

Methods

Setting and design

The present work is a register-based longitudinal follow-up study with a before-and-after design in the primary care of the city of Vantaa, the fourth largest city of Finland, having about 200,000 inhabitants in the year 2008. This study was performed in the primary health care ED (described in detail earlier [Citation11,Citation12]) which treated all those patients entering the ED without direct referral to specialist care. The physicians working in the ED were both General Practitioners (GPs) and unspecialized primary care physicians. A proportion of them worked permanently in the ED whereas some of them were regular GPs doing occasional duty. The specialist health care ED (Helsinki University Hospital, HUS, Helsingin ja Uudenmaan sairaanhoitopiiri) was located adjacent to the primary care ED and in the case of a need of specialist care the patient was referred to the secondary care [Citation11,Citation12]. The Finnish primary health care and its electronic health record -systems are maintained by municipalities and funded mostly with tax income.

Ethics

This study was carried out by examining data from the electronic health record-system without identifying the patients or ED physicians. The register holder (the health authorities of Vantaa) and the scientific ethical board of Vantaa City (TUTKE) granted permission (VD/8059/13.00.00/2016) to carry out the study.

Data acquisition

The data of the Vantaa primary health care ED system were obtained from the Graphic Finstar-electronic health record system (GFS, Logica LTD, Helsinki, Finland). GFS provides a specific field in the electronic health record-system where an appropriate diagnosis code (based on the 10th version of the International Classification of Diseases, ICD-10) could be entered during the patient’s visit to the ED physician. The system assists the physician in assigning an appropriate diagnosis code or allows the physician to enter the desired diagnosis code to the system directly as described in detail earlier [Citation9,Citation10]. The GFS system prompted ED physicians to enter a diagnosis code every time they wanted to complete recording the visit [Citation9,Citation10]. Upon encounter completion, the electronic health record system prompted the physician of the missing diagnosis code with an additional pop-up question ‘Are you sure you wish to complete the recording without including a diagnosis code?’. The physician then had a possibility to continue completing the recording by answering ‘Yes’ or alternatively, return to the encounter by answering ‘No’ and including the diagnosis code before eventually closing the encounter. The ED had no financial incentives associated with diagnose coding.

Primary and secondary measures

The report generator of the GFS system provided monthly figures for the number of different recorded diagnoses and the total number of ED physician visits, thus allowing the calculation of the recording rate of diagnoses on a monthly basis without identifying individual ED physicians or patients. For analysis, the ICD-10 diagnoses were collected and examined at accuracies of three digits and initial letters. Distributions of the diagnoses recorded in the ED were used as a measure for analysis in this study. The twenty most commonly recorded diagnoses were analyzed in more detail. In addition, the proportion of the visits having a recorded diagnosis in the ED was investigated.

The whole follow-up period consists 6-year time-period before the installation of the electronic reminder into the GFS. This intervention took place on February 1st, 2008. The data was available until December 31st, 2014. After that the ED was outsourced to HUS. Thus, the follow-up lasted altogether for 12 years. The obtained data were analyzed by comparing the rates and proportions of the 20 most frequently recorded diagnoses during the six-year time periods before (2002–2007) and after (2009–2014) the year of the installation of the electronic reminder into the electronic health record system (2008).

Statistical analyses

The comparisons of percentages or amounts of diagnoses before (2002–2007) and after (2009–2014) implementation of the electronic reminder were performed with t-test, Mann-Whitney U test or Χ2 test when appropriate. The rate of change in diagnosis recording was analyzed by using a general linear model of regression analysis allowing us to detect the mean change in the rate of recorded diagnoses (%/month) and its standard error of the mean (SEM) before, at the beginning of the intervention and at the stable state of the intervention (GLM procedure of SigmaPlot 10.0 Statistical Software, Systat Software Inc., Richmond, CA). These rates were then compared with t-test [Citation13–15], and p < 0.05 was considered to indicate a statistically significant difference.

Results

Distribution of diagnoses

During the whole follow-up period, there was a total of 605,704 visits to the ED. Diagnoses were recorded for 350,134 (58%) of these visits. In the ED, visits having one of the 20 most commonly recorded diagnoses constituted 45.9% of the visits for which a diagnosis was recorded (), and 26.5% of all recorded visits. Altogether, 1310 different diagnoses were assigned to the patients. The most commonly recorded diagnoses in the ED were acute upper respiratory infections (5.8%), gastric or pelvic pain (4.8%), middle ear infection (4.5%), back pain (4%), wound in head (2.7%) and acute bronchitis (2.7%) ().

Table 1. Cumulative percentage of visits to the primary health care emergency department physicians as a function of different recorded 10th edition International Classification of Diseases (ICD-10) diagnoses in the city of Vantaa, Finland.

Association between electronic reminders and frequency of recording diagnoses

The percentage of recorded diagnoses in the ED increased by 109% after the application of electronic reminders (). The diagnosis recording rate for visits to ED physicians increased from 41.3 (SD 3.9, SD) (first 6 years before intervention) to 86.3 (SD 3.5) (last 6 years of the intervention, p < 0.001).

Figure 1. Yearly percentage of visits with recorded diagnoses to the physicians of the primary health care Emergency Department before and after implementation of the electronic reminders 2002–2014 in the city of Vantaa, Finland.

Figure 1. Yearly percentage of visits with recorded diagnoses to the physicians of the primary health care Emergency Department before and after implementation of the electronic reminders 2002–2014 in the city of Vantaa, Finland.

There was no change in the monthly rate of recorded diagnoses before the installation of electronic reminders (−0.0097 ± 0.029%/month, p > 0.05). This rate of change increased to 3.56 ± 0.39%/month (p < 0.001) during the first year after the implementation of electronic reminders (). During the next 6 years of the follow-up of the post-intervention period this increase continued (0.12 ± 0.016%/month, p < 0.001). The rate of change in the recording of diagnoses was at its highest during the first year after the intervention (p < 0.001 vs. before intervention or six last years of the follow-up). This rate of change was still higher during the six post-intervention years when compared with the pre-intervention period (p < 0.001, ). The number of monthly visits to the ED decreased during the follow-up ().

Figure 2. Monthly proportion of visits with recorded diagnoses to the physicians of the primary health care Emergency Department 2002–2014 in the city of Vantaa, Finland.

Figure 2. Monthly proportion of visits with recorded diagnoses to the physicians of the primary health care Emergency Department 2002–2014 in the city of Vantaa, Finland.

Figure 3. Number of monthly visits to the primary care emergency department 2002–2014.

Figure 3. Number of monthly visits to the primary care emergency department 2002–2014.

Association of electronic reminders with changes in the distribution of different diagnoses

Mental and behavioural disorders (group F), and injuries (groups S–Y) were more frequently recorded after installation of electronic reminders (). This was both the case with symptomatic diagnoses (group R) as with most of the other main diagnosis groups, too. Instead, proportions of respiratory diseases (group J), miscellaneous infections (groups A and B) and diseases of the eye and the adnexa, and the ear and mastoid process (group H) decreased after this intervention.

Table 2. The distribution of the main groups of 10th edition International Classification of Diseases (ICD-10) diagnoses before (2002–2007) and after (2009–2014) application of electronic reminders in the primary health care emergency department in the city of Vantaa, Finland.

Both absolute numbers and relative proportions of all recorded ICD-10 code group R-diagnoses, such as abdominal and pelvic pain (837 ≥ 1850, 3.6% ≥ 5.8%), pain in throat and chest (290 ≥ 748, 1.3% ≥ 2.3%), malaise and fatigue (109 ≥ 549, 0.5% ≥ 1.7%), and abnormalities of breathing (182 ≥ 413, 0.8% ≥ 1.3%), increased after the installation of electronic reminders (). Diagnosis related to alcohol abuse (ICD-10 code F10) also increased (209 ≥ 885, 1.0% ≥ 2.8%) (). Various infections of upper respiratory airways were recorded less frequently after the installation of ERs ().

Table 3. Percentages and absolute numbers of the 20 most common 10th edition International Classification of Diseases (ICD-10) diagnosis groups 6 years before and after the implementation of electronic reminders during the follow-up 2002–2014.

Discussion

Most of the recorded diagnoses in the ED were infections in the superior part of the respiratory system. Electronic reminders were effective in facilitating the recording of diagnoses. Especially the recording of symptomatic diagnoses (ICD-10 code group R-diagnoses), mental and behavioural disorders (group F), and injuries (groups S-Y) were enhanced after implementation of electronic reminders. Additionally, diagnoses related to alcohol abuse increased.

The strength of this study is that the present result reflects real clinical activity in primary health care EDs. Thus, these results are only applicable with certainty to primary health care EDs. Due to the retrospective setting, the participants were unaware of being studied. Lack of data concerning individual physicians and their behavior inhibits us from drawing conclusions about whether there were physicians who did not respond to this intervention or whether there were physicians who regularly recorded inappropriate diagnoses despite the electronic reminders. We cannot totally exclude secular trends contributing partly to the changes in diagnosis recording rates. In the time of the follow-up there were also other changes in the ED, such as application of ABCDE-triage from February 1st, 2004 [Citation11] and its revised version [Citation16] from February 1st 2008 [Citation17], and a decrease of evening practices in the primary care of the Western part of Vantaa starting on June 1st 2005 [Citation12]. Neither we know surely whether electronic reminder system was solely responsible for change in practice or how much increased recording was due to education. However, the change in recording diagnoses was abrupt and happened right after the electronic reminder was introduced. Thus, this has much larger impact than reminders guiding testing or prescribing [Citation1]. Therefore, it is fair to conclude that the reminder played large role considering the fact that the diagnosis recording rate remained elevated throughout the remainder of the follow-up period. This is not to be interpreted that the individual feedback had no effect in terms of facilitating the change. However, there was considerable variation in the amount and frequency of feedback given to the doctors in the primary care of Vantaa [Citation9,Citation10] whereas the reminder was introduced systematically and simultaneously to all users in 2008.

In this context, it is important to notice that despite the rate of recorded diagnoses increasing with electronic reminders, categorizing patients with diagnoses per se does not automatically lead to better quality in the contents of recording because it does not guarantee that recorded diagnoses are clinically correct [Citation18]. Thus, diagnosing itself does not directly lead to ‘better treatment’ or necessarily improve the quality of care experienced by the patients [Citation19], although it may enhance the quality of treatment from the health care system’s point of view [Citation1].

Eliciting the missing diagnosis recoding data with electronic reminders also altered the distribution of documented diagnoses in the primary health care ED. It appears that ED physicians increased the recording of group R diagnoses of ICD-10 -system. These codes refer to diagnoses which describe only the symptoms, signs and abnormal clinical findings while not suggesting any specific disease underlying them [Citation20]. Thus, the physicians in the ED may not have reached a conclusion in terms of a specific diagnosis in all situations. As reported before [Citation21,Citation22], this fairly common with unscreened patients and therefore diagnosis recordings may have been neglected to some extent before the present intervention. Upon eliciting the missing diagnosis documentation with electronic reminders, physicians were more inclined to adapt to recording symptoms using the ICD-10 -system.

Analogously, recording the diagnosis for alcohol abuse in EDs is challenging for various reasons: the acceptance of alcohol in the culture of the Western world, and apathy or lack of skills on the part of the ED-staff, and denial on the part of the patient may decrease the recording of ICD-10 code F10 diagnoses in EDs [Citation23,Citation24]. Furthermore, alcohol-related diagnoses are easily stigmatizing [Citation25]. Visiting an ED under the influence of alcohol has been a frequent reason for one-fifth of the hospital admissions into the wards of the secondary care department of the ED currently being studied [Citation26]. Yet recording alcohol misuse as a reason to visit the ED was not common in the beginning of the follow-up. Thus, implementation of electronic reminders may have resulted in physicians gaining the confidence to record alcohol-related reasons for ED visits and the consequent increase in the use of that diagnosis. The same phenomenon may have explained the observed improvement in recording of mental and behavioural disorders (group F) which may also stigmatize patients easily [Citation27].

Yet there may also have been secular trends affecting the observed change in the distribution of diagnosis recordings. Naturally, some diagnostic drift and changes in the population's health is expected over a 12-year period. Furthermore, the decrease in relative proportions, as well as absolute numbers, of diagnosis recordings of mild respiratory infections suggests that there may have been changes in the inclusion criteria of ED patients. Indeed, a change in the triage system, namely, the adoption of the so-called ‘reverse triage’, was initiated in the beginning of 2008 [Citation17]. In this type of triage-method an ED tries to redirect patients with mild health disorders to office-hour general practitioners [Citation17], thereby reducing the number of patients entering the primary health care ED [Citation28]. Indirectly, this change in ICD-10 code J-group diagnoses recordings may suggest that by using ‘reverse triage’ the ED succeeded in reducing the amount of certain types of patients entering the facility, such as those with mild respiratory infections.

Although this study was performed in a primary health care ED, these results are in line with former studies suggesting the usefulness of electronic reminders in altering clinical practice in all EDs [Citation2–7]. Especially with the present, relatively simple type of intervention targeted at improving the quality of clinical recording, the application of electronic reminders seemed to function well. Reminders have been suggested as being an effective tool when pursuing improvement of the quality of patient records [Citation8]. The importance of this is further emphasized because the recording of diagnoses may ensure sufficient treatment actions, enhance planning activities and direct management of resources [Citation29]. Improving the extent of diagnosis recordings of chronic diseases may improve the quality of care [Citation29] including by improving adherence to guidelines [Citation5]. Recording diagnoses promotes diagnostic thinking [Citation30]. It may lead to better treatment outcomes and increased patient safety by enhancing rational judgement of treatment options [Citation30]. Recording diagnoses is, to some extent, a prerequisite for the use of computer-based clinical decision support systems [Citation30]. Educational functions are also supported by frequent recording of diagnoses [Citation31].

There was considerable variation in the percentages of visits with specific recorded diagnoses, depending on whether the percentage was calculated using only the number of visits having recorded diagnoses, or all visits to the ED physicians as a denominator. There is an explanation for these discrepancies. Due to the novel triage methods applied [Citation11,Citation17] and centralization procedures in the ED [Citation12], the number of visits in the ED decreased during the follow-up period [Citation27]. This may have modulated considerably the proportions calculated from all visits, but not those calculated from visits with recorded diagnoses. Therefore, studying diagnosis recordings as a measure of function should always be interpreted cautiously and several variables should be examined instead of observing only one.

Electronic reminders may alter clinical practice in EDs. At least the quality in terms of the extent of recorded diagnoses data can be improved by using them. Electronic reminders were effective in enhancing the recording of symptomatic diagnoses. They were also found to be effective with regard to diagnoses that tended to be neglected before their implementation, such as diagnoses related to alcohol abuse. By enhancing the recording of diagnoses ERs may provide a tool to ensure treatment actions, planning activities and management of resources in EDs.

Ethical permissions

The register holder (the health authorities of Vantaa) and the scientific ethical board of Vantaa City (TUTKE) granted permission (VD/8059/13.00.00/2016) to carry out the study.

Supplemental material

Supplemental Material

Download MS Word (128.7 KB)

Acknowledgements

This work was supported by The Hospital District of Helsinki and Uusimaa (ERVA). Michael Horwood, PhD, reviewed language. Open access funded by Helsinki University Library.

Disclosure statement

The authors have no potential conflicts of interest to disclose.

Additional information

Funding

This work was supported by The Hospital District of Helsinki and Uusimaa (ERVA). Michael Horwood, PhD, reviewed language.

References

  • Shojania KG, Jennings A, Mayhew A, et al. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;3:CD001096.
  • Bernstein SL, Whitaker D, Winograd J, et al. An electronic chart prompt to decrease proprietary antibiotic prescription to self-pay patients. Acad Emerg Med. 2005;12:225–231.
  • Rathlev N, Almomen R, Deutsch A, et al. Randomized controlled trial of electronic care plan alerts and resource utilization by high frequency emergency department users with opioid use disorder. West J Emerg Med. 2016;17:28–34.
  • Wilbur L, Huffman G, Lofton S, et al. The use of a computer reminder system in an emergency department universal HIV screening program. Ann Emerg Med. 2011;58(1 Suppl 1):S71–3.e1.
  • Safran C, Rind DM, Davis RB, et al. Guidelines for management of HIV infection with computer-based patient's record. Lancet. 1995;346(8971):341–346.
  • Dexheimer JW, Talbot TR, 3rd, Ye F, et al. A computerized pneumococcal vaccination reminder system in the adult emergency department. Vaccine. 2011;29:7035–7041.
  • Holmes JF, Freilich J, Taylor SL, et al. Electronic alerts for triage protocol compliance among emergency department triage nurses: a randomized controlled trial. Nurs Res. 2015;64:226–230.
  • Nguyen MC, Richardson DM, Hardy SG, et al. Computer-based reminder system effectively impacts physician documentation. Am J Emerg Med. 2014;32:104–106.
  • Lehtovuori T, Raina M, Suominen L, et al. A comparison of the effects of electronic reminders and group bonuses on the recording of diagnoses in primary care: a longitudinal follow-up study. BMC Res Notes. 2017;10(1):700.
  • Lehtovuori T, Heikkinen AM, Raina M, et al. The effect of electronic reminders on the recording of diagnoses in primary care: a longitudinal follow-up study. SAGE Open Med. 2020;8:205031212091826.
  • Kantonen J, Kaartinen J, Mattila J, et al. Impact of ABCDE triage on the number of patient visits to an emergency unit and to other parts of health care system: a controlled study. BMC Emerg Med. 2010;10:12.
  • Mustonen K, Kantonen J, Kauppila T. The effect on the patient flow in local health care services after closing a suburban primary care emergency department: a controlled longitudinal follow-up study. Scand J Traum Resusc Emerg Med. 2017;25:1–10, 116.
  • Berenberg RA, Forman DS, Wood DK, et al. Recovery of peripheral nerve function after axotomy. Exp Neurol. 1977;57:349–356.
  • Lehtovuori T, Kauppila T, Kallio J, et al. Financial team incentives improved recording of diagnoses in primary care: a quasi-experimental longitudinal follow-up study with controls. BMC Res Notes. 2015;8:668.
  • Kallio J, Kauppila T, Suominen L, et al. A competition between care teams improved recording of diagnoses in dental primary care: a longitudinal follow-up study. Int J Dent. 2017:ID3080957.
  • Kantonen J, Lloyd R, Mattila J, et al. Impact of ABCDE team triage combined with public guidance on division of work in an emergency department. Scand J Prim Health Care. 2015;33:74–81.
  • Kauppila T, Seppänen K, Mattila J, et al. The effect on the patient low in a local health care after implementing “reverse triage” in a primary care emergency department: a longitudinal follow-up study. Scand J Prim Health Care. 2017;35:214–220.
  • Sporaland GL, Mouland G, Bratland B, et al. General practitioners' use of ICPC diagnoses and their correspondence with patient record notes. Tidsskr nor Laegeforen. 2019;139.
  • Goudswaard AN, Lam K, Stolk RP, et al. Quality of recording of data from patients with type 2 diabetes is not a valid indicator of quality of care. A cross-sectional study. Fam Pract. 2003;20(2):173–177.
  • https://icd.who.int/browse10/2010/en.
  • Rosendal M, Carlsen AH, Rask MT, et al. Symptoms as the main problem in primary care: a cross-sectional study of frequency and characteristics. Scand J Prim Health Care. 2015;33:91–99.
  • Rask MT, Andersen RS, Bro F, et al. Towards a clinically useful diagnosis for mild-to-moderate conditions of medically unexplained symptoms in general practice: a mixed methods study. BMC Fam Pract. 2014;15:118.
  • Huntley JS, Blain C, Hood S, et al. Improving detection of alcohol misuse in patients presenting to an accident and emergency department. Emerg Med J. 2001;18(2):99–104.
  • Westwood G, Meredith P, Atkins S, et al. Universal screening for alcohol misuse in acute medical admissions is feasible and identifies patients at high risk of liver disease. J Hepatol. 2017;67(3):559–567.
  • Miller ER, Ramsey IJ, Tran LT, et al. How Australian general practitioners engage in discussions about alcohol with their patients: a cross-sectional study. BMJ Open. 2016;6(12):e013921.
  • Pohjola-Sintonen S, Kaurala M, Kantonen J, et al. Patients treated in secondary health care due to sickness caused by substance addiction: 6 months follow-up. [Päihderiippuvuuden aiheuttaman sairauden takia erikoissairaanhoidossa hoidetut potilaat: 6 kuukauden seuranta.]. Finn Med J. 2006;61:3739–3744.
  • Vistorte AOR, Ribeiro W, Ziebold C, et al. Clinical decisions and stigmatizing attitudes towards mental health problems in primary care physicians from Latin American countries. PLoS One. 2018;13(11):e0206440.
  • Lehto M, Mustonen K, Kantonen J, et al. A primary care emergency service reduction did not increase office-hour service use: a longitudinal follow-up study. J Prim Care Commun Health. 2019;10:1–7.
  • Hjerpe P, Merlo J, Ohlsson H, et al. Validity of registration of ICD codes and prescriptions in a research database in Swedish primary care: a cross-sectional study in Skaraborg primary care database. BMC Med Inform Decis Mak. 2010;10:23.
  • Kalenderian E, Ramoni RL, White JM, et al. The development of a dental diagnostic terminology. J Dent Educ. 2011;75:68–76.
  • Smeets HM, Kortekaas MF, Rutten FH, et al. Routine primary care data for scientific research, quality of care programs and educational purposes: the Julius General Practitioners' Network (JGPN). BMC Health Serv Res. 2018;18:735.