73
Views
1
CrossRef citations to date
0
Altmetric
Original Research

Implementation of an electronic surgical referral service. Collaboration, consensus and cost of the surgeon – general practitioner Delphi approach

, , , &
Pages 371-380 | Published online: 09 Sep 2014

Abstract

Background

Poor coordination between levels of care plays a central role in determining the quality and cost of health care. To improve patient coordination, systematic structures, guidelines, and processes for creating, transferring, and recognizing information are needed to facilitate referral routines.

Methods

Prospective observational survey of implementation of electronic medical record (EMR)-supported guidelines for surgical treatment.

Results

One university clinic, two local hospitals, 31 municipalities, and three EMR vendors participated in the implementation project. Surgical referral guidelines were developed using the Delphi method; 22 surgeons and seven general practitioners (GPs) needed 109 hours to reach consensus. Based on consensus guidelines, an electronic referral service supported by a clinical decision support system, fully integrated into the GPs’ EMR, was developed. Fifty-five information technology personnel and 563 hours were needed (total cost 67,000 £) to implement a guideline supported system in the EMR for 139 GPs. Economical analyses from a hospital and societal perspective, showed that 504 (range 401–670) and 37 (range 29–49) referred patients, respectively, were needed to provide a cost-effective service.

Conclusion

A considerable amount of resources were needed to reach consensus on the surgical referral guidelines. A structured approach by the Delphi method and close collaboration between IT personnel, surgeons and primary care physicians were needed to reach consensus.

Video abstract

Point your SmartPhone at the code above. If you have a QR code reader the video abstract will appear. Or use:

http://dvpr.es/1oEiO4V

Introduction

Busy hospital clinics and increased waiting time for surgical treatment have made it necessary to develop new referral routines and to improve the patient flow and coordination between primary and secondary care. Poor coordination between different levels of care plays a central role in determining health care quality and cost.Citation1Citation3 To improve coordination, systematic structures, guidelines (clinical decision support [CDS] systems), and processes for creating, transferring, and recognizing information are needed to facilitate primary–secondary care communication and referral routines.Citation1 Improved referral routines have the potential to decrease waiting time and to decrease the workload for hospital clinics.Citation4Citation7 CDS systems can be used as a tool to improve referral quality and the coordination of care. CDS systems provide clinicians with patient-specific assessment tools or guidelines to aid their clinical decision-making and have been shown to improve health care quality.Citation8,Citation9 CDS systems improve prescribing practices, reduce serious medication errors, enhance the delivery of preventive care services, improve adherence to guidelines, and result in lasting improvements in clinical practice.Citation10Citation13

In this research project we focused on referrals to outpatient surgery. Outpatient surgery is a cost-effective solution for certain surgical patients because it decreases the time between the referral and the surgery and subsequently improves the patient flow.Citation5,Citation14Citation19 Furthermore, outpatient surgery decreases the burden of internal hospital logistics by decreasing the number of administrative personnel involved in the referral process.Citation14Citation19

In 2007, we initiated an outpatient surgical referral program, aiming to decrease waiting times and improve the patient flow at the outpatient clinics and operational theatres. We wanted to implement a CDS-supported referral system in the general practitioners’ (GPs’) electronic medical record (EMR) and thereby improve surgical referral quality, improve the coordination of care, and increase the rate of outpatient surgery (one stop surgery). The objective of this observational trial was to describe the Delphi method and resources needed (money, time, and personnel) to develop and implement a CDS-supported surgical referral system in the GPs’ EMR.

Methods

This prospective observational study took place between June 2007 and June 2011 and was divided into three main phases: 1) reaching guideline consensus on the content of a CDS-supported referral service; 2) developing the CDS-supported referral software; and 3) large-scale implementation of an EMR-integrated referral service. The use of resources (surgeons, GPs, administrative staff, and technology) was prospectively registered. The primary objective of the survey was to describe the primary care physician– surgeon consensus process by the Delphi method. The secondary objective was to perform an estimate of the number of referrals needed to establish a cost-effective referral service (ie, cost of consensus and implementation = potential cost savings by improved referral routines).

Research setting

The Department of Digestive Surgery is divided into clinics located at three different hospitals. All of these clinics perform the surgical procedures included in the trial (pilonidal sinus: Bascom plasty; inguinal hernia: Lichtenstein repair; gallstone disease: laparoscopic cholecystectomy). In the county of Troms, there are 31 municipal GP practices with 139 GPs. All of the GP practices are connected to the Norwegian National Health Network, which sends referrals electronically to hospitals.

Patients

Patients were included in the analyses if they were diagnosed and referred to hospital by their GP for an inguinal hernia, umbilical hernia, sinus pilonidalis, or gallstone disease requiring surgical treatment.

Consensus of a guideline-supported referral system

A modified Delphi approach was used,Citation21 divided into the following phases: generation of referral recommendations, a panel meeting of senior surgeons, a first consensus round with all surgeons (review results), a second consensus round with all surgeons (ratings), and the evaluation of the consensus. Relevant evidence regarding the different conditions was presented, and all of the participants in the process were asked to include only the “need to know” information about the surgical procedure. This information includes:

  • Disease-specific guidelines: These guidelines included signs and symptoms, surgical indications and contraindications, blood samples, and radiological examinations needed prior to surgery (laparoscopic cholecystectomy).

  • Standardized referral forms: The referral forms included information needed for anesthesia (mandatory), information needed for surgeons (mandatory), and additional information.

  • Patient information: This information included the time of surgery, the surgical procedure, the instructions for the patient to follow after surgery, and the possible complications of surgery.

After we reached internal hospital department consensus, the referral templates and guidelines were discussed with a panel of three experienced GPs. The GPs provided comments and suggestions for further improvement of the referral forms, disease-specific guidelines, and patient information. All changes suggested by the GPs were then presented and accepted by the head of the surgical department.

All of the necessary resources (hours) used to reach consensus were prospectively registered.

Development of the CDS-supported EMR referral software

Two EMR companies were involved in the development, piloting, and implementation of the CDS solution. A third company was responsible for the software solution making communication between EMR 1 and EMR 2 possible. The development and implementation of the technology were adjusted to incorporate the features of CDS systems that have been proven effective for changing clinical practice.Citation20 All of the necessary resources were prospectively registered.

Referral piloting and large-scale implementation

A primary care office was chosen as the pilot office. The CDS-supported referral software was discussed with the GPs, and improvements were made after receiving feedback from the GPs. Test referrals were sent from the GP office to the hospital until all of the technological problems had been resolved. Information technology (IT) experts integrated the referral software into the GPs’ EMR. The software was fully integrated into the GPs’ EMR and triggered by the corresponding international classification of primary care (ICPC) codes.

Comparison of referral cost-effectiveness

Two referral routes were compared: a) the traditional referral route where all patients are referred by the GP to the outpatient clinic and the outpatient clinic surgeon then refers the patients to day case surgery; and b) The GP refers directly to day case surgery (). The sensitivity analysis used both a societal and a hospital perspective. The referral costs included administrative hospital costs, the examination in the surgical outpatient department (surgeon time, nurse time), the surgical treatment (surgeon time, anesthetist time, and nurse time), the unused surgical outpatient capacity caused by incorrect referrals (both for new and traditional service), and the patients’ travel costs. All of the cost estimates (Table S1) were created separately and compared. We assumed that 10% of the one-stop patients would be denied surgery because of inconsistent referral information and that 20% of the referred patients were on sick leave at the time of referral. The number of patients needed to break even (the threshold, ie, the point at which the cost savings from a one stop surgery (OSS) referral service equal the cost of implementation) was estimated. This value was obtained using the following equation: Potential savings of the referral service=Cost of the Delphi process+Cost of software development+Cost of implementation.(1)

Figure 1 Principle of a guideline-supported surgical referral system to outpatient surgery.

Notes: The aim is to decrease time spent on intrahospital logistics, by omitting the outpatient clinical examination and intrahospital referral to day case surgery. The traditional referral pathways (upper arrow) may be decreased by high-quality GP referrals directly to outpatient surgery (lower arrow).
Abbreviations: CDS, clinical decision support; GP, general practitioner.
Figure 1 Principle of a guideline-supported surgical referral system to outpatient surgery.

We defined a potential decrease in waiting time as “total waiting time – intrahospital waiting time.” Prehospital waiting time was defined as the time between the referral and the first consultation at the surgical outpatient clinic. Data from the national waiting list register was extracted (http://www.fritt-sykehusvalg.no/start/) to perform this analysis. Intrahospital waiting time was defined as the time between the first consultation at the outpatient clinic and the surgical treatment. The NOMESCO (Nordic Medico-Statistical Committee) Classification of Surgical Procedures codes were extracted from the hospital’s EMR database to perform this analysis. To estimate the potential frequency of patients referred by the new service, consecutive referrals (an 18-month time interval) for sinus pilonidalis (International Classification of Diseases [ICD] 10: L05.0 and L05.9), gallstone disease (ICD 10: K80.2), inguinal hernia (ICD 10: K40.0, K40.2, K40.9), and umbilical hernia (ICD 10: K42.0, K42.9) were reviewed by two authors (Knut Magne Augestad [KMA] and Rolv-Ole Lindsetmo [ROL]). Cost data were converted from Norwegian kroner (NOK) into British pounds at the rate of 1 £ =9.39 NOK (based on the exchange rage according to the Norwegian National Bank on June 27, 2012). The BMJ guidelines for health-related economic evaluations were followed.Citation22

Results

The Delphi process

All of the surgeons approved the guidelines, and consensus was reached after a 3-month period. Overall, 109 hours were needed to reach guideline consensus, to an estimated cost of 10,800 £ ( and ).

Table 1 The Delphi approach of referral consensus for surgeons and GPs

Table 2 Example of consensus guidelines for hernia surgery referral

Development and implementation of the referral software

IT personnel (n=24) from three different commercial vendors participated in the development of the CDS software, and the overall cost of the software development was estimated at 32,652 £. A total of 140 hours were needed to pilot and implement the software for 139 GPs, at a total cost of 23,581 £. The total cost of work phases 1 to 3 was 67,075 £ ().

Table 3 Referral software development and implementation

Main effects of new referral routines

We reviewed 700 referrals (ie, 18 months consecutive referrals); 189 (27%) were classified as well-suited for the referral service. The median waiting time to the examination in the outpatient clinic was 84 days, and the median time from the examination until the outpatient surgery was 101 days (ie, the overall median waiting time was 185 days). The estimated cost savings from the referral service were 133 £ per patient from the hospital perspective and 18,909 £ from the societal perspective ().

Table 4 Estimates of time and cost savings of the new referral routines

A tornado chart was employed to analyze the uncertainties of referral implementation cost. Small variations in the cost of CDS technology development (phase 2) will have large effects on the overall cost compared with the other cost elements we analyzed ().

Figure 2 Cost uncertainty of guideline implementation in the GP EMR.

Note: The variables with the highest impact on cost are listed at the top and ranked thereafter.
Abbreviations: CDS, clinical decision support; EMR, electronic medical record; GP, general practitioner.
Figure 2 Cost uncertainty of guideline implementation in the GP EMR.

Discussion

Summary of findings

To our knowledge, this survey is the first to address the time, resources, and funding needed to develop and implement an electronic hospital referral service supported by a CDS system. The decision support tool was fully integrated into the GPs’ EMR and was triggered by the referring ICPC code. A total of 84 persons (surgeons, GPs, administrative personnel, and health IT personnel) and 550 hours (from the beginning of the project) were needed to implement the CDS referral software in the EMR for 139 GPs. The overall cost of the surgical Delphi consensus process, the development of the CDS technology, and the implementation of the technology was 67,000 £. A sensitivity analysis showed that unexpected technology obstacles had the greatest impact on the overall cost of CDS implementation. Finally, we estimated the effects of an integrated CDS referral system for patients and the health care system. This surgical referral system has the potential to reduce the waiting time for surgery by 101 days. Of the referrals for selected surgical conditions, 27% were well-suited for a one-stop surgical service, which means that the service was cost-effective (from the hospital perspective) after 504 CDS-supported referrals. Because of the decreased waiting time for surgical treatment, the length of sick leave will decrease, resulting in societal savings of approximately 1,809 £ for each patient who is referred to an expedited one-stop surgical service.

Comparison with the existing literature

Effective communication is essential for coordinating health care; however, patient care is often compromised by poor communication between primary and secondary care services.Citation23Citation25 Poor coordination between primary and secondary care services contributes to avoidable patient morbidity and mortality.Citation26 Thus, effective communication between primary care physicians and hospital specialists regarding patient referrals, consultations, and treatment is necessary to improve patient outcomes and physician satisfaction.Citation27 Poor communication plays a central role in determining health care quality and cost, and systematic structures and tools (like CDS systems) are needed to facilitate primary–secondary care communication.Citation1Citation3

To address the deficiencies in communication and the coordination of care, health care is increasingly turning to CDS systems, which provide clinicians with patient-specific assessments or recommendations to aid in their clinical decision-making and process management.Citation20 CDS systems have been shown to reduce errors and improve the coordination of care.Citation20 Several features of CDS systems are associated with improvements in clinical practice (automatic provision, integration with the EMR, and provision of recommendations). Of these features, automatic provision of decision support as part of the clinician’s workflow is the single most important feature, with a reported odds ratio of 105.Citation20,Citation28 In this project, we focused on similar CDS features associated with improvements in clinical practice. When we designed the user interface of the CDS, the CDS was triggered by the referral ICPC code, thus becoming an automatic part of the GPs’ referral workflow.

The rate of referrals has been growing rapidly, with potential implications for health care spending.Citation29 There are no widely accepted guidelines for referring patients. Despite the push toward evidence-based decision-making, the referral of patients is driven primarily by the practice patterns of physicians, not by the patient case mix. Patient referrals can profoundly change the nature and cost of the care that patients receive. We need to understand the benefits and risks of specific referral patterns, as we do with any intervention.Citation30,Citation31

Strengths and limitations

This trial has some strengths. First, many trials have evaluated the clinical effects of CDS systems; however, few of these trials have assessed the effects of the systems on the coordination of care between different service levels of health care. Second, most studies that have assessed referral systems have been conducted without a fully integrated EMR system implemented in primary and secondary care. Although two separate EMR vendors support our EMR systems, they are fully integrated in the entire health care system, with referrals and text messages sent electronically between the two systems. This integration increases the potential of a CDS-supported referral service because it offers greater flexibility to adjust the CDS system to new routines or new referral patterns. The CDS referral system can be updated from one central server located at the university hospital (ie, no technical personnel have to travel to the GPs’ offices).

There are also limitations to this study. First, the long-term implementation and routine use of CDS systems remains challenging. In a recently published review of randomized trials on decision support systems, only 18% discussed long-term implementation and long-term use.Citation32 At the present time, we have not succeeded in fully incorporating the referral service into routine use, a problem that has also been reported in other trials.Citation33,Citation34 We acknowledge that there is a need to improve the GP reimbursement policy because of the increase in the referral workload. Second, as a quality improvement project, there are certain limitations that are inherent to our work.

The economic analysis has several limitations. There are uncertainties attached, especially with regard to the proportion of patients that can return faster back to work caused by decreased waiting times and the proportion of patients who are rejected because of improper clinical information in the referral. These uncertainties must be assessed using future prospective surveys.

Implications for patients and decision-makers

Higher-quality surgical referrals will have great implications for patients. We have analyzed the implications of a standardized surgical referral service, which produces a shorter waiting time before surgical treatment and subsequently a decrease in sick leave. For other conditions, high-quality referrals and closed communication loops improve the coordination of care. This means that there will be fewer hospital admissions, fewer radiologic exams, fewer blood samples, and more informed health care providers offering better continuity of care.Citation1,Citation3,Citation24,Citation25 These aspects are especially important for patients with multimorbidity and chronic diseases, for whom new strategies are needed to coordinate care.Citation35 For hospital decision-makers, high-quality referrals and better communication between GPs and hospital specialists might have large implications for the quality of care. Our hospital trust receives approximately 140,000 referrals annually, imposing a huge burden in terms of coordination and the workload for physicians and administrative personnel. A CDS referral system can improve coordination, decrease hospital travel time by improving process management, and reduce the burden on busy outpatient clinics.Citation27 Improved coordination has been shown to have large economic implications.Citation2 However, better technological coordination of EMR systems and greater standardization of patient pathways are needed. Our analyses show that the waiting time for surgery will decrease, thus decreasing the burden for patients and resulting in cost savings for society as the duration of sick leave decreases. Finally, fewer resources will be used by admitting hospitals because of the improvements in logistics and the coordination of care.

Conclusion

As referral rates and reports of poor coordination between primary and secondary care increase, quality improvement projects focusing on referral quality are needed.Citation2,Citation29,Citation31 CDS systems have the potential to improve communication and coordination between primary and secondary care and thus increase the OSS rate.Citation32 This study has two main conclusions. First, many resources (personnel, time, and funding) were needed to implement a CDS-supported referral service, mainly because of the time-consuming process of establishing a medical consensus, unexpected technology obstacles, and organizational obstacles in the interface between primary and secondary care. Increased efforts are needed to make CDS referral systems more attractive for GPs, and incentives must respond to the increase in the referral workload.

Author contributions

All authors contributed toward data analysis, drafting, and revising the paper and agree to be accountable for all aspects of the work.

Acknowledgments

This work was funded by the North Norwegian Health Authorities Research Fund (grant number 40614).

We thank Heidi Jacobsen at the Norwegian National Centre of Integrated Care and Telemedicine for her administrative support during the project.

The internal review board of University Hospital North Norway provided ethical approval for this project.

Supplementary material

Table S1 Details of the unit costs assigned to health care resource use data

Disclosure

The authors report no conflicts of interest in this work.

References

  • FoyRHempelSRubensteinLMeta-analysis: effect of interactive communication between collaborating primary care physicians and specialistsAnn Intern Med2010152424725820157139
  • BodenheimerTHigh and rising health care costs. Part 3: the role of health care providersAnn Intern Med200514212 Pt 1996100215968014
  • ChenAYeeHImproving primary care-specialty care communication: lessons from San Francisco’s safety net: comment on “Referral and consultation communication between primary care and specialist physicians”Arch Intern Med20111711656721220663
  • Canadian Agency for Drugs and Technologies in HealthSurgical Referral and Appropriateness of Surgery: Clinical Evidence, Best Practices and GuidelinesOttawaCanadian Agency for Drugs and Technologies in Health2011 Available from: http://www.cadth.ca/en/publication/2962Accessed June 25, 2014
  • DennisonJEisenSTowersMIngham ClarkCAn effective electronic surgical referral systemAnn R Coll Surg Engl200688655455617059716
  • AkbariAMayhewAAl-AlawiMAInterventions to improve outpatient referrals from primary care to secondary careCochrane Database Syst Rev2008CD00547118843691
  • ClarkeABlundellNFordeICan guidelines improve referral to elective surgical specialties for adults? A systematic reviewQual Saf Health Care201019318719420211956
  • HuntDLHaynesRBHannaSESmithKEffects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic reviewJAMA199828015133913469794315
  • GargAXAdhikariNKMcDonaldHEffects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic reviewJAMA2005293101223123815755945
  • BennettJWGlasziouPPComputerised reminders and feedback in medication management: a systematic review of randomised controlled trialsMed J Aust2003178521722212603185
  • ShiffmanRNLiawYBrandtCACorbGJComputer-based guideline implementation systems: a systematic review of functionality and effectivenessJ Am Med Inform Assoc19996210411410094063
  • LymanJACohnWFBloomrosenMDetmerDEClinical decision support: progress and opportunitiesJ Am Med Inform Assoc201017548749220819850
  • EmeryJDEffect of computerised evidence based guidelines. Computer support is complex interventionBMJ20033267385394 author reply 39412586680
  • PatkarVHurtCSteeleREvidence-based guidelines and decision support services: A discussion and evaluation in triple assessment of suspected breast cancerBr J Cancer200695111490149617117181
  • TrickettJPDonaldsonDRBearnPEScottHJHassallACA study on the routes of referral for patients with colorectal cancer and its affect on the time to surgery and pathological stageColorectal Dis20046642843115521930
  • JulianSNaftalinNJClarkMAn integrated care pathway for menorrhagia across the primary-secondary interface: patients’ experience, clinical outcomes, and service utilisationQual Saf Health Care200716211011517403756
  • EltahirAJibrilJSquairJThe accuracy of ‘one-stop’ diagnosis for 1,110 patients presenting to a symptomatic breast clinicJ R Coll Surg Edinb199944422623010453144
  • WitcherTPWilliamsMDHowlettDC“One-stop” clinics in the investigation and diagnosis of head and neck lumpsBr J Oral Maxillofac Surg2007451192216678313
  • McKessockLSmithBHScottAA randomized controlled trial of direct access for laparoscopic sterilizationFam Pract20011811811145620
  • KawamotoKHoulihanCABalasEALobachDFImproving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to successBMJ2005330749476515767266
  • LoblawDAPrestrudAASomerfieldMRAmerical Society of Clinical Oncology Clinical Practice GuidelinesAmerican Society of Clinical Oncology Clinical Practice Guidelines: formal systematic review-based consensus methodologyJ Clin Oncol201230253136314022778311
  • DrummondMFJeffersonTOGuidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ Economic Evaluation Working PartyBMJ199631370522752838704542
  • TorjesenICare of IBD patients compromised by poor communication between primary and secondary careBMJ2012344e267522498956
  • GandhiTKSittigDFFranklinMSussmanAJFairchildDGBatesDWCommunication breakdown in the outpatient referral processJ Gen Intern Med200015962663111029676
  • ShakibSPhilpottHClarkRWhat we have here is a failure to communicate! Improving communication between tertiary to primary care for chronic heart failure patientsIntern Med J200939959559919220534
  • McGlynnEAschSMAdamsJThe quality of health care delivered to adults in the United StatesN Engl J Med2003348262635264512826639
  • O’MalleyASReschovskyJDReferral and consultation communication between primary care and specialist physicians: finding common groundArch Intern Med20111711566521220662
  • TamblynRHuangATaylorLA randomized trial of the effectiveness of on-demand versus computer-triggered drug decision support in primary careJ Am Med Inform Assoc200815443043818436904
  • BarnettMLSongZLandonBETrends in physician referrals in the United States, 1999–2009Arch Intern Med2012172216317022271124
  • SalasEWilsonKAMurphyCEKingHSalisburyMCommunicating, coordinating, and cooperating when lives depend on it: tips for teamworkJt Comm J Qual Patient Saf200834633334118595379
  • KatzMHHow can we know so little about physician referrals?Arch Intern Med2012172210022271117
  • AugestadKMBerntsenGLassenKBellikaJGWoottonRLindsetmoROStudy Group of Research Quality in Medical Informatics and Decision Support (SQUID)Standards for reporting randomized controlled trials in medical informatics: a systematic review of CONSORT adherence in RCTs on clinical decision supportJ Am Med Inform Assoc2012191132121803926
  • EcclesMMcCollESteenNEffect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trialBMJ2002325737094112399345
  • HetlevikIHolmenJKrügerOKristensenPIversenHFurusethKImplementing clinical guidelines in the treatment of diabetes mellitus in general practice. Evaluation of effort, process, and patient outcome related to implementation of a computer-based decision support systemInt J Technol Assess Health Care200016121022710815366
  • BarnettKMercerSWNorburyMWattGWykeSGuthrieBEpidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional studyLancet20123809836374322579043