256
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Pre-hospital management and patient-related factors affecting access to the surgical care of appendicitis – a survey study

ORCID Icon, ORCID Icon & ORCID Icon
Received 25 Sep 2023, Accepted 06 Mar 2024, Published online: 18 Mar 2024

Abstract

Background and aims

Long pre-hospital delay substantially increases the likelihood of perforated appendicitis. This study aimed to find patient-related factors affecting this delay.

Methods

A survey was conducted for patients with acute appendicitis after appendectomy. The participants were asked about their path to the surgical center and socioeconomic status. Variables affecting delays and the rate of complicated appendicitis were analyzed.

Results

The study included 510 patients; 157 (31%) had complicated appendicitis with a median prehospital delay of 42 h. In patients with uncomplicated appendicitis, the delay was 21 h, p < .001. Forty-six (29%) patients with complicated appendicitis were not referred to the hospital after the first doctor’s visit. The multivariate analysis discovered factors associated with long pre-hospital delay: age 40–64 years (OR 1.63 (95% CI 1.06–2.52); compared to age 18–39), age more than 64 years (OR 2.84 (95% CI 1.18–6.80); compared to age 18–39), loss of appetite (OR 2.86 (95% CI 1.64–4.98)), fever (OR 1.66 (95% CI 1.08–2.57)), non-referral by helpline nurse (OR 2.02 (95% CI 1.15–3.53)) and non-referral at first doctors visit (OR 2.16 (95% CI 1.32–3.53)). Age 40–64 years (OR 2.41 (95% CI 1.50–3.88)), age more than 64 years (OR 8.79 (95% CI 2.19–35.36)), fever (OR 1.83 (95% CI 1.15–2.89)) and non-referral at first doctors visit (OR 1.90 (95% CI 1.14–3.14)) were also risk factors for complicated appendicitis.

Conclusions

Advanced age, fever and failure to suspect acute appendicitis in primary care are associated with prolonged pre-hospital delay and complicated appendicitis.

Introduction

Complicated appendicitis is associated with worse outcomes than uncomplicated appendicitis, including higher costs, longer hospital stays and more post-operative complications [Citation1]. Complicated appendicitis is more common in patients whose surgery is delayed. Past studies show that the pre-hospital delay is more consequential than the in-hospital delay [Citation2] since a substantial proportion of perforations have most probably already occurred when patients are admitted to the hospital. Internationally, many publications state that minority race and ethnicity [Citation3–5], older age [Citation6–12], lower socioeconomic status [Citation13] and inadequate insurance coverage [Citation14–17] are associated with a higher incidence of complicated appendicitis. Li et al. [Citation18] also discovered that delayed presentation of patients with acute appendicitis is associated with older age, living alone, a lack of knowledge of the disease, and low social support. These findings suggest that healthcare systems do not treat patients equally, and access to care varies between subgroups.

Different courses of appendicitis and its symptoms can affect the patient and the physician. Symptoms like profuse abdominal pain are prone to make patients head to medical care hastily, whereas other symptoms, such as vomiting, can confuse both the patient and the doctor.

In Finland, the healthcare system is based on public healthcare services to which everyone residing in Finland is entitled. The system is divided into primary health care and specialized medical care. In addition, there are private companies that mainly provide primary health care services, but also some specialized medical care. In Finland, patients with acute abdominal pain are first examined in primary care – public or private – and then invariably diagnosed and treated in public hospitals. All patients are informed to contact the medical helpline by telephone before arriving at the emergency clinics. The primary health care providers manage the helplines, and the nurses answering the calls are educated to advise all kinds of patients with different ailments. All services are available all the time. Consequently, the Finnish healthcare system can be considered reasonably equal for all emergency general surgical patients, such as patients with acute appendicitis.

To our knowledge, no prior studies have investigated the effect of the course of appendicitis or social, educational, professional or employment status on delay and rate of complicated appendicitis in Finland. Our goal in this study was to identify factors affecting delayed access to surgical care and, thus, find potential targets for quality improvement in patient management.

Materials and methods

Setting

This study of acute appendicitis was carried out as a survey at Meilahti Hospital in Helsinki. No pilot phase was carried out.

Patients

Acute appendicitis patients aged 16 or older who spoke either Finnish or Swedish were recruited at the hospital ward while still convalescing after having an appendectomy. Both doctors and nurses participated in the recruitment by asking patients to participate and fill out the questionnaire. Written informed consents were obtained from all the participants.

The questionnaire

A three-page printed questionnaire with 11 questions was offered in Finland’s main official languages, Finnish and Swedish. In the questionnaire, patients were asked to fill in the timings of symptom onset and first primary care doctor’s visits, the symptoms before seeing a doctor, if they had used a medical helpline, if they had used a private, occupational or public primary care provider, the examinations done in primary care, additional contacts to primary care before arrival to the surgical center, and usage of antibiotics during the 48 h before arriving to the surgical center. All the times were asked with an accuracy of 1 h. The questions were asked as closed-ended, but patients were provided additional space to construct their responses when needed. We also enquired about patients’ educational, professional and employment statuses and living arrangements.

Data collection

The data regarding other demographics, laboratory parameters, vital signs, intraoperative and histopathological findings, and hospital admission timings and surgery start were collected from electronic patient records. The data on surgical site infections and post-operative complications classified by the Clavien-Dindo grade [Citation19] were also collected. These data were combined with the data extracted from the questionnaire.

Data analysis

Delays were calculated. The patient, pre-hospital and total delays were defined as the time from the onset of symptoms to the first primary care doctor’s visits, from symptom onset to arrival at the surgical center, and from symptom onset to surgery, respectively. Also, the delay from the first primary care doctor’s visit to the arrival at the surgical center was calculated. Complicated appendicitis was defined as perforation with or without an abscess formation in surgery. The histopathological analysis showing transmural infiltration by neutrophils confirmed the diagnosis of acute appendicitis.

Research license

The institutional review board of Helsinki University Hospital approved this trial (ref. HUS/333/2019). It concluded that no ethical committee processing was needed since the study involved no interventions or changes to the standard management of acute appendicitis patients.

Statistical analysis

The delays in the univariate analysis were presented as medians with interquartile ranges and p values calculated using the Mann–Whitney U-test. When there were three or more categorical, independent subgroups, the Kruskal–Wallis test was first performed. If a statistical difference was found between the subgroups, the analysis continued with the Dunn–Bonferroni test to find the specific p values for subgroups. The odds ratios (ORs) for complicated appendicitis with 95% CI were calculated. Multivariate analyses were performed using binary logistic regression analysis on long delay or complicated appendicitis. Statistical analysis was done using SPSS® Statistics version 28 (IBM, Armonk, NY).

Results

A total of 510 non-consecutive patients consented to participate in the study from 29 November 2017 to 31 January 2021. Twenty-three percent of all patients treated with appendectomy during this period were recruited. Fifty-four percent of participants were female, and 56% belonged to the youngest subgroup aged 18–39. The overall rate of complicated appendicitis was 31% among recruited patients. Three hundred and nine (61%) patients phoned a medical helpline before the first doctor’s appointment. Four hundred and seventy-three patients (93%) were seen by a primary care doctor before arrival at the hospital: 385 (75%) once and 88 (17%) two or more times. Forty-six (33%) out of 141 patients who had complicated appendicitis at surgery and visited primary care doctors were not referred to the surgical center at their first doctor’s visit. Among patients who did not visit the primary care, 70% were transported to the hospital by ambulance; the rest came to the hospital on their own ride. Private primary care was involved with the care of 41% of patients; there was no difference in the rate of complicated appendicitis in this group compared to other patients. The median patient delay was 20 (I.Q.R. 9–38 h), and the median time from the first primary care doctor’s appointment to arriving at the surgical center was only two (1–5) hours. Demographics and clinical characteristics of patients with uncomplicated and complicated appendicitis are presented in . The study period included the start of the COVID-19 pandemic. No differences in patient or prehospital delays were noted between the periods before or after this.

Table 1. Demographics and clinical characteristics.

Patient delay

In the univariate analysis of patient delay (), we found that older patients came to primary care for a doctor’s visit substantially later than younger patients. Patients who did not feel pain or had fever or loss of appetite were more likely to see a doctor later. In contrast, nausea and vomiting made patients seek medical care earlier. Symptom onset at night led to earlier assessment by the primary care doctor, while weekends did not influence patient delay. Educational degree, professional status and employment status had little effect on patient delay, except for pensioners whose patient delay was substantially elevated.

Table 2A. Univariate analysis of factors associated with patient, pre-hospital and total delay in appendicitis.

Table 2B. Univariate analysis of factors associated with patient, pre-hospital and total delay in appendicitis.

The multivariate analysis () confirmed that older patients had a higher risk for longer than median (20 h) patient delay. Also, fever, loss of appetite, and professional status of a working student were independent risk factors for the long patient delay. In contrast, nausea and the nightly onset of symptoms predict a speedier arrival to primary care.

Table 3. Multivariate analysis of factors associated with long (20 h or longer) patient delay.

Delay from first primary care doctor’s visit to the surgical center

According to the univariate analysis (Supplementary Table 1), the risk of delayed referral to a surgical center by the primary care physician was high when patients presented with nausea, vomiting or felt no pain. Abdominal imaging and the start of antibiotic treatment were associated with longer delay in getting to the surgical center.

Pre-hospital delay

The univariate analysis () showed that patient and pre-hospital delays shared many associating factors. Antibiotics were started in primary care or at a non-surgical department for 16 (3%) before sending patients to the surgical unit. The reason for antibiotics was the wrong diagnosis in each of these cases. The start of antibiotics was associated with long pre-hospital delays in univariate analysis.

In the multivariate analysis (), older age, fever and loss of appetite are shown to be independent risk factors for pre-hospital delay of 24 h or longer. If patients were not referred to a doctor from the medical helpline or to a surgical center from primary care, the pre-hospital delays tended to be extended.

Table 4. Multivariate analysis of factors associated with long (24 h or longer) pre-hospital delay.

Complicated appendicitis

The patient and pre-hospital delays were both associated with raised numbers of complicated appendicitis. With patient delay ≥20 h and pre-hospital delay ≥24 h, the Odds rates for complicated appendicitis were 3.69 (95% CI 2.45–5.54) and 4.72 (95% CI 3.07–7.26), respectively.

In the univariate analysis of complicated appendicitis (Supplementary Table 2), we discovered that patients in the youngest subgroup were least likely and patients in the oldest subgroup were most likely to present with complicated appendicitis in surgery. Patients who did not experience pain and had fever or vomiting as symptoms were prone to complicated appendicitis. If the first primary care physician failed to refer a patient to a surgical center, the patient had more chance of getting complicated appendicitis. Patients who reported their professional status as working students had less complicated appendicitis, while unemployed and pensioners had more complicated appendicitis.

In the multivariate analysis (), age, fever and unemployment stood out as independent risk factors for complicated appendicitis. Also, if patients were not referred to a surgical unit at the first primary care doctor’s visit or did not visit the primary care, they had complicated appendicitis more often.

Table 5. Multivariate analysis of factors associated with complicated appendicitis.

Discussion

The present study supports previous findings that older patients with appendicitis seek doctor’s help later and have more complicated appendicitis compared to younger patients [Citation7,Citation9,Citation10,Citation12]. Since acute appendicitis is often considered to be a disease of children and young adults, the caretakers and physicians of senior citizens should be better educated to suspect it when evaluating abdominal pain. Although the most prolonged delays happen before seeing the primary care physician, elderly patients should be managed without additional holdups and referred to surgical centers, bearing in mind that the representation of these patients is that of the more advanced disease.

The symptom profile of patients with acute appendicitis varies and affects the diagnosis and patient management. Most patients have abdominal pain; however, those who do not are at risk of being wrongly diagnosed and having complicated appendicitis. Painless patients arrive late to primary care with advanced appendicitis and often must wait even longer to be sent to the surgical unit. Lack of abdominal pain in the presence of other acute gastrointestinal signs and symptoms cannot rule out appendicitis. Similarly, fever was associated with longer patient delay and complicated appendicitis. Fever most likely does not delay patients from seeking help; instead, patients who arrive late to primary care are more likely to have already complicated appendicitis, causing the fever. Nauseous patients sought help earlier, but the primary care physicians probably confused the symptoms with non-surgical ailments since these patients’ delay after primary care was elevated. Because appendicitis may present with atypical symptoms, patients with acute abdominal symptoms could benefit from a doctor’s physical examination with simple laboratory tests (CRP, white blood cell count and polymorphonuclear cell count) [Citation20]. Utilization of diagnostic scoring combined with selective imaging or active follow-up might also help identify patients with possible appendicitis. Repeated scoring with the Adult Appendicitis Score [Citation21,Citation22] can help diagnose patients with equivocal symptoms [Citation23].

When symptoms started at nighttime, the patient and pre-hospital delays were shorter, but this did not significantly affect the outcome of these patients. The availability of medical care in Helsinki also seems adequate during the weekends since there was no peak in delays or advanced appendicitis in patients who became ill during weekends.

In Helsinki, patients are advised to contact the medical helpline by telephone before arriving at a medical facility. On the phone, a nurse evaluates the need and urgency of seeing a doctor based on the patient history and symptoms. Sixty-one percent of patients followed these instructions and made the call. Among them, 27% were not advised to see a doctor, and this was found to be an independent risk factor for the prolonged pre-hospital delay. On the contrary, not following the instructions was not affecting the delay. Therefore, it can be argued that using a medical helpline does not help and can even harm patients with possible appendicitis.

A substantial proportion of patients with appendicitis were not referred to the surgical center at the first doctor’s appointment. This occurred in one-third of patients with complicated appendicitis who visited a doctor before going to the hospital, underlining the significant role of the first physician in assessing a patient in primary care. Not considering the possibility of appendicitis at that point increased the pre-hospital delay considerably, leading to more complicated appendicitis. Primary assessment sometimes led to the start of antibiotics, which was also associated with long pre-hospital delays. Patients who missed the primary care and arrived straight to the hospital by ambulance or their own ride, often had complicated appendicitis but not uncommonly long pre-hospital delay. They either had rapidly progressing appendicitis or did not recognize the earliest symptoms of appendicitis for some reason. Even though we noticed that abdominal imaging, namely ultrasound, at primary care slowed the process of getting to the hospital by a few hours, it should be considered a valid method to improve diagnostic accuracy [Citation24].

The living arrangements or educational, professional or employment statuses had little effect on delays or complicated appendicitis. Patients who reported being working students had long patient delays but very little complicated appendicitis. This can be presumed to be explained by most students being young. The long patient and pre-hospital delays observed with the pensioners were also associated with age. Unemployment was associated with a higher incidence of complicated appendicitis but not with long pre-hospital delay. This discrepancy could be partly explained by the higher prevalence of smoking [Citation25–27], alcoholism [Citation28,Citation29] and depression [Citation30] among the unemployed.

This study has weaknesses. Only 23% of patients who underwent appendectomy participated in the study. Patient selection was random, and the recruitment rate varied depending on current personnel resources and their workload, patients’ language and cognitive skills, and length of stay at the hospital ward. Thus, we caught fewer patients speaking minority languages and more patients with complicated appendicitis recuperating longer in the hospital. The rate of complicated appendicitis was elevated among our participants compared to our regular rate (20.5% in 2023). The recruited patients were markedly younger than in a previous study conducted in our hospital [Citation31]. Also, only retrospective and limited primary care data were available, making it difficult to study the reasons for non-referrals. The patients were asked to recall the previous days’ events, so there may be some errors in this data, especially when some had had severe pain and fever at the time. These results describe the management of appendicitis patients in one particular healthcare system; therefore, all of the findings are not generalizable to other healthcare units. This study has strength in the number of participants. Also, the systematic collection of patients’ symptoms and timing of symptom onset with the survey resulted in presumably better-quality data than a simple retrospective chart review.

Advanced age, fever and diagnostic challenges in primary care are associated with longer pre-hospital delays and complicated appendicitis. A large portion of patients with complicated appendicitis suffer from shortages in our healthcare system. The advice provided at the telephone helpline could be improved by providing more education to the helpline personnel. These results also suggest that patients with acute abdominal symptoms should be sent to a doctor’s appointment for clinical examination with a very low threshold. Because the diagnosis of appendicitis is still challenging, we would encourage the liberal use of laboratory tests and utilization of clinical scoring and active observation in patients with equivocal symptoms to avoid potentially hazardous delays in the diagnosis of appendicitis. The referral indications in primary care could be adjusted to reduce the risk of complicated appendicitis, especially among the elderly population.

Author contributions

Conceptualization and methodology: KL, PM and AL; data collection: KL; validation: PM; formal analysis: KL and PM; writing – original draft preparation: KL; writing – review and editing: KL, PM and AL; visualization: KL.

Supplemental material

Supplemental Material

Download MS Word (18.5 KB)

Supplemental Material

Download MS Word (21.2 KB)

Acknowledgements

The authors thank the attending surgeons Siironen P. and Tolonen M. and the nurses at ward MEM4 in Meilahti Hospital for recruiting patients to this study.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported financially by HUS Research Funds, Finland (Government Research Funds). Kirsi Lastunen was funded by The Mary and Georg C. Ehrnrooth Foundation.

References

  • Hernandez MC, Aho JM, Habermann EB, et al. Increased anatomic severity predicts outcomes. J Trauma Acute Care Surg. 2017;82(1):73–79. doi: 10.1097/TA.0000000000001274.
  • Sammalkorpi HE, Leppäniemi A, Mentula P. High admission C-reactive protein level and longer in-hospital delay to surgery are associated with increased risk of complicated appendicitis. Langenbecks Arch Surg. 2015;400(2):221–228. doi: 10.1007/s00423-014-1271-x.
  • Ponsky TA, Huang ZJ, Kittle K, et al. Hospital- and patient-level characteristics and the risk of appendiceal rupture and negative appendectomy in children. JAMA. 2004;292(16):1977–1982. doi: 10.1001/jama.292.16.1977.
  • Wu BU, Banks PA, Conwell DL. Disparities in emergency department wait times for acute gastrointestinal illnesses: results from the national hospital ambulatory medical care survey, 1997–2006. Am J Gastroenterol. 2009;104(7):1668–1673. doi: 10.1038/ajg.2009.189.
  • Zwintscher NP, Steele SR, Martin MJ, et al. The effect of race on outcomes for appendicitis in children: a nationwide analysis. Am J Surg. 2014;207(5):748–753; discussion 753. doi: 10.1016/j.amjsurg.2013.12.020.
  • Kraemer M, Franke C, Ohmann C, et al. Acute appendicitis in late adulthood: incidence, presentation, and outcome. Results of a prospective multicenter acute abdominal pain study and a review of the literature. Langenbecks Arch Surg. 2000;385(7):470–481. doi: 10.1007/s004230000165.
  • Segev L, Keidar A, Schrier I, et al. Acute appendicitis in the elderly in the twenty-first century. J Gastrointest Surg. 2015;19(4):730–735. doi: 10.1007/s11605-014-2716-9.
  • Körner H, Söndenaa K, Söreide JA, et al. Incidence of acute nonperforated and perforated appendicitis: age-specific and sex-specific analysis. World J Surg. 1997;21(3):313–317. doi: 10.1007/s002689900235.
  • Augustin T, Cagir B, Vandermeer TJ. Characteristics of perforated appendicitis: effect of delay is confounded by age and gender. J Gastrointest Surg. 2011;15(7):1223–1231. doi: 10.1007/s11605-011-1486-x.
  • Storm-Dickerson TL, Horattas MC. What have we learned over the past 20 years about appendicitis in the elderly? Am J Surg. 2003;185(3):198–201. doi: 10.1016/s0002-9610(02)01390-9.
  • Young YR, Chiu TF, Chen JC, et al. Acute appendicitis in the octogenarians and beyond: a comparison with younger geriatric patients. Am J Med Sci. 2007;334(4):255–259. doi: 10.1097/MAJ.0b013e3180ca8eea.
  • Fugazzola P, Ceresoli M, Agnoletti V, et al. The SIFIPAC/WSES/SICG/SIMEU guidelines for diagnosis and treatment of acute appendicitis in the elderly (2019 edition). World J Emerg Surg. 2020;15(1):15–19. doi: 10.1186/s13017-020-00298-0.
  • Golz RA, Flum DR, Sanchez SE, et al. Geographic association between incidence of acute appendicitis and socioeconomic status. JAMA Surg. 2020;155(4):330–338. doi: 10.1001/jamasurg.2019.6030.
  • Sutton TL, Pracht EE, Ciesla DJ. Acute appendicitis: variation in outcomes by insurance status. J Surg Res. 2016;201(1):118–125. doi: 10.1016/j.jss.2015.10.002.
  • Smink DS, Fishman SJ, Kleinman K, et al. Effects of race, insurance status, and hospital volume on perforated appendicitis in children. Pediatrics. 2005;115(4):920–925. doi: 10.1542/peds.2004-1363.
  • Zogg CK, Scott JW, Bhulani N, et al. Impact of affordable care act insurance expansion on pre-hospital access to care: changes in adult perforated appendix admission rates after medicaid expansion and the dependent coverage provision. J Am Coll Surg. 2019;228(1):29–43.e1. doi: 10.1016/j.jamcollsurg.2018.09.022.
  • Scott JW, Havens JM, Wolf LL, et al. Insurance status is associated with complex presentation among emergency general surgery patients. Surgery. 2017;161(2):320–328. doi: 10.1016/j.surg.2016.08.038.
  • Li J, Xu R, Hu D, et al. Prehospital delay and its associated psychosocial factors in patients presenting with acute appendicitis in a southwestern city in China: a single-centre prospective observational study. BMJ Open. 2019;9(6):e023491. doi: 10.1136/bmjopen-2018-023491.
  • Clavien PA, Barkun J, Oliveira MLd, et al. The Clavien-Dindo classification of surgical complications. Ann Surg. 2009;250(2):187–196. doi: 10.1097/SLA.0b013e3181b13ca2.
  • Andersson RE, Hugander AP, Ghazi SH, et al. Diagnostic value of disease history, clinical presentation, and inflammatory parameters of appendicitis. World J Surg. 1999;23(2):133–140. doi: 10.1007/pl00013174.
  • Sammalkorpi HE, Mentula P, Leppäniemi A. A new Adult Appendicitis Score improves diagnostic accuracy of acute appendicitis – a prospective study. BMC Gastroenterol. 2014;14(1):114. doi: 10.1186/1471-230X-14-114.
  • Sammalkorpi HE, Mentula P, Savolainen H, et al. The introduction of Adult Appendicitis Score reduced negative appendectomy rate. Scand J Surg. 2017;106(3):196–201. doi: 10.1177/1457496916683099.
  • Lastunen KS, Leppäniemi AK, Mentula PJ. DIAgnostic iMaging or Observation in early equivocal appeNDicitis (DIAMOND): open-label, randomized clinical trial. Br J Surg. 2022;109(7):588–594. doi: 10.1093/bjs/znac120.
  • Doria AS, Moineddin R, Kellenberger CJ, et al. US or CT for diagnosis of appendicitis in children and adults? A meta-analysis. Radiology. 2006;241(1):83–94. doi: 10.1148/radiol.2411050913.
  • Office for National Statistics (ONS). Adult smoking habits in the UK 2021.pdf; 2022 [cited 2022 Dec 6]. Available from: https://www.ons.gov.onsdigital.uk/peoplepopulationandcommunity/healthandsocialcare/healthandlifeexpectancies/bulletins/adultsmokinghabitsingreatbritain/2021
  • Brook JS, Zhang C, Burke L, et al. Trajectories of cigarette smoking from adolescence to adulthood as predictors of unemployment status. Nicotine Tob Res. 2014;16(12):1559–1566. doi: 10.1093/ntr/ntu107.
  • Prochaska JJ, Shi Y, Rogers A. Tobacco use among the job-seeking unemployed in California. Prev Med. 2013;56(5):329–332. doi: 10.1016/j.ypmed.2013.01.021.
  • Sio SD, Tittarelli R, Martino GD, et al. Alcohol consumption and employment: a cross-sectional study of office workers and unemployed people. PeerJ. 2020;8:e8774. doi: 10.7717/peerj.8774.
  • Egan KK, Jørgensen MB, Christensen AI, et al. Association between alcohol, socioeconomic position and labour market participation: a prospective cohort study of transitions between work and unemployment. Scand J Public Health. 2020;49(2):197–205. doi: 10.1177/1403494820911802.
  • Zuelke AE, Luck T, Schroeter ML, et al. The association between unemployment and depression – results from the population-based LIFE-adult-study. J Affect Disord. 2018;235:399–406. doi: 10.1016/j.jad.2018.04.073.
  • Lastunen K, Leppäniemi A, Mentula P. Perforation rate after a diagnosis of uncomplicated appendicitis on CT. BJS Open. 2021;5(1):656–657. doi: 10.1093/bjsopen/zraa034.