1,090
Views
11
CrossRef citations to date
0
Altmetric
Research Article

The Bedside Index for Severity in Acute Pancreatitis: a systematic review of prospective studies to determine predictive performance

ORCID Icon, ORCID Icon, , &
Pages 208-213 | Received 28 Apr 2017, Accepted 25 Jul 2017, Published online: 19 Sep 2017

ABSTRACT

Background: predicting the development of severe disease has remained a major challenge in management of acute pancreatitis. The Bedside Index for Severity in Acute Pancreatitis (BISAP) is easy to calculate from the data available in the first 24 hours. Here, we performed a systematic review to determine the prognostic accuracy of the BISAP for severe acute pancreatitis (SAP).

Methods: major databases of biomedical publications were searched during the first week of October 2015. Two independent reviewers searched records in two phases. Studies that reported prognostic accuracy of the BISAP for SAP from prospective cohorts were included. The pooled area under the receiver operating curve (AUC) was calculated.

Results: Twelve studies were included for data-synthesis and methodology quality assessment was performed for 10. All the studies had enrolled consecutive patients, had a broad spectrum of the disease severity, reported explicit interpretation of the predictor, outcome of interest was well defined and had adequate follow-up. Blinded outcome assessment was reported in only one study. The pooled AUC was 0.85 (95% CI 0.80–0.90). There was significant heterogeneity, I2 86.6%. Studies using revised Atlanta classification in defining SAP had a pooled AUC of 0.92 (95% CI, 0.90–0.95), but heterogeneity persisted, I2 67%. Subgroup analysis based on rate of SAP (>20% vs <20%) did not eliminate the heterogeneity.

Conclusion: the BISAP has very good predictive performance for SAP across different patient population and etiologies. Studies to evaluate the impact of incorporating the BISAP into clinical practice to improve outcome in acute pancreatitis are needed before adoption could be advocated with confidence.

1. Introduction

Acute pancreatitis is the most common gastrointestinal cause of hospitalization [Citation1]. The rate of hospitalization continues to grow [Citation2]. Analysis of national inpatient sample databases showed a 33% increase in acute pancreatitis-related hospitalization over a 7-year period from 1997 to 2003 [Citation3]. The rise in incidence of acute pancreatitis is probably a result of a combination of increasing incidence of risk factors such as obesity (gallstone disease) and more testing [Citation4].

The severity of acute pancreatitis is the major determinant of clinical outcomes with mortality ranging from 1–3% in mild to over 20% in severe acute pancreatitis (SAP), defined by the presence and persistence of organ failure [Citation5,Citation6]. A major challenge for care providers is to predict the development of severe pancreatitis early in the course, which would improve patient management and resource utilization. But most of the patients who develop severe pancreatitis during hospitalization present to the emergency room without organ failure initially, and no single laboratory test has been shown to reliably predict subsequent progression to severe pancreatitis. Therefore, an accurate clinical prediction rule has the potential to dramatically improve the management of acute pancreatitis.

The Bedside Index for Severity in Acute Pancreatitis (BISAP) was developed in 2008 [Citation7]. It is an easy to calculate from data points available in the first 24 hours of presentation to emergency department (Box 1). Other clinical prediction scores reported in the literature are cumbersome to calculate, need clinical and laboratory data from 48 hours of hospitalization and do not outperform BISAP in predicting severe pancreatitis [Citation8,Citation9]. This is all the more relevant since the first 24–48 hour period is the most crucial time window in management of pancreatitis, and by the end of 48 hours most patients have revealed the severity of their illness with clinical improvement or development of organ failure.

Multiple studies have validated the performance of the BISAP in predicting acute severe pancreatitis. A systematic review for accurate estimation of the predictive performance of the BISAP can provide an objective and quantitative estimate to complement clinical assessment in acute pancreatitis. Multiple prospective studies have been published since a systematic review was published [Citation10]. We thus have aimed to perform a comprehensive systematic review and meta-analysis to assess the predictive performance of the BISAP for SAP.

1.1. Methods

The reporting guidelines of Meta-analysis of Observational Studies in Epidemiology (MOOSE) were followed in this systematic review and meta-analysis [Citation11].

1.1.1. Search

The search was performed in the first week of October 2015 by one of the investigators (S.C.) who has prior experience in performing searches for systematic reviews. Major databases of biomedical publications (Medline, Scopus and Web of Science) were included. The period of search was limited to 2008–2015, as the BISAP was developed in 2008. Language restrictions were not applied. Details of the search strategy are described in Appendix 1. Reference lists of the eligible studies were searched to identify additional studies.

1.1.2. Study selection

We included studies that reported the predictive performance of the BISAP for SAP from prospective cohorts of patients hospitalized for acute pancreatitis. Retrospectives studies and studies not based on original data or published in abstract format only were excluded. Studies published in a non-English language were included in data-synthesis for quantitative analysis but excluded from the methodology quality assessment.

Studies were searched in two phases, by two independent reviewers (A.M., R.B.). In phase I, study titles and abstracts were screened for eligibility. Full reports of studies deemed eligible by either reviewer in phase I were obtained. In phase II, both reviewers assessed the full text of each study for eligibility. Disagreements were resolved by consensus in the presence of the third reviewer (S.C.).

1.1.3. Methodology quality assessment

The quality assessment parameters for study methodology were adopted from McGinn et al.’s users’ guide [Citation12]. These parameters assess patient selection for clinical and demographic characteristics, severity of the disease, accurate interpretation of the predictors and the outcomes (mutually blinded) and adequate follow-up (defined as available in >95% of enrolled subjects). Two reviewers performed quality assessment, independently (S.C., A.M.). Disagreements were resolved by consensus.

1.1.4. Data extraction

Two reviewers (S.C., A.M.) extracted data from all the included studies. A standardized electronic data-extraction datasheet was used. Because most of the studies did not report number of patients and outcomes for each BISAP score, the area under the receiver operating curve (AUC) was collected. The clinical outcome of interest was SAP. Acute severe pancreatitis is defined based on the presence of organ failure (Atlanta classification) or persistence of organ failure for more than 48 hours (revised Atlanta classification) [Citation13,Citation14].

1.1.5. Data synthesis and analysis

Pooled area under the AUC was calculated to determine BISAP’s predictive performance. MedCalc statistical software (Version 17.4.4) was used to calculate the pooled AUC using a random effects model. Heterogeneity among the studies was assessed using Cochran’s Q test and I2 statistics. A p value <0.1 was considered significant for heterogeneity. An a priori subgroup analysis was performed for severe pancreatitis rate (<20% and 20% or higher) and definition of SAP, based on the Atlanta classification versus the revised Atlanta classification. Funnel plot analysis was used to address heterogeneity.

2. Results

2.1. Study selection

The study selection process is summarized in . A total of 12 validation studies were included in data synthesis and quality assessment of the study methodology was performed for 10 studies.

Figure 1. Flow diagram of the study selection process.

Figure 1. Flow diagram of the study selection process.

2.2. Characteristics of the included studies

The characteristics of individual studies are summarized in . Twelve studies encompassing a total of 3069 patients were included in data synthesis for the meta-analysis. Three cohorts were from India, two from the USA, two from Peru and one each from South Korea, China, Pakistan, Poland and Serbia. All the patients were hospitalized with a diagnosis of acute pancreatitis. Sixty percent of the patients were male. Average age ranged from 39 years to 61 years.

Table 1. Characteristics of included studies and performance of the Bedside Index for Severity in Acute Pancreatitis (BISAP) score.

2.3. Methodology quality assessment

Scoring of individual studies on methodology quality assessment parameters is presented in . All the studies had enrolled a consecutive cohort of patients hospitalized with a diagnosis of acute pancreatitis and included a broad spectrum of the disease severity. Follow-up was adequate in all the reviewed studies. Explicit and accurate interpretation of the predictor was reported in each study. The outcome of interest (SAP) was well defined in each study. Six studies used the Atlanta classification [Citation15Citation20] and the other six used the revised Atlanta classification [Citation21Citation26]. Blinded outcome assessment was reported in only one study [Citation17].

Table 2. Methodology quality assessment of included studies.

2.4. Predictive performance of BISAP

Of the 3069 patients from the included studies, 16% of patients developed SAP. The pooled AUC was 0.84 (95% CI, 0.79–0.90); see . There was significant heterogeneity in pooled estimates, I2 91%, p < 0.001. A funnel plot showed significant asymmetry (). The distribution of asymmetry is consistent with publication bias [Citation27].

Figure 2. Pooled area under the receiver operating curve to demonstrated prognostic performance of the Bedside Index for Severe Acute Pancreatitis, 0.84 (95%, 0.79–0.90.

Figure 2. Pooled area under the receiver operating curve to demonstrated prognostic performance of the Bedside Index for Severe Acute Pancreatitis, 0.84 (95%, 0.79–0.90.

Figure 3. Funnel plot showing assymetry which represents probable publication bias.

Figure 3. Funnel plot showing assymetry which represents probable publication bias.

2.5. Heterogeneity

A priori subgroup analyses were performed to address the heterogeneity. Studies were grouped based on the prevalence of SAP (<20% and 20% or higher) and definition used for SAP, 1992 Atlanta classification versus the revised Atlanta classification. In studies with an SAP rate of >20%, the pooled AUC was 0.86 (95% CI, 0.79–0.93) with I2 84% and 0.83 (95% CI, 0.75–0.90) with I2 94% in studies with <20%. The pooled AUC from studies using the revised Atlanta classification was 0.87 (95% CI, 0.80–0.94), I2 92%, p < 0.001. Studies using the original Atlanta classification had a pooled AUC of 0.81 (95% CI, 0.74–0.88), I2 86% p < 0.001. Since heterogeneity still persisted, a funnel plot was constructed for studies using the revised Atlanta classification and outlier studies were excluded. Both of the excluded studies had a remarkably low rate of SAP, 6.9% and 8.4% [Citation24,Citation25]. The pooled AUC from the remaining four studies using the revised Atlanta classification was 0.92 (95% CI, 90–95), but heterogeneity persisted, I2 67% p = 0.029,

3. Discussion

In this systematic review and meta-analysis, a pooled analysis from 12 prospective cohorts demonstrated very good performance of BISAP for predicting SAP across different patient populations and severity of disease. The performance of BISAP was higher if severe pancreatitis was defined as persistence of organ failure for 48 hours or longer.

3.1. External validity

Twelve prospective cohorts were identified to calculate the pooled estimate. It included 3069 patients hospitalized with acute pancreatitis, of whom 491 developed SAP. Patient selection was consecutive and represented a wide range of severity of pancreatitis and varied etiologies (with gallstone and alcohol predominating). Therefore, inclusion of a good mix of etiology, pancreatitis severity and patient demographics with a large number of patients ensures excellent external validity of pooled estimates from this study.

3.2. Strengths and limitations

The strengths of this study include a search strategy that included three major databases of biomedical publications without any language restrictions and searching the bibliographies of the included studies. We used a robust method in conducting systematic reviews and two reviewers performed the study selection, data extraction and the methodology quality assessment of the included studies. Including prospective cohorts ensured accurate assessment of predictors because for most patients the eventual diagnostic outcome was not available at the time of predictor assessment.

This study was limited by relatively small numbers of studies being available in the literature, limited reporting of data and heterogeneity between the studies. This limits the quality of the evidence and ability to perform analysis at different cut-off points to determine sensitivity and specificity. There is probable publication bias. Efforts were made to minimize the publication bias, which included not using language restriction in the search, a manual search of reference lists of included studies and the use of multiple databases. Also, a random effect model was used in calculating pooled estimates instead of a fixed effect model. A random effect model provides more conservative pooled estimates.

3.3. Clinical implications and future direction

The BISAP is an easy-to-calculate clinical prediction scale using data from the initial clinical assessment of patients and routine laboratory data. Pooled estimates in the current study demonstrate its very good performance in predicting severe acute pancreatitis. The ease of calculation and accuracy make the BISAP a valuable tool for clinical providers caring for patients with acute pancreatitis. An implementation study is important before widespread adoption of a clinical prediction score can be recommended [Citation28]. To date, no studies have reported the impact of incorporating the BISAP into clinical practice to improve outcome in the management of acute pancreatitis, and further research in this area is warranted.

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

None.

References

  • Peery AF, Dellon ES, Lund J, et al. Burden of gastrointestinal disease in the USA: 2012 update. Gastroenterology. 2012;143(1179–87):e1–e3.
  • Peery AF, Crockett SD, Barritt AS, et al. Burden of gastrointestinal, liver, and pancreatic diseases in the USA. Gastroenterology. 2015;149(1731–1741):e3.
  • Brown A, Young B, Morton J, et al. Are health related outcomes in acute pancreatitis improving? an analysis of national trends in the U.S. from 1997 to 2003. JOP. 2008;9:408–414.
  • Yadav D, Ng B, Saul M, et al. Relationship of serum pancreatic enzyme testing trends with the diagnosis of acute pancreatitis. Pancreas. 2011;40:383–389.
  • Buter A, Imrie CW, Carter CR, et al. Dynamic nature of early organ dysfunction determines outcome in acute pancreatitis. Br J Surg. 2002;89:298–302.
  • Mofidi R, Duff MD, Wigmore SJ, et al. Association between early systemic inflammatory response, severity of multiorgan dysfunction and death in acute pancreatitis. Br J Surg. 2006;93:738–744.
  • Wu BU, Johannes RS, Sun X, et al. The early prediction of mortality in acute pancreatitis: a large population-based study. Gut. 2008;57:1698–1703.
  • Zhang J, Shahbaz M, Fang R, et al. Comparison of the BISAP scores for predicting the severity of acute pancreatitis in Chinese patients according to the latest Atlanta classification. J Hepatobiliary Pancreat Sci. 2014;21:689–694.
  • Park JY, Jeon TJ, Ha TH, et al. Bedside index for severity in acute pancreatitis: comparison with other scoring systems in predicting severity and organ failure. Hepatobiliary Pancreat Dis Int. 2013;12:645–650.
  • Gao W, Yang HX, Ma CE. The value of BISAP score for predicting mortality and severity in acute pancreatitis: a systematic review and meta-analysis. PLoS One. 2015;10:e0130412.
  • Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283:2008–2012.
  • McGinn TG, Guyatt GH, Wyer PC, et al. Users’ guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-based medicine working group. JAMA. 2000;284:79–84.
  • Bradley EL 3rd. A clinically based classification system for acute pancreatitis. Summary of the International Symposium on Acute Pancreatitis, Atlanta, Ga, September 11 through 13, 1992. Arch Surg. 1993;128:586–590.
  • Banks PA, Bollen TL, Dervenis C, et al. Classification of acute pancreatitis–2012: revision of the Atlanta classification and definitions by international consensus. Gut. 2013;62:102–111.
  • Kim BG, Noh MH, Ryu CH, et al. A comparison of the BISAP score and serum procalcitonin for predicting the severity of acute pancreatitis. Korean J Intern Med. 2013;28:322–329.
  • Bezmarević M, Kostić Z, Jovanović M, et al. Procalcitonin and BISAP score versus C-reactive protein and APACHE II score in early assessment of severity and outcome of acute pancreatitis. Vojnosanitetski Pregled. 2012;69:425–431.
  • Bollen TL, Singh VK, Maurer R, et al. A comparative evaluation of radiologic and clinical scoring systems in the early prediction of severity in acute pancreatitis. Am J Gastroenterol. 2012;107:612–619.
  • Khanna AK, Meher S, Prakash S, et al. Comparison of Ranson, Glasgow, MOSS, SIRS, BISAP, APACHE-II, CTSI scores, IL-6, CRP, and procalcitonin in predicting severity, organ failure, pancreatic necrosis, and mortality in acute pancreatitis. HPB Surg. 2013;2013:367581.
  • Surco Y, Huerta Mercado J, Pinto J, et al. Early prediction of severity in acute pancreatitis. Rev Gastroenterol Peru. 2012;32:241–250.
  • Shabbir S, Jamal S, Khaliq T, et al. Comparison of BISAP score with Ranson’s score in determining the severity of acute pancreatitis. J Coll Physicians Surg Pak. 2015;25:328–331.
  • Senapati D, Debata PK, Jenasamant SS, et al. A prospective study of the Bedside Index for Severity in Acute Pancreatitis (BISAP) score in acute pancreatitis: an Indian perspective. Pancreatology. 2014;14:335–339.
  • Yu XE, Deng YH, Huang PN, et al. EPIC combined with NLR vs BISAP for early prediction of severity of acute pancreatitis. World Chin J Digestology. 2014;22:4345–4351.
  • Mok SR, Mohan S, Elfant AB, et al. The acute physiology and chronic health evaluation IV, a new scoring system for predicting mortality and complications of severe acute pancreatitis. Pancreas. 2015;44:1314–1319.
  • Pérez Campos A, Bravo Paredes E, Prochazka Zarate R, et al. [BISAP-O y APACHE-O: utility in predicting severity in acute pancreatitis in modified Atlanta classification]. Rev Gastroenterol Peru. 2015;35:15–24.
  • Koziel D, Gluszek S, Matykiewicz J, et al. Comparative analysis of selected scales to assess prognosis in acute pancreatitis. Can J Gastroenterol Hepatol. 2015;29:299–303.
  • Yadav J, Yadav SK, Kumar S, et al. Predicting morbidity and mortality in acute pancreatitis in an Indian population: a comparative study of the BISAP score, Ranson’s score and CT severity index. Gastroenterol Rep (Oxf). 2016;4:216–220.
  • Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53:1119–1129.
  • Stiell IG, Wells GA. Methodologic standards for the development of clinical decision rules in emergency medicine. Ann Emerg Med. 1999;33:437–447.