Performance of the LACE index to predict 30-day hospital readmissions in patients with chronic obstructive pulmonary disease

Abstract

Background and objective

Patients hospitalized for acute exacerbation of chronic obstructive pulmonary disease (COPD) have a high 30-day hospital readmission rate, which has a large impact on the health care system and patients’ quality of life. The use of a prediction model to quantify a patient’s risk of readmission may assist in directing interventions to patients who will benefit most. The objective of this study was to calculate the rate of 30-day readmissions and evaluate the accuracy of the LACE index (length of stay, acuity of admission, co-morbidities, and emergency department visits within the last 6 months) for 30-day readmissions in a general hospital population of COPD patients.

Methods

All patients admitted with a principal diagnosis of COPD to Liverpool Hospital, a tertiary hospital in Sydney, Australia, between 2006 and 2016 were included in the study. A LACE index score was calculated for each patient and assessed using receiver operator characteristic curves.

Results

During the study period, 2,662 patients had 5,979 hospitalizations for COPD. Four percent of patients died in hospital and 25% were readmitted within 30 days; 56% of all 30-day readmissions were again due to COPD. The most common reasons for readmission, following COPD, were heart failure, pneumonia, and chest pain. The LACE index had moderate discriminative ability to predict 30-day readmission (C-statistic =0.63).

Conclusion

The 30-day hospital readmission rate was 25% following hospitalization for COPD in an Australian tertiary hospital and as such comparable to international published rates. The LACE index only had moderate discriminative ability to predict 30-day readmission in patients hospitalized for COPD.

Video abstract

Point your SmartPhone at the code above. If you have a QR code reader the video abstract will appear. Or use:

http://youtu.be/hzp03MvH1L4

Keywords:

• predictor model
• risk prediction
• unwarranted variation

Introduction

Many patients with chronic conditions are frequent users of the health care system and need to be admitted to hospital repeatedly, often within short intervals. Hospital readmissions, frequently measured as 30-day readmissions (occurring within 30 days of discharge), have a significant impact on patients’ quality of life,¹ add to the disease and treatment burden experienced by COPD patients,^2,3 are a burden on the health care system, and put a strain on hospital resources.⁴ In 2003–2004, 19.6% of the 11,855,702 Medicare beneficiaries in the USA who had been discharged from a hospital were rehospitalized within 30 days.⁵

The number of 30-day hospital readmissions has been steadily rising in high income countries over the last decade. In Scotland, readmission rates went from 20.5 to 24.5% from 1996 to 2005.⁶ In England, there was a 27% increase from 2000 to 2012.⁷ The reasons for this are not entirely clear but may potentially be associated with the increasing prevalence of chronic diseases as well as changes in the organization and delivery of health care with shorter lengths of stay in hospital and efforts to increasingly care for patients in an outpatient setting. In some countries, such as the USA and Australia, financial penalties for hospitals have been implemented to reduce readmission rates. In the USA, readmission reduction programs are implemented with an added penalty to hospitals if they have excess readmission rates among their Medicare patients; in 2015, $280 million dollars in Medicare funds were withheld from 2,217 hospitals.^8,9 In the state of New South Wales, Australia (the setting of this study), hospitals with readmission rates above the state average receive decreased funding in their annual budgets. In 2015 and 2016, underperforming hospitals were penalized millions of dollars.

Chronic obstructive pulmonary disease (COPD) has one of the highest rates of 30-day hospital readmissions, along with congestive heart failure and pneumonia.¹⁰ COPD readmission rates vary across countries and hospitals. In 2014, a quarter of all states in the USA had high 30-day hospital readmission rates ranging from 23 to 28%,¹¹ and among Medicare beneficiaries, the national average readmission rate was 19.6%.⁵ In New South Wales, Australia, there were 22 readmissions per 100 hospitalizations for COPD (total of 47,359 index hospitalizations) within 30 days in 2012–2015, of whom 55% were again for a principal diagnosis of COPD and 10% were for a condition related to COPD.¹²

There is a multitude of predictor models that aim to predict individual patient’s risk of short-term hospital readmission, with a 2016 systematic review identifying 73 unique models.¹³ Models predicted either 28-day or 30-day readmissions for all causes or specifically for medical, surgical, or mental health diagnoses. An optimal readmission risk prediction model strikes a good balance between discriminative ability and model simplicity. One model that meets this criterion is the LACE index (length of stay, acuity of admission, co-morbidities, emergency department visits within the last 6 months).¹⁴ The LACE index was discriminative with the C-statistic (area under the receiver operator characteristic [ROC] curve) of 0.684 in predicting readmissions and mortality within 30 days in a general hospital population it was originally tested in.¹⁴ In addition, it is relatively simple to use in clinical care compared to other predictor models as it uses patient characteristics that can be easily obtained by health care professionals. The model was originally tested on a mixed cohort of hospital patients consisting of elective and nonelective, medical, and surgical patients. Its predictive ability has been tested for some specific diseases (eg, heart failure),¹⁵ but little is known about its ability to predict the risk of short-term hospital readmission in patients with COPD. A relatively small study applied the LACE index to 461 COPD patients in the USA and did not find that the LACE index predicted 30-day all-cause hospital readmissions.¹⁶ The aim of this study was to evaluate the ability of the LACE index to predict 30-day all-cause hospital readmissions in a large cohort of patients with COPD in Australia.

Methods

Study design and setting

This was a retrospective cohort study from January 2006 to January 2016, using data extracted from the electronic hospital management system of Liverpool Hospital, a tertiary hospital in Sydney, Australia. The hospital is located in an area of low socioeconomic status with many migrants of non-English speaking background. The study cohort comprised patients older than 18 years with a hospitalization for COPD as principal diagnosis, identified through International Classification of Diseases-10 codes (J44.0, J44.1, J44.8, and J44.9). Patients discharged to a nursing home were excluded. Ethical approval was obtained from the South Western Sydney Local Health District Human Research Ethics Committee (HREC/15/LPOOL/557). The requirement to obtain patient consent was waived because this was a retrospective database study. Patient confidentiality was maintained by de-identification of all data and aggregation of potentially identifiable variables to a level that precludes identification.

Data analysis

A 30-day readmission was defined as a readmission for any diagnosis following an index hospitalization with a principal diagnosis of COPD. The LACE index (length of stay, acuity of admission, comorbidities [based on the Charlson comorbidity index],¹⁷ and emergency visits within the last 6 months) was used to calculate a score for each patient. All patients were given the maximum score of 3 points for acuity because all patients with COPD were admitted via the emergency department. The predictive ability of the LACE index in the study cohort was assessed using ROC curves. The outcomes tested were readmission within 30 days and death during index hospitalization combined and 30-day readmission alone. ROC curves were obtained to assess the sensitivity and specificity of the predictor model. The association between each of the LACE variables and readmission was assessed using a generalized estimating equation. To assess if the predictive ability of the LACE model could be improved, the following five different LACE models were assessed, each modified by substituting the 3 points for acuity of admission for: presence of mental health disorders (F01–F99), presence of heart failure (I50.00–I50.43), admission during a weekend, admission after core hours, and a male patient.

A Chi-square of trend was used to assess if readmission rates increased over time. A generalized estimating equation was used to test if there was a significant interaction term between readmission rates and length of stay over time.

Statistical analysis was conducted using SAS 9.4 (SAS Institute Inc., Cary, NC, USA).

Results

The study cohort included 2,662 patients. They accounted for 26,789 hospitalizations during the study period, of which 5,979 hospitalizations were for COPD. More than half of the patients were male (53.3%) with an average age of 72.5 (SD =12, range: 21–99) years. All patients had a minimum Charlson score of 1 by definition (attributed to COPD).

Of 5,979 index hospitalizations for COPD, 25.1% resulted in a hospital readmission within 30 days, of which 56.0% were due to COPD. The other main reasons for readmission during 30 days and 1 year were heart failure and pneumonia (Table 1). On average, patients were readmitted within 13.3 days, with 7 days being the most common time for readmission. Readmission rates for any diagnosis within 90, 180, and 366 days were 43.5, 54.8, and 65.2%, respectively. Readmission rates for COPD only within 30, 90, 180, and 366 days were 14.2, 23.9, 29.4, and 34.0%, respectively. During index hospitalizations for COPD, 239 (4.0%) patients died in hospital.

Table 1 Reasons for readmission within 30 days and 366 days following an index hospitalization for COPD

Diagnosis	Number of readmissions
	Within 30 days, n (%)	Within 366 days, n (%)
COPD	847 (56)	2,034 (52)
Heart failure	39 (2.7)	117 (3)
Pneumonia	29 (1.9)	77 (2)
Chest pain	21 (1.4)	78 (2)
Myocardial infarction	17 (1)	40 (1)
Cellulitis	15 (1)	32 (<1)
Asthma	11 (<1)	42 (1)
Others	540 (36)	1,593 (38)

Abbreviation: COPD, chronic obstructive pulmonary disease.

Readmission rates per year over the last decade gradually increased from 22.6% in 2006 to 27.9% in 2015 (Figure 1). The average length of stay for patients readmitted within 30 days decreased from 9.1 days in 2006 to 5.7 days in 2015 (Figure 2). There was a significant trend in increasing readmission rates over time (P=0.007); however, increased readmission rates and decreased length of stay were not statistically significantly associated (P=0.93).

Figure 1 Thirty-day readmission rates from 2006 to 2015 for any diagnosis following an index hospitalization of COPD.

Abbreviation: COPD, chronic obstructive pulmonary disease.

Figure 2 Length of stay during index hospitalization for COPD from 2006 to 2015 in patients who were readmitted within 30 days and those who were not readmitted.

Abbreviation: COPD, chronic obstructive pulmonary disease.

The average LACE score for each index admission of COPD was 9.8 points (out of a possible range of 1–19 for patients with COPD); the distribution of scores is shown in Figure 3. The odds ratios of the association between the different LACE variables and the risk of 30-day readmission (for a one category increase within each variable) were 1.02 (95% CI 0.94–1.10) for the length of stay, 1.00 (95% CI 0.93–1.09) for comorbidity, and 1.25 (95% CI 1.21–1.29) for the number of emergency visits in the last 6 months. The acuity criterion from the LACE index was not relevant to our cohort as every patient was admitted through the emergency room, and there were no elective admissions.

Figure 3 Distribution of LACE scores among the COPD cohort.

Abbreviation: COPD, chronic obstructive pulmonary disease.

The ROC analysis, using the outcome of 30-day readmissions, showed an area under the curve (Figure 4) or C-statistic of 0.63 (95% CI 0.62–0.65). When including the outcomes death or 30-day readmissions, the C-statistic was also 0.63 (95% CI 0.62–0.65). This demonstrated that the LACE model has only moderate predictive ability for 30-day readmission following hospitalizations for COPD. The sensitivity and specificity of the model varied based on the cutoff scores between high and low risk patients for 30-day readmission (Table 2). Figure 5 illustrates the percentage of 30-day read-missions per given LACE score.

Figure 4 ROC curve for the LACE index in COPD.

Notes: The ROC curve illustrates the performance of the LACE index for predicting 30-day readmission at different cutoff points. With increased sensitivity, specificity is decreased and vice versa. The area under the curve, which is equal to the C-statistic, is 0.63, indicating a moderate predictive ability of the model for identifying patients at risk of readmission within 30 days.
Abbreviations: COPD, chronic obstructive pulmonary disease; ROC, receiver operator characteristic.

Figure 5 Correlation between 30-day readmissions and LACE index score.

Table 2 Sensitivity and specificity for each cutoff point of the LACE index in COPD patients

LACE score	Sensitivity	Specificity
4	1.00	0.00
5	0.99	0.02
6	0.97	0.07
7	0.94	0.14
8	0.90	0.23
9	0.79	0.39
10	0.63	0.56
11	0.51	0.68
12	0.39	0.78
13	0.25	0.85
14	0.15	0.92
15	0.09	0.95
16	0.04	0.98
17	0.02	0.99
18	0.01	1.00
19	0.01	1.00

Note: Each score identifies individuals in the high-risk group for hospital readmission, for example, at 10, admissions with a score of ≥10 are identified as returning to hospital within 30 days by the LACE index.

Abbreviation: COPD, chronic obstructive pulmonary disease.

When using a cutoff point of LACE score ≥10 (a cutoff previously used by another study and found to have a good discriminatory ability to predict the risk of 30-day readmission¹⁸), 48.5% of the cohort were in the high-risk group. In this high-risk group, 32.8% of patients were readmitted within 30 days (ie, positive predictive value of the model). In the low-risk group, 17.9% of patients were readmitted within 30 days and 82.1% were not readmitted (ie, negative predictive value of the model). The sensitivity of using a cutoff point of ≥10 was 0.63, and the specificity was 0.56. Overall, of the 1,502 readmissions (25.1% of all COPD index hospitalizations), 63.4% of readmissions had a LACE score of ≥10.

Modification of the LACE index by replacing the acuity variable, as it was not relevant to our cohort, showed no improvement in the predictive ability of the LACE index. The C-statistic from each model was as follows: mental health disorders =0.626 (95% CI 0.61–0.64), heart failure =0.629 (95% CI 0.61–0.65), admission during a weekend =0.618 (95% CI 0.60–0.63), admission after core hours =0.617 (95% CI 0.60–0.63), and being male =0.6305 (95% CI 0.61–0.65).

Discussion

In our cohort, one in four patients admitted to hospital for COPD was readmitted within 30 days. More than half of these patients were readmitted for COPD exacerbations, followed by other respiratory and cardiovascular diagnoses. The LACE index was only moderately predictive for 30-day hospital readmissions, possibly due to its simplicity.

A systematic review identified 73 unique predictor models for 28 or 30 days unplanned hospital readmissions in both broader and specific patient populations.¹³ The predictive ability of these models vastly varied with C-statistic between 0.21 and 0.88, with the better performing models generally having more variables. In clinical practice, it is important that the model is simple and contains variables that can be easily obtained; however, this means that the predictive ability of the model may be compromised. A 2012 study on predictors of readmission in patients with COPD found six variables (at least two COPD exacerbations within 1 year, body mass index, number of previous surgeries, type of antibiotics administered, and albumin level) that were correlated with 30-day readmissions and a C-statistic of 0.72.¹⁹ Another study focusing on readmissions in COPD patients found nine variables, such as being male, history of osteoporosis, and no statin prescription, to be associated with increased risk of readmission (C-statistic =0.68).²⁰ However, neither study integrated the variables into a scoring model that can be clinically used without the assistance of a statistical analysis program.

The LACE index has been previously tested in different populations with mixed results. The original study with a mixed hospital population had a C-statistic of 0.68. In a cohort of heart failure patients, the C-statistic was 0.56, indicating that it performed only slightly better than chance.¹⁵ In a cohort of all patients discharged from hospital with a mean age of 84.8 years, the LACE also performed poorly. The median LACE score between those readmitted and those who were not was 12.5 vs 12 (P=0.13) with a C-statistic of 0.60.²¹ On the other hand, another study found the LACE index to be a good predictor for readmission in their cohort of all patients discharged from six hospitals in Toronto, Canada. They found that the high-risk group was twice more likely to be readmitted within 30 days than the low-risk group (relative risk 2.1 95% CI: 1.9–2.2).²²

The PEARL study developed a new prediction model for 90-day hospital readmission for patients with COPD. The criteria they used (PEARL) included previous admissions, extended Medical Research Council dyspnoea scale (eMRCD), age, right-sided heart failure, and left-sided heart failure. Their C-statistic for predicting which patients would be readmitted within 90 days was 0.73.²³ In the same study, other prediction tools were tested, including the LACE index, which had a C-statistic of 0.65 for predicting 90-day readmissions.

A relatively small study conducted in 2013 in the USA applied the LACE index to 461 COPD patients and found that a LACE score of ≥13 was not associated with 30-day readmissions (P=0.186).¹⁶ Importantly, because of big differences in health care systems globally, the predictive validity of the LACE index (or any other index) needs to be tested in the setting where it is going to be applied.

Generic prediction models, such as the LACE index, tested on COPD and other patient populations have highlighted the heterogeneity in patient populations. Many predictors can be very specific for a certain patient population but are not relevant to another. Acuity of the admission, for example, which is included in the LACE index, is almost completely irrelevant in COPD, as almost all hospitalizations for COPD are due to exacerbations of COPD and are thus acute and not elective. Having a COPD-specific prediction tool can ensure that all the important factors that increase patients’ risk of readmission can be included to maximize the predictive ability of the model.

Strengths of our study are the long observation period (10 years) and the relatively large cohort of patients (n=2,662). The 10-year time period allowed us to look at trends in readmission rates and length of stay and how they have changed over time. A limitation of our study was that information was only available on readmissions to the same hospital where the patients had been hospitalized for their index hospitalization. In New South Wales, Australia, 15% of COPD patients represented to a different hospital than their index hospital.¹² Not capturing 30-day readmissions of patients who had an index admission at the study hospital but presented to another hospital for readmission would have resulted in underestimation of the readmission risk. In contrast, there would have been patients who had an index hospitalization at a different hospital and presented to the study hospital for readmission and they would not have been included in our analysis as readmissions. Therefore, in the end, there is likely minimal directional bias as index hospitalizations and rehospitalizations would have been missed.

Epidemiological studies have shown that up to 20.9% of COPD patients have concurrent heart failure.²⁴ Each disease may have an impact on the disease progression of the other; however, the effects of interactions between these diseases on patients and hospital readmission rates are unclear.²⁵ In our cohort, 13.4% of COPD patients had heart failure; however, it did not increase their risk of 30-day readmission (odds ratio [OR]: 1.22 95% CI: 0.80–1.86).

A prospective cohort study in the UK found that depressive symptoms predict risk of 30-day readmission in COPD patients (OR: 1.30, 95% CI: 1.06–1.60, P=0.013).²⁶ While there was a high rate of mental health disorders (22.3%) among our COPD cohort, it was not significantly correlated with 30-day readmissions (OR: 1.19, 95% CI: 0.88–1.62).

In our study, there was a trend showing that during the 10-year study period, as length of stay decreased, 30-day readmissions increased. While some studies have shown that there is a correlation between the two variables, others have found none.²⁷ In our cohort, the association between length and stay and readmission risk was not statistically significant. The clinical relevance of the trend remains unclear.

High 30-day readmission rates can potentially be the result of insufficient patient management practices and post-discharge care; however, many chronic diseases will lead to repeat hospital admissions despite best possible care. Studies have shown that COPD exacerbations occur in clusters.²⁸ Therefore, 30-day readmissions for COPD exacerbation are common and often inevitable despite optimal management. In our study, 56.0% of readmissions (after index hospitalization for COPD) were again due to COPD, which was significantly higher than in a large study from the USA, in which COPD was only responsible for 27.6% of all readmissions.²⁹ Whether this indicates a higher proportion of unavoidable readmissions in our cohort is, however, unclear. Discrepancies in readmission rates between different settings and over time suggest that at least some readmissions are potentially avoidable and can be reduced with appropriate interventions.⁴ Unavoidable readmissions may occur due to the natural progression of an underlying disease or a diagnosis unrelated to the index admission.³⁰ The proportion of readmissions that are preventable is unclear. A systematic review of 34 studies found the range of avoidable readmission between 5 and 79%, with a median of 27% of all 30-day readmissions.³¹

Possible interventions that may be utilized to reduce the number of preventable readmissions have been tested in various studies. A postdischarge care bundle plan applied to a cohort of 44 COPD patients found the intervention group to have a 30-day readmission rate of 9.1% compared to 54.5% in the control group.³² Two other studies also demonstrated a decrease in 30-day readmissions when utilizing care bundles, 14.7% from 22.7%³³ and 15.4% from 17.4%.³⁴ However, not all interventions work. A randomized controlled trial using a new comprehensive care management program was terminated after 1 year due to increased deaths in the intervention group than in the control. The discrepancy in the effectiveness of different interventions highlights the importance of continuing research in this field to not only reduce readmissions in COPD patients but also improve patient-important outcomes.

It is important to note that the use of risk assessment tools to predict hospital readmissions emerged in the context of health services/administrations aiming to ensure service efficiency and reduce readmissions. The role of predicting patients’ risk for hospital readmission in a clinical context is less clear. It has been argued that identification of patients at high risk of 30-day readmission allows care processes and eventually patient-important outcomes to be improved, but the evidence to support this assumption is currently insufficient and the relationship between the process measure “30-day hospital readmission” and patient-important outcomes such as mortality and health-related quality of life is poorly understood.

No doubt, hospitalizations, and possibly even more so, hospital readmissions, interfere with a patient’s daily living and will (at least temporarily) reduce a patient’s health-related quality of life. Whether reducing hospital readmissions will go hand-in-hand with improving patient-important outcomes is, however, unclear and will likely depend on the intervention used to reduce readmissions. When frail patients are acutely unwell, misguided efforts to keep them out of the hospital might increase their risk of an adverse outcome by delaying necessary acute care. A study published in 2016 that analyzed data from the US Centers for Medicare and Medicaid from hospitals across the USA found that hospitals with the highest rates of readmission were actually more likely to show better mortality scores in patients treated for heart failure, COPD, and stroke.³⁵ These data certainly caution us against overemphasizing the importance of 30-day hospital readmissions as a measure for the quality of patient care.

Conclusion

Predictor models for the risk of 30-day hospital readmission can potentially be useful to define a target population who will most likely benefit from a tailored discharge and/or follow-up intervention to reduce the risk of readmission. In the absence of a simple yet highly accurate prediction tool for readmissions in patients with COPD, the LACE index can serve as user-friendly tool with moderate (but better than chance) predictive ability, especially in a context where sparse resources need to be focused on patients with the biggest potential need. Increasing the LACE score threshold will increase the positive predictive value of the tool; however, more patients who will be readmitted would be missed.

Future research should focus on assessing the association between hospital readmissions and patient-important outcomes; in particular, it should examine the effect of interventions to reduce hospital readmissions in patients with COPD on patient-important outcomes, such as health-related quality of life and mortality.

Acknowledgments

CCD was supported by an Australian National Health and Medical Research Council fellowship (APP1123733) and an award from the South Western Sydney Local Health District.

Disclosure

The authors report no conflicts of interest in this work.