A meta-analysis to derive literature-based benchmarks for readmission and hospital mortality after patient discharge from intensive care

Transitions of patient care between providers are vulnerable periods in health care delivery that expose patients to preventable errors and adverse events [1]. The discharge of patients from the intensive care unit (ICU) to a hospital ward is one of the highest-risk transitions of care [1]. This has been attributed to the sickest patients in the hospital being transitioned from a resource-rich environment to one with fewer resources, the number of providers involved, a lack of standardized discharge procedures and the complexity of verbal and written communication between providers and patients and/or their families as well as between providers themselves [2]-[5].

Opportunities exist to improve the quality of care during ICU discharge, and measures of ICU readmission and hospital mortality following patient discharge from the ICU have been proposed as quality metrics [6]-[10]. However, the reported incidences of readmission and hospital mortality vary widely, and there are currently no established benchmarks to guide quality improvement efforts [11],[12].

Therefore, we performed a secondary meta-analysis of studies by conducting a systematic review of prognostic factors for readmission to the ICU and hospital mortality in patients discharged alive from the ICU to derive literature-based estimates of these outcomes.

We followed the recommendations set forth in the Preferred Reporting Items in Systematic Reviews and Meta-Analysis and Meta-Analysis of Observational Studies in Epidemiology statements [13],[14]. This study did not require research ethics approval, as all of the data are in the public domain. Similarly, no consent was required from patients, as all of the data were abstracted in aggregate and are available in the public domain.

We identified 58 studies that satisfied the inclusion criteria and that had data which allowed calculation of the cumulative incidence of readmission to the ICU (n = 46 studies) or the cumulative incidence of hospital mortality (n = 49 studies) for patients discharged alive from the ICU (Figure 1) [2],[4],[5],[8],[11],[12],[19]-[70]. The characteristics of the studies are summarized in Table 1. The studies were published between 1986 and 2013 and represented 18 countries, including the United States (n = 12), the United Kingdom (n = 8), Australia (n = 6), Canada (n = 6) and Germany (n = 4). The number of patients within the studies ranged from 86 to 704,963, with an aggregate total of 2,073,170 patients included in our meta-analysis. The majority of studies were conducted in mixed medical-surgical ICUs (n = 34), with fewer studies conducted in cardiac ICUs (n = 7) or exclusively medical ICUs (n = 4) or surgical ICUs (n = 3). The mean (standard deviation) age of patients was 59.7 (5.4) years among the 44 studies in which a mean age was reported. Patient illness severity in most studies was reported based on the Acute Physiology and Chronic Health Evaluation score (n = 31) or the Simplified Acute Physiology Score (n = 12). The majority of studies were single-centered (n = 32), included patients with DNR orders (n = 42) and used multivariable adjustment (n = 49) in their data analysis. Most studies followed patients until hospital discharge (n = 46). In three studies, the investigators reported readmission to the ICU and hospital mortality at fixed time periods following patient discharge from the ICU (48 hours [26], 7 days [44] and 2 weeks [36]).

The pooled cumulative incidence of readmission to the ICU and cumulative incidence of hospital mortality using both fixed effects models and random effects models are summarized in Figure 2 and Figure 3, respectively. In patients discharged alive from the ICU, the fixed effects pooled cumulative incidence of readmission to the ICU during the same hospitalization was 4.0 readmissions per 100 patient discharges (95% CI, 3.9 to 4.0), whereas the random effects pooled cumulative incidence was 6.3 readmissions per 100 patients (95% CI, 5.6 to 6.9). In patients discharged alive from the ICU, the fixed effects pooled hospital mortality cumulative incidence during the same hospitalization was 3.3 deaths per 100 patient discharges (95% CI, 3.3 to 3.3), whereas the random effects pooled cumulative incidence was 6.8 deaths per 100 patient discharges (95% CI, 6.1 to 7.6). Heterogeneity among these estimates was high, with I ²-values of 99.7% and P < 0.001 for all estimates.

The stratified pooled cumulative incidence of readmission to the ICU and the stratified pooled cumulative incidence of hospital mortality for patients discharged alive from the ICU varied by geographic region, ICU type, patient characteristics and study characteristics (Table 2). Compared to medical-surgical ICUs, lower cumulative incidences of readmission (3.8 vs. 5.6 readmissions per 100 patient discharges) and hospital mortality (0.1 vs. 4.4 deaths per 100 patient discharges) were reported for cardiovascular ICUs. The cumulative incidence of ICU readmission and hospital mortality varied according to age, severity of illness and goals of care designations of the patients included in the studies. For example, studies that excluded patients with DNRs had lower cumulative incidences of readmission (3.5 vs. 5.5 readmissions per 100 patient discharges) and hospital mortality (2.2 vs. 3.5 deaths per 100 patient discharges) compared to studies that included DNR patients.

In this meta-analysis, we report the first pooled estimates of readmission to the ICU and hospital mortality for patients discharged alive from the ICU. These estimates suggest that, on average, for every 100 patients discharged alive from the ICU, between 4 and 6 patients will be readmitted to the ICU and between 3 and 7 patients will die prior to hospital discharge. Important variations in the incidence of readmission and mortality were observed according to geographic regions and patient-related, institutional and study methodological characteristics.

Our study underscores important opportunities and challenges in improving the quality of care provided to patients discharged from intensive care. We identified estimates of readmission and death for patients discharged alive from the ICU that are similar in magnitude to the estimates of adverse events reported in an Institute of Medicine report, To Err Is Human, that prompted major efforts to improve the safety and quality of care [71],[72]. Although readmission to the ICU and hospital mortality after ICU discharge do not equate to medical errors or adverse events and are not necessarily preventable [12], our data highlight that patient discharge from the ICU is a high-risk transition of care. There are opportunities to reduce the risks pertaining to patients (for example, relapsing and/or remitting comorbid illness), providers (for example, differential continuity of care), institutions (for example, availability of transition resources) and health systems (for example, ICU capacity) [73]. Our analysis reinforces the importance of measuring performance and considering internal (that is, monitoring performance over time) and external (that is, monitoring performance across institutions) benchmarking to guide quality improvement activities. For example, deviations from anticipated performance could be used to trigger audits of patient care to identify potentially preventable events and their root causes and thereby implement locally tailored interventions.

Our results can be used to inform quality metrics designed to measure the incidence of readmission to the ICU and the incidence of hospital mortality after patient discharge from the ICU. Currently, there is no consensus on ICU benchmarks for readmission and post-ICU mortality. ICU readmission was initially identified by Cooper et al. as an important indicator that captured complementary aspects of hospital-related performance [8]. Rosenberg et al. identified a readmission incidence of 7% and suggested its use as a quality-of-care indicator [5]. More recently, professional societies [6], provider groups [74] and accreditation organizations [75] across multiple countries [76] have proposed ICU readmission as a quality indicator, but they have not specified benchmark values. Measures of ICU and hospital mortality have similarly been proposed [10],[76]. Systematic reviews and meta-analyses have been used to derive quality improvement benchmarks [77], and our present study provides literature-based estimates of readmission to the ICU and hospital mortality that could be used by institutions to select potential benchmark values.

So, which literature-based estimates should be considered? Our analyses provide two sets of pooled estimates for both ICU readmission and hospital mortality that offer a range of potential benchmarks. The fixed effects model assumes that ICU readmission incidence is the same from study to study and provides a weighted average that gives large studies greater weight [78]. The random effects model does not assume that the ICU readmission incidence is the same from study to study (that is, that it may vary from study to study) and provides a weighted average that gives studies of different sizes similar weights [79]. Although the random effects model does better justice to the full range of data available, it does potentially allow a larger weight to be given to smaller studies that may have been selected for publication on the basis of their higher event rates [18]. Therefore, one approach would be to consider ICU readmission incidence (6 patients per 100 patient discharges) and hospital mortality incidence (7 patients per 100 patient discharges) above the random effects estimates to represent suboptimal quality of care. To represent adequate quality of care accurately, it may be necessary to consider ICU readmission incidence (4 to 6 patients per 100 patient discharges) and hospital mortality incidence (3 to 7 patients per 100 patient discharges) using both the fixed effects and random effects models. It may also be necessary to consider ICU readmission incidence (4 patients per 100 patient discharges) and hospital mortality incidence (3 patients per 100 patient discharges) below the fixed effects estimates as high-quality care and benchmark targets. The stratified analyses can be used to further refine benchmark selection to more closely represent different organizations’ patient and institutional characteristics. As an important caveat, the data highlight the complexity of identifying appropriate benchmarks, reinforce the importance of a cautious approach to adopting benchmarks and suggest potential value in employing benchmark ranges as opposed to individual values in quality improvement initiatives.

Our data also highlight that hospital mortality is common among patients discharged from the ICU. This reinforces observations that the utilization of intensive care resources by patients with life-limiting illnesses is steadily rising and that end-of-life care is increasingly initiated in the ICU [80],[81]. Whereas many of these patients will die during their ICU stay, others will be discharged from the ICU before dying. This suggests that consideration needs to be given to ensure that end-of-life care is effectively delivered during transitions of care. Incorporating joint metrics for goals of care reconciliation at the time of patient discharge from the ICU, as well as both ICU readmission and hospital mortality following patient discharge from the ICU, may help in the evaluation and monitoring of the care provided to patients discharged from the ICU who are at the end of life [82].

There are caveats to our study findings. First, the studies included in this analysis were identified by conducting a literature search targeted for studies in which associations between prognostic factors and the risk of readmission to ICU and hospital mortality for patients discharged alive from the ICU were examined. Nevertheless, it is unlikely that the incidence in other studies reporting readmission and death after patient discharge would be different from ours. Second, we identified heterogeneity that is not fully explained. This is an expected finding, given the diversity of geographic locations (for example, health systems, available resources), institutions (for example, procedures for discharge and post-ICU care), providers (for example, discharge practices) and patient populations (for example, severity of illness, patient and family care preferences) in the included studies. We have discussed the relative merits and limitations of using fixed effects models and random effects models to interpret benchmarks. Against this backdrop of heterogeneity, our meta-analysis summarizes what other institutions are reporting. Third, in the majority of studies, patients were followed to hospital discharge and data at fixed time periods following patient discharge from the ICU were not reported. Although measuring readmission to the ICU and hospital mortality during the remainder of a patient’s hospital stay provides valuable information, the implications of these events likely vary by time period (that is, implication of patient readmission within 24 hours is likely different from readmission within 7 days [15]) and may introduce bias into external benchmarking activities if the hospitals being compared employ different discharge practices (for example, timing of discharge or disposition to home, to rehabilitation, to long-term care [83]). Establishing consensus time periods for measuring quality metrics of transitions of patient care between the ICU and hospital ward would facilitate future research and quality improvement initiatives.

On the basis of our analysis of the literature, for every 100 patients discharged alive from the ICU, on average, between 4 and 6 patients will be readmitted to the ICU and between 3 and 7 patients will die prior to hospital discharge. Opportunities exist to improve the quality of care provided to patients discharged from intensive care. The literature-based estimates derived from this systematic review and meta-analysis can be used to inform the selection of benchmarks for quality metrics of transitions of patient care between the ICU and the hospital ward.