Implementation of sepsis bundles in public hospitals in Brazil: a prospective study with heterogeneous results

Although sepsis is still a leading cause of mortality worldwide, mortality rates are decreasing [1], especially in developed countries [2, 3]. However, low- and middle-income countries (LMICs) are responsible for a significant portion of the sepsis burden [4], and mortality rates are still very high in these settings [5‐8]. Quality improvement initiatives are successful in reducing fatality rates in high-income countries [9], but there are only a few reports of such initiatives in LMICs [10‐15]. In Brazil, some studies have already shown higher mortality rates in public institutions than in private ones [16, 17]; also, public institutions have worse compliance with treatment quality indicators, and mortality reductions in quality improvement initiatives seem not to be sustained [16, 18].

Public hospitals in emerging countries pose a challenge to quality improvement initiatives. These facilities usually have considerable limitations, including infrastructure issues; low availability of resources [19]; low availability of intensive care unit (ICU) beds [20]; a shortage of healthcare professionals [21]; inadequate staff qualification and high turnover [22, 23]; and overcrowding, especially in the emergency department (ED). One of the main barriers is the low awareness of sepsis [23], leading to late recognition with a consequent delay in intervention and increased lethality [16, 24]. Therefore, one of the main goals of any quality improvement initiative should be to train hospital staff to identify those patients in earlier phases. Early recognition and training are associated with a reduction in the severity of illness among patients with sepsis, as well as with lower severity scores and less organ dysfunction at the time of the sepsis diagnosis [15].

Therefore, we aimed to assess whether a quality improvement initiative in a network of public hospitals in Brazil would decrease mortality and the factors that would be associated with this reduction. On the basis of our previous experience in public hospitals [18], we anticipated that the success of the initiative would be heterogeneous among the hospitals; therefore, our secondary objective was to identify the quality indicators associated with a reduction in mortality rates.

We conducted a prospective study in a network of nine public hospitals with a central administration. The institutions were instructed to include clinical and sepsis management variables from all patients admitted to the ED, wards, or ICUs with a diagnosis of sepsis or septic shock in a centralized electronic database [25]. We defined sepsis as the presence of infection complicated by acute organ dysfunction (previously called severe sepsis) [17], as detailed in the Additional file. Septic shock was defined by the presence of refractory hypotension with the need for vasopressors. Patients could be included in the database only once in the same hospital admission. Patients receiving end-of-life care were excluded. The research and ethics committee of Universidade Federal de São Paulo approved the study (1387/10) and waived the need for informed consent because of the nature of the study.

From September 2010 to August 2012, we included 3435 patients from the 9 participating hospitals. The baseline characteristics of the patients throughout the intervention are available in Table 1, and the individual results are provided in Additional file 1: Table S2. There was no major change in the patients’ characteristics, except for discreet changes in the frequency of some comorbidities, the urinary tract as a source of infection, and the location at sepsis presentation.

There was a significant reduction in the mortality rates over time with p < 0.0001 (Table 2). This reduction was significant for patients with sepsis and septic shock. There was also an improvement in the secondary outcomes with a significant reduction in the time to sepsis diagnosis and an increased percentage of patients diagnosed with sepsis instead of septic shock. Concomitantly, there was a reduction in the disease severity, as measured by the APACHE II score, SOFA score, and total number of organs with dysfunction. The compliance with the first three required items of the 6-h bundle, as well as compliance with the entire bundle, also increased significantly.

In the logistic regression model, the time to sepsis diagnosis was independently associated with increased mortality (Table 3) in both institution types. By contrast, neither compliance with the entire 6-h bundle nor compliance with antibiotics or fluids and vasopressors (Additional file 1: Table S3) was associated with a reduction in the risk of death. The results of the sensitivity analysis excluding the institutions that did not include patients until the last quarter of the intervention showed similar results (Additional file 1: Table S4). The results of the univariate analysis are available in Additional file 1: Table S5. Other classical variables were also independently associated with a higher risk of death, such as age, cancer and illness severity, and presenting with sepsis in the wards.

Only two institutions had a significant reduction in mortality rates along the quarters (Additional file 1: Table S6 and Figure S1). The reduction in mortality rates can be seen in Fig. 1a. The baseline characteristics of the patients are available in Additional file 1: Table S7. There were some differences in the patient profiles. The percentage of patients from the ED was higher in the successful groups, but these patients also had a higher frequency of comorbidities. These sites were analyzed together (successful institutions) and compared with the institutions without success (nonsuccessful institutions), as shown in Table 2. Although the time to sepsis diagnosis was significantly reduced in both groups, the reduction was greater at the successful sites (Fig. 1b). Although the time curves decayed in parallel, the absolute numbers in the last quarter were smaller in the successful ones. The median time to sepsis diagnosis was still 2.0 (1.0–7.5) in the nonsuccessful hospitals, which was significantly different from the successful ones (0.8 [0.4–2.0], p < 0.0001). We also calculated the mean ratio for one-trimester difference for both types of institutions. In the successful ones, the ratio of decline was 0.777 (0.752–0.804, p < 0.0001), indicating that there was, on average, a 23% of decline in the time to sepsis diagnosis in each quarter of the intervention. By contrast, the ratio of decline in the nonsuccessful hospitals was 0.868 (0.675–1.116, p = 0.270), indicating that the mean ratio of decline did not differ between the quarters. We also found a greater increase in the proportion of patients with sepsis than in those with septic shock at the successful institutions. By contrast, compared with the successful sites, the nonsuccessful sites had a significant increase in compliance with the bundles for both the required items and the entire 6-h bundle (Fig. 1c).

Our results show that the implementation of a sepsis protocol in public institutions in an emerging country led to an overall reduction in the risk of death, proportion of septic shock cases, time to sepsis diagnosis, and improvement in compliance with all 6-h bundle items. These results might be associated with earlier sepsis recognition rather than compliance with treatment indicators. Our findings also suggest that the impact of the implementation of sepsis protocols in public institutions in an emerging country is variable and that mortality reduction is achieved only in some institutions. The successful institutions seemed to be able to reduce the time to sepsis diagnosis more aggressively than the nonsuccessful ones.

Quality improvement initiatives in emerging countries face many challenges [27]. We observed that time to sepsis diagnosis was independently associated with a reduction in the risk of death, although compliance with the 6-h bundle with antibiotics or fluids was not. Although previous studies have demonstrated that compliance with the 6-h bundle and antibiotics was associated with a mortality reduction [15, 28], we were not able to replicate these findings. One explanation is that compliance in this study was measured with time zero beginning at the time of sepsis diagnosis, as acknowledged in the patients’ charts, and not at the time of organ dysfunction onset. Any potential effect of compliance on mortality would be better assessed if compliance were measured according to organ dysfunction onset and not in relation to the moment of sepsis diagnosis. Therefore, compliance alone, not considering the time to sepsis diagnosis, will hardly be associated with mortality reduction in settings where late recognition is frequent. Unfortunately, time zero for calculating compliance is not consistently reported in quality improvement studies. Our findings reinforce the key role of raising awareness, because delayed, although adequate, treatment might not result in optimal survival rates. Another potential explanation is that among the bundle items, some are direct interventions such as antibiotics and others are diagnostic tools, and their impact on mortality will be highly dependent on physicians’ management and not directly on compliance, such as lactate sampling or blood cultures, and we did not assess the adequacy of treatment in a broader way.

As previously shown [29], we observed a trend toward a reduction in disease severity throughout the study period, although none of the hospitals changed their admission profiles. The reduction in the time to sepsis diagnosis could have contributed to a higher percentage of patients being diagnosed with sepsis instead of in the latter stages of septic shock. The early diagnosis also possibly contributed to earlier treatment and therefore could have reduced the odds of progression to septic shock. This hypothesis is reinforced by the finding of a significant reduction in the SOFA score and number of organs with dysfunction. We might argue that a modification in the institution profile could have contributed to these findings. However, there was no relevant change in the baseline characteristics of the patients, except by discreet and irrelevant oscillations in the frequency of some comorbidities. Some differences might have been influenced by our intervention. For example, the increased inclusion of ED patients may indicate a higher awareness of the ED staff. The reduction in the frequency of pneumonia as the source of infection may be a consequence of training and, consequently, the correct diagnosis of respiratory dysfunction secondary to other sources.

The old sepsis definition was used in this study because it was a quality improvement initiative carried out before the new Sepsis 3.0 guidelines definition was available. However, because the Sepsis 3 guidelines define sepsis as the presence of a life-threatening organ dysfunction caused by infection, the definition we used is compatible with this broad concept. The variation in SOFA score, which is the current clinical criterion to define organ dysfunction, is not useful in quality improvement initiatives, because it would require calculations and also, in some cases, time to meet the criteria, which might result in delay in care. As recognized by the Sepsis 3 task force, this was not the intention of the new definition [30]. Thus, the SSC guidelines, on which this quality improvement initiative is based, did not change their criteria even after the launching of the definitions.

Although data from resource-limited settings are scarce, mortality reduction is not a consistent or sustained finding [15, 18, 31]. Our findings support this heterogeneity because only two institutions reduced their mortality rates despite the consistent global improvement in other quality indicators. In the successful institutions, there was a greater reduction in the time to sepsis diagnosis, reinforcing the results of our multivariate analysis. Unfortunately, our study did not address other factors that might influence the feasibility of quality improvement initiatives and help to explain this finding. Difficulties in implementing sepsis protocols have already been reported and include a lack of dedicated staff in the protocol; low availability of resources [32]; shortage of medical and nursing staff [21]; and low compliance with basic principles of quality care, such as continuous training strategies, which is associated with a high professional turnover rate [22], contributing to an inadequate safety culture and low quality of care [33]. These institutional characteristics were not addressed in our study. Also, we did not assess other institutional factors that might be associated with higher sepsis mortality rates, such as the availability of ICU beds or the percentage of patients transferred from other facilities.

Our study has some strengths. First, we reported data from a network of public institutions with a central administration, which is an original approach for a quality improvement initiative in an emerging country. Our results can be generalized to a significant proportion of the Brazilian public healthcare system and potentially to other emerging countries. Second, our implementation strategy was well planned with use of previously validated quality indicators, and we assessed patients in all hospital sectors instead of restricting inclusion to ICU patients. Third, the length of the intervention was sufficiently long to assess the persistence of the effects. However, our study also has some limitations. First, although the LASI provided all tools and information to allow for a similar intervention in all sites, local implementation was highly dependent on the local conditions. We did not measure the percentage of training staff in each site or the number of individually organized meetings. As in most quality improvement initiatives, this step is difficult to measure. Although the audit and feedback provided by the LASI was continuous throughout the intervention, differences in training capacities might have influenced the success of the institutions. The screening process could have been slightly different in some of the hospitals, such that patients might have been missed. Second, we did not monitor the quality of data collection with on-site verification of source documents, although we implemented central monitoring of data for completeness and consistency. Third, the before-after study design precludes any assessment of causality because there was no randomization process or control group. Fourth, we did not measure other concurrent quality improvement processes that might have influenced the results in the successful institutions. In addition, as previously described, we did not assess other information that could explain the differences between institutions, such as the availability of resources, staffing, ICU availability, and other general institutional quality indicators. Organizational factors in each of the institutions, such as nurse/patient ratio, physician and resident staffing hours, the presence of multidisciplinary rounds, the use of protocols in the ICU, or the use of checklists, are not described and might have influenced the results. Fifty, one of the successful sites had baseline mortality rates lower than the other institutions. However, the impact of having a lower baseline mortality rate in a quality improvement initiative is not clear, because this does not necessarily imply that there is a better chance of reducing mortality. We can argue that hospitals with lower mortality are better organized and thus are better settings for quality improvement initiatives. By contrast, this might also mean that the basic adjustments in quality improvement have already been done and that further improvement would be harder to achieve. Along these lines, settings with higher baseline mortality rates might succeed in adjusting basic processes, which will lower their mortality rates.

A multifaceted approach for sepsis treatment increased compliance and awareness in public institutions in Brazil. However, the impact on mortality was variable. Early recognition seems to be a more relevant factor than compliance with the 6-h bundle in terms of improving the chances of survival.