Materials and methods
Study design and data source
We conducted an observational study in a multiple-center database (OUTCOMEREA) from January 1997 to June 2009. Methods of data collection and quality of the database have been described in details elsewhere [
10]. Briefly, a large set of data on a random sample of patients older than 16 years with ICU stays longer than 24 h was prospectively collected by the senior physicians of the participating ICUs and entered into the database each year. The quality control procedure involved multiple automatic checking of internal consistency and biennial audits.
Ethics approval
In accordance with French law, the OUTCOMEREA database was declared to the Commission Nationale de l'Informatique et des Libertés. The study was approved by the ethics committee of Clermont-Ferrand, France. Since the study did not modify patients' management and data were processed anonymously, the need for informed consent was waived.
Study population and definitions
All patients in the database were eligible. Exclusion criteria were: chronic kidney disease (CKD) (with or without complete loss of kidney function), pre-renal cause of renal dysfunction (that is rapidly reversible functional renal failure), multiple ICU stays, decision to withhold or withdraw life-sustaining treatments, and renal replacement therapy for extra-renal indications (such as, intoxications or cardiogenic shock). CKD was defined either according to the Acute Physiology and Chronic Health Evaluation (APACHE) II definition or a specific code in the database when not requiring dialysis. Pre-renal cause of renal dysfunction was also identified through a specific code in the database. The reason for excluding these patients was that their prognosis may be different from that of patients with prior normal renal function who present a non-rapidly reversible cause of AKI. Patients with multiple ICU stays, or with a decision to withhold or withdraw life-sustaining treatments, were also excluded to avoid confusion in the assessment of hospital mortality.
Among the remaining patients, those in whom AKI occurred were analyzed. AKI was defined according to the RIFLE (Risk, Injury, Failure, Loss and End-stage renal failure) criteria [
11], and patients were classified according to the maximum RIFLE class (Risk, Injury or Failure) reached during their ICU stay. The maximum RIFLE class was determined before RRT initiation in patients who received RRT and whenever during the ICU stay in patients who did not. Since the 6- and 12-h urine outputs were not recorded in the database, we used the glomerular filtration rate (GFR) only. The GFR criteria were determined according to changes in serum creatinine from baseline values. As AKI may be present on ICU admission in a high proportion of patients, we chose to assess baseline creatinine values using the Modification of Diet in Renal Disease (MDRD) equation. As recommended by the Acute Dialysis Quality Initiative Group, a normal GFR of 75 ml/min/1.73 m
2 before ICU admission was assumed [
11].
RRT consisted of intermittent hemodialysis or continuous veno-venous hemofiltration/hemodiafiltration. All participating centers were able to provide both techniques of RRT. The decision to start RRT was left at the discretion of the attending ICU physicians.
Data collection
The following data were recorded:
• baseline characteristics on ICU admission: age, sex, McCabe class (class 1, no fatal underlying disease; class 2, underlying disease fatal within five years; class 3, underlying disease fatal within one year), Simplified Acute Physiology Score (SAPS) II, comorbidities assessed according to the APACHE II definitions, transfer from ward (defined as a stay in an acute-bed ward ≥24 hrs immediately before ICU admission), and admission category (medical, scheduled surgery, or unscheduled surgery),
• during the ICU stay: daily biological parameters (blood urea nitrogen, serum creatinine, kaliemia), daily urine output, daily weight, time from admission to maximum RIFLE class, time to RRT, daily Sequential Organ Failure Assessment (SOFA) score, and modified SOFA score (mSOFA, SOFA - specific renal component),
• on ICU discharge: renal status (recovery or need for prolonged renal support), and length of ICU stay, and,
• on hospital discharge: vital status.
Endpoints
The primary endpoint was hospital mortality.
The secondary endpoints were the length of ICU stay, and renal status on ICU discharge.
Propensity technique
Since RRT was not randomly assigned in our study population, treatment selection bias was accounted for by using the propensity technique. When building a propensity score, the main risk is the omission of an important variable in the propensity regression. Thus, we fitted and compared two different models to strengthen our analysis. As recommended, propensity scores were determined through multivariate logistic regression [
12], in which RRT was the dependent variable. Independent variables were related to the probability of receiving the treatment and also outcome in order to reduce both the bias and the variance in the estimation of treatment effect [
13,
14]. Independent variables introduced in model 1 were: rising creatinine reflected by maximum RIFLE class, oliguria reflected by the 24-h urine output on reaching maximum RIFLE class, and SAPS II score. Independent variables introduced in model 2 were: blood urea nitrogen, serum creatinine and kaliemia measured on reaching maximum RIFLE class (that is, before RRT was started), fluid accumulation (reflected by the difference between patients' weight recorded on reaching maximum RIFLE class and that recorded on ICU admission), and SAPS II score.
Using an algorithm [
15], we matched patients who received RRT during their ICU stay to other AKI patients who did not on the basis of each of the two propensity scores that we built (model 1 and model 2). Specifically, we sought to match each patient with RRT up to three controls who had the closest propensity score (within 0.05 on a scale of 0 to 1).
Besides, patients were also matched on center and period of admission to account for possible inconsistent institutional practices or changes in RRT practices over time. Age (+/- 5 years) was the final matching criterion. The adequacy of the propensity scores in controlling for treatment selection bias was demonstrated by testing for differences between matched patients in biological parameters likely to trigger RRT on reaching maximum RIFLE class.
The goodness of fit and the discrimination of the two logistic regression models used to derive a propensity score for RRT were evaluated by the Hosmer-Lemeshow (HL) test, and the c statistic (area under the receiver operating characteristics curve), respectively.
Statistical analyses
Results are expressed as numerical values and percentages for categorical variables, and as means and standard deviations (SD) or medians and quartiles [Q1-Q3] for continuous variables.
In the whole cohort, comparisons of patients with and those without RRT were based on chi-square tests for categorical data, and on Student's t-test or Wilcoxon's test for continuous data, as appropriate.
Comparisons between matched patients were based on univariate conditional logistic regression. Multivariate conditional logistic regression analysis was used to examine the association between RRT and subsequent hospital mortality, adjusting for variables potentially related to mortality that were not considered in the propensity regression (namely baseline characteristics that had a P value < 0.1 in univariate analysis, and the modified SOFA score (SOFA score - specific renal component) computed on the day maximum RIFLE class was reached).
Sensitivity analyses were performed to test whether any delay in RRT initiation could affect patients' prognosis. For that purpose, the timing of RRT was divided into three classes (less than 24 h, between 24 and 48 h, greater than 48 h after reaching maximum RIFLE class).
Since the use of the MDRD equation to estimate baseline creatinine values has not been validated in ICU patients, we also performed sensitivity analyses that included only patients with a normal serum creatinine value measured on ICU admission.
Wald χ2 tests were used to determine the significance of each variable. Adjusted odds ratios (ORs) and 95% confidence intervals (CIs) were calculated for each parameter estimate.
Analyses were computed using the SAS 9.1 software package (SAS Institute, Cary, NC, USA).
Discussion
While the impact of RRT modalities has been widely investigated through randomized controlled trials [
16‐
21], the overall efficacy of RRT remains uncertain. Actually, there is no real head-to-head comparison of AKI patients with and without RRT in the current literature. Mortality rates are usually higher in patients with than in those without RRT [
1‐
5]. However, no definitive conclusions can be can be drawn from these data due to the absence of clear indications for RRT and the many differences in severity patterns between patients who receive RRT and those who do not. In other words, treatment selection bias and patients' underlying severity are major confounders making the assessment of RRT efficacy challenging.
Our study brings a new insight in the field. By using the propensity technique, we were able to compare hospital mortality rates in matched patients with and without RRT, having a close probability of receiving RRT (somewhat as though RRT had been 'randomly assigned'). Moreover, since the SAPS II score was included in the propensity regressions, matched patients with and without RRT had also a similar predicted hospital mortality. Consequently, the risk of biased assessment of the association between RRT and hospital mortality was minimized.
Like in the interesting study of Elseviers
et al. [
22] that reported an increased risk of death for RRT compared to conservative treatment in ICU patients after extensive adjustment on disease severity, we failed to demonstrate any beneficial effect of RRT. While it cannot be totally run out that RRT
per se is potentially harmful (hemodynamic instability, central venous catheter-related blood stream infections, inflammation and coagulation disorders, which are common complications of RRT, may well have outweighed its metabolic benefits), these results emphasize the need for a critical reappraisal of current RRT practices and definitions of AKI. Particularly, it must be kept in mind that timing of RRT initiation is undoubtedly a key issue. In this regard, a plausible explanation for our findings is that RRT was in fact initiated too late. Actually, patients were classified according to the glomerular filtration rate (GFR) criteria of RIFLE whereas increases in serum creatinine often lag behind the true reduction in GFR. Thus, although RRT was in place within 24 h after reaching maximum RIFLE class in the vast majority of patients, it might well have been initiated at a more advanced stage of renal dysfunction than clinically appreciated. So, our results do not imply, as one may believe at first sight, that RRT should be abandoned. Rather, the key message could be: 'initiate RRT as early as possible'. That patients who received RRT had more coexisting organ failures on reaching maximum RIFLE class than their matched controls lends support to this hypothesis of delayed AKI diagnosis and RRT. Since initiation of RRT when multiple organ failures are present probably limits its ability to improve patients' outcomes, the utilization of highly sensitive and early diagnostic biomarkers such as cystatin C or neutrophil gelatinase-associated lipocalin (instead of serum creatinine) as triggers for RRT is worth considering for future investigations in the ICU [
23‐
30].
Despite the use of an original statistical approach minimizing the risk of bias, our study has potential limitations that merit consideration.
First, residual confounding cannot be totally excluded because of the observational design. However, by applying the propensity technique and matching on age, and center and period of admission, we dealt with confounding more extensively than in prior reports. Besides, that the two propensity models yielded similar results made the hypothesis of having omitted an important confounding variable unlikely.
Second, we encountered the same problem as others [
31,
32]: the 6- and 12-h urine outputs were not recorded in our database. Therefore, patients were classified according to the GFR criteria only. Patients classified according the GFR criteria seem to be more severely ill and have slightly higher mortality rates than their counterparts classified according to the urine output criteria [
33,
34]. Having considered both criteria may have resulted in a different estimation of RRT efficacy. Yet, urine output does not differentiate functional (pre-renal) AKI from organic AKI and new serum or urine biomarkers are probably much more reliable for the early diagnosis of AKI.
Third, the MDRD equation used to estimate baseline creatinine values has not been validated in ICU patients. Nevertheless, the sensitivity analysis including only data from patients with a normal serum creatinine value on ICU admission yielded similar results as the full analysis, showing that the use of the MDRD equation did not bias the results.
Fourth, the use of the MDRD equation to estimate baseline creatinine values refrains from precisely establishing AKI onset (that is, patients with an apparent early-onset AKI may in fact have developed AKI for several days before ICU admission). This could be problematic in that the prognosis of early AKI may differ from that of late AKI. That results of the sensitivity analysis, including only data from patients with a normal serum creatinine value on ICU admission, yielded similar results as the full analysis runs counter to the hypothesis of differential prognosis and impact of RRT between early and late AKI. However, this issue needs further evaluation.
Fifth, it might be argued that RRT initiation may have prevented R or I class patients from reaching a higher RIFLE class (thus leading to an underestimation of their degree of renal dysfunction, and subsequent comparison of RRT patients with non-RRT patients having a more severe renal dysfunction). Yet, this limit, which is inherent to the RIFLE classification, does not apply to F class patients. Since odds ratios of mortality associated with RRT in the whole population were similar as those in the F class patients, it is very unlikely that results were flawed by a potential misclassification bias induced by an underestimation of renal dysfunction in RRT patients.
Sixth, the prognostic impact of the dose and initial modality of RRT was not assessed. It must be emphasized, however, that all randomized controlled trials conducted so far have showed equivalence between high and low doses, and continuous and intermittent RRT [
16‐
21].
Finally, data on the long-term impact of AKI and RRT were not recorded in the database, and concomitant measures likely to prevent or positively influence the course of renal dysfunction (optimization of hemodynamics and renal perfusion, avoidance of nephrotoxic drugs) were not analyzed. These issues deserve future prospective evaluations.
Acknowledgements
We are indebted in the persons listed below for their participation in the Outcomerea study group:
Scientific committee
Jean-François Timsit (Hôpital Albert Michallon and INSERM U823, Grenoble, France), Elie Azoulay (Medical ICU, Hôpital Saint Louis, Paris, France), Yves Cohen (ICU, Hôpital Avicenne, Bobigny, France), Maïté Garrouste-Orgeas (ICU Hôpital Saint-Joseph, Paris, France), Lilia Soufir (ICU, Hôpital Saint-Joseph, Paris, France), Jean-Ralph Zahar (Microbiology Department, Hôpital Necker, Paris, France), Christophe Adrie (ICU, Hôpital Delafontaine, Saint Denis, France), and Christophe Clec'h (ICU, Hôpital Avicenne, Bobigny, and INSERM U823, Grenoble, France).
Biostatistical and informatics expertise
Jean-Francois Timsit (Hôpital Albert Michallon and INSERM U823, Grenoble, France), Sylvie Chevret (Medical Computer Sciences and Biostatistics Department, Hôpital Saint-Louis, Paris, France), Corinne Alberti (Medical Computer Sciences and Biostatistics Department, Robert Debré, Paris, France), Adrien Français (INSERM U823, Grenoble, France), Aurélien Vesin INSERM U823, Grenoble, France), Christophe Clec'h (ICU, Hôpital Avicenne, Bobigny, and INSERM U823, Grenoble, France), Frederik Lecorre (Supelec, France), and Didier Nakache (Conservatoire National des Arts et Métiers, Paris, France).
Investigators of the Outcomerea database
Christophe Adrie (ICU, Hôpital Delafontaine, Saint Denis, France), Bernard Allaouchiche (ICU, Edouard Herriot Hospital, Lyon), Caroline Bornstain (ICU, Hôpital de Montfermeil, France), Alexandre Boyer (ICU, Hôpital Pellegrin, Bordeaux, France), Antoine Caubel (ICU, Hôpital Saint-Joseph, Paris, France), Christine Cheval (SICU, Hôpital Saint-Joseph, Paris, France), Marie-Alliette Costa de Beauregard (Nephrology, Hôpital Tenon, Paris, France), Jean-Pierre Colin (ICU, Hôpital de Dourdan, Dourdan, France), Mickael Darmon (ICU, CHU Saint Etienne), Anne-Sylvie Dumenil (Hôpital Antoine Béclère, Clamart France), Adrien Descorps-Declere (Hôpital Antoine Béclère, Clamart France), Jean-Philippe Fosse (ICU, Hôpital Avicenne, Bobigny, France), Samir Jamali (ICU, Hôpital de Dourdan, Dourdan, France), Hatem Khallel (ICU, Cayenne General Hospital), Christian Laplace (ICU, Hôpital Kremlin-Bicêtre, Bicêtre, France), Alexandre Lauttrette (ICU, CHU G Montpied, Clermont-Ferrand), Thierry Lazard (ICU, Hôpital de la Croix Saint-Simon, Paris, France), Eric Le Miere (ICU, Hôpital Louis Mourier, Colombes, France), Laurent Montesino (ICU, Hôpital Bichat, Paris, France), Bruno Mourvillier (ICU, Hôpital Bichat, France), Benoît Misset (ICU, Hôpital Saint-Joseph, Paris, France), Delphine Moreau (ICU, Hôpital Saint-Louis, Paris, France), Etienne Pigné (ICU, Hôpital Louis Mourier, Colombes, France), Bertrand Souweine (ICU, CHU G Montpied, Clermont-Ferrand), Carole Schwebel (CHU A Michallon, Grenoble, France), Gilles Troché (Hôpital Antoine, Béclère, Clamart France), Marie Thuong (ICU, Hôpital Delafontaine, Saint Denis, France), Guillaume Thierry (ICU, Hôpital Saint-Louis, Paris, France), Dany Toledano (CH Gonnesse, France), and Eric Vantalon (SICU, Hôpital Saint-Joseph, Paris, France).
Study monitors: Caroline Tournegros, Loic Ferrand, Nadira Kaddour, Boris Berthe, Samir Bekkhouche, Sylvain Anselme.
Authors' contributions
CC designed the study and wrote the manuscript; CC and JFT performed the statistical analyses; MD, AL, FC, EA, CS, ASD, MGO, DGT, and YC participated in the collection of data and critically revised the manuscript for important intellectual content. All authors read and approved the final manuscript.