Skip to main content
Erschienen in: Intensive Care Medicine 11/2009

01.11.2009 | Original

External validation of the Simplified Acute Physiology Score (SAPS) 3 in a cohort of 28,357 patients from 147 Italian intensive care units

verfasst von: Daniele Poole, Carlotta Rossi, Abramo Anghileri, Michele Giardino, Nicola Latronico, Danilo Radrizzani, Martin Langer, Guido Bertolini

Erschienen in: Intensive Care Medicine | Ausgabe 11/2009

Einloggen, um Zugang zu erhalten

Abstract

Objective

To evaluate the SAPS 3 score predictive ability of hospital mortality in a large external validation cohort.

Design

Prospective observational study.

Setting and patients

A total of 28,357 patients from 147 Italian ICUs joining the Project Margherita national database of the Gruppo italiano per la Valutazione degli interventi in Terapia Intensiva (GiViTI).

Interventions

None.

Measurement

Evaluation of discrimination through ROC analysis and of overall goodness-of-fit through the Cox calibration test.

Main results

Although discrimination was good, calibration turned out to be poor. The general and the South-Europe Mediterranean countries equations overestimated hospital mortality overall (SMR values 0.73 with 95% CI 0.72–0.75 for both equations) and homogeneously across risk classes. Overprediction was confirmed among important subgroups, with SMR values ranging between 0.47 and 0.82.

Conclusions

The result strictly supported by our data is that the SAPS 3 score calibrates inadequately in a large sample of Italian ICU patients and thus should not be used for benchmarking, at least in Italian settings.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Altman DG, Royston P (2000) What do we mean by validating a prognostic model? Stat Med 19:453–473CrossRefPubMed Altman DG, Royston P (2000) What do we mean by validating a prognostic model? Stat Med 19:453–473CrossRefPubMed
3.
Zurück zum Zitat Metnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3–from evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med 31:1336–1344CrossRefPubMed Metnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3–from evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med 31:1336–1344CrossRefPubMed
4.
Zurück zum Zitat Ledoux D, Canivet JL, Preiser JC, Lefrancq J, Damas P (2008) SAPS 3 admission score: an external validation in a general intensive care population. Intensive Care Med 34:1873–1877CrossRefPubMed Ledoux D, Canivet JL, Preiser JC, Lefrancq J, Damas P (2008) SAPS 3 admission score: an external validation in a general intensive care population. Intensive Care Med 34:1873–1877CrossRefPubMed
5.
Zurück zum Zitat Soares M, Salluh JI (2006) Validation of the SAPS 3 admission prognostic model in patients with cancer in need of intensive care. Intensive Care Med 32:1839–1844CrossRefPubMed Soares M, Salluh JI (2006) Validation of the SAPS 3 admission prognostic model in patients with cancer in need of intensive care. Intensive Care Med 32:1839–1844CrossRefPubMed
6.
Zurück zum Zitat Krauss C, Sakr Y, Amaral A, Rea-Neto A, Specht M, Reinhart K, Marx G (2008) Assessment of the performance of the SAPS 3, SAPS II, and APACHE II prognostic models in a surgical ICU. Crit Care 12(Suppl 2):P502 Krauss C, Sakr Y, Amaral A, Rea-Neto A, Specht M, Reinhart K, Marx G (2008) Assessment of the performance of the SAPS 3, SAPS II, and APACHE II prognostic models in a surgical ICU. Crit Care 12(Suppl 2):P502
7.
Zurück zum Zitat Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3–from evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31:1345–1355CrossRefPubMed Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3–from evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31:1345–1355CrossRefPubMed
8.
Zurück zum Zitat Moreno R, Apolone G, Miranda DR (1998) Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 24:40–47CrossRefPubMed Moreno R, Apolone G, Miranda DR (1998) Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 24:40–47CrossRefPubMed
9.
Zurück zum Zitat Hosmer DW, Lemeshow S (1995) Confidence interval estimates of an index of quality performance based on logistic regression models. Stat Med 14:2161–2172CrossRefPubMed Hosmer DW, Lemeshow S (1995) Confidence interval estimates of an index of quality performance based on logistic regression models. Stat Med 14:2161–2172CrossRefPubMed
10.
Zurück zum Zitat Kramer AA, Zimmerman JE (2007) Assessing the calibration of mortality benchmarks in critical care: the Hosmer–Lemeshow test revisited. Crit Care Med 35:2052–2056CrossRefPubMed Kramer AA, Zimmerman JE (2007) Assessing the calibration of mortality benchmarks in critical care: the Hosmer–Lemeshow test revisited. Crit Care Med 35:2052–2056CrossRefPubMed
11.
Zurück zum Zitat Bertolini G, D’Amico R, Nardi D, Tinazzi A, Apolone G (2000) One model, several results: the paradox of the Hosmer-Lemeshow goodness-of-fit test for the logistic regression model. J Epidemiol Biostat 5:251–253PubMed Bertolini G, D’Amico R, Nardi D, Tinazzi A, Apolone G (2000) One model, several results: the paradox of the Hosmer-Lemeshow goodness-of-fit test for the logistic regression model. J Epidemiol Biostat 5:251–253PubMed
12.
Zurück zum Zitat Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K (2006) Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 34:1378–1388CrossRefPubMed Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K (2006) Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 34:1378–1388CrossRefPubMed
13.
Zurück zum Zitat Hyam JA, Welch CA, Harrison DA, Menon DK (2006) Case mix, outcomes and comparison of risk prediction models for admissions to adult, general and specialist critical care units for head injury: a secondary analysis of the ICNARC Case Mix Programme Database. Crit Care 10(Suppl 2):S2CrossRefPubMed Hyam JA, Welch CA, Harrison DA, Menon DK (2006) Case mix, outcomes and comparison of risk prediction models for admissions to adult, general and specialist critical care units for head injury: a secondary analysis of the ICNARC Case Mix Programme Database. Crit Care 10(Suppl 2):S2CrossRefPubMed
14.
Zurück zum Zitat Seillier-Moiseiwitsch F (1996) Predictive diagnostics for logistic models. Stat Med 15:2149–2160CrossRefPubMed Seillier-Moiseiwitsch F (1996) Predictive diagnostics for logistic models. Stat Med 15:2149–2160CrossRefPubMed
15.
Zurück zum Zitat Cox D (1958) Two further applications of a model for a method of binary regression. Biometrika 45:562–565 Cox D (1958) Two further applications of a model for a method of binary regression. Biometrika 45:562–565
16.
Zurück zum Zitat Miller ME, Hui SL, Tierney WM (1991) Validation techniques for logistic regression models. Stat Med 10:1213–1226CrossRefPubMed Miller ME, Hui SL, Tierney WM (1991) Validation techniques for logistic regression models. Stat Med 10:1213–1226CrossRefPubMed
17.
Zurück zum Zitat Boffelli S, Rossi C, Bertolini G (2008) Progetto Margherita—Promuovere la ricerca e la valutazione in Terapia Intensiva. Rapporto 2007. Edizioni Sestante, Bergamo Boffelli S, Rossi C, Bertolini G (2008) Progetto Margherita—Promuovere la ricerca e la valutazione in Terapia Intensiva. Rapporto 2007. Edizioni Sestante, Bergamo
18.
Zurück zum Zitat Zimmerman JE, Kramer AA, McNair DS, Malila FM (2006) Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today’s critically ill patients. Crit Care Med 34:1297–1310CrossRefPubMed Zimmerman JE, Kramer AA, McNair DS, Malila FM (2006) Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today’s critically ill patients. Crit Care Med 34:1297–1310CrossRefPubMed
19.
Zurück zum Zitat Black N (1997) Developing high quality clinical databases. BMJ 315:381–382PubMed Black N (1997) Developing high quality clinical databases. BMJ 315:381–382PubMed
20.
Zurück zum Zitat Beck DH, Smith GB, Pappachan JV, Millar B (2003) External validation of the SAPS II, APACHE II and APACHE III prognostic models in South England: a multicentre study. Intensive Care Med 29:249–256PubMed Beck DH, Smith GB, Pappachan JV, Millar B (2003) External validation of the SAPS II, APACHE II and APACHE III prognostic models in South England: a multicentre study. Intensive Care Med 29:249–256PubMed
21.
Zurück zum Zitat Aegerter P, Boumendil A, Retbi A, Minvielle E, Dervaux B, Guidet B (2005) SAPS II revisited. Intensive Care Med 31:416–423CrossRefPubMed Aegerter P, Boumendil A, Retbi A, Minvielle E, Dervaux B, Guidet B (2005) SAPS II revisited. Intensive Care Med 31:416–423CrossRefPubMed
22.
Zurück zum Zitat Metnitz PG, Lang T, Vesely H, Valentin A, Le Gall JR (2000) Ratios of observed to expected mortality are affected by differences in case mix and quality of care. Intensive Care Med 26:1466–1472CrossRefPubMed Metnitz PG, Lang T, Vesely H, Valentin A, Le Gall JR (2000) Ratios of observed to expected mortality are affected by differences in case mix and quality of care. Intensive Care Med 26:1466–1472CrossRefPubMed
Metadaten
Titel
External validation of the Simplified Acute Physiology Score (SAPS) 3 in a cohort of 28,357 patients from 147 Italian intensive care units
verfasst von
Daniele Poole
Carlotta Rossi
Abramo Anghileri
Michele Giardino
Nicola Latronico
Danilo Radrizzani
Martin Langer
Guido Bertolini
Publikationsdatum
01.11.2009
Verlag
Springer-Verlag
Erschienen in
Intensive Care Medicine / Ausgabe 11/2009
Print ISSN: 0342-4642
Elektronische ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-009-1615-0

Weitere Artikel der Ausgabe 11/2009

Intensive Care Medicine 11/2009 Zur Ausgabe

Mit dem Seitenschneider gegen das Reißverschluss-Malheur

03.06.2024 Urologische Notfallmedizin Nachrichten

Wer ihn je erlebt hat, wird ihn nicht vergessen: den Schmerz, den die beim Öffnen oder Schließen des Reißverschlusses am Hosenschlitz eingeklemmte Haut am Penis oder Skrotum verursacht. Eine neue Methode für rasche Abhilfe hat ein US-Team getestet.

Schlaganfall: frühzeitige Blutdrucksenkung im Krankenwagen ohne Nutzen

31.05.2024 Apoplex Nachrichten

Der optimale Ansatz für die Blutdruckkontrolle bei Patientinnen und Patienten mit akutem Schlaganfall ist noch nicht gefunden. Ob sich eine frühzeitige Therapie der Hypertonie noch während des Transports in die Klinik lohnt, hat jetzt eine Studie aus China untersucht.

Reanimation bei Kindern – besser vor Ort oder während Transport?

29.05.2024 Reanimation im Kindesalter Nachrichten

Zwar scheint es laut einer Studie aus den USA und Kanada bei der Reanimation von Kindern außerhalb einer Klinik keinen Unterschied für das Überleben zu machen, ob die Wiederbelebungsmaßnahmen während des Transports in die Klinik stattfinden oder vor Ort ausgeführt werden. Jedoch gibt es dabei einige Einschränkungen und eine wichtige Ausnahme.

Nicht Creutzfeldt Jakob, sondern Abführtee-Vergiftung

29.05.2024 Hyponatriämie Nachrichten

Eine ältere Frau trinkt regelmäßig Sennesblättertee gegen ihre Verstopfung. Der scheint plötzlich gut zu wirken. Auf Durchfall und Erbrechen folgt allerdings eine Hyponatriämie. Nach deren Korrektur kommt es plötzlich zu progredienten Kognitions- und Verhaltensstörungen.

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.