Skip to main content
Erschienen in: Journal of Translational Medicine 1/2022

Open Access 01.12.2022 | COVID-19 | Letter to the Editor

Revalidating the prognostic COVID-19 severity assessment (COSA) score for variants of concern

verfasst von: Verena Schöning, Evangelia Liakoni, Christine Baumgartner, Aristomenis K. Exadaktylos, Wolf E. Hautz, Andrew Atkinson, Felix Hammann

Erschienen in: Journal of Translational Medicine | Ausgabe 1/2022

download
DOWNLOAD
print
DRUCKEN
insite
SUCHEN
Hinweise

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Abkürzungen
AUROC
Area under the receiver operating characteristic
BMI
Body mass index
COSA
COVID-19 severity assessment
COVID-19
Coronavirus disease 19
CRP
C-reactive protein
eGFR
Estimated glomerular filtration rate
ICU
Intensive Care Unit
RT-PCR
Reverse-transcriptase polymerase chain reaction
SARS-CoV-2
Severe acute respiratory syndrome coronavirus 2
VOC
Variants of concern
Dear Editor,
Many prediction models have been published for Coronavirus disease 2019 (COVID-19) to support clinical decision-making for either diagnosis, prediction of mortality risk, or disease progression. An ongoing review concluded that most of these were poorly reported and had a high risk of bias, casting doubt over their real-world predictive value [1]. Additionally, dominant strains are no longer the ancestral type but variants of concern (VOCs) with different pathogenicity, and vaccinations and herd immunity can influence individual outcomes. We aimed to assess the performance of our previously published COSA (COVID-19 Severity Assessment) score on admitted patients in the twelve months following its development, a time during which the score was used clinically for risk stratification.
The COSA score was developed using data from patients who tested positive for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) by reverse-transcriptase polymerase chain reaction (RT-PCR) between February 1st and November 16th, 2020 (1st and 2nd waves in Switzerland, i.e. the original cohort) [2]. The revalidation cohort consisted of patients who tested positive for SARS-CoV-2 between November 17th, 2020 and November 16th, 2021. The primary outcome was disease severity, as determined by the worst outcome at any point after diagnosis:
  • Non-severe outcome: no intensive care unit (ICU) admission or death of any cause during the observational period
  • Severe outcome: ICU admission at any stage and / or death of any cause
All patients were discharged or had died by the time the revalidation was performed.
The COSA score (Table 1) was calculated for each patient using the most extreme laboratory values within 3 days prior to 1 day after the positive SARS-CoV-2 test. The results of the original and the revalidation cohort were then compared.
Table 1
COVID-19 severity assessment (COSA) score (from Ref. [2])
Parameter
Value
Score points
Sex
Male
1
CRP
 ≥ 25 mg/L
3
Sodium
 ≥ 144 mmol/L
2
Hemoglobin
 ≤ 100 g/L
1
eGFR according to CKD-EPI
 ≤ 75 mL/min
1
Glucose
 ≥ 8.6 mmol/L
1
Leucocytes
 ≥ 10 G/L
1
The COSA score was calculated for each patient using the most extreme values within 3 days prior to 1 day after the positive SARS-CoV-2 test, with a score of 6 or higher indicating a high risk (> 50%) for a severe progression
Data wrangling, analysis, and visualization were performed in GNU R (version 4.0.2, [3]). Statistical significance levels were defined at a p-value of < 0.05, and determined with the Wilcoxon rank sum test for continuous variables, and the Chi-square test for categorical variables using the stats package (version 4.0.2). The area under the receiver operating characteristic curve (AUROC) and the 95% confidence intervals (CI) were calculated to assess the discriminatory power of the COSA score to predict a severe outcome. The COSA score was considered validated if the 95% CI of the AUROC from fitting the original and the revalidation data set were overlapping.
The original cohort consisted of 626 patients (457 non-severe and 169 severe outcomes), and 508 patients were included in the revalidation cohort (301 non-severe and 208 severe outcomes). A comparison of the demographics and laboratory parameters of both cohorts is provided in Table 2. The patients in the original non-severe cohort were significantly younger with a lower share of inpatients than in the non-severe revalidation cohort. The latter had significantly higher peak C-reactive protein (CRP) and glucose, and lower minimal hemoglobin and estimated glomerular filtration rate values. For severe patients, we noted a higher proportion of inpatients and deaths, and significantly lower body weights and body mass index in the revalidation cohort. There was no significant difference in laboratory parameters.
Table 2
General demographics and laboratory parameters of the original and revalidation cohort
 
Non-severe (N = 758)
Severe (N = 512)
Original
(N = 457)
Revalidation
(N = 301)
P value
Original
(N = 171)
Revalidation
(N = 208)
P value
Demographics
 Age (years)
  Median
(IQR)
64.00 (49.00, 76.00)
72.00 (59.00, 82.00)
 < 0.002
68.00 (57.00, 78.00)
72.00 (59.75, 82.25)
0.058
 Sex
  Female, n (%)
188 (41.05)
125 (41.81)
0.895
45 (26.32)
63 (30.29)
0.460
 Hospitalization
  Inpatients, n (%)
319 (69.58)
299 (100.00)
 < 0.002
163 (95.27)
208 (100.00)
0.005
 Deaths
  Deceased, n (%)
0 (0.00)
0 (0.00)
51 (29.82)
120 (57.69)
 < 0.002
 Weight (kg)
  Median
(IQR)
77.90 (66.23, 88.00)
76.30 (65.62, 88.00)
0.526
81.00 (70.40, 93.70)
75.20 (65.20, 90.00)
0.026
 Height (cm)
  Median
(IQR)
170.00 (165.00, 176.00)
170.00 (163.00, 177.00)
0.241
170.00 (165.00, 176.00)
170.00 (165.00, 176.75)
0.883
 Body Mass Index (BMI, kg/m2)
  Median
(IQR)
25.98 (23.38, 29.74)
26.20 (23.29, 30.32)
0.489
28.07 (25.20, 31.20)
26.87 (23.28, 29.81)
0.018
Laboratory parameters
 Maximum C-reactive protein (CRP) levels
  Median (IQR)
37.00 (10.00, 78.00)
60.00 (21.00, 107.50)
 < 0.002
106.00 (59.00, 175.00)
125.50 (62.00, 202.50)
0.300
 Maximum sodium levels
  Median (IQR)
139.00 (137.00, 141.00)
139.00 (137.00, 142.00)
0.262
142.00 (139.00, 145.00)
142.00 (138.00, 146.00)
0.901
 Minimum hemoglobin levels
  Median (IQR)
132.00 (118.00, 144.00)
126.00 (111.00, 142.00)
0.004
113.00 (89.50, 125.00)
107.50 (84.75, 124.25)
0.372
 Minimum glomerular filtration rate (GFR) values
  Median (IQR)
82.00 (61.00, 97.00)
75.00 (52.00, 93.00)
0.007
64.00 (39.50, 87.00)
56.00 (31.75, 84.25)
0.158
 Minimum glucose values
  Median (IQR)
6.40 (5.67, 7.90)
6.90 (6.00, 8.46)
0.002
9.50 (7.46, 12.55)
9.45 (7.18, 11.80)
0.393
 Minimum leukocytes values
  Median (IQR)
6.32 (4.70, 8.61)
6.41 (4.91, 9.09)
0.235
8.92 (6.65, 13.70)
10.90 (7.03, 15.12)
0.072
Laboratory parameters were considered from three day prior to until 1 day after the first positive SARS-CoV-2 PCR test result
IQR interquartile range
Bold numbers indicate significant differences (p < 0.05) between severe and non-severe cases.
The AUROC was 0.85 (95% CI 0.82–0.88) and 0.80 (95% CI 0.76–0.84) for the original and revalidation cohort, respectively (Fig. 1). A closer look at the severity distribution per score value (Fig. 2) revealed a greater share of severe cases with low score values (0–4 points) in the revalidation cohort than in the original cohort. No major differences are noticeable for score points greater than 4.
Patients in the revalidation cohort presented with overall worse laboratory markers and a greater likelihood of severe outcomes compared to the original cohort (69.1% vs. 37.4%). This could be due to more selective laboratory testing for hospitalized patients only and differences in circulating variants. Although no sequencing data is available for either cohort, national surveys indicate that the dominant strain during the 1st and 2nd waves (original cohort) was the ancestral type, whereas the 3rd and 4th waves (revalidation cohort) were driven by the more transmissible and virulent VOCs Alpha (B.1.1.7) and Delta (B.1.617.2) [4]. Vaccination campaigns and an emerging population-level immunity likely mitigated the individual disease severity [5].
While the performance of the score remains robust with strong positive discriminative ability we did note a decrease in specificity towards the lower end of the scale (Fig. 2). This suggests that readjustment of the cut-offs might be beneficial for a better separation of the severity classes as new variants emerge.
Despite changes in the viral landscape and population immunity, the COSA score still delivered good predictions of disease progression one year after its development. We attribute this to the simple set of covariates and the rigorous internal and external validation in the original model-building process. Adaptations to the score could become necessary in the near future as vaccination effects begin to wane and if drastically different VOCs appear.

Acknowledgements

We thank Noel Frey, Myoori Wijayasingham, and the Insel Data Coordination Lab for database and infrastructure support.

Declarations

The study was approved by the Cantonal Ethics Committee of Bern (Project-ID 2020–00973). Participants either agreed to a general research consent or, for participants with no registered general research consent status (neither agreement nor rejection), a waiver of consent was granted by the ethics committee.
Not applicable.

Competing interests

The authors declare that they have no competing interests.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://​creativecommons.​org/​licenses/​by/​4.​0/​. The Creative Commons Public Domain Dedication waiver (http://​creativecommons.​org/​publicdomain/​zero/​1.​0/​) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Literatur
1.
Zurück zum Zitat Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, Bonten MMJ, Dahly DL, Damen JA, Debray TPA, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369: m1328.CrossRef Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, Bonten MMJ, Dahly DL, Damen JA, Debray TPA, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369: m1328.CrossRef
2.
Zurück zum Zitat Schöning V, Liakoni E, Baumgartner C, Exadaktylos AK, Hautz WE, Atkinson A, Hammann F. Development and validation of a prognostic COVID-19 severity assessment (COSA) score and machine learning models for patient triage at a tertiary hospital. J Trans Med. 2021;19:56.CrossRef Schöning V, Liakoni E, Baumgartner C, Exadaktylos AK, Hautz WE, Atkinson A, Hammann F. Development and validation of a prognostic COVID-19 severity assessment (COSA) score and machine learning models for patient triage at a tertiary hospital. J Trans Med. 2021;19:56.CrossRef
3.
Zurück zum Zitat R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2022. R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2022.
5.
Zurück zum Zitat Zeng B, Gao L, Zhou Q, Yu K, Sun F. Effectiveness of COVID-19 vaccines against SARS-CoV-2 variants of concern: a systematic review and meta-analysis. BMC Med. 2022;20:200.CrossRef Zeng B, Gao L, Zhou Q, Yu K, Sun F. Effectiveness of COVID-19 vaccines against SARS-CoV-2 variants of concern: a systematic review and meta-analysis. BMC Med. 2022;20:200.CrossRef
Metadaten
Titel
Revalidating the prognostic COVID-19 severity assessment (COSA) score for variants of concern
verfasst von
Verena Schöning
Evangelia Liakoni
Christine Baumgartner
Aristomenis K. Exadaktylos
Wolf E. Hautz
Andrew Atkinson
Felix Hammann
Publikationsdatum
01.12.2022
Verlag
BioMed Central
Schlagwort
COVID-19
Erschienen in
Journal of Translational Medicine / Ausgabe 1/2022
Elektronische ISSN: 1479-5876
DOI
https://doi.org/10.1186/s12967-022-03634-x

Weitere Artikel der Ausgabe 1/2022

Journal of Translational Medicine 1/2022 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Echinokokkose medikamentös behandeln oder operieren?

06.05.2024 DCK 2024 Kongressbericht

Die Therapie von Echinokokkosen sollte immer in spezialisierten Zentren erfolgen. Eine symptomlose Echinokokkose kann – egal ob von Hunde- oder Fuchsbandwurm ausgelöst – konservativ erfolgen. Wenn eine Op. nötig ist, kann es sinnvoll sein, vorher Zysten zu leeren und zu desinfizieren. 

Umsetzung der POMGAT-Leitlinie läuft

03.05.2024 DCK 2024 Kongressbericht

Seit November 2023 gibt es evidenzbasierte Empfehlungen zum perioperativen Management bei gastrointestinalen Tumoren (POMGAT) auf S3-Niveau. Vieles wird schon entsprechend der Empfehlungen durchgeführt. Wo es im Alltag noch hapert, zeigt eine Umfrage in einem Klinikverbund.

Proximale Humerusfraktur: Auch 100-Jährige operieren?

01.05.2024 DCK 2024 Kongressbericht

Mit dem demographischen Wandel versorgt auch die Chirurgie immer mehr betagte Menschen. Von Entwicklungen wie Fast-Track können auch ältere Menschen profitieren und bei proximaler Humerusfraktur können selbst manche 100-Jährige noch sicher operiert werden.

Die „Zehn Gebote“ des Endokarditis-Managements

30.04.2024 Endokarditis Leitlinie kompakt

Worauf kommt es beim Management von Personen mit infektiöser Endokarditis an? Eine Kardiologin und ein Kardiologe fassen die zehn wichtigsten Punkte der neuen ESC-Leitlinie zusammen.

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.