This study aimed to establish and validate an easy-to-operate novel scoring system based on simple and readily available clinical indices for predicting the progression of chronic kidney disease (CKD).
Methods
We retrospectively evaluated 1045 eligible CKD patients from a publicly available database. Factors included in the model were determined by univariate and multiple Cox proportional hazard analyses based on the training set.
Results
Independent prognostic factors including etiology, hemoglobin level, creatinine level, proteinuria, and urinary protein/creatinine ratio were determined and contained in the model. The model showed good calibration and discrimination. The area under the curve (AUC) values generated to predict 1-, 2-, and 3-year progression-free survival in the training set were 0.947, 0.931, and 0.939, respectively. In the validation set, the model still revealed excellent calibration and discrimination, and the AUC values generated to predict 1-, 2-, and 3-year progression-free survival were 0.948, 0.933, and 0.915, respectively. In addition, decision curve analysis demonstrated that the model was clinically beneficial. Moreover, to visualize the prediction results, we established a web-based calculator (https://ncutool.shinyapps.io/CKDprogression/).
Conclusion
An easy-to-operate model based on five relevant factors was developed and validated as a conventional tool to assist doctors with clinical decision-making and personalized treatment.
Hinweise
Qian Xu, Yunyun Wang and Yiqun Fang contributed equally to this work
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Abkürzungen
CKD
Chronic kidney disease
AUC
Area under the curve
ESRD
End-stage renal disease
GFR
Glomerular filtration rate
eGFR
Estimated glomerular filtration rate
UPCR
Urinary protein/creatinine ratio
RAAS
Renin–angiotensin–aldosterone-system
AIC
Akaike information criterion
ROC
Receiver operating characteristic
DCA
Decision curve analysis; C-index, concordance index
Introduction
Chronic kidney disease (CKD), a common kidney disease with a progressive decline in renal function, is increasingly recognized as a global public health problem [1]. It causes more than half a million patients to develop end-stage renal disease (ESRD) every year, and over 700,000 deaths [2]. CKD is multifactorial and is defined as glomerular filtration rate (GFR) < 60 mL/min per 1.73 m2 or abnormalities in kidney structure or function present for more than 3 months [3, 4]. Diabetic nephropathy is the leading cause of CKD, accounting for approximately 40% of patients with non-dialysis-dependent CKD and ESRD [5]. Other pathological processes for CKD include chronic glomerulonephritis, ureteral obstruction, and renal fibrosis [6‐8]. As effective therapeutic strategies for ESRD are currently limited, it is important to identify treatments to delay the progression of CKD to ESRD. Rapid CKD progression leads to irreversible pathological changes and may be associated with unfavorable outcomes. Once a patient has developed ESRD, renal replacement therapy is needed to maintain their daily activities. Therefore, there is an urgent need for reliable and accurate progression prediction models for CKD.
Many definitions of CKD progression have been used over the years, such as doubling of serum creatinine level, decrease in estimated GFR (eGFR) to < 15 mL/min per 1.73 m2, and development of ESRD [9, 10]. Currently, there are no clinically robust biomarkers to predict progressive CKD. Rather, clinicians rely on multiple longitudinal kidney measurements, such as the eGFR, proteinuria, and urinary protein/creatinine ratio (UPCR) to identify progression [11]. The shortcomings of these traditional biomarkers are well recognized, and a single index has limited predictive capacity for progressive CKD [12]. However, the use of complex and potentially expensive detection strategies may prevent at risk patients from benefiting from preventative interventions, especially in settings where renal replacement therapy is not readily available. The use of risk models is an attractive and likely cost-effective method for large-scale CKD risk stratification and would allow the identification of populations that would benefit the most from CKD detection. There have been several attempts to create a risk model for predicting the progression of CKD. However, the prediction accuracy of these models has not been tested through widespread application in clinical practice [13‐16].
Anzeige
In the present study, we aimed to establish a model using Cox regression analysis based on commonly used and readily available clinical characteristics to predict disease progression in CKD patients. We performed univariate and multivariate analyses to screen for independent risk factors. The visualization model was constructed by nomogram and web-based calculator, and prediction performance was measured by discrimination, calibration, and clinical utility. This novel simple-to-use model might predict the prognosis of patients with CKD with high accuracy.
Methods
Ethics statement
The study was conducted in accordance with the ethical standards and the Declaration of Helsinki and according to national and international guidelines. It was approved by the authors' institutional review board (No. 883).
Patients
This study used data from 1138 patients with CKD obtained via the Dryad Digital Repository (http://www.datadryad.org/), shared by Limori et al. [17]. According to Dryad's terms of service, researchers can use these data for secondary analysis without infringing on the author's rights. All eligible individuals who were not undergoing dialysis were diagnosed with stage G2–G5 CKD based on the Kidney Disease Improving Global Outcomes classification [18]. All participants were at least 20 years of age and visited nephrology centers for the first time between October 2010 and December 2011. Patients with malignancy that was diagnosed or treated within the previous 2 years, transplant recipients, and those with active gastrointestinal bleeding at enrollment were excluded. All eligible patients were randomly stratified into two groups in a 2:1 ratio (training set and validation set, respectively).
Data collection
We performed a secondary analysis based on data from the above database. Fifteen probable prediction variables were selected, including gender, age, etiology (diabetes, nephrosclerosis, glomerulonephritis, and others), hemoglobin level, serum albumin level, creatinine level, eGFR, proteinuria, urinary occult blood, UPCR, hypertension, history of cardiovascular disease, diabetes, use of RAAS inhibitor, use of calcium channel blocker, and use of diuretics. Moreover, the vital status and follow-up time of each CKD case were extracted.
Anzeige
Predictor selection and development of the prediction model
Depending on the training set, Cox proportion hazard regression models were used to screen potential prognostic factors and estimate their weights [19, 20]. Univariable Cox regression analysis was performed to explore the potential predictors [21]. The selected prognostic factors (p value below 0.05 in univariate analysis) were then included in a multivariate Cox regression analysis to obtain an integrated nomogram by a stepwise feature selection algorithm based on the AIC [22]. Moreover, to facilitate clinical application, we established a visualization tool by a web-based calculator.
Validation of the prediction model
The performance of our model to predict survival was quantified using AUC values from the ROC analysis and the C-index. The performance of the novel model was also evaluated by examining calibration in training and validation sets. In addition, DCA was carried out to assess the clinical utility of the model. These tests were all performed in both the training and validation sets.
Statistical analysis
Continuous variables following a normal distribution are presented as mean ± standard deviation and categorical variables are presented as percentages. Differences between the training and validation sets were analyzed using chi-square tests for the categorical variables and t-tests for the continuous variables. A p value < 0.05 was used as a cutoff for statistical significance. Statistical analysis was performed using SPSS software (version 24.0) and R software (version 3.6.2).
Results
Baseline characteristics
Figure 1 shows a flow diagram of the selection process. After excluding 93 patients with missing data, a total of 1,045 patients was included in the analysis. Patients were randomly divided at a ratio of 6:3 into training (N = 696) and validation sets (N = 349). The demographics and clinical characteristics of the whole, training, and validation sets are presented in Table 1. In the whole cohort, 69.9% of the participants were male, and the mean age was 67.31 ± 13.6 years. Most patients had positive proteinuria and history of hypertension. Across the entire study population, 260 patients had disease progression (CKD progression defined as > 50% eGFR loss or initiation of dialysis).
Fig. 1
Flow diagram that shows the development and validation of the prediction model
Table 1
Baseline demographics and clinical characteristics of patients in training cohort and validation cohort
Variables
All patients
(N = 1045)
Training set
(N = 696)
Validation set
(N = 349)
P-value
Gender, n (%)
0.966
Male
730 (69.9%)
487 (70.0%)
243 (69.6%)
Female
315 (30.1%)
209 (30.0%)
106 (30.4%)
Age, years
67.31 ± 13.60
66.70 ± 13.90
68.54 ± 12.90
0.039
Etiology, n (%)
0.759
Diabetic
271 (25.9%)
177 (25.4%)
94 (26.9%)
Nephrosclerosis
411 (39.3%)
270 (38.8%)
141 (40.4%)
Glomerulonephritis
197 (18.9%)
137 (19.7%)
60 (17.2%)
Others
166 (15.9%)
112 (16.1%)
54 (15.5%)
Hemoglobin, g/dL
11.97 ± 2.28
12.02 ± 2.29
11.87 ± 2.26
0.304
Serum albumin, g/dL
3.85 ± 0.63
3.87 ± 0.63
3.82 ± 0.64
0.211
Creatinine, g/dL
2.26 ± 1.72
2.25 ± 1.72
2.28 ± 1.71
0.825
eGFR, mL/min/1.73 m2
32.95 ± 18.82
33.15 ± 18.78
32.56 ± 18.90
0.632
Proteinuria, n (%)
0.919
Negative
381 (36.5%)
255 (36.6%)
126 (36.1%)
Positive
664 (63.5%)
441 (63.4%)
223 (63.9%)
Urinary occult blood, n (%)
0.361
Negative
689 (65.9%)
466 (67.0%)
223 (63.9%)
Positive
356 (34.1%)
230 (33.0%)
126 (36.1%)
UPCR, g/gCr
2.17 ± 3.24
2.04 ± 2.98
2.42 ± 3.69
0.073
Hypertension, n (%)
0.864
No
101 (9.7%)
66 (9.5%)
35 (10.0%)
Yes
944 (90.3%)
630 (90.5%)
314 (90.0%)
History of CVD, n (%)
0.183
No
765 (73.2%)
519 (74.6%)
246 (70.5%)
Yes
280 (26.8%)
177 (25.4%)
103 (29.5%)
Diabetes, n (%)
0.693
No
651 (62.3%)
437 (62.8%)
214 (61.3%)
Yes
394 (37.7%)
259 (37.2%)
135 (38.7%)
Use of RAAS inhibitor, n (%)
0.047
No
380 (36.4%)
238 (34.2%)
142 (40.7%)
Yes
665 (63.6%)
458 (65.8%)
207 (59.3%)
Use of calcium channel blocker, n (%)
0.616
No
547 (52.3%)
360 (51.7%)
187 (53.6%)
Yes
498 (47.7%)
336 (48.3%)
162 (46.4%)
Use of diuretics, n (%)
0.154
No
694 (66.4%)
473 (68.0%)
221 (63.3%)
Yes
351 (33.6%)
223 (32.0%)
128 (36.7%)
Vital status, n (%)
0.773
Alive
972 (93.0%)
649 (93.2%)
323 (92.6%)
Deceased
73(7.0%)
47(6.8%)
26 (7.4%)
CKD progression, n (%)
0.479
No
785 (75.1%)
528 (75.9%)
257 (73.6%)
Yes
260 (24.9%)
168 (24.1%)
92 (26.4%)
×
Prognostic factors of CKD
Univariate Cox regression analysis showed that age, etiology, hemoglobin level, serum albumin level, creatinine level, eGFR, proteinuria, urinary occult blood, UPCR, hypertension, diabetes, use of renin–angiotensin–aldosterone-system (RAAS) inhibitor, use of calcium channel blocker, and use of diuretics were correlated with CKD progression. Multivariate Cox regression analysis identified etiology, hemoglobin level, creatinine level, proteinuria, and UPCR as independent prognostic factors of CKD patients (Table 2).
Table 2
Univariate and multivariable Cox hazards analysis of the training cohort
Variables
Univariate
P-value
Multivariate
P-value
HR (95% CI)
HR (95% CI)
Gender
Male
Ref.
–
Ref.
–
Female
1.018 (0.734–1.412)
0.914
–
Age
0.989 (0.979–0.999)
0.028
0.998 (0.985–1.011)
0.720
Etiology
Diabetic
Ref.
Ref.
–
Nephrosclerosis
0.147 (0.098–0.220)
0.000
0.540 (0.297–0.979)
0.042
Glomerulonephritis
0.230 (0.148–0.359)
0.000
0.437 (0.228–0.836)
0.012
Others
0.170 (0.097–0.299)
0.000
0.269 (0.118–0.618)
0.002
Hemoglobin
0.701 (0.655–0.751)
0.000
0.821 (0.749–0.900)
0.000
Serum albumin
0.267 (0.216–0.330)
0.000
0.869 (0.624–1.212)
0.409
Creatinine
1.429 (1.370–1.490)
0.000
1.314 (1.221–1.413)
0.000
Proteinuria
Negative
Ref.
Ref.
Positive
28.395 (10.53–76.571)
0.000
7.214 (2.547–20.436)
0.000
Urinary occult blood
Negative
Ref.
Ref.
Positive
2.156 (1.592–2.919)
0.000
1.096 (0.779–1.543)
0.597
UPCR
1.305 (1.264–1.348)
0.000
1.192 (1.126–1.261)
0.000
Hypertension
No
Ref.
Ref.
Yes
5.976 (1.908–18.719)
0.002
0.930 (0.271–3.197)
0.909
History of CVD
No
Ref.
–
Ref.
–
Yes
1.366 (0.977–1.910)
0.068
–
Diabetes
No
Ref.
–
Ref.
–
Yes
3.005 (2.205–4.096)
0.000
0.898 (0.527–1.528)
0.690
Use of RAAS inhibitor
No
Ref.
–
Ref.
–
Yes
1.808 (1.259–2.595)
0.001
0.928 (0.627–1.374)
0.710
Use of calcium channel blocker
No
Ref.
−
Ref.
–
Yes
2.024 (1.474–2.778)
0.000
1.298 (0.925–1.821)
0.132
Use of diuretics
No
Ref.
–
Ref.
–
Yes
2.833 (2.092–3.836)
0.000
1.04 (0.741–1.461)
0.819
P < 0.05 is shown in bold
Development of an individualized prediction model
Based on Akaike information criterion (AIC) results, five factors (etiology, hemoglobin, creatinine, proteinuria, and UPCR) were selected to establish the predictive nomogram, which is an intuitive visualization of the model (Fig. 2A). According to the constructed model, the risk score of each sample was calculated according to the model coefficients combined with the corresponding value of the five chosen factors. CKD patients were divided into high- (N = 348) and low-risk (N = 348) groups based on their median risk score. Risk score distribution is shown in Fig. 2B. The Kaplan–Meier survival curve of low- and high-risk groups in the training set is shown in Fig. 2C (p < 0.001). The CKD progression status and follow-up time of each individual is shown in Fig. 2D.
Fig. 2
The model to predict the probability of progression in chronic kidney disease (CKD) patients from the training cohort. A The nomogram based on the five variables identified by the Cox hazards analysis. B Distribution of the risk scores calculated by the nomogram scoring system. C Progression-free survival curves stratified by the low- and high-score groups. D Patient distribution in the low- and high-score groups based on progression status
×
Establishment of a web-based calculator
For convenient clinical use and visualization of the prognostic model, we developed an easy-to-operate web-based model (https://ncutool.shinyapps.io/CKDprogression/) to predict the progression of CKD based on the established nomogram (Fig. 3). Estimated disease progression probabilities can be obtained by drawing a perpendicular line from the total point axis to the outcome axis.
Fig. 3
Establishing an easy-to-operate web-based calculator for predicting the progression of chronic kidney disease (https://ncutool.shinyapps.io/CKDprogression/). A Web progression-free survival rate calculator. B 95% confidence interval of the web progression-free survival rate
×
Model performance in the training set
In the training set, the model was evaluated using time-dependent receiver operating characteristic (ROC) curve analysis over 1-, 2-, and 3-years, along with the concordance index (C-index). The area under the ROC curve (AUC) values for the 1-, 2-, and 3-year survival probabilities were 0.947, 0.931, and 0.939, respectively (Fig. 4A). The C-index for the prediction of progression-free survival was 0.912. The calibration curves of the model showed good probability consistencies between the predicted and observed values (Fig. 4B). These results might confirm that our model was reliable in predicting the prognosis of CKD. Furthermore, a decision curve analysis (DCA) confirmed our expectations, as the analysis revealed that the net benefit in 1-, 2- and 3-year predictions was the highest in the combined nomogram model compared to the single variable (Fig. 4C). Hence, we chose the combined model for clinical use.
Fig. 4
Model discrimination and performance in the training set. A Receiver operating characteristic curves for model-based progression-free survival prediction. B Calibration plot examining estimation accuracy. C Decision curve analysis assessing clinical utility
×
Anzeige
Model performance in the validation set
In the validation set, CKD patients were divided into high- (N = 174) and low-risk (N = 175) cohorts based on their median risk score. The risk score distribution is shown in Fig. 5A. The CKD progression status and follow-up time of all individuals are shown in Fig. 5B. The Kaplan–Meier survival curve of the low- and high-risk groups is shown in Fig. 5C (p < 0.001). The time-dependent ROC curve analysis validated prediction accuracy of this model over other features (Fig. 5C).
Fig. 5
Validation of the nomogram in the validation set. A Distribution of the risk scores calculated by the nomogram scoring system. B Patient distribution in the low- and high-score groups based on progression status. C Progression-free survival curves stratified by the low- and high-score groups. D Time-dependent ROC curves for nomogram vs. other single parameters included in the model
×
In addition, we performed calibration plot analysis in the validation set. The calibration curves of the model showed good probability consistencies between the predicted and observed values (Fig. 6A). DCA analysis revealed that the net benefit in the 1-, 2- and 3-year predictions was the highest in the combined nomogram model compared to the single variable (Fig. 6B).
Fig. 6
Assessment of the model in the validation set. A Calibration plot examining estimation accuracy. B Decision curve analysis assessing clinical utility
×
Discussion
Predicting the CKD outcome in individual patients is beneficial for identifying those who need an aggressive therapeutic regimen. This study showed that etiology, together with proteinuria, serum creatinine, and UPCR, was a better predictor of the risk of progression in patients with CKD when compared to a single indicator. Furthermore, a novel nomogram and corresponding web-based calculator were built as a reference for clinicians to help with clinical decision-making. The risk score identified the highest risk patients accurately, and therefore can identify patients who may benefit most from management by nephrologists without referring the entire population with CKD to them.
The etiology of CKD is multifactorial and diverse. The main causes included diabetes, nephrosclerosis, and glomerulonephritis. In the present study, we found that the highest risk of progression is diabetic kidney disease (DKD). Type 2 diabetes is the most common cause of severe kidney disease worldwide, and DKD is associated with premature death [23]. Although, the fundamental mechanism responsible for the development of DKD to ESRD is poorly understood [24], it is now believed that vessel disease and inflammation are the main pathological mechanisms of CKD [25]. Approximately 40% of diabetic patients develop DKD, and the resultant kidney damage often leads to kidney failure, ultimately requiring dialysis or kidney transplant [26]. Our results suggest that measures should be taken to delay the progression of CKD, especially in cases of DKD.
Anzeige
Proteinuria generally precedes the loss of renal function in kidney disease [27]. For instance, a population-based cohort study in China found that elevated albuminuria was a key predictor of progression to CKD or ESRD and indicated a higher risk of cardiovascular disease and mortality [28]. However, an increasing number of studies have cast doubt on this classic paradigm. In several recent studies, eGFR reduced to 20–39% resulted in normal albuminuria levels [29‐31]. In some clinical trials, improvement in proteinuria did not translate to an increased GFR or a reduction in end points such as the need for dialysis or death [32, 33]. The critical role of proteinuria as a single predictor of CKD prognosis requires further study. In the current study, incorporation of several factors including proteinuria might increase model accuracy.
Anemia is a common feature at any stage of CKD, especially in patients with advanced stages of CKD. Anemia in CKD is mainly attributable to the relative decrease in erythropoietin production by the kidneys, absolute or functional iron deficiency, and shortened red blood cell survival. The severity of anemia increases with CKD progression and affects nearly all patients with ESRD [34, 35]. The development of erythropoietic stimulatory agents, such as recombinant human erythropoietin and darbepoetin alpha, has resulted in substantial health benefits for patients with end-stage renal failure, including improved quality of life, reduced blood transfusion requirements, decreased left ventricular mass, diminished sleep disturbance, and enhanced exercise capacity [36, 37]. It is generally believed that low levels of hemoglobin are associated with worse outcomes in patients with CKD [38]. These results are in agreement with the findings of our model.
Previous studies have tried to establish models for progression of CKD to kidney failure [13, 14, 39, 40]. Although the estimations produced by previous models were moderately accurate, the results were somewhat complex because many predictors were involved, each with precise classification levels. We identified five easily accessible and simple demographic and clinical characteristics to include in our novel model, which demonstrated that these traditional factors are important in patients with CKD. Our model showed good calibration and discrimination, and the AUC values generated to predict 1-, 2-, and 3-year progression-free survival in the training set were 0.947, 0.931, and 0.939, respectively. In the validation set, the model revealed excellent calibration and discrimination, and the AUC values generated to predict 1-, 2-, and 3-year progression-free survival were 0.948, 0.933, and 0.915, respectively. These results showed that our model can perfectly predict patient survival in CKD. Moreover, we developed an easy-to-operate calculator that allows the public to freely predict local cases and diagnose the adaptability of the model.
Admittedly, there are some shortcomings in our research. First, the model was developed based on the five variables. However, these factors were unstable throughout the follow-up period, which might have partly influenced the precision of the model. Second, although the performance of the model was good in both the training and validation sets, multicenter clinical application is needed to evaluate the external utility of this model. Third, as the main outcome measure was the progression status of CKD, other outcomes such as survival time should be evaluated in future studies.
Anzeige
In conclusion, we constructed and validated a model incorporating five clinical characteristics (etiology, proteinuria, hemoglobin, creatinine, and UPCR) to predict disease progression in CKD patients. This model could serve as a reliable tool for determining CKD treatment strategies and potential outcomes.
Acknowledgements
We would like to thank the investigators of Tokyo Medical and Dental University Hospital and its affiliated hospitals for sharing their data.
Declarations
Ethics approval and consent to participate
The present study was approved by the Ethics Committee and Institutional Review Board of affiliated Cancer Hospital & Institute of Guangzhou Medical University.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Obwohl ein rezidivierender Herzinfarkt bei chronischem Koronarsyndrom wahrscheinlich die Hauptsorge sowohl der Patienten als auch der Ärzte ist, sind andere Ereignisse womöglich gefährlicher. Laut einer französischen Studie stellt eine Hospitalisation wegen Herzinsuffizienz eine größere Gefahr dar.
Immer mehr jüngere Menschen leiden unter Vorhofflimmern. Betroffene unter 65 Jahren haben viele Risikofaktoren und ein signifikant erhöhtes Sterberisiko verglichen mit Gleichaltrigen ohne die Erkrankung.
Chronische Insomnie als eigenständiges Krankheitsbild ernst nehmen und adäquat nach dem aktuellen Forschungsstand behandeln: Das forderte der Schlafmediziner Dr. Dieter Kunz von der Berliner Charité beim Praxis Update.
Immer häufiger wird ein Typ-2-Diabetes sowohl mit einem GLP-1-Rezeptor-Agonisten als auch mit einem SGLT-2-Inhibitor behandelt. Wie sich das verglichen mit den Einzeltherapien auf kardiovaskuläre und renale Komplikationen auswirkt, wurde anhand von Praxisdaten aus Großbritannien untersucht.
Update Innere Medizin
Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.
