Application of machine learning algorithm in prediction of lymph node metastasis in patients with intermediate and high-risk prostate cancer

According to the global cancer statistics in 2020, PCa ranks sixth in incidence rate and seventh in mortality in China. (Cao 2020). Pelvic lymph node metastasis (PLNM) accounts for about 15% of all newly diagnosed PCa patients, which is related to biochemical recurrence (BCR) and distant metastasis (DM) after treatment (von Bodman et al. 2010; Wilczak et al. 2018). Gervasi et al. reported that the 10-year risk of DM in lymph node positive patients was 83%, and the 10 year risk of death from PCa was 57% (Wagner et al. 2008). Extended pelvic lymph node dissection (ePLND) has become an integral part of radical prostatectomy (RP), while the American Association of Urology (AUA) and the European Association of Urology (EAU) recommend that low-risk patients do not need ePLND; ePLND is an option for patients with intermediate- and high-risk PCa whose Briganti nomogram predicts that the probability of LNM is greater than 5% (Engel et al. 2010; Lestingi et al. 2021). Therefore, the clinical staging of PCa is the key to precision medicine, and accurate identification of PLNM of PCa patients is crucial to determine the appropriate treatment plan (Hou et al. 2021; Mottet et al. 2017).

At present, many studies have reported that non-invasive imaging techniques can be used to predict LNM of PCa before treatment. CT and MRI, the most commonly used in clinic, can assess the status of pelvic lymph nodes by examining their size. Both of them have no obvious advantages and disadvantages, with a sensitivity of about 40% and a specificity of about 82% (Créhange et al. 2012; Hövels et al. 2008). Von Below et al. showed that multi parameter MRI (mpMRI) is more sensitive and specific than MRI in detecting tumors and lymph nodes, but it is easy to lose signal or image distortion in DWI sequence (von Below et al. 2016). Similarly, PSMA PET/CT has been widely used to detect PCa in prostate, soft tissue and bone, however, and its detection rate of 2–5 mm lymph node invasion is about 60% (Hofman et al. 2018; van Leeuwen et al. 2017). In addition, new imaging technologies are being developed such as MR lymphography with superparamagnetic iron oxide (SPIO) nanoparticles and targeted positron emission tomography imaging (PET) (Muteganya et al. 2018). Their efficacy of prediction for the NLM is still unclear.

Recently, scientists have made great efforts to explore different methods for more accurately evaluating the risks of LNM. However, due to the complexity of medical data, there are important connections between various factors, and certain differences in the calculation methods of models. Therefore, machine learning (ML) has become a powerful tool for improvement of clinical strategies in the field of medical research (Mirza et al. 2019; Oliveira 2019). Compared with traditional regression analysis, ML algorithm has significant advantages in prediction performance in large databases (Bi et al. 2019; Wang et al. 2020). Tian et al. established RDA model using ML to accurately predict LNM of early gastric cancer (Tian et al. 2021). Li et al. established XGB model to predict LNM of patients with osteosarcoma (Li and Liu et al. 2022). Li et al. established RF model to better predict LNM of Ewing’s sarcoma (Li and Zhou et al. 2022).

To our knowledge, there is no effective ML model for predicting risks of LNM of PCa. Therefore, in this study, we established a new model for predicting risks of LNM in patients with intermediate- and high-risk PCa through 6 ML methods based on the clinical and histopathological parameters that are closely related to the prognosis of the PCa in the SEER database.

LNM is a paramount prognostic factor for patients with PCa, and has been proved to be an important predictor of BCR survival, metastasis free survival and overall survival of PCa (Engel et al. 2010; Wilczak et al. 2018). Wessels et al. extracted prognostic information from the H&E histology of PCa and used the deep learning method to predict the LN status in PCa patients (Wessels et al. 2021). Hou et al. established PLNM risk calculator by integrating radiologist’s interpretation, clinicopathologic factors and MRIs, and using ML and deep migration learning algorithms (Hou et al. 2021). For the sake of accurately evaluating the risk of LNM, Some studies have designed different prediction models for lymph node prediction of intermediate- and high-risk PCa according to the detection pathway. Diamand R et al. reported and validated the LNM of patients treated with ePLND by nomogram, and provided a more reasonable cut-off value (Diamand et al. 2020). Ferraro DA et al. designed a new model by combining PSA, Gleason score and visual lymph node analysis on 68 Ga-PSMA-11 PET. Compared with the previously used clinical nomograms, this model has a remarkably improved the positive rate of LNM in the patient selecting to perform ePLND (Ferraro et al. 2020). In this study, we used the large sample size of SEER database and ML algorithm to develop six prediction models to predict LNM in the patients with intermediate- and high-risk PCa. Logistic regression analysis showed that T stage, Gleason score, PSA and bone metastasis were independent risk factors for pelvic LNM of intermediate- and high-risk PCa.

Among the six models, the AUC value of GBM model is the highest, and the prediction accuracy of other models for LNM is about 80%. RF model shows the best prediction performance before and after data balancing, with obvious advantages of high precision and fast speed; however, it also has the disadvantage of over fitting. F1 score, which represents the harmonic average of the accuracy rate and recall rate, is the final assessment parameter of the evaluating each model. According to the evaluation results of the test set, the prediction performance of GBM model is better than that of RF model. It can be seen that RF model may show over fitting in the training process, which makes it unsuitable for the data in the test set, while GBM model has the best prediction performance. To increase the application feasibility of this model, we developed a calculator to evaluate the individual probability of LNM in patients with intermediate- and high-risk PCa.

The results of this study showed that T stage, PSA, Gleason score and bone metastasis were the most important predictors in the patients with intermediate- and high-risk PCa. As an important indicator of tumor progression, T stage is positively correlated with LNM in a large number of tumors (Barriera-Silvestrini et al. 2021). A large number of research data in this study show that the level of high PSA will increase the rate of lymph node invasion, which is contrary to the results of the previous studies. The possible reason is PSA may be more meaningful in D'Amico risk stratification. The increase of Gleason score also increases the risk of lymph node invasion (Turk et al. 2018). Bone metastasis is significantly related to LNM of PCa, which can provide some ideas for follow-up research, that is, consider the existence of metastasis of other sites as a factor before patients have LNM.

The EAU guidelines used Briganti’s nomogram prediction model to screen ePLND patients. The advantage of this study is to compare several models head-to-head with the nomogram model. The sensitivity, specificity and AUC of the nomogram are 0.882, 0.705 and 0.80, respectively, while the sensitivity, specificity and AUC of GBM are 0.877, 0.783 and 0.813, respectively. It shows that GBM in the six predictive models has the best predictive value for LNM in the patients with intermediate- and high-risk PCa. To further facilitate clinical application, we designed a preliminary calculator model that can quickly calculate the probability of LNM.

Of course, this study has several limitations. First, this study is a retrospective study, which may have some selection bias. Second, SEER database lacks more data such as tumor volume, percentage of positive tissue cores, testosterone level, and so on. In addition, the external validation set data is small, and more sample sizes need to be included to test the effectiveness of the model. Finally, although we have corrected the sample imbalance problem of SEER dataset as much as possible, this problem will still interfere with the results and affect the generalization ability of the model.

This research has developed and validated six prediction models using ML algorithm, of which GBM model has the best performance. Based on this algorithm, a preliminary model of the calculator is designed, and then the local LNM probability in patients with intermediate- and high-risk PCa can be individually predicted according to the existing clinical characteristics, which can help clinicians quickly and accurately assess the risk of LNM, finally, precise therapy.