nach oben

BMC Cancer

Erschienen in:

Open Access 01.12.2014 | Research article

A computational model to predict bone metastasis in breast cancer by integrating the dysregulated pathways

verfasst von: Xionghui Zhou, Juan Liu

Erschienen in: BMC Cancer | Ausgabe 1/2014

Abstract

Background

Although there are a lot of researches focusing on cancer prognosis or prediction of cancer metastases, it is still a big challenge to predict the risks of cancer metastasizing to a specific organ such as bone. In fact, little work has been published for such a purpose nowadays.

Methods

In this work, we propose a Dysregulated Pathway Based prediction Model (DPBM) built on a merged data set with 855 samples. First, we use bootstrapping strategy to select bone metastasis related genes. Based on the selected genes, we then detect out the dysregulated pathways involved in the process of bone metastasis via enrichment analysis. And then we use the discriminative genes in each dysregulated pathway, called as dysregulated genes, to construct a sub-model to forecast the risk of bone metastasis. Finally we combine all sub-models as an ensemble model (DPBM) to predict the risk of bone metastasis.

Results

We have validated DPBM on the training, test and independent sets separately, and the results show that DPBM can significantly distinguish the bone metastases risks of patients (with p-values of 3.82E-10, 0.00007 and 0.0003 on three sets respectively). Moreover, the dysregulated genes are generally with higher topological coefficients (degree and betweenness centrality) in the PPI network, which means that they may play critical roles in the biological functions. Further functional analysis of these genes demonstrates that the immune system seems to play an important role in bone-specific metastasis of breast cancer.

Conclusions

Each of the dysregulated pathways that are enriched with bone metastasis related genes may uncover one critical aspect of influencing the bone metastasis of breast cancer, thus the ensemble strategy can help to describe the comprehensive view of bone metastasis mechanism. Therefore, the constructed DPBM is robust and able to significantly distinguish the bone metastases risks of patients in both test set and independent set. Moreover, the dysregulated genes in the dysregulated pathways tend to play critical roles in the biological process of bone metastasis of breast cancer.

Additional file 1: This file contains two supplementary methods, three supplementary tables (Table S1 – Table S3) and two supplementary figures (Figure S1 – Figure S2).(DOCX 474 KB)

Additional file 2: Table S4: (Functional clusters of dysregulated genes in the metastasis process to bone). This file describes the functional clusters of dysregulated genes involved in the bone metastasis process. (XLSX 46 KB)

Additional file 3: Table S5: (Functional clusters of dysregulated genes in the metastasis process to non-bone). This file describes the functional clusters of dysregulated genes involeved in the metastases processes to other organs. (XLSX 46 KB)

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Electronic supplementary material

The online version of this article (doi:10.1186/1471-2407-14-618) contains supplementary material, which is available to authorized users.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

JL raised the question, XZ and JL developed the methodology, XZ executed the experiments, XZ and JL wrote and revised the manuscript. Both authors read and approved the final manuscript.

Background

Metastasis is the main cause of death in breast cancer [1, 2], and bone is the organ suffering from metastasis most frequently [3]. Breast cancer patients with bone metastases may suffer marked decreased mobility, pathologic fractures, neurological damage and other symptoms, and the patients with high risks of bone metastases should take agents tailored treatments [4, 5]. Thus for cancer therapy, it is essential to identify the prognostic factors which can help to identify the patients with high risks of bone metastasis [4‐6].

Because the ability of tumour cells metastasizing to a specific organ is an inherent genetic property [7, 8], it is possible to predict bone metastasis of breast cancer by using gene expression profiles [8]. However, up to now only several researches have attempted to identify bone metastasis related genes from gene expression data [3, 9‐11], and only one in which [3] has made use of the identified genes as signature to construct classification model for predicting bone metastasis risk of breast cancer. What is more, the published work just considered very limited number of samples when selecting gene signatures and did not perform strict independent tests on any larger data set. As breast cancer is a heterogeneous disease, the characters associated with metastases may vary widely across different patients [1]. Insufficient patient samples would not cover all aspects of the metastases, thus gene signatures selected from small number of samples may not be credible enough. In fact, it has been found out that the gene signatures identified using one data set may perform badly on another data set [12‐14].

In recent years, several methods have been used to derive gene sets that are related to specific biological functions, such as protein-protein interaction network [15], pathway [16], GO Term [17], and so on. For example, the gene set statistics method [17] infers the activity of one gene set by counting all expression levels of genes in the set, and then uses the activity to build the classifier to predict the metastasis risk of breast cancer. Extracting gene sets rather than selecting single genes can provide more stable signatures, thus can construct classifiers with higher performances [18]. However, most of the existing methods consider all genes in the same set equally without noticing that some genes are less important than others. In fact in a pathway or other kind of gene set, only a part of genes would be dysregulated during the metastasis process of cancer. Although Lee et al. just considered a subset of the genes to infer the activity of each pathway, and used all activities to construct a model to classify cancer patients [18], there are still two drawbacks. Firstly, this method uses the inferred activities instead of the gene expression levels to construct the classifier, resulting in the loss of some important information for classification. Secondly, some pathways not involved in the disease process may be considered improperly, leading that some noises could be imported into the prediction model.In this work, we present a new prediction model, Dysregulated Pathway Based prediction Model (DPBM), to predict the risk of bone metastasis of breast cancer (Figure 1). To get enough samples, we integrate four breast cancer sets together to obtain 855 breast cancer samples, from which we select genes that are significantly correlated with bone metastasis of breast cancer by using bootstrapping strategy. The selected genes are also called as candidate genes. After that, we identify KEGG pathways that are enriched by the candidate genes as abnormal pathways in the bone metastasis process. We call these pathways as dysregulated pathways and the candidate genes involved in the dysregulated pathways as dysregulated genes. Since different pathways are involved in different aspects of the bone metastasis process, the genes related to them can correspondently be divided into different functional groups. Therefore, we can use the dysregulated genes in each pathway to construct one sub-model, and then integrate all sub-models into an ensemble model (DPBM) to predict the bone metastases risks of breast cancer patients by majority voting strategy. We evaluate DPBM both on test set and independent set in terms of prediction accuracy and robustness. We also investigate the topological characteristics of the dysregulated genes in protein-protein interaction network and their functional annotations, trying to uncover the biological mechanisms that play important roles in bone metastasis of breast cancer.

Methods

Data sets and pre-processing

We have downloaded gene expression profiles of breast cancer patients along with the clinical information from UNC microarray database [8]. The downloaded data consists of four microarray data sets: GSE2034 [19], GSE2603 [20], GSE12276 [21] and NKI295 [22], and has been processed and normalized by the original paper [8]. Details of these data sets are shown in Table 1. In our work, GSE2034 was used as an independent test set. As for the other three data sets, we randomly selected 2/3 samples as the training set and the remainder samples as the test set. As a result, we got a training set consisting of 380 samples (113 are bone metastases and 267 are free of bone metastases) and a test set containing 189 samples (56 are bone metastases and 133 are free of bone metastases). In these data sets, if the first metastasis organ of a patient is bone, then the status is set as bone metastasis, otherwise it is set as free of bone metastasis (including cases of non-bone metastases and non metastases).

Table 1

Breast cancer data sets

Data set	Bone metastasis samples	Metastasis samples	Samples
GSE2034	69	95	286
GSE2603	14	24	82
GSE12276	102	173	192
NKI295	53	84	295

GSE2034 was used as an independent set. The other three data sets were combined into one merged set, from which we randomly selected 2/3 samples into the training set and the other 1/3 samples into the test set.

We have also downloaded the human protein-protein interactions from the HIPPI (Human Integrated Protein-Protein Interaction rEference) [23], and the pathways from the Molecular Signatures Database (MSigDB) [24].

Selecting candidate genes by bootstrapping

As is known to all, t-test is a popular method used to select discriminative genes, thus it could be used in our work. However, t-test method requires that every sample must be attached with a class label. While in our work, for the reason that the clinical information of some patients is censored, not every sample can be assigned as either low-risk or high-risk of bone metastasis according to the widely used criterion that patients who are bone-metastasized within a threshold of years belong to high-risk group, and patients who are free of bone metastases and survive longer than the threshold belong to low-risk group, which results that some valuable samples not satisfying the criterion have to be removed from the training set if t-test method is used. Different with t-test method, however, the Cox proportional hazards regression can involve all samples into the calculation, thus it is more proper for our work to select the bone metastasis related genes.

In this work, we used a simple bootstrapping strategy to select candidate genes of which expression levels were significantly correlated with the bone metastasis risk. Concretely, we first randomly selected 3/4 of all the 380 samples from the training set; and then for each gene, we applied Cox proportional hazards regression to calculate the coefficient between the gene expression level and the bone metastasis risk across the chosen samples. The above procedure was repeated 400 times, and the genes with Cox p-values less than 0.05 in more than 80% of all runs were regarded as the candidate genes. For every selected gene, its averaged Cox coefficient and Cox p-value over all the 400 runs were set to be its final corresponding values for further calculations.

Identifying the dysregulated pathways

The candidate genes are those significantly correlated with bone metastasis risk. If the candidates are enriched in a pathway (that is, the overlap of the candidate genes and the genes in the pathway is significant), then we call this pathway as a dysregulated pathway. In this work, we applied the widely used hyper geometric cumulative distribution function to test the significance of the overlap:

p - value = 1 - F (x / M, K, N) = 1 - \sum_{i = 0}^{x - 1} \frac{(\begin{array}{l} K \\ i \end{array}) (\begin{array}{l} M - K \\ N - i \end{array})}{(\begin{array}{l} M \\ N \end{array})}

Where x stands for the size of intersection set; K represents the number of the candidate genes; N stands for the number of the genes in the pathway; and M represents the number of all genes in our calculation (the universal gene set). For a pathway, if the p-value is less than 0.05, then it is considered as the dysregulated one; and the genes belonging to the intersection set are called as dysregulated genes.

Constructing the DPBM

With the hypothesis that one dysregulated pathway may describe only one aspect of the bone metastasis mechanism, while all dysregulated pathways can provide a comprehensive view of the bone metastasis, we adopted the ensemble strategy [14] to construct DPBM to predict the bone metastases risks of breast cancer patients. We chose the dysregulated genes in each dysregulated pathway as features to construct a sub-model to distinguish the bone metastases risks of the patients, and all the sub-models were integrated as DPBM by majority voting strategy.

To construct each sub-model, we used a simple strategy, similar to the Gene expression Grade Index (GGI) [25], to calculate the bone metastasis risk for every patient, shown as the following equation:

Risk Score = \sum x_{i} - \sum x_{j}

Where x _i (x _j) represents the expression level of the dysregulated gene i (j) which has a positive (negative) Cox coefficient with metastasis risk. The higher the RiskScore is, the greater the risk of bone metastasis. We applied 10-fold cross validation test to set the proper threshold value of RiskScore. In each run, the n-th smallest riskScore value (n is the number of training patients free of bone metastases) in the training samples was set as the cut-off to determine the class labels of the test samples, based on which, the performance (log rank test) can be obtained. The final threshold value was set as the one with the best performance in ten runs. Any patient with RiskScore value greater than this threshold is considered as high-risk of bone metastasis by this sub-model, otherwise it is considered as low-risk of bone metastasis.

For a patient, if more than half sub-models vote for “high-risk of bone metastasis”, it will be finally predicted as “high-risk of bone metastasis” by DPBM, and vice versa. In order to assess the performance of DPBM, we used the log rank test to evaluate the significance of the risk differences between the patients in two groups. Kaplan Meier curves and the log rank test were performed using a tool (http://www.mathworks.com/matlabcentral/fileexchange/22317-logrank).

Topologically investigating dysregulated genes in PPI network

Protein-protein interaction network has been successfully applied to select signature genes [26]. For example, Hase et al. illustrated that the signature genes tended to have bigger degrees in the network [27]; and Yao et al. reported that the signature genes were usually with higher betweenness centralities in the network [28]. Thus we investigated two network topological coefficients (Degree and Betweenness Centrality) of the selected dysregulated genes by comparing with candidate genes (dysregulated genes excluded) and all genes in the PPI network (dysregulated genes excluded). The differences of the topological coefficients between the dysregulated genes and other two kinds of genes were tested by the Mann–Whitney-Wilcoxon non-parametric test for two unpaired groups. And the topology analysis of PPI network was performed by the Network Analyzer plug-in for Cytoscape [29].

Investigating dysregulated genes by functional analysis

DAVID [30] was applied to extract the GO Terms (Biological Processes) which were significantly enriched by the dysregulated genes and the ones with p-values less than 0.05 were set as enriched GO Terms. All enriched GO Terms were clustered into several functional groups by the functional annotation clustering method with the default threshold of enrichment score [30].

Results

Dysregulated pathways and genes

By bootstrapping method, we selected out 267 candidate genes (Additional file 1: Table S1), from which we got 35 dysregulated genes involved in eight dysregulated pathways (Table 2). In order to validate our strategy, we also used t-test to select the discriminative genes between the patients of the high-risk group and the low-risk group (see Additional file 1: Supplementary Methods), based on which, the dysregulated genes as well as dysregulated pathways can be gotten by using the similar strategy to ours. As a result, most of the identified dysregulated pathways and genes based on the candidates selected by bootstrapping method are significantly coincident with those selected by t-test method (Additional file 1: Figure S1). Moreover, most of the dysregulated pathways and genes are shown to be related to bone metastasis in literature.

Table 2

The dysregulated pathways

KEGG pathway	Enrichment p-value	Gene ID	Gene symbol	Cox coefficient	Cox p-value	Stability
Cytokine Cytokine Receptor Interaction	0.029	355	FAS	−0.42	0.0048	0.9925
		1235	CCR6	−0.22	0.023	0.905
		1439	CSF2RB	−0.32	0.0046	0.9875
		2322	FLT3	−0.28	0.015	0.93
		3561	IL2RG	−0.20	0.031	0.8125
		3570	IL6R	−0.37	0.027	0.85
		3575	IL7R	−0.23	0.0044	0.995
		4982	TNFRSF11B	−0.22	0.019	0.9125
		6363	CCL19	−0.11	0.033	0.8025
		6375	XCL1	−0.21	0.013	0.9575
		7042	TGFB2	−0.24	0.016	0.9325
		7422	VEGFA	0.15	0.031	0.83
Chemokine Signaling Pathway	0.041	112	ADCY6	0.34	0.032	0.8225
		1235	CCR6	−0.22	0.023	0.905
		3702	ITK	−0.18	0.023	0.87
		3717	JAK2	−0.48	0.0025	1
		5579	PRKCB1	−0.39	0.021	0.8975
		5613	PRKX	−0.26	0.031	0.815
		5829	PXN	0.34	0.021	0.8725
		6363	CCL19	−0.11	0.033	0.8025
		6375	XCL1	−0.21	0.013	0.9575
Cell Cycle	0.012	894	CCND2	−0.27	0.013	0.96
		1021	CDK6	−0.48	0.010	0.955
		1869	E2F1	0.32	0.0015	1
		1870	E2F2	0.33	0.031	0.8375
		7042	TGFB2	−0.24	0.016	0.9325
		8243	SMC1A	0.75	0.0085	0.98
		9700	ESPL1	0.25	0.010	0.97
		10744	PTTG2	0.46	0.011	0.975
Natural Killer Cell Mediated Cytotoxicity	0.048	355	FAS	−0.42	0.0048	0.9925
		3002	GZMB	−0.23	0.0067	0.985
		3383	ICAM1	−0.32	0.022	0.8975
		3821	KLRC1	−0.43	0.0073	0.97
		3932	LCK	−0.24	0.025	0.875
		5579	PRKCB1	−0.39	0.021	0.8975
		22914	KLRK1	−0.34	0.015	0.9325
T Cell Receptor Signaling Pathway	0.046	917	CD3G	−0.43	0.00097	0.9975
		3702	ITK	−0.18	0.023	0.87
		3932	LCK	−0.24	0.025	0.875
		5788	PTPRC	−0.21	0.024	0.8675
		10892	MALT1	−0.43	0.015	0.905
		29851	ICOS	−0.41	0.018	0.915
Pancreatic Cancer	0.027	1021	CDK6	−0.48	0.010	0.955
		1869	E2F1	0.32	0.0015	1
		1870	E2F2	0.33	0.031	0.8375
		7042	TGFB2	−0.24	0.016	0.9325
		7422	VEGFA	0.15	0.031	0.83
Non Small Cell Lung Cancer	0.0095	1021	CDK6	−0.48	0.010	0.955
		1869	E2F1	0.32	0.0015	1
		1870	E2F2	0.33	0.031	0.8375
		5579	PRKCB1	−0.39	0.021	0.8975
		6256	RXRA	0.45	0.012	0.9525
Primary Immunodeficiency	0.0014	3561	IL2RG	−0.20	0.031	0.8125
		3575	IL7R	−0.23	0.0044	0.995
		3932	LCK	−0.24	0.025	0.875
		5788	PTPRC	−0.21	0.024	0.8675
		29851	ICOS	−0.41	0.018	0.915

The first column contains the names of the pathways; the second column contains the enrichment p-value of the candidate genes to the pathways; the third column (Gene ID) and the forth column (Gene Symbol) contains all candidate genes in the pathways; the fifth column contains the average Cox coefficients of the genes in the 400 runs; the fifth column contains the average p-values of the genes in the 400 runs and the last column contains the stability of the genes in the 400 runs (the ratios of the genes are significant across all the 400 runs). In the table, there are 35 unique genes (some genes may be present at more than one pathways).

Some cytokines have been reported to be related to breast invasion and metastasis site [31], while cytokine receptor interaction pathway has been found significant in our work. What is more, the dysregulated genes IL2RG, IL6R, IL7R and TGFB2 have been reported to be associated with metastasis site or prognosis [31], and CCR6 is associated with both live metastasis in breast cancer [32] and bone metastasis in human neuroblastoma [33].

Chemokines and their receptors have been shown to play critical roles in determining the metastatic destination of tumour cells [34]. In our work, the chemokine signalling pathway is also enriched with the candidate genes. In the meanwhile, among the nine dysregulated genes, Jak2 has been reported to be mediated by IL6 to involve in bone metastasis [35]; CCR6 is associated with bone metastasis [33]; PPKX regulates endothelial cell migration and vascular-like structure formation [36]; XCL1 and CCL19 are associated with organ specific metastasis [34, 37].

Cell cycle pathway plays an important role in tumorigenesis and cancer prognosis [38], and it has also been found to be dysregulated in our work. Among its dysregulated genes, CCND2 is differentially expressed between breast cancer patients with bone metastases and other patients [11]; E2F1 can regulate DZ13 to induce a cytotoxic stress response in tumour cells metastasizing to bone [39]; TGFB2 is related to the bone metastases development [40].

It is interesting that non-small cell lung cancer and pancreatic cancer pathways have also be found dysregulated in bone metastasis. In fact, lung is the organ with the second frequent metastasis for breast cancer [8], and it has been reported that some breast cancer would metastasize to pancreatic [41]. This phenomenon suggests that either lung cancer or pancreatic cancer might share some common mechanisms with bone metastasis of breast cancer, for the dysregulated genes E2F1 [39] and TGFB2 [40] in pancreatic cancer pathway have been shown to be also involved in bone metastasis process; while E2F2 gene, the family member of E2F1, has been found to be the dysregulated gene in the non-small cell lung pathway.

We have also found that three immune related pathways have been dysregulated in bone metastasis of breast cancer: natural killer cell mediated cytotoxicity pathway, T cell receptor signalling pathway and primary immunodeficiency pathway. In fact, some immune related genes are essential in bone metastasis of breast cancer [42‐44], and their family members, such as FAS, IL2RG and IL7R, have shown dysregulated in our work and have been reported to be either metastasis related or bone metastasis related [31, 35, 45].

Now that references [3, 9‐11] have published bone metastasis related genes, we merged all the reported genes and investigated the overlap with our dysregulated genes. It is surprising that there are only four common genes (Additional file 1: Figure S2) between two sets of genes. We thus investigated the functions of published genes and found that they are most enriched in ‘metabolic process’ (data not shown), while our dysregulated genes are mainly related to immune system. By literature investigation, we further found that the immune cells can play essential roles in bone metastasis or metastasis of cancer [42, 44], which illustrates that our dysregulated genes are related to some new biological mechanism of bone metastasis, compared to the reported genes.

Distinguishing bone metastasis risk by DPBM

From the training set we have extracted eight dysregulated pathways for bone metastasis in breast cancer, based on which, eight sub-models were constructed and then integrated into DPBM for predicting the bone metastases risks of patients. Therefore, we decided to evaluate DPBM on the training set, test set and independent set respectively.Just as expected, DPBM performed well in the training set. Among all the 380 patients, 308 have been classified as low-risk of bone metastases, and 72 as high-risk of bone metastases. The hazard ratio of the two groups was 3.25 (95% CI 2.21 – 4.78), with p-value of 3.82E-10 (Figure 2a).Then we validated DPBM on the test set and found it also performed very well. Among the 189 patients, 150 samples were predicted as low-risk and the others as high-risk. Survival analysis showed that the hazard ratio was 2.89 (95% CI 1.67 – 5.00), with p-value of 0.00007 (Figure 2b).It is notable that both the training and test sets belong to the same integrated data set, the test set is hardly independent with the training set even though it has not taken part in the construction of DPBM. Therefore, it would be bias to evaluate DPBM just with the test set or even with the training set. Herein, we also used a completely independent set, GSE2034, to evaluate DPBM. The result shows that DPBM consistently performed well in the independent set. Among the 286 samples, 218 patients were predicted as low-risk group and the other 68 ones were assigned into the high-risk group. The hazard ratio between the two groups was 2.35 (95% CI 1.44 – 3.83), and the p-value of log rank test was 0.0003 (Figure 2c).

We noticed that different types of samples in any of the training, test and independent sets are imbalanced, which would lead to the overestimation problem. In order to address this issue, we also used random sampling methodology to choose the same number of cases from high-risk and low-risk groups and re-evaluated the DPBM on each of three data sets. We repeated the above process 1000 times, and the means of hazard ratios for training test and independent sets were 3.31 (p-value of 2.49E-04), 3.15 (p-value of 0.0082) and 2.48 (p-value of 0.015) respectively (Additional file 1: Table S2). The results further unveil the robustness of our model. In the meanwhile, the stable performance of the DPBM also indicates the reliability of the dysregulated genes identified by our method.

Topological analysis of dysregulated genes in PPI network

The degrees and betweenness centralities of three groups of genes (35 dysregulated genes, 232 candidate genes (the dysregulated genes excluded), all genes (the dysregulated genes excluded) in PPI network) are shown in Figure 3(a) and Figure 3(b) respectively, where three gene groups are correspondingly denoted as ‘Dysregulated genes’ , ‘Candidate genes’ and ‘All genes’.

From Figure 3(a), it is clear that the dysregulated genes tend to have bigger degrees than the other two groups of genes, and the p-values of dysregulated vs candidate genes, dysregulated vs all genes are 2.29E-04 and 4.86E-07 respectively. Moreover, Figure 3(b) demonstrates that the betweenness centralities of the dysregulated genes are usually bigger than the other two groups of genes (with p-value = 1.17E-05 and p-value = 1.68E-08 separately).

From above results we can see that the dysregulated genes take up more important positions in the PPI network than the other genes, and tend to be essential genes for the bone metastasis.

Difference between bone and non-bone metastasis

We noticed that there are also some samples metastasized to other organs instead of bone in the data sets. By using the same strategy as we have done for bone metastasis, we have found nine dysregulated pathways and a total of 67 dysregulated genes related to non-bone metastases (metastases to other organs except for bone) (Additional file 1: Table S3). Therefore, we investigated the different functional groups to which these two kinds of genes belong, with the purpose of uncovering the biological mechanism of bone specific metastasis. By function annotating and clustering, the 35 dysregulated genes of bone metastasis were found to belong to 16 functional groups (Additional file 2: Table S4), and the 67 dysregulated genes of non-bone metastases were found to belong to 15 functional clusters (Additional file 3: Table S5).

By comparison, we found that these two kinds of genes shared a lot of common functional clusters. For example, cell differentiation related cluster, cell cycle related cluster, cell migration cluster, apoptosis related cluster, hormone stimulus related cluster, phosphate metabolic process and phosphorylation related cluster. As is known to all, cell differentiation, cell cycle, cell migration, and cell apoptosis are all famous caner hallmark related GO Terms that are related to cancer and cancer prognosis [46‐48], while hormones are related to the risk of breast cancer and hormones-replacement therapy is a common therapy for breast cancer patients [49]. In addition, phosphorylation of some proteins have been reported to be related to breast cancer [50] and cancer prognosis [51].

The main difference between these two kinds of dysregulated genes was that dysregulated genes of bone metastasis are also enriched in biological processes associated with immune system, whereas dysregulated genes of non-bone metastases were not. The difference suggests that the immune system may be essential in the bone specific metastasis of breast cancer.

Comparing DPBM with other classification methods

In DPBM, we simply used a cut-off of the RiskScore in each dysregulated pathways to make a prediction, instead of training a complex classifier such as SVM (Support Vector Machine). In order to evaluate this option, we herein adopted two strategies to construct SVM classifers and investigated their performances. By one strategy, we used the RiskScore values of the eight dysregulated pathways as eight features to construct a SVM classifier. By the other strategy, we used all the 35 dysregulated genes as features to construct another SVM classifier to predict the bone metastasis risk. To construct both SVM classifiers, the patients in the training set were labelled as high-risk or low-risk as described in Additional file 1: Supplementary Methods. The performances of these two kinds of SVM classifiers are listed in Table 3. The comparing results indicate the superiority of DPBM even through it adopts a simple classification strategy.

Table 3

Comparing DPBM with other methods

	Training data set		Test data set		Independent data set
	AUC	Accuracy	AUC	Accuracy	AUC	Accuracy
DPBM	0.76	0.64	0.60	0.60	0.61	0.66
SVM (RiskScore)	0.72	0.71	0.58	0.59	0.60	0.60
SVM (dysregulated genes)	0.75	0.75	0.55	0.54	0.60	0.59
SCC	0.78	0.65	0.57	0.55	0.57	0.44

As far as we know, there is only one published work to construct a model for predicting bone metastases risks of cancer patients [3], by using SCC (shrunken centroids classifier) [52] method. Therefore, we also compared DPBM with SCC. Since the data set used in the original work is too small, we constructed SCC and evaluated its performances on our data sets (the training samples were labelled as high-risk or low-risk as described in Additional file 1: Supplementary Methods, and 35 dysregulated genes were used as features). The results are also listed in Table 3, from which we can see that our DPBM performs better than SCC that has been used in previous work [3].

Discussion and conclusions

Predicting the bone metastases risks for breast cancer patients is essential in cancer therapy, which is an urgent challenge now [5]. In this work, we have proposed a Dysregulated Pathway Based prediction Model (DPBM) to address this problem. We first selected the candidate genes (correlated with the bone metastasis) by bootstrapping strategy. Then we identified the dysregulated pathways enriched by the candidate genes. After that, we used the dysregulated genes in each dysregulated pathway to construct a sub-model to predict the bone metastasis risk separately. Finally, we combined all sub-models together by using majority voting strategy as an ensemble model, DPBM, to predict the risk of bone metastasis. Validation results on test set and independent set have shown the great prediction power of DPBM.

By literature investigation, most of the dysregulated pathways and dysregulated genes are related to bone metastasis. In addition, the dysregulated genes tend to have higher degrees and betweenness centralities in PPI network, suggesting that they play critical roles in the biological functions. By comparing the functional groups to which the dysregulated genes of bone and non-bone metastases belong, we found that the immune system may be essential in the bone specific metastasis of breast cancer.

All the results illustrate that the dysregulated genes may be good biomarker candidates. The facts that DPBM consistently performs well in both test set and independent set may be due to the following merits: (1) we used the pathways to filter the candidate genes, which can help to remove those genes less essential to the bone metastasis; (2) instead of selecting pathways or other functional gene sets via the activity differences between different phenotypes, we selected the dysregulated pathways enriched by the discriminative genes, which can help to preserve the useful information for classification and reduce noises; (3) we constructed one sub-model based on each dysregulated pathway, and then combined all sub-models by majority voting strategy. The ensemble classifier usually performs better than simple classifiers [53].

In this work, although we have collected 855 samples, the samples with the metastases to other specific organs are still insufficient, that is why we merged all samples with metastatic tumour of the other organs as one group (non-bone metastases group). This is reasonable for us to understand the difference between the bone metastasis and other organ metastases. Of course, if the samples with other organ metastases are sufficient, the differences among different metastases organs may also be well studied.

Acknowledgements

This work was supported by the National Science Foundation of China [61272274, 60970063]; the program for New Century Excellent Talents in Universities [NCET-10-0644]; and the Fundamental Research Funds for the Central Universities [2012211020208].

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

JL raised the question, XZ and JL developed the methodology, XZ executed the experiments, XZ and JL wrote and revised the manuscript. Both authors read and approved the final manuscript.

Electronic supplementary material

Additional file 1: This file contains two supplementary methods, three supplementary tables (Table S1 – Table S3) and two supplementary figures (Figure S1 – Figure S2).(DOCX 474 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Landemaine T, Jackson A, Bellahcene A, Rucci N, Sin S, Abad BM, Sierra A, Boudinet A, Guinebretiere JM, Ricevuto E, Nogues C, Briffod M, Bieche I, Cherel P, Garcia T, Castronovo V, Teti A, Lidereau R, Driouch K: A six-gene signature predicting breast cancer lung metastasis. Cancer Res. 2008, 68 (15): 6092-6099. 10.1158/0008-5472.CAN-08-0436.CrossRefPubMed

Santini D, Galluzzo S, Zoccoli A, Pantano F, Fratto ME, Vincenzi B, Lombardi L, Gucciardino C, Silvestris N, Riva E, Rizzo S, Russo A, Maiello E, Colucci G, Tonini G: New molecular targets in bone metastases. Cancer Treat Rev. 2010, 36: S6-S10.CrossRefPubMed

Smid M, Wang YX, Klijn JGM, Sieuwerts AM, Zhang Y, Atkins D, Martens JWM, Foekens JA: Genes associated with breast cancer metastatic to bone. J Clin Oncol. 2006, 24 (15): 2261-2267. 10.1200/JCO.2005.03.8802.CrossRefPubMed

Kominsky SL, Davidson NE: A “bone” fide predictor of metastasis? Predicting breast cancer metastasis to bone. J Clin Oncol. 2006, 24 (15): 2227-2229. 10.1200/JCO.2005.05.5319.CrossRefPubMed

Korde LA, Gralow JR: Can we predict who’s at risk for developing bone metastases in breast cancer?. J Clin Oncol. 2011, 29 (27): 3600-3604. 10.1200/JCO.2011.35.7038.CrossRefPubMed

Roodman GD: Mechanisms of disease: mechanisms of bone metastasis. New Engl J Med. 2004, 350 (16): 1655-1664. 10.1056/NEJMra030831.CrossRefPubMed

Weigelt B, Hu ZY, He XP, Livasy C, Carey LA, Ewend MG, Glas AM, Perou CM, van’t Veer LJ: Molecular portraits and 70-gene prognosis signature are preserved throughout the metastatic process of breast cancer. Cancer Res. 2005, 65 (20): 9155-9158. 10.1158/0008-5472.CAN-05-2553.CrossRefPubMed

Harrell JC, Prat A, Parker JS, Fan C, He XP, Carey L, Anders C, Ewend M, Perou CM: Genomic analysis identifies unique signatures predictive of brain, lung, and liver relapse. Breast Cancer Res Tr. 2012, 132 (2): 523-535. 10.1007/s10549-011-1619-7.CrossRef

Kang YB, Siegel PM, Shu WP, Drobnjak M, Kakonen SM, Cordon-Cardo C, Guise TA, Massague J: A multigenic program mediating breast cancer metastasis to bone. Cancer Cell. 2003, 3 (6): 537-549. 10.1016/S1535-6108(03)00132-6.CrossRefPubMed

10.

Dean-Colomb W, Hess KR, Young E, Gornet TG, Handy BC, Moulder SL, Ibrahim N, Pusztai L, Booser D, Valero V, Hortobagyi GN, Esteva FJ: Elevated serum P1NP predicts development of bone metastasis and survival in early-stage breast cancer. Breast Cancer Res Tr. 2013, 137 (2): 631-636. 10.1007/s10549-012-2374-0.CrossRef

11.

Sanz-Pamplona R, Garcia-Garcia J, Franco S, Messeguer X, Driouch K, Oliva B, Sierra A: A taxonomy of organ-specific breast cancer metastases based on a protein-protein interaction network. Mol Biosyst. 2012, 8 (8): 2085-2096. 10.1039/c2mb25104c.CrossRefPubMed

12.

Chuang HY, Lee E, Liu YT, Lee D, Ideker T: Network-based classification of breast cancer metastasis. Mol Syst Biol. 2007, 3: 140-CrossRefPubMedPubMedCentral

13.

Venet D, Dumont JE, Detours V: Most random gene expression signatures are significantly associated with breast cancer outcome. Plos Comput Biol. 2011, 7 (10): e1002240-10.1371/journal.pcbi.1002240.CrossRefPubMedPubMedCentral

14.

Zhou X, Liu J, Xiong J: Predicting distant metastasis in breast cancer using ensemble classifier based on context-specific miRNA regulation modules. Bioinformatics and Biomedicine (BIBM), 2012 IEEE International Conference on. 2012, Philadelphia, PA: IEEE, 1-6.CrossRef

15.

Taylor IW, Linding R, Warde-Farley D, Liu Y, Pesquita C, Faria D, Bull S, Pawson T, Morris Q, Wrana JL: Dynamic modularity in protein interaction networks predicts breast cancer outcome. Nat Biotechnol. 2009, 27 (2): 199-204. 10.1038/nbt.1522.CrossRefPubMed

16.

Van Vliet MH, Klijn CN, Wessels LF, Reinders MJ: Module-based outcome prediction using breast cancer compendia. PLoS One. 2007, 2 (10): e1047-10.1371/journal.pone.0001047.CrossRefPubMedPubMedCentral

17.

Abraham G, Kowalczyk A, Loi S, Haviv I, Zobel J: Prediction of breast cancer prognosis using gene set statistics provides signature stability and biological context. BMC Bioinformatics. 2010, 11: 277-10.1186/1471-2105-11-277.CrossRefPubMedPubMedCentral

18.

Lee E, Chuang HY, Kim JW, Ideker T, Lee D: Inferring pathway activity toward precise disease classification. Plos Comput Biol. 2008, 4 (11): e1000217-10.1371/journal.pcbi.1000217.CrossRefPubMedPubMedCentral

19.

Wang YX, Klijn JGM, Zhang Y, Sieuwerts A, Look MP, Yang F, Talantov D, Timmermans M, Meijer-van Gelder ME, Yu J, Jatkoe T, Berns EMJJ, Atkins D, Foekens JA: Gene-expression pro-files to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet. 2005, 365 (9460): 671-679. 10.1016/S0140-6736(05)17947-1.CrossRefPubMed

20.

Minn AJ, Gupta GP, Siegel PM, Bos PD, Shu WP, Giri DD, Viale A, Olshen AB, Gerald WL, Massague J: Genes that mediate breast cancer metastasis to lung. Nature. 2005, 436 (7050): 518-524. 10.1038/nature03799.CrossRefPubMedPubMedCentral

21.

Bos PD, Zhang XHF, Nadal C, Shu WP, Gomis RR, Nguyen DX, Minn AJ, van de Vijver MJ, Gerald WL, Foekens JA, Massague J: Genes that mediate breast cancer metastasis to the brain. Nature. 2009, 459 (7249): 1005-U1137. 10.1038/nature08021.CrossRefPubMedPubMedCentral

22.

van de Vijver MJ, He YD, van ’t Veer LJ, Dai H, Hart AAM, Voskuil DW, Schreiber GJ, Peterse JL, Roberts C, Marton MJ, Parrish M, Atsma D, Witteveen A, Glas A, Delahaye L, van der Velde T, Bartelink H, Rodenhuis S, Rutgers ET, Friend SH, Bernards R: A gene-expression signature as a predictor of survival in breast cancer. N Engl J Med. 2002, 347 (25): 1999-2009. 10.1056/NEJMoa021967.CrossRefPubMed

23.

Schaefer MH, Fontaine JF, Vinayagam A, Porras P, Wanker EE, Andrade-Navarro MA: HIPPIE: Integrating protein interaction networks with experiment based quality scores. Plos One. 2012, 7 (2): e31826-10.1371/journal.pone.0031826.CrossRefPubMedPubMedCentral

24.

Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, Paulovich A, Pomeroy SL, Golub TR, Lander ES, Mesirov JP: Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. P Natl Acad Sci USA. 2005, 102 (43): 15545-15550. 10.1073/pnas.0506580102.CrossRef

25.

Sotiriou C, Wirapati P, Loi S, Harris A, Fox S, Smeds J, Nordgren H, Farmer P, Praz V, Haibe-Kains B, Desmedt C, Larsimont D, Cardoso F, Peterse H, Nuyten D, Buyse M, Van de Vijver MJ, Bergh J, Piccart MT, Delorenzi M: Gene expression profiling in breast cancer: understanding the molecular basis of histologic grade to improve prognosis. J Natl Cancer I. 2006, 98 (4): 262-272. 10.1093/jnci/djj052.CrossRef

26.

Moreau Y, Tranchevent LC: Computational tools for prioritizing candidate genes: boosting disease gene discovery. Nat Rev Genet. 2012, 13 (8): 523-536. 10.1038/nrg3253.CrossRefPubMed

27.

Hase T, Tanaka H, Suzuki Y, Nakagawa S, Kitano H: Structure of protein interaction networks and their implications on drug design. Plos Comput Biol. 2009, 5 (10): e1000550-10.1371/journal.pcbi.1000550.CrossRefPubMedPubMedCentral

28.

Yao LX, Rzhetsky A: Quantitative systems-level determinants of human genes targeted by successful drugs. Genome Res. 2008, 18 (2): 206-213. 10.1101/gr.6888208.CrossRefPubMedPubMedCentral

29.

Assenov Y, Ramirez F, Schelhorn SE, Lengauer T, Albrecht M: Computing topological parameters of biological networks. Bioinformatics. 2008, 24 (2): 282-284. 10.1093/bioinformatics/btm554.CrossRefPubMed

30.

Huang DW, Sherman BT, Lempicki RA: Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc. 2009, 4 (1): 44-57.CrossRef

31.

Nicolini A, Carpi A, Rossi G: Cytokines in breast cancer. Cytokine Growth F R. 2006, 17 (5): 325-337. 10.1016/j.cytogfr.2006.07.002.CrossRef

32.

Ben-Baruch A: Organ selectivity in metastasis: regulation by chemokines and their receptors. Clin Exp Metastas. 2008, 25 (4): 345-356. 10.1007/s10585-007-9097-3.CrossRef

33.

Airoldi I, Cocco C, Morandi F, Prigione I, Pistoia V: CXCR5 may be involved in the attraction of human metastatic neuroblastoma cells to the bone marrow. Cancer Immunol Immun. 2008, 57 (4): 541-548. 10.1007/s00262-007-0392-2.CrossRef

34.

Muller A, Homey B, Soto H, Ge N, Catron D, Buchanan ME, McClanahan T, Murphy E, Yuan W, Wagner SN, Barrera JL, Mohar A, Verastegui E, Zlotnik A: Involvement of chemokine receptors in breast cancer metastasis. Nature. 2001, 410 (6824): 50-56. 10.1038/35065016.CrossRefPubMed

35.

Ara T, DeClerck YA: Interleukin-6 in bone metastasis and cancer progression. Eur J Cancer. 2010, 46 (7): 1223-1231. 10.1016/j.ejca.2010.02.026.CrossRefPubMedPubMedCentral

36.

Li XH, Lomini C, Hyink D, Wilson PD: PRKX critically regulates endothelial cell proliferation, migration, and vascular-like structure formation. Dev Biol. 2011, 356 (2): 475-485. 10.1016/j.ydbio.2011.05.673.CrossRefPubMed

37.

Zlotnik A, Burkhardt AM, Homey B: Homeostatic chemokine receptors and organ-specific metastasis. Nat Rev Immunol. 2011, 11 (9): 597-606. 10.1038/nri3049.CrossRefPubMed

38.

Michalides R: Cell cycle regulators: role in etiology, prognosis and treatment in cancer. Ann Oncol. 2002, 13: 39-10.1093/annonc/mdf636.CrossRefPubMed

39.

Dass CR, Tan ML, Galloway SJ, Choong PF: Dz13 induces a cytotoxic stress response with upregulation of E2F1 in tumor cells metastasizing to or from bone. Oligonucleotides. 2010, 20 (2): 79-91. 10.1089/oli.2009.0224.CrossRefPubMed

40.

Janssens K, Ten Dijke P, Janssens S, Van Hul W: Transforming growth factor-β1 to the bone. Endocr Rev. 2005, 26 (6): 743-774. 10.1210/er.2004-0001.CrossRefPubMed

41.

Bonapasta SA, Gregori M, Lanza R, Sangiorgi E, Menghi A, Scarpini M, Modesti M: Metastasis to the Pancreas from Breast Cancer: Difficulties in Diagnosis and Controversies in Treatment. Breast Care. 2010, 5 (3): 170-172. 10.1159/000314249.CrossRefPubMedPubMedCentral

42.

Bidwell BN, Slaney CY, Withana NP, Forster S, Cao Y, Loi S, Andrews D, Mikeska T, Mangan NE, Samarajiwa SA, de Weerd NA, Gould J, Argani P, Möller A, Smyth MJ, Anderson RL, Hertzog PJ, Parker BS: Silencing of Irf7 pathways in breast cancer cells promotes bone metastasis through immune escape. Nat Med. 2012, 18 (8): 1224-1231. 10.1038/nm.2830.CrossRefPubMed

43.

Jones DH, Nakashima T, Sanchez OH, Kozieradzki I, Komarova SV, Sarosi I, Morony S, Rubin E, Sarao R, Hojilla CV, Komnenovic V, Kong YY, Schreiber M, Dixon SJ, Sims SM, Khokha R, Wada T, Penninger JM: Regulation of cancer cell migration and bone metastasis by RANKL. Nature. 2006, 440 (7084): 692-696. 10.1038/nature04524.CrossRefPubMed

44.

DeNardo DG, Johansson M, Coussens LM: Immune cells as mediators of solid tumor metastasis. Cancer Metast Rev. 2008, 27 (1): 11-18. 10.1007/s10555-007-9100-0.CrossRef

45.

Bewick M, Conlon M, Parissenti AM, Lee H, Zhang L, Gluck S, Lafrenie RM: Cutting edge communication - Soluble Fas (CD95) is a prognostic factor in patients with metastatic breast cancer undergoing high-dose chemotherapy and autologous stem cell transplantation. J Hematoth Stem Cell. 2001, 10 (6): 759-768. 10.1089/152581601317210854.CrossRef

46.

Almand B, Resser JR, Lindman B, Nadaf S, Clark JI, Kwon ED, Carbone DP, Gabrilovich DI: Clinical significance of defective dendritic cell differentiation in cancer. Clin Cancer Res. 2000, 6 (5): 1755-1766.PubMed

47.

Evan GI, Vousden KH: Proliferation, cell cycle and apoptosis in cancer. Nature. 2001, 411 (6835): 342-348. 10.1038/35077213.CrossRefPubMed

48.

Friedl P, Gilmour D: Collective cell migration in morphogenesis, regeneration and cancer. Nat Rev Mol Cell Bio. 2009, 10 (7): 445-457. 10.1038/nrm2720.CrossRef

49.

Banks E, Beral V, Bull D, Reeves G, Austoker J, English R, Patnick J, Peto R, Vessey M, Wallis M, Abbott S, Bailey E, Baker K, Balkwill A, Barnes I, Black J, Brown A, Cameron B, Canfell K, Cliff A, Crossley B, Couto E, Davies S, Ewart D, Ewart S, Ford D, Gerrard L, Goodill A, Green J, Gray W: Breast cancer and hormone-replacement therapy in the Million Women Study. Lancet. 2003, 362 (9382): 419-427.CrossRef

50.

Foster JS, Wimalasena J: Estrogen regulates activity of cyclin-dependent kinases and retinoblastoma protein phosphorylation in breast cancer cells. Mol Endocrinol. 1996, 10 (5): 488-498.PubMed

51.

Kreisberg JI, Malik SN, Prihoda TJ, Bedolla RG, Troyer DA, Kreisberg S, Ghosh PM: Phosphorylation of Akt (Ser(473)) is an excellent predictor of poor clinical outcome in prostate cancer. Cancer Res. 2004, 64 (15): 5232-5236. 10.1158/0008-5472.CAN-04-0272.CrossRefPubMed

52.

Tibshirani R, Hastie T, Narasimhan B, Chu G: Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc Natl Acad Sci U S A. 2002, 99 (10): 6567-6572. 10.1073/pnas.082099299.CrossRefPubMedPubMedCentral

53.

Dietterich TG: Ensemble methods in machine learning. Multiple Classifier Systems. 1857, 2000: 1-15.

The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/14/618/prepub

Titel: A computational model to predict bone metastasis in breast cancer by integrating the dysregulated pathways
verfasst von: Xionghui Zhou
Juan Liu
Publikationsdatum: 01.12.2014
Verlag: BioMed Central
Erschienen in: BMC Cancer / Ausgabe 1/2014
Elektronische ISSN: 1471-2407
DOI: https://doi.org/10.1186/1471-2407-14-618

Neu im Fachgebiet Onkologie

23.04.2024 | Medikamente in Schwangerschaft und Stillzeit | Nachrichten

Live-Webinar: Aktuelle Leitlinien bei Herz-Kreislauf-Erkrankungen

Springer Medizin

A computational model to predict bone metastasis in breast cancer by integrating the dysregulated pathways

Abstract

Background

Methods

Results

Conclusions

Electronic supplementary material

Competing interests

Authors’ contributions

Background

Methods

Data sets and pre-processing

Selecting candidate genes by bootstrapping

Identifying the dysregulated pathways

Constructing the DPBM

Topologically investigating dysregulated genes in PPI network

Investigating dysregulated genes by functional analysis

Results

Dysregulated pathways and genes

Distinguishing bone metastasis risk by DPBM

Topological analysis of dysregulated genes in PPI network

Difference between bone and non-bone metastasis

Comparing DPBM with other classification methods

Discussion and conclusions

Acknowledgements

Competing interests

Authors’ contributions

Electronic supplementary material

Authors’ original submitted files for images

Neu im Fachgebiet Onkologie

ICI-Therapie in der Schwangerschaft wird gut toleriert

Krebspatienten impfen: Was? Wen? Und wann nicht?

Müde im Alter? Auch an die Nebenniere denken

Stufenschema weist Prostatakarzinom zuverlässig nach

Update Onkologie

Live-Webinar: Aktuelle Leitlinien bei Herz-Kreislauf-Erkrankungen

Springer Medizin

Abstract

Background

Methods

Results

Conclusions

Electronic supplementary material

Competing interests

Authors’ contributions

Background

Methods

Data sets and pre-processing

Selecting candidate genes by bootstrapping

Identifying the dysregulated pathways

Constructing the DPBM

Topologically investigating dysregulated genes in PPI network

Investigating dysregulated genes by functional analysis

Results

Dysregulated pathways and genes

Distinguishing bone metastasis risk by DPBM

Topological analysis of dysregulated genes in PPI network

Difference between bone and non-bone metastasis

Comparing DPBM with other classification methods

Discussion and conclusions

Acknowledgements

Competing interests

Authors’ contributions

Electronic supplementary material

Authors’ original submitted files for images

Weitere Artikel der Ausgabe 1/2014

ROCK1 as a novel prognostic marker in vulvar cancer

Randomized controlled trial to evaluate the effects of ethyl-2-cyanoacrylate on pain intensity and quality of life in head and neck cancer patients suffering from cetuximab-induced rhagades during radioimmunotherapy: the support trial

The expression of microRNA-375 in plasma and tissue is matched in human colorectal cancer

The expression of beclin-1, an autophagic gene, in hepatocellular carcinoma associated with clinical pathological and prognostic significance

Clinical relevance of breast cancer-related genes as potential biomarkers for oral squamous cell carcinoma

L1CAM is expressed in triple-negative breast cancers and is inversely correlated with Androgen receptor

Neu im Fachgebiet Onkologie

ICI-Therapie in der Schwangerschaft wird gut toleriert

Krebspatienten impfen: Was? Wen? Und wann nicht?

Müde im Alter? Auch an die Nebenniere denken

Stufenschema weist Prostatakarzinom zuverlässig nach

Update Onkologie