Skip to main content
Erschienen in: BMC Cancer 1/2014

Open Access 01.12.2014 | Research article

Prognostication of patients with clear cell renal cell carcinomas based on quantification of DNA methylation levels of CpG island methylator phenotype marker genes

verfasst von: Ying Tian, Eri Arai, Masahiro Gotoh, Motokiyo Komiyama, Hiroyuki Fujimoto, Yae Kanai

Erschienen in: BMC Cancer | Ausgabe 1/2014

Abstract

Background

The CpG island methylator phenotype (CIMP) of clear cell renal cell carcinomas (ccRCCs) is characterized by accumulation of DNA methylation at CpG islands and poorer patient outcome. The aim of this study was to establish criteria for prognostication of patients with ccRCCs using the ccRCC-specific CIMP marker genes.

Methods

DNA methylation levels at 299 CpG sites in the 14 CIMP marker genes were evaluated quantitatively in tissue specimens of 88 CIMP-negative and 14 CIMP-positive ccRCCs in a learning cohort using the MassARRAY system. An additional 100 ccRCCs were also analyzed as a validation cohort.

Results

Receiver operating characteristic curve analysis showed that area under the curve values for the 23 CpG units including the 32 CpG sites in the 7 CIMP-marker genes, i.e. FAM150A, ZNF540, ZNF671, ZNF154, PRAC, TRH and SLC13A5, for discrimination of CIMP-positive from CIMP-negative ccRCCs were larger than 0.95. Criteria combining the 23 CpG units discriminated CIMP-positive from CIMP-negative ccRCCs with 100% sensitivity and specificity in the learning cohort. Cancer-free and overall survival rates of patients with CIMP-positive ccRCCs diagnosed using the criteria combining the 23 CpG units in a validation cohort were significantly lower than those of patients with CIMP-negative ccRCCs (P = 1.41 × 10−5 and 2.43 × 10−13, respectively). Patients with CIMP-positive ccRCCs in the validation cohort had a higher likelihood of disease-related death (hazard ratio, 75.8; 95% confidence interval, 7.81 to 735; P = 1.89 × 10−4) than those with CIMP-negative ccRCCs.

Conclusions

The established criteria are able to reproducibly diagnose CIMP-positive ccRCCs and may be useful for personalized medicine for patients with ccRCCs.
Begleitmaterial
Hinweise

Electronic supplementary material

The online version of this article (doi:10.​1186/​1471-2407-14-772) contains supplementary material, which is available to authorized users.

Competing interests

The authors declare that they have no competing interests.
Abkürzungen
AUC
Area under the curve
CIMP
CpG island methylator phenotype
CV
Cutoff value
NCBI
National Center for Biotechnology Information
ccRCC
Clear cell renal cell carcinoma
ROC
Receiver operating characteristic.

Background

Clear cell renal cell carcinoma (ccRCC) is the most common histological subtype of adult kidney cancer [1]. In general, ccRCCs at an early stage are curable by nephrectomy. However, some ccRCCs relapse and metastasize to distant organs, even if the resection has been considered complete [2]. Even though novel targeting agents have been developed for treatment of ccRCC, unless relapsed or metastasized tumors are diagnosed early by close follow-up, the effectiveness of any therapy is restricted [3]. Therefore, reliable prognostic criteria need to be established.
Not only genetic, but also epigenetic events appear to accumulate during carcinogenesis, and DNA methylation alterations are one of the most consistent epigenetic changes in human cancers [46]. We and other groups have revealed that DNA methylation alterations participate in renal carcinogenesis and are significantly correlated with the clinicopathological diversity of ccRCCs [711]. In addition, a distinct cancer phenotype known as the CpG island methylator phenotype (CIMP), characterized by accumulation of DNA methylation at CpG islands, has been defined in well-studied cancers [12, 13] such as those of the colorectum [14] and stomach [15], and shown to be significantly correlated with clinicopathological parameters. Although the relevance of the CIMP-positive phenotype in the context of ccRCCs has not yet been clearly defined [16], our group very recently identified CIMP-positive ccRCCs based on genome-wide DNA methylation analysis [7]. We also identified 17 genes, i.e. FAM150A, GRM6, ZNF540, ZFP42, ZNF154, RIMS4, PCDHAC1, KHDRBS2, ASCL2, KCNQ1, PRAC, WNT3A, TRH, FAM78A, ZNF671, SLC13A5 and NKX6-2, which are hallmarks of CIMP in ccRCCs [7], using single CpG-resolution Infinium assay [17]. The CIMP-positive ccRCCs in our cohort were clinicopathologically aggressive and associated with poorer patient outcome [7], indicating that CIMP in ccRCCs might be applicable as a prognostic indicator.
However, in our previous study, CIMP-positive ccRCCs were identified using hierarchical clustering analysis based on DNA methylation profiles in the examined cohort [7]. The DNA methylation status of entire promoter CpG islands, other than Infinium probe sites, in the CIMP marker genes has not been evaluated quantitatively. Therefore, to establish criteria for CIMP diagnosis that would be applicable to individual patients, CpG sites having the largest diagnostic impact should be identified in the entire promoter CpG islands of the CIMP marker genes based on quantification of DNA methylation levels. Moreover, appropriate cutoff values of DNA methylation levels need to be established for the identified CpG sites in order to discriminate CIMP-positive from CIMP-negative ccRCCs.
In the present study, we quantitatively evaluated DNA methylation levels at 299 CpG sites throughout the promoter CpG islands of the ccRCC-specific CIMP marker genes in 88 CIMP-negative ccRCCs and 14 CIMP-positive ccRCCs using the MassARRAY system. We then validated the prognostic impact of the established criteria for CIMP diagnosis in a validation cohort of 100 additional ccRCCs.

Methods

Patients and tissue samples

As a learning cohort, 102 samples of cancerous tissue obtained from specimens surgically resected from 102 patients with primary ccRCCs were subjected to the present analysis. These patients did not receive preoperative treatment and underwent nephrectomy at the National Cancer Center Hospital, Tokyo, Japan. There were 71 men and 31 women with a mean (± standard deviation) age of 62.9 ± 10.4 years (range, 36 to 85 years). Histological diagnosis was made in accordance with the World Health Organization classification [18].
In our previous study, unsupervised hierarchical clustering based on genome-wide DNA methylation analysis using single CpG-resolution Infinium assay divided the 102 ccRCCs in the learning cohort into 88 CIMP-negative ccRCCs and 14 CIMP-positive ccRCCs [7]. In the same study, we showed that the CIMP-positive ccRCCs were clinicopathologically more aggressive and associated with a poorer patient outcome than CIMP-negative ccRCCs [7]: the clinicopathological characteristics [19, 20] of CIMP-negative and CIMP-positive ccRCCs in the learning cohort are summarized in Additional file 1: Table S1.
As a validation cohort, 100 samples of cancerous tissue were obtained from specimens surgically resected from 100 patients with primary ccRCCs. These patients also did not receive preoperative treatment and underwent nephrectomy at the National Cancer Center Hospital, Tokyo, Japan. The patients comprised 68 men and 32 women with a mean (± standard deviation) age of 62.5 ± 11.4 years (range, 33 to 87 years). The clinicopathological characteristics [19, 20] of ccRCCs in the validation cohort are summarized in Additional file 2: Table S2.
Tissue specimens were taken and frozen immediately after surgical removal and have been stored in liquid nitrogen until DNA extraction. ccRCCs are hypervascular tumors with an increased opportunity for infiltration of non-cancerous cells such as lymphocytes [21]: the microscopically examined tumor cell contents (%) of all ccRCC tissue specimens in the learning and validation cohorts are shown in Additional file 3: Table S3. Tissue specimens were provided by the National Cancer Center Biobank, Tokyo, Japan. This study was approved by the Ethics Committee of the National Cancer Center, Tokyo, Japan, and was performed in accordance with the Declaration of Helsinki. All the patients provided written informed consent prior to inclusion in the study.

DNA extraction and bisulfite modification

High-molecular-weight DNA was extracted from fresh-frozen tissue samples using phenol-chloroform followed by dialysis [22]. One microgram of genomic DNA was subjected to bisulfite treatment using an EpiTect Bisulfite Kit (QIAGEN GmbH, Hilden, Germany), in accordance with the manufacturer’s protocol. This process converts non-methylated cytosine to uracil, while methylated cytosine remains unchanged [23].

Quantitative DNA methylation analysis with the MassARRAY system

DNA methylation levels at individual CpG sites were evaluated quantitatively using the MassARRAY platform (Sequenom, San Diego, CA). This method utilizes base-specific cleavage and matrix-assisted laser desorption/ionization time-of-flight mass spectrometry (MALDI-TOF MS) [24]. Specific PCR primers for bisulfite-converted DNA were designed using the EpiDesigner software package (http://​www.​epidesigner.​com, Sequenom), encompassing all promoter CpG islands of the previously identified ccRCC-specific CIMP marker genes [7]. The sequences of the 16 primer sets are given in Additional file 4: Table S4. A T7-promoter tag (5′-CAGTAATACGACTCACTATAGGGAGAAGGCT-3′) was added to each reverse primer for in vitro transcription, and a 10-mer tag (5′-AGGAAGAGAG-3′) was added to each forward primer to balance the PCR.
To overcome PCR bias in DNA methylation analysis, we optimized the annealing temperature and type of DNA polymerase: 0%, 50% and 100% methylated control DNA (Epitect methylated human control DNA; QIAGEN) was used as template to test the linearity of the protocol. Using HotStar Taq DNA polymerase (QIAGEN) or TaKaRa Taq HS DNA polymerase (Takara Bio, Shiga, Japan), the annealing temperature for each of the 16 primer sets was set to give a correlation coefficient (R2) of more than 0.9 and to make the slope of the standard curve close to 1 (Additional file 5: Figure S1 and Additional file 4: Table S4). The PCR products were separated electrophoretically on 2% agarose gel and stained with ethidium bromide to confirm that specific products of the appropriate size and no non-specific products were obtained upon amplification.
Then, the PCR products were used as a template for in vitro transcription and the RNase A-mediated cleavage reaction using an EpiTYPER Reagent Kit (Sequenom). The fragmented samples were dispensed onto a SpectroCHIP array, and then detected on a MassARRAY analyzer compact MALDI-TOF MS instrument. The data were visualized using EpiTYPER Analyzer software v1.0 (Sequenom). The DNA methylation level (%) at each CpG site was determined by comparing the signal intensities of methylated and non-methylated templates. A cluster of consecutive CpG sites, each giving one measured value by the MassARRAY system, is defined as a “CpG unit” in the manufacturer’s protocol. The DNA methylation levels at the 299 examined CpG sites in the CIMP marker genes were then expressed as data for the 193 CpG units. Experiments were performed in triplicate for each sample-CpG unit, and the mean value for the three experiments was used as the DNA methylation level.

Statistics

Differences in DNA methylation levels at individual CpG units between CIMP-positive ccRCCs and CIMP-negative ccRCCs were analyzed using Mann–Whitney U test. The CpG units having the largest diagnostic impact were identified by receiver operating characteristic (ROC) curve analysis [25]: For 23 CpG units showing area under the curve (AUC) values larger than 0.95, appropriate cutoff values were determined in order to discriminate CIMP-positive from CIMP-negative ccRCCs [26]. For discriminating CIMP-positive from CIMP-negative ccRCCs, the Youden index [26] was used as a cutoff value for each CpG unit. Survival curves for patients with ccRCCs were analyzed by the Kaplan-Meier method and the log-rank test. Correlations between DNA methylation levels and recurrence and disease-related death were analyzed using the Cox proportional hazards model. All statistical analyses were performed using SPSS statistics version 20 (IBM Corp., Armonk, NY). Differences at P values of less than 0.05 were considered statistically significant.

Results

DNA methylation status of CIMP marker genes in CIMP-negative and CIMP-positive ccRCCs

Previously, we had identified 17 ccRCC-specific CIMP marker genes based on genome-wide DNA methylation analysis using the Infinium HumanMethylation27K BeadChip [7]. Six exact Infinium probe CpG sites in ccRCC-specific CIMP marker genes (Probe ID: cg06274159 for the ZFP42 gene, cg03975694 for the ZNF540 gene, cg08668790 for the ZNF154 gene, cg01009664 for the TRH gene, cg22040627 for the SLC13A5 gene, and cg19246110 for the ZNF671 gene) were examined using the MassArray system in the learning cohort (Additional file 6; Figure S2). Significant correlations between DNA methylation levels determined by our previous Infinium assay [7] and those determined by the present MassArray analysis were statistically confirmed (P = 1.25 × 10−35, P = 1.98 × 10−32, P = 1.31 × 10−41, P = 5.30 × 10−34, P = 7.91 × 10−22 and P = 7.61 × 10−44, respectively).
In the present study, our primary intention was to evaluate quantitatively the DNA methylation status of not only the Infinium probe sites but also the entire promoter CpG islands in the ccRCC-specific CIMP marker genes using the MassARRAY system [24]. Since the promoter regions of the CIMP marker genes, KCNQ1, FAM78A and NKX6-2, have a very high GC content, for these three genes we were unable to set optimized PCR conditions. Then, the DNA methylation status of 193 CpG units including 299 CpG sites in the remaining 14 ccRCC-specific CIMP marker genes, i.e. FAM150A, GRM6, ZNF540, ZFP42, ZNF154, RIMS4, PCDHAC1, KHDRBS2, ASCL2, PRAC, WNT3A, TRH, ZNF671 and SLC13A5, was evaluated quantitatively using the MassARRAY system. The average DNA methylation levels of 38 CpG units including 68 CpG sites located within the 1347 bp 5′-region of the representative CIMP marker gene, SLC13A5, in CIMP-negative (n = 88) and CIMP-positive (n = 14) ccRCCs in the learning cohort are shown in Figure 1A. Similarly, the average DNA methylation levels of 21 CpG units including 29 CpG sites located within the 428 bp 5′-region of another representative CIMP marker gene, ZNF671, in CIMP-negative and CIMP-positive ccRCCs in the learning cohort are shown in Figure 1B. The average DNA methylation levels of all the CpG units examined (59 in total) in the SLC13A5 and ZNF671 genes in the CIMP-positive ccRCCs were significantly higher than those in CIMP-negative ccRCCs (the P values for each CpG unit are shown in Additional file 7: Table S5). Similarly, the average DNA methylation levels of 130 CpG units including 195 CpG sites, out of the 134 CpG units examined including 202 CpG sites in the remaining 12 CIMP marker genes, in the CIMP-positive ccRCCs were significantly higher than those in CIMP-negative ccRCCs (Additional file 7: Table S5). These data indicated that almost the entire promoter CpG islands in all the CIMP marker genes examined were methylated in CIMP-positive ccRCCs.

Establishment of criteria for discriminating CIMP-positive from CIMP-negative ccRCCs in the learning cohort

Since quantitative DNA methylation analysis using the MassARRAY system revealed that many CpG sites showed significant differences in DNA methylation levels between CIMP-negative and CIMP-positive ccRCCs among all the promoter CpG islands of CIMP marker genes (Figure 1 and Additional file 7: Table S5), we attempted to identify CpG sites having the largest diagnostic impact, and to establish criteria for discriminating CIMP-positive from CIMP-negative ccRCCs. ROC curves were constructed for all 193 CpG units examined, including 299 CpG sites in the 14 CIMP marker genes examined, and the corresponding AUC values [25] were calculated. Eighty-six CpG units, including 135 CpG sites, showed AUC values larger than 0.9 (Additional file 8: Table S6). Among these 86, the top 23 CpG units including 32 CpG sites showing AUC values larger than 0.95 were used to establish the criteria for discriminating CIMP-positive from CIMP-negative ccRCCs (Table 1). For discriminating CIMP-positive from CIMP-negative ccRCCs, the Youden index [26] was used as a cutoff value for each CpG unit (Table 1).
Table 1
The 23 CpG units showing area under the curve (AUC) values larger than 0.95 in receiver operating characteristic curve analysis for discrimination of CpG island methylator phenotype (CIMP)-positive clear cell renal cell carcinomas (ccRCCs) from CIMP-negative ccRCCs in the learning cohort
ID of CpG unit1
Gene symbol
Chromo-
some
Position of CpG site2
AUC value
Cutoff value3(%)
Sensitivity4
(%)
Specificity4
(%)
81
TRH
3
129693406, 129693412
0.973
30.8
100.0
88.6
85
TRH
3
129693518, 129693521, 129693528
0.950
18.2
100.0
78.4
89
TRH
3
129693586
0.952
11.0
92.3
92.0
94
TRH
3
129693635
0.967
6.6
100.0
87.5
8
FAM150A
8
53478477
0.968
27.2
83.3
94.1
11
FAM150A
8
53478511
0.968
27.2
83.3
94.1
78
PRAC
17
46799755
0.957
40.7
92.9
89.8
102
SLC13A5
17
6616733
0.983
7.5
92.9
96.6
105
SLC13A5
17
6616812
0.983
18.5
100.0
94.3
106
SLC13A5
17
6616826, 6616828
0.951
23.3
100.0
88.6
107
SLC13A5
17
6616851, 6616854, 6616857
0.954
14.8
100.0
87.5
110
SLC13A5
17
6616927, 6616929
0.951
23.3
100.0
88.6
30
ZNF540
19
38042496
0.983
41.0
100.0
98.3
32
ZNF540
19
38042518
0.960
35.7
100.0
93.1
33
ZNF540
19
38042530, 38042532
0.991
36.4
100.0
96.6
43
ZNF154
19
58220567
0.956
13.3
92.9
90.9
44
ZNF154
19
58220627
0.966
14.8
85.7
95.5
45
ZNF154
19
58220657, 58220662
0.959
22.2
92.9
95.5
149
ZNF671
19
58238780
0.954
15.2
85.7
89.7
158
ZNF671
19
58238928
0.965
10.5
100.0
88.5
160
ZNF671
19
58238954
0.954
15.2
85.7
89.7
161
ZNF671
19
58238987
0.954
15.2
85.7
89.7
163
ZNF671
19
58239012
0.951
10.5
85.7
92.0
1ID of CpG unit is defined in Additional file 4: Table S4.
2National Center for Biotechnology Information (NCBI) Database (Genome Build 37).
3The Youden index was used as a cutoff value for discriminating CIMP-positive ccRCCs in the learning cohort from CIMP-negative ccRCCs. When the cancerous tissue shows a DNA methylation level equal to or higher than the cutoff value, the ccRCC is considered to be CIMP-positive; when the cancerous tissue shows a DNA methylation level lower than the cutoff value, the ccRCC is considered to be CIMP-negative.
4Sensitivity and specificity for discrimination of CIMP-positive ccRCCs in the learning cohort from CIMP-negative ccRCCs using individual CpG units.
Figure 2A shows scattergrams of the DNA methylation levels of representative CpG units in CIMP-negative and CIMP-positive ccRCCs in the learning cohort along with cutoff values listed in Table 1. The sensitivity and specificity of such discrimination using the cutoff values derived for each CpG unit are shown in Figure 2A and Table 1. A histogram showing the number of CpG units showing DNA methylation levels higher than the cutoff values listed in Table 1 in the learning cohort is shown in Figure 2B. All 14 ccRCCs showing DNA methylation levels higher than the cutoff values listed in Table 1 at 16 or more CpG units based on the present MassARRAY analysis (red bars in Figure 2B) were CIMP-positive ccRCCs identified by our previous hierarchical clustering based on the Infinium assay. All 88 ccRCCs showing DNA methylation levels higher than the cutoff values listed in Table 1 at less than 16 CpG units based on the present MassARRAY analysis (blue bars in Figure 2B) were CIMP-negative ccRCCs identified by our previous hierarchical clustering based on the Infinium assay.
Based on Figure 2B, we established the following criteria: when ccRCC tissue shows DNA methylation levels higher than the cutoff values listed in Table 1 at 16 or more CpG units (green line in Figure 2B), it is judged to be CIMP-positive. When ccRCC tissue shows DNA methylation levels higher than the cutoff values listed in Table 1 at less than 16 CpG units, it is judged to be CIMP-negative. Using these criteria, CIMP-positive ccRCCs in the learning cohort were discriminated from CIMP-negative ccRCCs with 100% sensitivity and specificity.

Prognostic impact of CIMP diagnosis in the validation cohort

It has previously been revealed that patients with CIMP-positive ccRCCs show a poorer outcome [7]. Therefore, we attempted to validate the prognostic impact of CIMP diagnosis using criteria based on the cutoff values listed in Table 1. Using the additional 100 ccRCCs in the validation cohort, DNA methylation levels at the 23 CpG units including the 32 CpG sites in Table 1 were evaluated quantitatively using the MassARRAY system. The DNA methylation statuses of the 100 ccRCCs in the validation cohort were used to construct a histogram showing the number of CpG units with DNA methylation levels higher than the cutoff values listed in Table 1 (Figure 2C). The distribution of DNA methylation status at the 23 CpG units of the ccRCCs in the validation cohort (Figure 2C) was similar to that in the learning cohort (Figure 2B). Based on the criteria for CIMP diagnosis established using the learning cohort, 5 ccRCCs showing DNA methylation levels higher than the cutoff values listed in Table 1 at 16 or more CpG units were diagnosed as CIMP-positive, whereas 95 ccRCCs showing such higher DNA methylation levels at less than 16 CpG units were diagnosed as CIMP-negative.
Survival curves of the 100 patients belonging to the validation cohort were calculated by the Kaplan-Meier method (Figure 3). The period covered ranged from 27 to 5,031 days (mean: 1,860 days). Cancer-free (Figure 3A) and overall (Figure 3B) survival rates of patients with CIMP-positive ccRCCs diagnosed using the criteria based on the cutoff values listed in Table 1 were significantly lower than those of patients with CIMP-negative ccRCCs (P = 1.41 × 10−5 and 2.43 × 10−13, respectively, log-rank test).
Among 5 ccRCCs diagnosed as CIMP-positive in the validation cohort, one tumor was grade 2, two were grade 3, and two were grade 4 (Figure 2C); four were stage III and one was stage IV. Even after adjusting the grades, the cancer-free (P = 1.01 × 10−3) and overall (P = 7.04 × 10−4) survival rates of patients with CIMP-positive high-grade (grades 3 and 4) ccRCCs were significantly lower than those of patients with CIMP-negative high-grade (grades 3 and 4) ccRCCs (log-rank test, Additional file 9: Figure S3). The cancer-free (P = 7.76 × 10−4) and overall (P = 5.48 × 10−5) survival rates of patients with CIMP-positive high-stage (stages III and IV) ccRCCs were significantly lower than those of patients with CIMP-negative high-stage (stages III and IV) ccRCCs in the validation cohort (log-rank test, Additional file 9: Figure S3).
When compared with CIMP-negative ccRCCs, the CIMP-positive ccRCCs in the validation cohort had a significantly higher likelihood of recurrence (hazard ratio, 10.6; 95 percent confidence interval, 2.81 to 40.2; P = 5.03 × 10−4), and of disease-related death (hazard ratio, 75.8; 95 percent confidence interval, 7.81 to 735; P = 1.89 × 10−4) (Cox proportional hazards model). These data indicated that the validation cohort clearly demonstrated the prognostic significance of the criteria for CIMP diagnosis established in the present study.

Discussion

Since the effectiveness of any therapy for relapsed or metastasized ccRCC is restricted unless it is diagnosed early by close follow-up after nephrectomy [3], significant prognostic criteria need to be established. Unlike alterations of mRNA and protein expression, which can be easily affected by the microenvironment of cancer cells, DNA methylation alterations are stably preserved on DNA double strands by covalent bonds [4, 5]. Therefore, DNA methylation levels at appropriate marker CpG sites would appear to be optimal prognostic indicators if evaluated quantitatively [27].
The present learning cohort comprised 88 CIMP-negative ccRCCs and 14 CIMP-positive ccRCCs: CIMP in the learning cohort was identified using hierarchical clustering based on single CpG-resolution Infinium assay in our previous study [7], which had revealed that CIMP-positive ccRCCs in the learning cohort were clinicopathologically aggressive tumors with a larger diameter, more frequent vascular involvement, infiltrating growth, and renal pelvis invasion, as well as having higher histological grades and pathological TNM stages than CIMP-negative ccRCCs [7] (Additional file 1: Table S1). During the follow-up period after nephrectomy, the cancer-free and overall survival rates of patients with CIMP-positive ccRCCs in the learning cohort were significantly lower than those of patients with CIMP-negative ccRCCs in our previous study [7], indicating that CIMP in ccRCCs might be applicable as a prognostic indicator.
We previously identified ccRCC-specific CIMP marker genes whose DNA methylation levels differed markedly between CIMP-negative and CIMP-positive ccRCCs based on the Infinium assay [7]. Since hierarchical clustering is not applicable to clinical use, in the present study we attempted to establish criteria for CIMP diagnosis that would be applicable to patients admitted to hospitals on an individual basis. The DNA methylation status of all promoter CpG islands, even CpG sites other than the Infinium probe sites, in the CIMP marker genes was evaluated quantitatively using the MassARRAY system, which is known to be suitable for quantification of multiple CpG sites [24]. Moreover, we carefully optimized the experimental conditions for MassARRAY analysis in order to avoid any PCR bias (Additional file 4: Table S4).
It was revealed that the entire promoter CpG islands in all the CIMP marker genes examined, i.e. FAM150A, GRM6, ZNF540, ZFP42, ZNF154, RIMS4, PCDHAC1, KHDRBS2, ASCL2, PRAC, WNT3A, TRH, ZNF671 and SLC13A5, were methylated in CIMP-positive ccRCCs without exception (Figure 1 and Additional file 7: Table S5). Within such promoter CpG islands, there were many CpG sites where DNA methylation levels were useful for discrimination of CIMP-positive ccRCCs in the learning cohort from CIMP-negative ccRCCs (Additional file 8: Table S6). We identified the top 23 CpG units whose AUC values were larger than 0.95 in ROC analysis, and the Youden index was used as a cutoff value for such discrimination in each CpG unit (Table 1). The sensitivity and specificity of each of the 23 CpG units was sufficient for such discrimination (Table 1 and Figure 2A). Moreover, combination of the 23 CpG units generated criteria with 100% sensitivity and specificity for discrimination of CIMP-positive ccRCCs in the learning cohort from CIMP-negative ccRCCs (Figure 2B).
As a validation cohort, an additional 100 ccRCCs that had not been previously subjected to Infinium assay or hierarchical clustering were analyzed. The distribution of DNA methylation levels at the 23 CpG units in the validation cohort (Figure 2C) was quite similar to that in the learning cohort (Figure 2B), indicating that distinct DNA methylation profiles of the 23 CpG units are reproducible in ccRCCs. In the validation cohort, 5 ccRCCs were diagnosed as CIMP-positive based on the criteria established in the present MassARRAY analysis (Table 1). CIMP-positive ccRCCs diagnosed in the validation cohort had significantly lower cancer-free and overall survival rates than those of CIMP-negative ccRCCs (Figure 3). Even after adjusting the grades and stages, the cancer-free and overall survival rates of patients with high-grade (grade 3/4) and high-stage (stage III/IV) CIMP-positive ccRCCs were significantly lower than those of patents with high-grade (grade 3/4) and high-stage (stage III/IV) CIMP-negative ccRCCs (Additional file 9: Figure S3). Moreover, CIMP-positive ccRCCs had a higher likelihood of both recurrence and disease-related death (hazard ratios 10.6 and 75.8, respectively). These data indicated that CIMP of ccRCCs can be reproducibly diagnosed using the criteria established in the present study, and that CIMP diagnosis is useful for prognostication of patients with ccRCCs.
Reproducible diagnosis of CIMP using the criteria established in the present study makes it possible to explore the molecular background of CIMP-positive renal carcinogenesis. Since CIMP-positive ccRCCs show clinicopathological aggressiveness and poorer outcome [7], the molecular pathways participating in CIMP-positive renal carcinogenesis should be clarified and the therapeutic targets of CIMP-positive ccRCCs need to be identified. Even though we [28] and another group [29, 21] reported the results of multilayer omics analyses in ccRCCs, such reports did not focus on CIMP. Therefore we are now performing multilayer omics (i.e. genome (whole-exome), transcriptome and proteome) analyses of tissue specimens from CIMP-negative and -positive ccRCCs. Frequently affected molecular pathways that might potentially become therapeutic targets are now being identified in more aggressive CIMP-positive ccRCCs (unpublished data).
The criteria for CIMP diagnosis established in the present study may be useful for not only prognostication but also companion diagnostics for personalized medicine [30]. If our CIMP diagnosis reveals CIMP-negativity in samples of tumor tissue obtained by nephrectomy, the risk of recurrence and metastasis would be considered low, and such patients would not require adjuvant therapy. On the other hand, if our CIMP diagnosis reveals CIMP-positivity, then the risk of recurrence and metastasis would be considered high. Therefore, close follow-up and frequent imaging diagnosis are recommended for early diagnosis of recurrence. In addition, inhibitors for frequently affected molecular pathways identified by multilayer omics analysis in CIMP-positive ccRCCs might be effective after recurrence. If further preclinical examinations support the effectiveness of adjuvant therapy using inhibitors for frequently affected molecular pathways in CIMP-positive ccRCCs, such adjuvant therapy may be recommended immediately after nephrectomy in patients with CIMP-positive ccRCCs.

Conclusions

CIMP of ccRCCs is characterized by accumulation of DNA methylation at CpG islands and poorer patient outcome. Based on quantification of DNA methylation levels of the ccRCC-specific CIMP marker genes, the criteria for CIMP diagnosis have been established. CIMP of ccRCCs can be reproducibly diagnosed using the criteria established in the present study. The prognostic significance of the criteria has been clearly validated in the validation cohort. Frequently affected molecular pathways that might potentially become therapeutic targets are now being identified using multilayer omics analyses in more aggressive CIMP-positive ccRCCs. The criteria for CIMP diagnosis may be useful for not only prognostication but also companion diagnostics for personalized medicine.

Author’s contributions

EA and YK were responsible for the study design, development of the analysis plan and study management. YT, EA, and MG performed MassARRAY and statistical analyses. EA, MK, HF and YK collected tissue samples and performed clinicopathological analysis. YT, EA and YK interpreted the data and prepared the manuscript. All authors read and approved the final manuscript.

Acknowledgments

This work was supported by The Program for Promotion of Fundamental Studies in Health Sciences (10–42) of the National Institute of Biomedical Innovation (NiBio), Japan, A Grant-in-Aid for the Third Term Comprehensive 10-Year Strategy for Cancer Control (19140201) from the Ministry of Health, Labor and Welfare of Japan and Grants-in-Aid for Scientific Research (B) (23390090) and (C) (25460487) from the Japan Society for the Promotion of Science (JSPS), Japan. National Cancer Center Biobank is supported by the National Cancer Center Research and Development Fund (23A-1), Japan.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
The Creative Commons Public Domain Dedication waiver (https://​creativecommons.​org/​publicdomain/​zero/​1.​0/​) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Competing interests

The authors declare that they have no competing interests.
Anhänge

Electronic supplementary material

Authors’ original submitted files for images

Literatur
1.
Zurück zum Zitat Ljungberg B, Campbell SC, Choi HY, Jacqmin D, Lee JE, Weikert S, Kiemeney LA: The epidemiology of renal cell carcinoma. Eur Urol. 2011, 60: 615-621. 10.1016/j.eururo.2011.06.049.CrossRefPubMed Ljungberg B, Campbell SC, Choi HY, Jacqmin D, Lee JE, Weikert S, Kiemeney LA: The epidemiology of renal cell carcinoma. Eur Urol. 2011, 60: 615-621. 10.1016/j.eururo.2011.06.049.CrossRefPubMed
2.
Zurück zum Zitat Donat SM, Diaz M, Bishoff JT, Coleman JA, Dahm P, Derweesh IH, Herrell SD, Hilton S, Jonasch E, Lin DW, Reuter VE, Chang SS: Follow-up for clinically localized renal neoplasms: AUA guideline. J Urol. 2013, 190: 407-416. 10.1016/j.juro.2013.04.121.CrossRefPubMed Donat SM, Diaz M, Bishoff JT, Coleman JA, Dahm P, Derweesh IH, Herrell SD, Hilton S, Jonasch E, Lin DW, Reuter VE, Chang SS: Follow-up for clinically localized renal neoplasms: AUA guideline. J Urol. 2013, 190: 407-416. 10.1016/j.juro.2013.04.121.CrossRefPubMed
3.
Zurück zum Zitat Logan JE, Rampersaud EN, Sonn GA, Chamie K, Belldegrun AS, Pantuck AJ, Slamon DJ, Kabbinavar FF: Systemic therapy for metastatic renal cell carcinoma: a review and update. Rev Urol. 2012, 14: 65-78.PubMedPubMedCentral Logan JE, Rampersaud EN, Sonn GA, Chamie K, Belldegrun AS, Pantuck AJ, Slamon DJ, Kabbinavar FF: Systemic therapy for metastatic renal cell carcinoma: a review and update. Rev Urol. 2012, 14: 65-78.PubMedPubMedCentral
5.
Zurück zum Zitat Baylin SB, Jones PA: A decade of exploring the cancer epigenome - biological and translational implications. Nat Rev Cancer. 2011, 11: 726-734. 10.1038/nrc3130.CrossRefPubMedPubMedCentral Baylin SB, Jones PA: A decade of exploring the cancer epigenome - biological and translational implications. Nat Rev Cancer. 2011, 11: 726-734. 10.1038/nrc3130.CrossRefPubMedPubMedCentral
6.
Zurück zum Zitat Kanai Y: Genome-wide DNA methylation profiles in precancerous conditions and cancers. Cancer Sci. 2010, 101: 36-45. 10.1111/j.1349-7006.2009.01383.x.CrossRefPubMed Kanai Y: Genome-wide DNA methylation profiles in precancerous conditions and cancers. Cancer Sci. 2010, 101: 36-45. 10.1111/j.1349-7006.2009.01383.x.CrossRefPubMed
7.
Zurück zum Zitat Arai E, Chiku S, Mori T, Gotoh M, Nakagawa T, Fujimoto H, Kanai Y: Single-CpG-resolution methylome analysis identifies clinicopathologically aggressive CpG island methylator phenotype clear cell renal cell carcinomas. Carcinogenesis. 2012, 33: 1487-1493. 10.1093/carcin/bgs177.CrossRefPubMedPubMedCentral Arai E, Chiku S, Mori T, Gotoh M, Nakagawa T, Fujimoto H, Kanai Y: Single-CpG-resolution methylome analysis identifies clinicopathologically aggressive CpG island methylator phenotype clear cell renal cell carcinomas. Carcinogenesis. 2012, 33: 1487-1493. 10.1093/carcin/bgs177.CrossRefPubMedPubMedCentral
8.
Zurück zum Zitat Arai E, Wakai-Ushijima S, Fujimoto H, Hosoda F, Shibata T, Kondo T, Yokoi S, Imoto I, Inazawa J, Hirohashi S, Kanai Y: Genome-wide DNA methylation profiles in renal tumors of various histological subtypes and non-tumorous renal tissues. Pathobiology. 2011, 78: 1-9. 10.1159/000322072.CrossRefPubMed Arai E, Wakai-Ushijima S, Fujimoto H, Hosoda F, Shibata T, Kondo T, Yokoi S, Imoto I, Inazawa J, Hirohashi S, Kanai Y: Genome-wide DNA methylation profiles in renal tumors of various histological subtypes and non-tumorous renal tissues. Pathobiology. 2011, 78: 1-9. 10.1159/000322072.CrossRefPubMed
9.
Zurück zum Zitat Arai E, Ushijima S, Fujimoto H, Hosoda F, Shibata T, Kondo T, Yokoi S, Imoto I, Inazawa J, Hirohashi S, Kanai Y: Genome-wide DNA methylation profiles in both precancerous conditions and clear cell renal cell carcinomas are correlated with malignant potential and patient outcome. Carcinogenesis. 2009, 30: 214-221.CrossRefPubMed Arai E, Ushijima S, Fujimoto H, Hosoda F, Shibata T, Kondo T, Yokoi S, Imoto I, Inazawa J, Hirohashi S, Kanai Y: Genome-wide DNA methylation profiles in both precancerous conditions and clear cell renal cell carcinomas are correlated with malignant potential and patient outcome. Carcinogenesis. 2009, 30: 214-221.CrossRefPubMed
10.
Zurück zum Zitat Arai E, Kanai Y, Ushijima S, Fujimoto H, Mukai K, Hirohashi S: Regional DNA hypermethylation and DNA methyltransferase (DNMT) 1 protein overexpression in both renal tumors and corresponding nontumorous renal tissues. Int J Cancer. 2006, 119: 288-296. 10.1002/ijc.21807.CrossRefPubMed Arai E, Kanai Y, Ushijima S, Fujimoto H, Mukai K, Hirohashi S: Regional DNA hypermethylation and DNA methyltransferase (DNMT) 1 protein overexpression in both renal tumors and corresponding nontumorous renal tissues. Int J Cancer. 2006, 119: 288-296. 10.1002/ijc.21807.CrossRefPubMed
11.
Zurück zum Zitat Rydzanicz M, Wrzesiński T, Bluyssen HA, Wesoły J: Genomics and epigenomics of clear cell renal cell carcinoma: Recent developments and potential applications. Cancer Lett. 2013, 341: 111-126. 10.1016/j.canlet.2013.08.006.CrossRefPubMed Rydzanicz M, Wrzesiński T, Bluyssen HA, Wesoły J: Genomics and epigenomics of clear cell renal cell carcinoma: Recent developments and potential applications. Cancer Lett. 2013, 341: 111-126. 10.1016/j.canlet.2013.08.006.CrossRefPubMed
12.
Zurück zum Zitat Issa JP: CpG island methylator phenotype in cancer. Nat Rev Cancer. 2004, 4: 988-993. 10.1038/nrc1507.CrossRefPubMed Issa JP: CpG island methylator phenotype in cancer. Nat Rev Cancer. 2004, 4: 988-993. 10.1038/nrc1507.CrossRefPubMed
13.
Zurück zum Zitat Toyota M, Ahuja N, Ohe-Toyota M, Herman JG, Baylin SB, Issa JP: CpG island methylator phenotype in colorectal cancer. Proc Natl Acad Sci U S A. 1999, 96: 8681-8686. 10.1073/pnas.96.15.8681.CrossRefPubMedPubMedCentral Toyota M, Ahuja N, Ohe-Toyota M, Herman JG, Baylin SB, Issa JP: CpG island methylator phenotype in colorectal cancer. Proc Natl Acad Sci U S A. 1999, 96: 8681-8686. 10.1073/pnas.96.15.8681.CrossRefPubMedPubMedCentral
14.
Zurück zum Zitat Shen L, Toyota M, Kondo Y, Lin E, Zhang L, Guo Y, Hernandez NS, Chen X, Ahmed S, Konishi K, Hamilton SR, Issa JP: Integrated genetic and epigenetic analysis identifies three different subclasses of colon cancer. Proc Natl Acad Sci U S A. 2007, 104: 18654-18659. 10.1073/pnas.0704652104.CrossRefPubMedPubMedCentral Shen L, Toyota M, Kondo Y, Lin E, Zhang L, Guo Y, Hernandez NS, Chen X, Ahmed S, Konishi K, Hamilton SR, Issa JP: Integrated genetic and epigenetic analysis identifies three different subclasses of colon cancer. Proc Natl Acad Sci U S A. 2007, 104: 18654-18659. 10.1073/pnas.0704652104.CrossRefPubMedPubMedCentral
15.
Zurück zum Zitat Toyota M, Ahuja N, Suzuki H, Itoh F, Ohe-Toyota M, Imai K, Baylin SB, Issa JP: Aberrant methylation in gastric cancer associated with the CpG island methylator phenotype. Cancer Res. 1999, 59: 5438-5442.PubMed Toyota M, Ahuja N, Suzuki H, Itoh F, Ohe-Toyota M, Imai K, Baylin SB, Issa JP: Aberrant methylation in gastric cancer associated with the CpG island methylator phenotype. Cancer Res. 1999, 59: 5438-5442.PubMed
16.
Zurück zum Zitat Morris MR, Maher ER: Epigenetics of renal cell carcinoma: the path towards new diagnostics and therapeutics. Genome Med. 2010, 2: 59-10.1186/gm180.CrossRefPubMedPubMedCentral Morris MR, Maher ER: Epigenetics of renal cell carcinoma: the path towards new diagnostics and therapeutics. Genome Med. 2010, 2: 59-10.1186/gm180.CrossRefPubMedPubMedCentral
17.
Zurück zum Zitat Bibikova M, Le J, Barnes B, Saedinia-Melnyk S, Zhou L, Shen R, Gunderson KL: Genome-wide DNA methylation profiling using Infinium® assay. Epigenomics. 2009, 1: 177-200. 10.2217/epi.09.14.CrossRefPubMed Bibikova M, Le J, Barnes B, Saedinia-Melnyk S, Zhou L, Shen R, Gunderson KL: Genome-wide DNA methylation profiling using Infinium® assay. Epigenomics. 2009, 1: 177-200. 10.2217/epi.09.14.CrossRefPubMed
18.
Zurück zum Zitat Eble JN, Sauter G, Epstein JI, Sesterhenn IA: Renal cell carcinoma. World Health Organization classification of tumours. Pathology and genetics. Tumours of the urinary system and male genital organs. 2004, Lyon: IARC Press, 10-43. Eble JN, Sauter G, Epstein JI, Sesterhenn IA: Renal cell carcinoma. World Health Organization classification of tumours. Pathology and genetics. Tumours of the urinary system and male genital organs. 2004, Lyon: IARC Press, 10-43.
19.
Zurück zum Zitat Fuhrman SA, Lasky LC, Limas C: Prognostic significance of morphologic parameters in renal cell carcinoma. Am J Surg Pathol. 1982, 6: 655-663. 10.1097/00000478-198210000-00007.CrossRefPubMed Fuhrman SA, Lasky LC, Limas C: Prognostic significance of morphologic parameters in renal cell carcinoma. Am J Surg Pathol. 1982, 6: 655-663. 10.1097/00000478-198210000-00007.CrossRefPubMed
20.
Zurück zum Zitat Sobin LH, Wittekind C: International Union Against Cancer (UICC). TNM classification of malignant tumors. 2002, New York: Wiley-Liss, 193-195. 6 Sobin LH, Wittekind C: International Union Against Cancer (UICC). TNM classification of malignant tumors. 2002, New York: Wiley-Liss, 193-195. 6
21.
Zurück zum Zitat The Cancer Genome Atlas Research Network: Comprehensive molecular characterization of clear cell renal cell carcinoma. Nature. 2013, 499: 43-49. 10.1038/nature12222.CrossRefPubMedCentral The Cancer Genome Atlas Research Network: Comprehensive molecular characterization of clear cell renal cell carcinoma. Nature. 2013, 499: 43-49. 10.1038/nature12222.CrossRefPubMedCentral
22.
Zurück zum Zitat Sambrook J, Fritsch EF, Maniatis T: Molecular Cloning: A Laboratory Manual. 2001, New York: Cold Spring Harbor Laboratory Press, 6.14-6.15. 3 Sambrook J, Fritsch EF, Maniatis T: Molecular Cloning: A Laboratory Manual. 2001, New York: Cold Spring Harbor Laboratory Press, 6.14-6.15. 3
23.
Zurück zum Zitat Clark SJ, Harrison J, Paul CL, Frommer M: High sensitivity mapping of methylated cytosines. Nucleic Acids Res. 1994, 22: 2990-2997. 10.1093/nar/22.15.2990.CrossRefPubMedPubMedCentral Clark SJ, Harrison J, Paul CL, Frommer M: High sensitivity mapping of methylated cytosines. Nucleic Acids Res. 1994, 22: 2990-2997. 10.1093/nar/22.15.2990.CrossRefPubMedPubMedCentral
24.
Zurück zum Zitat Jurinke C, Denissenko MF, Oeth P, Ehrich M, van den Boom D, Cantor CR: A single nucleotide polymorphism based approach for the identification and characterization of gene expression modulation using MassARRAY. Mutat Res. 2005, 573: 83-95. 10.1016/j.mrfmmm.2005.01.007.CrossRefPubMed Jurinke C, Denissenko MF, Oeth P, Ehrich M, van den Boom D, Cantor CR: A single nucleotide polymorphism based approach for the identification and characterization of gene expression modulation using MassARRAY. Mutat Res. 2005, 573: 83-95. 10.1016/j.mrfmmm.2005.01.007.CrossRefPubMed
25.
Zurück zum Zitat Fan J, Upadhye S, Worster A: Understanding receiver operating characteristic (ROC) curves. CJEM. 2006, 8: 19-20.PubMed Fan J, Upadhye S, Worster A: Understanding receiver operating characteristic (ROC) curves. CJEM. 2006, 8: 19-20.PubMed
26.
Zurück zum Zitat Akobeng AK: Understanding diagnostic tests 3: Receiver operating characteristic curves. Acta Paediatr. 2007, 96: 644-647. 10.1111/j.1651-2227.2006.00178.x.CrossRefPubMed Akobeng AK: Understanding diagnostic tests 3: Receiver operating characteristic curves. Acta Paediatr. 2007, 96: 644-647. 10.1111/j.1651-2227.2006.00178.x.CrossRefPubMed
27.
Zurück zum Zitat Arai E, Kanai Y: DNA methylation profiles in precancerous tissue and cancers: carcinogenetic risk estimation and prognostication based on DNA methylation status. Epigenomics. 2010, 2: 467-481. 10.2217/epi.10.16.CrossRefPubMed Arai E, Kanai Y: DNA methylation profiles in precancerous tissue and cancers: carcinogenetic risk estimation and prognostication based on DNA methylation status. Epigenomics. 2010, 2: 467-481. 10.2217/epi.10.16.CrossRefPubMed
28.
Zurück zum Zitat Arai E, Sakamoto H, Ichikawa H, Totsuka H, Chiku S, Gotoh M, Mori T, Nakatani T, Ohnami S, Nakagawa T, Fujimoto H, Wang L, Aburatani H, Yoshida T, Kanai Y: Multilayer-omics analysis of renal cell carcinoma, including the whole exome, methylome and transcriptome. Int J Cancer. 2014, 135: 1330-1342. 10.1002/ijc.28768.CrossRefPubMedPubMedCentral Arai E, Sakamoto H, Ichikawa H, Totsuka H, Chiku S, Gotoh M, Mori T, Nakatani T, Ohnami S, Nakagawa T, Fujimoto H, Wang L, Aburatani H, Yoshida T, Kanai Y: Multilayer-omics analysis of renal cell carcinoma, including the whole exome, methylome and transcriptome. Int J Cancer. 2014, 135: 1330-1342. 10.1002/ijc.28768.CrossRefPubMedPubMedCentral
29.
Zurück zum Zitat Sato Y, Yoshizato T, Shiraishi Y, Maekawa S, Okuno Y, Kamura T, Shimamura T, Sato-Otsubo A, Nagae G, Suzuki H, Nagata Y, Yoshida K, Kon A, Suzuki Y, Chiba K, Tanaka H, Niida A, Fujimoto A, Tsunoda T, Morikawa T, Maeda D, Kume H, Sugano S, Fukayama M, Aburatani H, Sanada M, Miyano S, Homma Y, Ogawa S: Integrated molecular analysis of clear-cell renal cell carcinoma. Nat Genet. 2013, 45: 860-867. 10.1038/ng.2699.CrossRefPubMed Sato Y, Yoshizato T, Shiraishi Y, Maekawa S, Okuno Y, Kamura T, Shimamura T, Sato-Otsubo A, Nagae G, Suzuki H, Nagata Y, Yoshida K, Kon A, Suzuki Y, Chiba K, Tanaka H, Niida A, Fujimoto A, Tsunoda T, Morikawa T, Maeda D, Kume H, Sugano S, Fukayama M, Aburatani H, Sanada M, Miyano S, Homma Y, Ogawa S: Integrated molecular analysis of clear-cell renal cell carcinoma. Nat Genet. 2013, 45: 860-867. 10.1038/ng.2699.CrossRefPubMed
30.
Zurück zum Zitat Ziegler A, Koch A, Krockenberger K, Grosshennig A: Personalized medicine using DNA biomarkers: a review. Hum Genet. 2012, 131: 1627-1638. 10.1007/s00439-012-1188-9.CrossRefPubMedPubMedCentral Ziegler A, Koch A, Krockenberger K, Grosshennig A: Personalized medicine using DNA biomarkers: a review. Hum Genet. 2012, 131: 1627-1638. 10.1007/s00439-012-1188-9.CrossRefPubMedPubMedCentral
Metadaten
Titel
Prognostication of patients with clear cell renal cell carcinomas based on quantification of DNA methylation levels of CpG island methylator phenotype marker genes
verfasst von
Ying Tian
Eri Arai
Masahiro Gotoh
Motokiyo Komiyama
Hiroyuki Fujimoto
Yae Kanai
Publikationsdatum
01.12.2014
Verlag
BioMed Central
Erschienen in
BMC Cancer / Ausgabe 1/2014
Elektronische ISSN: 1471-2407
DOI
https://doi.org/10.1186/1471-2407-14-772

Weitere Artikel der Ausgabe 1/2014

BMC Cancer 1/2014 Zur Ausgabe

Update Onkologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.