http://orcid.org/0000-0001-7662-8724
Figures
Abstract
Objectives
The clinical management of meningioma is guided by tumor grade and biological behavior. Currently, the assessment of tumor grade follows surgical resection and histopathologic review. Reliable techniques for pre-operative determination of tumor grade may enhance clinical decision-making.
Methods
A total of 175 meningioma patients (103 low-grade and 72 high-grade) with pre-operative contrast-enhanced T1-MRI were included. Fifteen radiomic (quantitative) and 10 semantic (qualitative) features were applied to quantify the imaging phenotype. Area under the curve (AUC) and odd ratios (OR) were computed with multiple-hypothesis correction. Random-forest classifiers were developed and validated on an independent dataset (n = 44).
Results
Twelve radiographic features (eight radiomic and four semantic) were significantly associated with meningioma grade. High-grade tumors exhibited necrosis/hemorrhage (ORsem = 6.6, AUCrad = 0.62–0.68), intratumoral heterogeneity (ORsem = 7.9, AUCrad = 0.65), non-spherical shape (AUCrad = 0.61), and larger volumes (AUCrad = 0.69) compared to low-grade tumors. Radiomic and sematic classifiers could significantly predict meningioma grade (AUCsem = 0.76 and AUCrad = 0.78). Furthermore, combining them increased the classification power (AUCradio = 0.86). Clinical variables alone did not effectively predict tumor grade (AUCclin = 0.65) or show complementary value with imaging data (AUCcomb = 0.84).
Citation: Coroller TP, Bi WL, Huynh E, Abedalthagafi M, Aizer AA, Greenwald NF, et al. (2017) Radiographic prediction of meningioma grade by semantic and radiomic features. PLoS ONE 12(11): e0187908. https://doi.org/10.1371/journal.pone.0187908
Editor: Johan Pallud, Centre Hospitalier Sainte Anne, FRANCE
Received: March 21, 2017; Accepted: October 28, 2017; Published: November 16, 2017
Copyright: © 2017 Coroller et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files. The relevant imaging and clinical data cannot be shared publicly due to restrictions imposed by the institutional IRB. However, interested researchers may request access to study data by contacting the corresponding author (tcoroller@lroc.harvard.edu).
Funding: Authors acknowledge financial support from the National Institute of Health (NIH-USA U24CA194354, and NIH-USA U01CA190234). This project was partially funded by the Kaye Scholar Award, the Brigham and Women's Hospital Department of Radiation Oncology Clinical Translational Grant, and King Abdulaziz City for Science and Technology grant (MA).
Competing interests: The authors have declared that no competing interests exist.
Introduction
Meningiomas are the most common primary brain tumor in adults, with most considered benign by the World Health Organization histopathologic criteria (WHO grade I)[1,2]. A distinct and increasing proportion of meningiomas are deemed high-grade (WHO grade II-III) and recur despite aggressive treatment, leading to substantial morbidity. Standard-of-care management typically involves surgical resection and often radiation therapy for high-grade (grade II-III) or progressive tumors.
Currently, the assessment of tumor grade occurs once a mass is resected and histopathological review is performed. Upon detection of a mass lesion that displays radiological features suggestive of meningioma, reliable parameters do not exist that can predict tumor grade and the associated clinical course. For example, clinical information such as age and gender show poor association with grade. Non-invasive and early predictors of meningioma grade may enhance clinical decision-making by providing prognostic information that could guide the decision of whether to observe or to treat.
The radiographic appearance of a tumor can be described using both quantitative and qualitative measures (Fig 1). Radiomics is an emerging field of quantitative imaging focused on leveraging large sets of imaging features to create an atlas[3–9] that would foster the automatic, reproducible, and unbiased assessment of active clinical cases[10–13]. In comparison, semantic features are tumor traits (e.g. bone invasion, necrosis) that are assessed visually by radiologists. While semantic features are highly intuitive, they are inherently subject to inter-observer variability. Both radiomic[14–29] and semantic[30–33] features have been applied as prognostic biological signatures, and therefore, may offer complementary streams to predict clinical status.
A) Potential impact of radiographic features on meningioma patient management. Pre-operative radiographic assessment of grade may improve the ability to tailor precision medicine decision trees to individual patients. B) A combined model of semantic and radiomic radiographic features was used to predict meningioma grade and validated on an independent cohort of meningiomas.
In this study, we investigated the value of radiomic and semantic imaging features for predicting the histologic grade of meningiomas from preoperative gadolinium-enhanced T1-weighted MRI.
Methods
This study was reviewed and approved by the Brigham and Women’s Hospital institutional review boards (IRB). Patient consent was waived by IRB protocol. All methods were performed in accordance with the relevant guidelines and regulations.
Patient data
A total of 181 meningiomas resected at our institution between 2003 and 2014 were reviewed for histopathology and imaging. Pre-operative gadolinium-enhanced T1-weighted MRI sequences were chosen for analysis to represent the most frequently reviewed images for meningiomas. Six cases with motion artifact were excluded from analyses.
Histopathologic review of all tumors was performed by two board-certified neuropathologists (S.S., M.A.). Meningiomas were graded according to the 2007 World Health Organization (WHO) classification system [1]. The data were additionally reviewed according to the 2016 WHO classification system to assess any potential impact that the inclusion of brain invasion as a formal diagnostic criterion for grade II meningiomas might have on their association with imaging features. In this study, low and high grade refers to grade I and grade II/III, respectively. Atypical features for meningiomas were individually tabulated [34].
Image-based phenotyping
In this study, semantic (qualitative) and radiomic (quantitative) feature quantification was applied to preoperative MRI (Fig 1B, Table 1). The standard preoperative imaging protocol for intracranial tumors include a high-resolution gadolinium-enhanced T1-weighted 3D MPRAGE or SPGR sequence, acquired on a 1.5T or 3T scanner. For patients who had had serial imaging prior to surgery, we analyzed the MRI that was acquired closest to the date of surgery. We exported images into 3D Slicer[35] for editing and reconstructed meningioma volumes from the manual contours of individual axial MRI slices performed by two fully trained neurosurgeons familiar with the radiographic appearance of the meningiomas to limit inclusion of radiologic artifacts. All contours were reviewed by an experienced neuroradiologist (R.H.) to ensure standardization of contouring criteria across the dataset. We applied image processing prior to feature extraction to reduce noise (mean +/- 3 standard deviations) according to well-established MRI-normalization methods. We resampled the voxel dimensions using 3x3x3 mm3 as the common spacing.
Individual descriptions are given for each group and parameter or feature.
Semantic features such as speculation and mass effect are MRI characteristics regularly assessed during the standard evaluation of images from patients with meningiomas. Ten binary (to avoid high inter-observer variability) semantic features were scored by an experienced neuroradiologist (R.H.) whereas radiomic features were extracted from images using a custom Matlab script. A total of 1,055 radiomic features were computed that quantify the tumor phenotype (description in S1 File). We selected fifteen features for this study based on their variance and correlation (Fig 2).
Additionally, we included two tumor size features (maximum axial diameter and volume) in the clinical data set, along with age, gender, and radiation induced status. Tumor location was also classified by two skull base surgery trained neurosurgeons, based on the origin of the meningioma, and clustered into five groups for purposes of analysis: 1) midline skull base, 2) lateral skull base, 3) midline convexity, 4) lateral convexity or 5) other.
Univariate analysis
All statistical analyses were performed in R software version 3.3.1[36]. Our primary endpoint was the potential applicability of radiographic features to predict meningioma grade. The predictive power of semantic features (binary) was evaluated using the odds ratio (OR) and Fisher’s exact test. The predictive power of radiomic features (continuous) was analyzed using the area under the receiver operator characteristics curve (AUC) using the “survcomp” package[37] and Noether’s test.
Additionally, prediction of low grade (grade I) with the presence of atypical features was studied. A subset of the cohort with only low grade meningioma was analyzed, where we compared patients with one or more atypical features (including spontaneous necrosis, high nuclear-to-cytoplasmic ratio, prominent nucleoli, and sheet-like growth) versus none of these features using the same imaging features as for grade prediction. Hypercellularity was almost ubiquitously observed across the meningioma cohort, and therefore, not included as an atypical feature for purposes of analysis.
Finally, the association between radiomic and semantic features was investigated using the AUC. Every semantic feature was predicted by each of the radiomic features in a univariate manner. All p-values were adjusted for multiple hypothesis testing using the false discovery rate method[38].
Multivariate analysis
A temporal split was used to assign patients to a training or validation dataset. Feature selection was based on the training dataset, to ensure independence from the validation dataset (Table A in S1 File). Differences in clinical variables between datasets were assessed using the Fisher’s exact test (for categorical variables) and the Wilcoxon test (for continuous variables).
We investigated five models for grade classification based on: 1) clinical, 2) location, 3) semantic, 4) radiomic, 5) radiographic (combined radiomic and semantic features), and 6) a combined model integrating all features above. Classifications were made using the random forest method from the “randomForest” package [39]. Nested cross validation was used for model tuning and training using the “caret” package on the training set [40], leaving the validation dataset independent from the model selection process. Differences in predictive power between models were assessed using bootstrapping (1,000 iterations).
Results
Clinical cohort
Our cohort of 175 patients was mainly composed of female patients (62%), with a median age of 57 years (Table 2). 59% of cases were low-grade and 41% were high-grade. No differences were observed in WHO grade (p = 0.48), radiation-induced status (p = 0.51), or gender (p = 0.15) between the training and validation datasets.
Radiographic associations with meningioma grade or atypical features
First, examination of individual semantic (qualitative) features revealed significant associations between meningioma grade and four features (Fig 3A.1, Table 3). These features included intratumoral heterogeneity (OR = 7.9, p<0.001), necrosis/hemorrhage (OR = 6.6, p = 0.01), venous sinus invasion (OR = 2.9, p = 0.02), and mass effect (OR = 2.3, p = 0.042). Interestingly, cystic component was not significantly associated with grade despite a high OR (6.8, p = 0.13), which is likely due a low incidence of events (6 cases, 3.4%), which introduces a high margin error. All significant features had an OR greater than one, indicating that higher grade corresponds to an increased incidence of the feature.
A) Heatmap of the predictive power of (1) semantic and (2) radiomic features for meningioma grade (n = 175) or presence of histopathologic atypia in low grade meningiomas (n = 103). B) The association between semantic and radiomic features was investigated. Every semantic feature was predicted with each of the radiomic feature in a univariate manner that indicates their relationship. * indicates significance from random after multiple correction.
Odds ratio, lower and higher 95% confidence interval and p-value (with multiple testing correction) are reported for each features.
Second, we investigated the relationship between radiomic (quantitative) features and meningioma pathology (Fig 3A.2, Table 4). Eight radiomic features were significant from random in their association with tumor grade (range AUC = 0.59 to 0.65, p<0.05). The best performing radiomic feature, high intensity large area emphasis (HILAE), was associated with high grade meningioma (AUC = 0.69, p<0.001). HILAE is sensitive to large zones with high intensities (e.g. hemorrhage). In addition, low intensity large area emphasis (LILAE) was also associated with high grade meningioma (AUC = 0.63, p = 0.008) and is sensitive to large areas of low intensities (e.g. necrosis). These suggest that hemorrhagic or necrotic tumors were more likely to be high grade, consistent with the semantic feature analysis. High values of spherical disproportion (SD), which measures the degree of deviation of a tumor’s shape from a sphere of similar volume, and run length non-uniformity (RLN), which is sensitive to heterogeneity, were both significantly associated with high-grade tumors (AUC = 0.61, p = 0.012 and AUC = 0.65, p = 0.002, respectively).
AUC, lower and higher 95% confidence interval and p-value (with multiple testing correction) are reported for each features.
Additionally, we examined the ability of imaging to distinguish low grade meningiomas with (n = 69) and without (n = 34) one of four atypical features (Fig 3A, Tables B-C in S2 File). While intratumoral heterogeneity and multifocality carried an OR of 1.7 and 2.1, respectively, no significant association was observed between semantic features and the presence of atypical features. In comparison, four radiomic features were significantly associated with atypical features. These features included voxel mean intensity (AUC = 0.68), low intensity small area emphasis (LISAE) (AUC = 0.66), difference entropy (DE) (AUC = 0.66), and cluster prominence (CP) (AUC = 0.65). LISAE indicated that hypointense tumors were more likely to be low grade with atypical features. None of the low grade meningiomas had a cystic component; therefore, this semantic feature was not investigated in this analysis.
Relationship between radiomic and semantic features
We investigated the link between radiomic and semantic features. We found a median AUC of 0.57 (range: 0.50–0.89) between these two categories of features (Fig 3B, Table D in S2 File). A significant interaction between particular pairs of features was found (p<0.05). Spherical disproportion (SD) was associated with mass effect (AUC = 0.61), spiculation (AUC = 0.89), and invasion of bone and venous sinus (AUC of 0.74 and 0.69, respectively). Textural features, such as high intensity large area emphasis (HILAE), run length non-uniformity (RLN) and short run length gray-level (SRLGL) were associated with tumor heterogeneity (AUC = 0.65–0.72), cystic component (AUC = 0.71–0.84), and hemorrhage / necrosis (AUC = 0.70–0.76).
Improving grade classification by combining radiographic features
Given that radiomic and semantic analyses each provide a distinct quantification of the tumor phenotype, we explored whether combining radiomic and semantic features may be synergistic in predicting meningioma grade (Fig 4, Table 5).
“*” indicates p-value <0.05, “***” indicates p-value <0.0001 from random prediction (Noether test).
AUC, lower and higher 95% confidence interval and p-value (from random) are reported for each features.
A model based on clinical data, composed of information available to a clinician prior to MR imaging, did not associate with meningioma grade (AUC = 0.65, p = 0.11). In comparison, location (AUC = 0.67), semantic (AUC = 0.77) and radiomic (AUC = 0.79) models independently classified meningioma grade (p<0.05). Interestingly, a radiographic model that combined both radiomic and semantic features showed an increased performance in the classification of tumor grade (AUC = 0.86, p<0.001). Despite the fact that the performance of the radiographic model was higher than the semantic and radiomic models, it was not significantly better than each alone (p-value = 0.23–0.32). Lastly, adding clinical and location data to the radiographic model did not improve the performance (AUC = 0.84) compared to radiographic features (AUC = 0.86).
Additionally, we verified the validity of the imaging association with meningioma grade using the 2016 WHO guidelines, which includes brain invasion as a formal inclusion criterion for grade II. We observed similar results with the updated WHO criteria as the 2007 criteria, with additional observation of a significant association between the clinical model and pathologic grade (in Fig A, Table E in S2 File), attesting to the robustness of the radiographic association with tumor grade.
Discussion
Meningioma grade is a powerful predictor of clinical outcome and therefore influences patient management, including the decision of whether to observe, operate, or administer adjuvant therapies. Currently, tumor grade can only be determined following surgical resection and histopathological review[41]. A better approach would allow clinicians to discriminate low and high grade meningiomas before surgery, thereby facilitating management decisions and counseling at an earlier stage of clinical care. Such a shift in the diagnostic paradigm would have substantial implications for patient management, particularly in the increasingly common scenario era in which asymptomatic meningiomas are incidentally diagnosed on imaging performed for unrelated reasons. In our study, we sought to develop and test methodologies for the pre-operative diagnostic assessment of meningioma grade using two categories of radiographic data (semantic and radiomic) derived from T1-weighted contrast-enhanced MRI.
We observed strong associations between specific radiographic features and meningioma histologic grade. In particular, heterogeneous tumors with necrosis and/or hemorrhage, and irregularly shaped (non-spherical) tumors were more likely to be higher grade on univariate analysis. Two radiomic features, HILAE and LILAE, were sensitive to high and low intensity large areas, respectively, which are commonly indicative of hemorrhage and necrosis on MR images. Interestingly, both semantic and radiomic features were significantly associated with these traits and their presence indicated an increased likelihood of a high grade tumor. Tumor heterogeneity was also significantly associated with more aggressive meningioma grade in both semantic and radiomic feature analyses.
Irregularities in the shape of meningiomas such as “mushrooming” has been previously associated with high grade tumor in multiple studies[42–45]. Meningioma heterogeneity, on the other hand, is a more complex tumor trait that may be accounted for by a variety of underlying causes, including intratumoral necrosis, cystic degeneration, heterogeneous tumor cell expansion, variability in cell density, and hemorrhage[46,47]. Tumor radiographic heterogeneity has been extensively studied in glioblastoma, lung cancer, renal cell cancer, and other systemic malignancies and is felt to contribute significantly to treatment resistance and disease relapse[48]. Awareness of tumor heterogeneity may play an important role in assessing treatment response in meningiomas as well, given recent and impending clinical trials assessing novel targeted and immune therapies for aggressive meningiomas[49–51].
We further confirmed the ability of radiographic features to classify meningioma grade on an independent validation dataset. Moreover, even though semantic and radiomic features capture some common traits in the tumor (e.g. heterogeneity), the information contained in these “common” features were complementary. Merging both feature sets significantly improved classification performance, indicating an additive effect between qualitative and quantitative imaging analyses. Additionally, tumor location alone was able to classify tumor grade but was not able to improve the combined model once added to the radiographic and clinical information (likely mostly driven by the radiographic features). Clinical data, added for comparison, did not classify patients well nor did it add power to the radiographic model in the validation, although this could be limited by selection bias in the variables analyzed.
Associations between tumor characteristics and pre-operative images have been previously investigated[52]. However, no sets of phenotypic features have been consistently demonstrated to significantly associate with meningioma grade across studies. Differences between meningioma and low grade glioma was investigated using imaging features from T1-weighed and DWI[53], however, the study presented several limitations including a small sample size (n = 15). Some studies investigating imaging features suggest that benign tumors display higher ADC while malignant tumors have lower ADC values[54–56], while others fail to corroborate a similar relationship [57–59]. These conflicting results may be due to technical factors, such as the region of interest (ROI) defined and feature standardization[59,60].
Likewise, our study faces several limitations. Variations in image acquisition and quality can influence quantitative analyses. We attempted to standardize the uniformity of scans by resampling all images with a common voxel spacing to ensure dimension homogeneity and by filtering voxel intensities to reduce outlier values. Additionally, the semantic features are reported by human thus are subject to inter-observer variability. To reduce this variation, we used largely binary features to simply the output, as compared to a more complex scale (such as a score from 1 to 5) which have been suggested to associate with more inter-observer variability [61]. We used a temporal split to obtain an independent validation dataset, with comparable demographics between the cohorts, in attempt to internally validate our results. External validation from multiple institutions would strengthen these observations in the future. Our clinical model was predicated on common non-radiographic variables that may influence tumor behavior, but may reflect selection bias and data availability in this single-institution cohort.
In conclusion, we found a radiographic signature for meningioma grade using standard pre-operative contrast-enhanced MR images. We demonstrated that there is a strong link between the radiographic phenotype of a tumor and its pathology, which may provide a useful tool for precision medicine. Early and accurate prediction of meningioma grade may influence the decision to observe a tumor or to pursue surgery and earlier consideration of adjuvant therapies. Our study highlights the potential clinical impact of integrative imaging analysis in guiding meningioma management.
Supporting information
S1 File. Table A.
Description of the training radiomic set. Individual description is given for every features.
https://doi.org/10.1371/journal.pone.0187908.s001
(DOCX)
S2 File.
Table B Univariate results for the semantic features. Odds ratio, lower and higher 95% confidence interval and p-value (with multiple testing correction) are reported for each features. Table C Univariate results for the radiomic features. AUC, lower and higher 95% confidence interval and p-value (with multiple testing correction) are reported for each features. Table D. Association between radiomic and semantic features was investigated using AUC. Table E. Meningioma classification validation (n = 44) for each model is reported using the WHO 2016. AUC, lower and higher 95% confidence interval and p-value (from random) are reported for each features. Fig A. Area under the curve (AUC) from random forest models on the independent validation set (n = 44) for meningioma WHO 2016 grade classification. “*” indicates p-value <0.05, “***” indicates p-value <0.0001 from random prediction (Noether test).
https://doi.org/10.1371/journal.pone.0187908.s002
(DOCX)
References
- 1. Louis DN, Ohgaki H, Wiestler OD, Cavenee WK, Burger PC, Jouvet A, et al. The 2007 WHO Classification of Tumours of the Central Nervous System. Acta Neuropathol (Berl). 2007;114: 97–109. pmid:17618441
- 2. Bondy M, Ligon BL. Epidemiology and etiology of intracranial meningiomas: a review. J Neurooncol. 1996;29: 197–205. pmid:8858525
- 3. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RGPM, Granton P, et al. Radiomics: Extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48: 441–446. pmid:22257792
- 4. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More than Pictures, They Are Data. Radiology. 2015; 151169. pmid:26579733
- 5. Aerts HJWL. The Potential of Radiomic-Based Phenotyping in Precision Medicine: A Review. JAMA Oncol. 2016; pmid:27541161
- 6. Larue RTHM, Defraene G, De Ruysscher D, Lambin P, van Elmpt W. Quantitative radiomics studies for tissue characterization: A review of technology and methodological procedures. Br J Radiol. 2016; 20160665. pmid:27936886
- 7. Kumar V, Gu Y, Basu S, Berglund A, Eschrich SA, Schabath MB, et al. Radiomics: the process and the challenges. Magn Reson Imaging. 2012;30: 1234–1248. pmid:22898692
- 8. Yip SSF, Aerts HJWL. Applications and limitations of radiomics. Phys Med Biol. 2016;61: R150–R166. pmid:27269645
- 9. Hatt M, Tixier F, Visvikis D, Cheze Le Rest C. Radiomics in PET/CT: more than meets the eye? J Nucl Med. 2016; pmid:27811126
- 10. Balagurunathan Y, Gu Y, Wang H, Kumar V, Grove O, Hawkins S, et al. Reproducibility and Prognosis of Quantitative Features Extracted from CT Images. Transl Oncol. 2014;7: 72–87. pmid:24772210
- 11. Fried DV, Tucker SL, Zhou S, Liao Z, Mawlawi O, Ibbott G, et al. Prognostic Value and Reproducibility of Pretreatment CT Texture Features in Stage III Non-Small Cell Lung Cancer. Int J Radiat Oncol. 2014; pmid:25220716
- 12. Parmar C, Rios Velazquez E, Leijenaar R, Jermoumi M, Carvalho S, Mak RH, et al. Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation. Woloschak GE, editor. PLoS ONE. 2014;9: e102107. pmid:25025374
- 13. Zhao B, Tan Y, Tsai W-Y, Qi J, Xie C, Lu L, et al. Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci Rep. 2016;6: 23428. pmid:27009765
- 14. Coroller TP, Grossmann P, Hou Y, Rios Velazquez E, Leijenaar RTH, Hermann G, et al. CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma. Radiother Oncol. 2015;114: 345–350. pmid:25746350
- 15. Desseroit M-C, Visvikis D, Tixier F, Majdoub M, Perdrisot R, Guillevin R, et al. Development of a nomogram combining clinical staging with 18F-FDG PET/CT image features in non-small-cell lung cancer stage I–III. Eur J Nucl Med Mol Imaging. 2016; pmid:26896298
- 16. Coroller TP, Agrawal V, Narayan V, Hou Y, Grossmann P, Lee SW, et al. Radiomic phenotype features predict pathological response in non-small cell lung cancer. Radiother Oncol. 2016; pmid:27085484
- 17. Coroller TP, Agrawal V, Huynh E, Narayan V, Lee SW, Mak RH, et al. Radiomic-Based Pathological Response Prediction from Primary Tumors and Lymph Nodes in NSCLC. J Thorac Oncol. 2017;12: 467–476. pmid:27903462
- 18. Parmar C, Leijenaar RTH, Grossmann P, Rios Velazquez E, Bussink J, Rietveld D, et al. Radiomic feature clusters and Prognostic Signatures specific for Lung and Head & Neck cancer. Sci Rep. 2015;5: 11044. pmid:26251068
- 19. Ingrisch M, Schneider MJ, Nörenberg D, Negrao de Figueiredo G, Maier-Hein K, Suchorska B, et al. Radiomic Analysis Reveals Prognostic Information in T1-Weighted Baseline Magnetic Resonance Imaging in Patients With Glioblastoma. Invest Radiol. 2017; pmid:28079702
- 20. Leijenaar RT, Carvalho S, Hoebers FJ, Aerts HJ, van Elmpt WJ, Huang SH, et al. External validation of a prognostic CT-based radiomic signature in oropharyngeal squamous cell carcinoma. Acta Oncol. 2015; 1–7.
- 21. Huynh E, Coroller TP, Narayan V, Agrawal V, Hou Y, Romano J, et al. CT-based radiomic analysis of stereotactic body radiation therapy patients with lung cancer. Radiother Oncol. 2016; pmid:27296412
- 22. Antunes J, Viswanath S, Rusu M, Valls L, Hoimes C, Avril N, et al. Radiomics Analysis on FLT-PET/MRI for Characterization of Early Treatment Response in Renal Cell Carcinoma: A Proof-of-Concept Study. Transl Oncol. 2016;9: 155–162. pmid:27084432
- 23. Hassan I, Kotrotsou A, Bakhtiari AS, Thomas GA, Weinberg JS, Kumar AJ, et al. Radiomic Texture Analysis Mapping Predicts Areas of True Functional MRI Activity. Sci Rep. 2016;6: 25295. pmid:27151623
- 24. Aerts HJWL, Velazquez ER, Leijenaar RTH, Parmar C, Grossmann P, Cavalho S, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5. pmid:24892406
- 25. Desseroit M-C, Tixier F, Weber WA, Siegel BA, Cheze Le Rest C, Visvikis D, et al. Reliability of PET/CT shape and heterogeneity features in functional and morphological components of Non-Small Cell Lung Cancer tumors: a repeatability analysis in a prospective multi-center cohort. J Nucl Med Off Publ Soc Nucl Med. 2016; pmid:27765856
- 26. Kickingereder P, Go tz M, Muschelli J, Wick A, Neuberger U, Shinohara RT, et al. Large-scale Radiomic Profiling of Recurrent Glioblastoma Identifies an Imaging Predictor for Stratifying Anti-Angiogenic Treatment Response. Clin Cancer Res. 2016;22: 5765–5771. pmid:27803067
- 27. van den Burg EL, van Hoof M, Postma AA, Janssen AML, Stokroos RJ, Kingma H, et al. An Exploratory Study to Detect Ménière’s Disease in Conventional MRI Scans Using Radiomics. Front Neurol. 2016;7. pmid:27872606
- 28. Hatt M, Majdoub M, Vallieres M, Tixier F, Le Rest CC, Groheux D, et al. 18F-FDG PET Uptake Characterization Through Texture Analysis: Investigating the Complementary Nature of Heterogeneity and Functional Tumor Volume in a Multi-Cancer Site Patient Cohort. J Nucl Med. 2015;56: 38–44. pmid:25500829
- 29. Huynh E, Coroller TP, Narayan V, Agrawal V, Romano J, Franco I, et al. Associations of Radiomic Data Extracted from Static and Respiratory-Gated CT Scans with Disease Recurrence in Lung Cancer Patients Treated with SBRT. PloS One. 2017;12: e0169172. pmid:28046060
- 30. Wang H, Schabath MB, Liu Y, Berglund AE, Bloom GC, Kim J, et al. Semiquantitative Computed Tomography Characteristics for Lung Adenocarcinoma and Their Association With Lung Cancer Survival. Clin Lung Cancer. 2015; pmid:26077095
- 31. Gimenez F, Xu J, Liu Y, Liu T, Beaulieu C, Rubin D, et al. Automatic annotation of radiological observations in liver CT images. AMIA Annu Symp Proc AMIA Symp AMIA Symp. 2012;2012: 257–263.
- 32. Yanagawa M, Tanaka Y, Kusumoto M, Watanabe S, Tsuchiya R, Honda O, et al. Automated assessment of malignant degree of small peripheral adenocarcinomas using volumetric CT data: Correlation with pathologic prognostic factors. Lung Cancer. 2010;70: 286–294. pmid:20392516
- 33. Lee H-J, Kim YT, Kang CH, Zhao B, Tan Y, Schwartz LH, et al. Epidermal growth factor receptor mutation in lung adenocarcinomas: relationship with CT characteristics and histologic subtypes. Radiology. 2013;268: 254–264. pmid:23468578
- 34. Backer-Grøndahl T, Moen BH, Torp SH. The histopathological spectrum of human meningiomas. Int J Clin Exp Pathol. 2012;5: 231–242. pmid:22558478
- 35.
Pieper S, Halle M, Kikinis R. 3D Slicer. IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2004. 2004. p. 632–635 Vol. 1. 10.1109/ISBI.2004.1398617
- 36.
R Core Team (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org/.
- 37. Schröder MS, Culhane AC, Quackenbush J, Haibe-Kains B. survcomp: an R/Bioconductor package for performance assessment and comparison of survival models. Bioinformatics. 2011;27: 3206–3208. pmid:21903630
- 38. Benjamini Y, Hochberg Y. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J R Stat Soc Ser B Methodol. 1995;57: 289–300.
- 39. Liaw A, Wiener M. Classification and Regression by randomForest. R News. 2002;2: 18–22.
- 40. Kuhn M. Building predictive models in R using the caret package. J Stat Softw. 2008;28: 1–26.
- 41.
Abedalthagafi MS, Ramkissoon SH, Ligon KL, Ligon AH, Folkerth RD, Santagata S. Clinical Molecular Staging in Meningiomas: Prospective Experience of a Single Institution Using Routine FFPE Samples. LABORATORY INVESTIGATION. NATURE PUBLISHING GROUP 75 VARICK ST, 9TH FLR, NEW YORK, NY 10013–1917 USA; 2014. p. 433A–433A.
- 42. Rohringer M, Sutherland GR, Louw DF, Sima AA. Incidence and clinicopathological features of meningioma. J Neurosurg. 1989;71: 665–672. pmid:2809720
- 43. Liu Y, Chotai S, Chen M, Jin S, Qi S, Pan J. Preoperative Radiologic Classification of Convexity Meningioma to Predict the Survival and Aggressive Meningioma Behavior. Sherman JH, editor. PLOS ONE. 2015;10: e0118908. pmid:25786236
- 44. Servo A, Porras M, Jääskeläinen J, Paetau A, Haltia M. Computed tomography and angiography do not reliably discriminate malignant meningiomas from benign ones. Neuroradiology. 32: 94–97. pmid:2398947
- 45. Chernov MF, Kasuya H, Nakaya K, Kato K, Ono Y, Yoshida S, et al. 1H-MRS of intracranial meningiomas: what it can add to known clinical and MRI predictors of the histopathological and biological characteristics of the tumor? Clin Neurol Neurosurg. 2011;113: 202–212. pmid:21144647
- 46. Buetow MP, Buetow PC, Smirniotopoulos JG. Typical, atypical, and misleading features in meningioma. RadioGraphics. 1991;11: 1087–1106. pmid:1749851
- 47. Nakasu S, Nakasu Y, Nakajima M, Matsuda M, Handa J. Preoperative identification of meningiomas that are highly likely to recur. J Neurosurg. 1999;90: 455–462. pmid:10067913
- 48. Gerlinger M, Rowan AJ, Horswell S, Larkin J, Endesfelder D, Gronroos E, et al. Intratumor heterogeneity and branched evolution revealed by multiregion sequencing. N Engl J Med. 2012;366: 883–892. pmid:22397650
- 49. Bi WL, Zhang M, Wu WW, Mei Y, Dunn IF. Meningioma Genomics: Diagnostic, Prognostic, and Therapeutic Applications. Front Surg. 2016;3: 40. pmid:27458586
- 50. Bi WL, Wu WW, Santagata S, Reardon DA, Dunn IF. Checkpoint inhibition in meningiomas. Immunotherapy. 2016;8: 721–731. pmid:27197540
- 51. Bi WL, Abedalthagafi M, Horowitz P, Agarwalla PK, Mei Y, Aizer AA, et al. Genomic landscape of intracranial meningiomas. J Neurosurg. 2016; 1–11.
- 52. Sachdeva J, Kumar V, Gupta I, Khandelwal N, Ahuja C kamal. A dual neural network ensemble approach for multiclass brain tumor classification: BRAIN TUMOR CLASSIFICATION USING DUAL NETWORK ENSEMBLE APPROACH. Int J Numer Methods Biomed Eng. 2012;28: 1107–1120. pmid:23109381
- 53. Piper RJ, Mikhael S, Wardlaw JM, Laidlaw DH, Whittle IR, Bastin ME. Imaging signatures of meningioma and low-grade glioma: a diffusion tensor, magnetization transfer and quantitative longitudinal relaxation time MRI study. Magn Reson Imaging. 2016;34: 596–602. pmid:26708035
- 54. Surov A, Gottschling S, Mawrin C, Prell J, Spielmann RP, Wienke A, et al. Diffusion-Weighted Imaging in Meningioma: Prediction of Tumor Grade and Association with Histopathological Parameters. Transl Oncol. 2015;8: 517–523. pmid:26692534
- 55. Tang Y, Dundamadappa SK, Thangasamy S, Flood T, Moser R, Smith T, et al. Correlation of Apparent Diffusion Coefficient With Ki-67 Proliferation Index in Grading Meningioma. Am J Roentgenol. 2014;202: 1303–1308. pmid:24848829
- 56. Hakyemez B, Yıldırım N, Gokalp G, Erdogan C, Parlak M. The contribution of diffusion-weighted MR imaging to distinguishing typical from atypical meningiomas. Neuroradiology. 2006;48: 513–520. pmid:16786348
- 57. Santelli L, Ramondo G, Della Puppa A, Ermani M, Scienza R, d’Avella D, et al. Diffusion-weighted imaging does not predict histological grading in meningiomas. Acta Neurochir (Wien). 2010;152: 1315–1319. pmid:20428902
- 58. Pavlisa G, Rados M, Pazanin L, Padovan RS, Ozretic D, Pavlisa G. Characteristics of typical and atypical meningiomas on ADC maps with respect to schwannomas. Clin Imaging. 2008;32: 22–27. pmid:18164390
- 59. Sanverdi SE, Ozgen B, Oguz KK, Mut M, Dolgun A, Soylemezoglu F, et al. Is diffusion-weighted imaging useful in grading and differentiating histopathological subtypes of meningiomas? Eur J Radiol. 2012;81: 2389–2395. pmid:21723681
- 60. Surov A, Ginat DT, Sanverdi E, Lim CCT, Hakyemez B, Yogi A, et al. Use of Diffusion Weighted Imaging in Differentiating Between Maligant and Benign Meningiomas. A Multicenter Analysis. World Neurosurg. 2016;88: 598–602. pmid:26529294
- 61. Dolnicar S, Grün B. How constrained a response: A comparison of binary, ordinal and metric answer formats. J Retail Consum Serv. 2007;14: 108–122.