Skip to main content
Erschienen in: Acta Neurochirurgica 12/2018

30.10.2018 | Original Article - Vascular Neurosurgery - Aneurysm

External validation of cerebral aneurysm rupture probability model with data from two patient cohorts

verfasst von: Felicitas J. Detmer, Daniel Fajardo-Jiménez, Fernando Mut, Norman Juchler, Sven Hirsch, Vitor Mendes Pereira, Philippe Bijlenga, Juan R. Cebral

Erschienen in: Acta Neurochirurgica | Ausgabe 12/2018

Einloggen, um Zugang zu erhalten

Abstract

Background

For a treatment decision of unruptured cerebral aneurysms, physicians and patients need to weigh the risk of treatment against the risk of hemorrhagic stroke caused by aneurysm rupture. The aim of this study was to externally evaluate a recently developed statistical aneurysm rupture probability model, which could potentially support such treatment decisions.

Methods

Segmented image data and patient information obtained from two patient cohorts including 203 patients with 249 aneurysms were used for patient-specific computational fluid dynamics simulations and subsequent evaluation of the statistical model in terms of accuracy, discrimination, and goodness of fit. The model’s performance was further compared to a similarity-based approach for rupture assessment by identifying aneurysms in the training cohort that were similar in terms of hemodynamics and shape compared to a given aneurysm from the external cohorts.

Results

When applied to the external data, the model achieved a good discrimination and goodness of fit (area under the receiver operating characteristic curve AUC = 0.82), which was only slightly reduced compared to the optimism-corrected AUC in the training population (AUC = 0.84). The accuracy metrics indicated a small decrease in accuracy compared to the training data (misclassification error of 0.24 vs. 0.21). The model’s prediction accuracy was improved when combined with the similarity approach (misclassification error of 0.14).

Conclusions

The model’s performance measures indicated a good generalizability for data acquired at different clinical institutions. Combining the model-based and similarity-based approach could further improve the assessment and interpretation of new cases, demonstrating its potential use for clinical risk assessment.
Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
2
The AneuX dataset was processed under supervision of Vitor Mendes Pereira, Philippe Bijlenga, Rafik Ouared, Norman Juchler, and Sven Hirsch. It is maintained within the scope of the SystemsX.ch project AneuX.
 
Literatur
1.
Zurück zum Zitat Austin PC, Steyerberg EW (2014) Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers. Stat Med 33(3):517–535CrossRef Austin PC, Steyerberg EW (2014) Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers. Stat Med 33(3):517–535CrossRef
2.
Zurück zum Zitat Bijlenga P, Gondar R, Schilling S, Morel S, Hirsch S, Cuony J, Corniola M-V, Perren F, Rüfenacht D, Schaller K (2017) PHASES score for the management of intracranial aneurysm: a cross-sectional population-based retrospective study. Stroke 48(8):2105–2112CrossRef Bijlenga P, Gondar R, Schilling S, Morel S, Hirsch S, Cuony J, Corniola M-V, Perren F, Rüfenacht D, Schaller K (2017) PHASES score for the management of intracranial aneurysm: a cross-sectional population-based retrospective study. Stroke 48(8):2105–2112CrossRef
3.
Zurück zum Zitat Cebral JR, Castro MA, Appanaboyina S, Putman CM, Millan D, Frangi AF (2005) Efficient pipeline for image-based patient-specific analysis of cerebral aneurysm hemodynamics: technique and sensitivity. IEEE Trans Med Imaging 24(4):457–467CrossRef Cebral JR, Castro MA, Appanaboyina S, Putman CM, Millan D, Frangi AF (2005) Efficient pipeline for image-based patient-specific analysis of cerebral aneurysm hemodynamics: technique and sensitivity. IEEE Trans Med Imaging 24(4):457–467CrossRef
4.
Zurück zum Zitat Cebral JR, Castro MA, Putman CM, Alperin N (2008) Flow-area relationship in internal carotid and vertebral arteries. Physiol Meas 29:585–594CrossRef Cebral JR, Castro MA, Putman CM, Alperin N (2008) Flow-area relationship in internal carotid and vertebral arteries. Physiol Meas 29:585–594CrossRef
5.
Zurück zum Zitat Cebral JR, Sheridan MJ, Putman CM (2010) Hemodynamics and Bleb formation in intracranial aneurysms. AJNR Am J Neuroradiol 31:304–310CrossRef Cebral JR, Sheridan MJ, Putman CM (2010) Hemodynamics and Bleb formation in intracranial aneurysms. AJNR Am J Neuroradiol 31:304–310CrossRef
6.
Zurück zum Zitat Cebral J, Ollikainen E, Chung BJ, Mut F, Sippola V, Jahromi BR, Tulamo R, Hernesniemi J, Niemela M, Robertson AM, Frösen J (2017) Flow conditions in the intracranial aneurysm lumen are associated with inflammation and degenerative changes of the aneurysm wall. AJNR Am J Neuroradiol 38:119–126CrossRef Cebral J, Ollikainen E, Chung BJ, Mut F, Sippola V, Jahromi BR, Tulamo R, Hernesniemi J, Niemela M, Robertson AM, Frösen J (2017) Flow conditions in the intracranial aneurysm lumen are associated with inflammation and degenerative changes of the aneurysm wall. AJNR Am J Neuroradiol 38:119–126CrossRef
9.
Zurück zum Zitat Collins GS, Reitsma JB, Altman DG, Moons K (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med 13(1):1CrossRef Collins GS, Reitsma JB, Altman DG, Moons K (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med 13(1):1CrossRef
10.
Zurück zum Zitat Detmer FJ, Chung BJ, Mut F, Slawski M, Hamzei-Sichani F, Putman C, Jiménez C, Cebral JR (2018) Development and internal validation of an aneurysm rupture probability model based on patient characteristics and aneurysm location, morphology, and hemodynamics. Int J Comput Assist Radiol Surg. https://doi.org/10.1007/s11548-018-1837-0 CrossRef Detmer FJ, Chung BJ, Mut F, Slawski M, Hamzei-Sichani F, Putman C, Jiménez C, Cebral JR (2018) Development and internal validation of an aneurysm rupture probability model based on patient characteristics and aneurysm location, morphology, and hemodynamics. Int J Comput Assist Radiol Surg. https://​doi.​org/​10.​1007/​s11548-018-1837-0 CrossRef
11.
Zurück zum Zitat Gabriel RA, Kim H, Sidney S, McCulloch CE, Singh V, Johnston SC, Ko NU, Achrol AS, Zaroff JG, Young WL (2010) Ten-year detection rate of brain arteriovenous malformations in a large, multiethnic, defined population. Stroke 41(1):21–26CrossRef Gabriel RA, Kim H, Sidney S, McCulloch CE, Singh V, Johnston SC, Ko NU, Achrol AS, Zaroff JG, Young WL (2010) Ten-year detection rate of brain arteriovenous malformations in a large, multiethnic, defined population. Stroke 41(1):21–26CrossRef
13.
Zurück zum Zitat Greving JP, Wermer MJ, Brown RD, Morita A, Juvela S, Yonekura M, Ishibashi T, Torner JC, Nakayama T, Rinkel GJ, Algra A (2014) Development of the PHASES score for prediction of risk of rupture of intracranial aneurysms: a pooled analysis of six prospective cohort studies. Lancet Neurol 13:59–66CrossRef Greving JP, Wermer MJ, Brown RD, Morita A, Juvela S, Yonekura M, Ishibashi T, Torner JC, Nakayama T, Rinkel GJ, Algra A (2014) Development of the PHASES score for prediction of risk of rupture of intracranial aneurysms: a pooled analysis of six prospective cohort studies. Lancet Neurol 13:59–66CrossRef
14.
Zurück zum Zitat Hernandez M, Frangi AF (2007) Non-parametric geodesic active regions: method and evaluation for cerebral aneurysms segmentation in 3DRA and CTA. Med Image Anal 11:224–241CrossRef Hernandez M, Frangi AF (2007) Non-parametric geodesic active regions: method and evaluation for cerebral aneurysms segmentation in 3DRA and CTA. Med Image Anal 11:224–241CrossRef
15.
Zurück zum Zitat Huang MC, Baaj AA, Downes K, Youssef AS, Sauvageau E, van Loveren HR, Agazzi S (2011) Paradoxical trends in the management of unruptured cerebral aneurysms in the United States: analysis of nationwide database over a 10-year period. Stroke 42(6):1730–1735CrossRef Huang MC, Baaj AA, Downes K, Youssef AS, Sauvageau E, van Loveren HR, Agazzi S (2011) Paradoxical trends in the management of unruptured cerebral aneurysms in the United States: analysis of nationwide database over a 10-year period. Stroke 42(6):1730–1735CrossRef
16.
Zurück zum Zitat Jabbarli R, Dinger TF, Darkwah Oppong M, Pierscianek D, Dammann P, Wrede KH, Kaier K, Köhrmann M, Forsting M, Kleinschnitz C, Sure U (2018) Risk factors for and clinical consequences of multiple intracranial aneurysms: a systematic review and meta-analysis. Stroke 49(4):848–855CrossRef Jabbarli R, Dinger TF, Darkwah Oppong M, Pierscianek D, Dammann P, Wrede KH, Kaier K, Köhrmann M, Forsting M, Kleinschnitz C, Sure U (2018) Risk factors for and clinical consequences of multiple intracranial aneurysms: a systematic review and meta-analysis. Stroke 49(4):848–855CrossRef
17.
Zurück zum Zitat Japan Investigators UCAS, Morita A, Kirino T, Hashi K, Aoki N, Fukuhara S, Hashimoto N, Nakayama T, Sakai M, Teramoto A, Tominari S, Yoshimoto T (2012) The natural course of unruptured cerebral aneurysms in a Japanese cohort. N Engl J Med 366:2474–2482CrossRef Japan Investigators UCAS, Morita A, Kirino T, Hashi K, Aoki N, Fukuhara S, Hashimoto N, Nakayama T, Sakai M, Teramoto A, Tominari S, Yoshimoto T (2012) The natural course of unruptured cerebral aneurysms in a Japanese cohort. N Engl J Med 366:2474–2482CrossRef
18.
Zurück zum Zitat Juvela S, Poussa K, Lehto H, Porras M (2013) Natural history of unruptured intracranial aneurysms: a long-term follow-up study. Stroke 44:2414–2421CrossRef Juvela S, Poussa K, Lehto H, Porras M (2013) Natural history of unruptured intracranial aneurysms: a long-term follow-up study. Stroke 44:2414–2421CrossRef
20.
Zurück zum Zitat Korja M, Kaprio J (2016) Controversies in epidemiology of intracranial aneurysms and SAH. Nat Rev Neurol 12(1):50–55CrossRef Korja M, Kaprio J (2016) Controversies in epidemiology of intracranial aneurysms and SAH. Nat Rev Neurol 12(1):50–55CrossRef
21.
Zurück zum Zitat Korja M, Lehto H, Juvela S (2014) Lifelong rupture risk of intracranial aneurysms depends on risk factors: a prospective Finnish cohort study. Stroke 45:1958–1963CrossRef Korja M, Lehto H, Juvela S (2014) Lifelong rupture risk of intracranial aneurysms depends on risk factors: a prospective Finnish cohort study. Stroke 45:1958–1963CrossRef
22.
Zurück zum Zitat Korja M, Lehto H, Juvela S, Kaprio J (2016) Incidence of subarachnoid hemorrhage is decreasing together with decreasing smoking rates. Neurology 87(11):1118–1123CrossRef Korja M, Lehto H, Juvela S, Kaprio J (2016) Incidence of subarachnoid hemorrhage is decreasing together with decreasing smoking rates. Neurology 87(11):1118–1123CrossRef
23.
Zurück zum Zitat Lindgren AE, Koivisto T, Björkman J, von und zu Fraunberg M, Helin K, Jääskeläinen JE, Frösen J (2016) Irregular shape of intracranial aneurysm indicates rupture risk irrespective of size in a population-based cohort. Stroke 47(5):1219–1226CrossRef Lindgren AE, Koivisto T, Björkman J, von und zu Fraunberg M, Helin K, Jääskeläinen JE, Frösen J (2016) Irregular shape of intracranial aneurysm indicates rupture risk irrespective of size in a population-based cohort. Stroke 47(5):1219–1226CrossRef
24.
Zurück zum Zitat Piccinelli M, Bacigaluppi S, Boccardi E, Ene-Iordache B, Remuzzi A, Veneziani A, Antiga L (2011) Geometry of the internal carotid artery and recurrent patterns in location, orientation, and rupture status of lateral aneurysms: an image-based computational study. Neurosurgery 68(5):1270–1285CrossRef Piccinelli M, Bacigaluppi S, Boccardi E, Ene-Iordache B, Remuzzi A, Veneziani A, Antiga L (2011) Geometry of the internal carotid artery and recurrent patterns in location, orientation, and rupture status of lateral aneurysms: an image-based computational study. Neurosurgery 68(5):1270–1285CrossRef
25.
26.
Zurück zum Zitat Rinkel GJ, Djibuti M, van Gijn J (1998) Prevalence and risk of rupture of intracranial aneurysms: a systematic review. Stroke 29:251–259CrossRef Rinkel GJ, Djibuti M, van Gijn J (1998) Prevalence and risk of rupture of intracranial aneurysms: a systematic review. Stroke 29:251–259CrossRef
27.
Zurück zum Zitat Rivero-Arias O, Gray A, Wolstenholme J (2010) Burden of disease and costs of aneurysmal subarachnoid haemorrhage (aSAH) in the United Kingdom. Cost Eff Resour Alloc 8(1):6CrossRef Rivero-Arias O, Gray A, Wolstenholme J (2010) Burden of disease and costs of aneurysmal subarachnoid haemorrhage (aSAH) in the United Kingdom. Cost Eff Resour Alloc 8(1):6CrossRef
28.
Zurück zum Zitat Sangalli LM, Secchi P, Vantini S (2014) AneuRisk65: a dataset of three-dimensional cerebral vascular geometries. Electron J Stat 8(2):1879–1890CrossRef Sangalli LM, Secchi P, Vantini S (2014) AneuRisk65: a dataset of three-dimensional cerebral vascular geometries. Electron J Stat 8(2):1879–1890CrossRef
29.
Zurück zum Zitat Steiner T, Juvela S, Unterberg A, Jung C, Forsting M, Rinkel G (2013) European stroke organization guidelines for the management of intracranial aneurysms and subarachnoid haemorrhage. Cerebrovasc Dis 35(2):93–112CrossRef Steiner T, Juvela S, Unterberg A, Jung C, Forsting M, Rinkel G (2013) European stroke organization guidelines for the management of intracranial aneurysms and subarachnoid haemorrhage. Cerebrovasc Dis 35(2):93–112CrossRef
30.
Zurück zum Zitat Thompson BG, Brown RD, Amin-Hanjani S, Broderick JP, Cockroft KM, Connolly ES, Duckwiler GR, Harris CC, Howard VJ, Johnston SC, Meyers PM, Molyneux A, Ogilvy CS, Ringer AJ, Torner J (2015) Guidelines for the management of patients with unruptured intracranial aneurysms: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46(8):2368–2400CrossRef Thompson BG, Brown RD, Amin-Hanjani S, Broderick JP, Cockroft KM, Connolly ES, Duckwiler GR, Harris CC, Howard VJ, Johnston SC, Meyers PM, Molyneux A, Ogilvy CS, Ringer AJ, Torner J (2015) Guidelines for the management of patients with unruptured intracranial aneurysms: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46(8):2368–2400CrossRef
31.
Zurück zum Zitat Tulamo R, Frosen J, Hernesniemi J, Niemela M (2010) Inflammatory changes in the aneurysm wall: a review. J Neurointerv Surg 2:120–130CrossRef Tulamo R, Frosen J, Hernesniemi J, Niemela M (2010) Inflammatory changes in the aneurysm wall: a review. J Neurointerv Surg 2:120–130CrossRef
32.
Zurück zum Zitat Villa-Uriol MC, Berti G, Hose DR, Marzo A, Chiarini A, Penrose J, Pozo J, Schmidt JG, Singh P, Lycett R, Larrabide I, Frangi AF (2011) @neurIST complex information processing toolchain for the integrated management of cerebral aneurysms. Interface Focus 1(3):308–319CrossRef Villa-Uriol MC, Berti G, Hose DR, Marzo A, Chiarini A, Penrose J, Pozo J, Schmidt JG, Singh P, Lycett R, Larrabide I, Frangi AF (2011) @neurIST complex information processing toolchain for the integrated management of cerebral aneurysms. Interface Focus 1(3):308–319CrossRef
33.
Zurück zum Zitat Vlak MH, Algra A, Brandenburg R, Rinkel GJ (2011) Prevalence of unruptured intracranial aneurysms, with emphasis on sex, age, comorbidity, country, and time period: a systematic review and meta-analysis. Lancet Neurol 10:626–636CrossRef Vlak MH, Algra A, Brandenburg R, Rinkel GJ (2011) Prevalence of unruptured intracranial aneurysms, with emphasis on sex, age, comorbidity, country, and time period: a systematic review and meta-analysis. Lancet Neurol 10:626–636CrossRef
34.
Zurück zum Zitat Wang G, Zhang Z, Ayala C, Dunet DO, Fang J, George MG (2014) Costs of hospitalization for stroke patients aged 18-64 years in the United States. J Stroke Cerebrovasc Dis 23(5):861–868CrossRef Wang G, Zhang Z, Ayala C, Dunet DO, Fang J, George MG (2014) Costs of hospitalization for stroke patients aged 18-64 years in the United States. J Stroke Cerebrovasc Dis 23(5):861–868CrossRef
35.
Zurück zum Zitat Wermer MJ, van der Schaaf IC, Algra A, Rinkel GJ (2007) Risk of rupture of unruptured intracranial aneurysms in relation to patient and aneurysm characteristics: an updated meta-analysis. Stroke 38:1404–1410CrossRef Wermer MJ, van der Schaaf IC, Algra A, Rinkel GJ (2007) Risk of rupture of unruptured intracranial aneurysms in relation to patient and aneurysm characteristics: an updated meta-analysis. Stroke 38:1404–1410CrossRef
36.
Zurück zum Zitat Wiebers DO, Whisnant JP, Huston J, Meissner I, Brown RD, Piepgras DG, Forbes GS, Thielen K, Nichols D, O’Fallon WM, Peacock J, Jaeger L, Kassell NF, Kongable-Beckman GL, Torner JC (2003) Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet 362:103–110CrossRef Wiebers DO, Whisnant JP, Huston J, Meissner I, Brown RD, Piepgras DG, Forbes GS, Thielen K, Nichols D, O’Fallon WM, Peacock J, Jaeger L, Kassell NF, Kongable-Beckman GL, Torner JC (2003) Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet 362:103–110CrossRef
37.
Zurück zum Zitat Xiang J, Varble N, Davies JM, Rai AT, Kono K, Sugiyama S, Binning MJ, Tawk RG, Choi H, Ringer AJ, Snyder KV, Levy EI, Hopkins LN, Siddiqui AH, Meng H (2017) Initial clinical experience with AView—a clinical computational platform for intracranial aneurysm morphology, hemodynamics, and treatment management. World Neurosurg 108:534–542CrossRef Xiang J, Varble N, Davies JM, Rai AT, Kono K, Sugiyama S, Binning MJ, Tawk RG, Choi H, Ringer AJ, Snyder KV, Levy EI, Hopkins LN, Siddiqui AH, Meng H (2017) Initial clinical experience with AView—a clinical computational platform for intracranial aneurysm morphology, hemodynamics, and treatment management. World Neurosurg 108:534–542CrossRef
38.
Zurück zum Zitat Yang X, Liu C, Le Minh H, Wang Z, Chien A, Cheng K-T (2017) An automated method for accurate vessel segmentation. Phys Med Biol 62(9):3757–3778CrossRef Yang X, Liu C, Le Minh H, Wang Z, Chien A, Cheng K-T (2017) An automated method for accurate vessel segmentation. Phys Med Biol 62(9):3757–3778CrossRef
Metadaten
Titel
External validation of cerebral aneurysm rupture probability model with data from two patient cohorts
verfasst von
Felicitas J. Detmer
Daniel Fajardo-Jiménez
Fernando Mut
Norman Juchler
Sven Hirsch
Vitor Mendes Pereira
Philippe Bijlenga
Juan R. Cebral
Publikationsdatum
30.10.2018
Verlag
Springer Vienna
Erschienen in
Acta Neurochirurgica / Ausgabe 12/2018
Print ISSN: 0001-6268
Elektronische ISSN: 0942-0940
DOI
https://doi.org/10.1007/s00701-018-3712-8

Weitere Artikel der Ausgabe 12/2018

Acta Neurochirurgica 12/2018 Zur Ausgabe

Leitlinien kompakt für die Neurologie

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Neurologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.