Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 12/2023

19.06.2023 | Original Article

Unsupervised synthesis of realistic coronary artery X-ray angiogram

verfasst von: Rémi Martin, Paul Segars, Ehsan Samei, Joaquim Miró, Luc Duong

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 12/2023

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Medical image analysis suffers from a sparsity of annotated data necessary in learning-based models. Cardiorespiratory simulators have been developed to counter the lack of data. However, the resulting data often lack realism. Hence, the proposed method aims to synthesize realistic and fully customizable angiograms of coronary arteries for the training of learning-based biomedical tasks, for cardiologists performing interventions, and for cardiologist trainees.

Methods

3D models of coronary arteries are generated with a fully customizable realistic cardiorespiratory simulator. The transfer of X-ray angiography style to simulator-generated images is performed using a new vessel-specific adaptation of the CycleGAN model. The CycleGAN model is paired with a vesselness-based loss function that is designed as a vessel-specific structural integrity constraint.

Results

Validation is performed both on the style and on the preservation of the shape of the arteries of the images. The results show a PSNR of 14.125, an SSIM of 0.898, and an overlapping of 89.5% using the Dice coefficient.

Conclusion

We proposed a novel fluoroscopy-based style transfer method for the enhancement of the realism of simulated coronary artery angiograms. The results show that the proposed model is capable of accurately transferring the style of X-ray angiograms to the simulations while keeping the integrity of the structures of interest (i.e., the topology of the coronary arteries).
Literatur
1.
Zurück zum Zitat Wang D, Ma X, Yang X (2022) TL-GAN: improving traffic light recognition via data synthesis for autonomous driving. arXiv:2203.15006 Wang D, Ma X, Yang X (2022) TL-GAN: improving traffic light recognition via data synthesis for autonomous driving. arXiv:​2203.​15006
2.
Zurück zum Zitat Yoo TK, Choi JY, Kim HK, Ryu IH, Kim JK (2021) Adopting low-shot deep learning for the detection of conjunctival melanoma using ocular surface images. Comput Methods Programs Biomed 205:106086CrossRefPubMed Yoo TK, Choi JY, Kim HK, Ryu IH, Kim JK (2021) Adopting low-shot deep learning for the detection of conjunctival melanoma using ocular surface images. Comput Methods Programs Biomed 205:106086CrossRefPubMed
3.
Zurück zum Zitat Zheng C, Bian F, Li L, Xie X, Liu H, Liang J, Chen X, Wang Z, Qiao T, Yang J, Mingzhi Z (2021) Assessment of generative adversarial networks for synthetic anterior segment optical coherence tomography images in closed-angle detection. Transl Vis Sci Technol 10(4):34–34CrossRefPubMedPubMedCentral Zheng C, Bian F, Li L, Xie X, Liu H, Liang J, Chen X, Wang Z, Qiao T, Yang J, Mingzhi Z (2021) Assessment of generative adversarial networks for synthetic anterior segment optical coherence tomography images in closed-angle detection. Transl Vis Sci Technol 10(4):34–34CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat Tavakkoli A, Kamran SA, Hossain KF, Zuckerbrod SL (2020) A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs. Sci Rep 10(1):1–15CrossRef Tavakkoli A, Kamran SA, Hossain KF, Zuckerbrod SL (2020) A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs. Sci Rep 10(1):1–15CrossRef
5.
6.
Zurück zum Zitat Segars W, Bond J, Frush J, Hon S, Eckersley C, Williams CH, Feng J, Tward DJ, Ratnanather J, Miller M, Frush DP, Samei E (2013) Population of anatomically variable 4d xcat adult phantoms for imaging research and optimization. Med Phys 40(4):043701CrossRefPubMedPubMedCentral Segars W, Bond J, Frush J, Hon S, Eckersley C, Williams CH, Feng J, Tward DJ, Ratnanather J, Miller M, Frush DP, Samei E (2013) Population of anatomically variable 4d xcat adult phantoms for imaging research and optimization. Med Phys 40(4):043701CrossRefPubMedPubMedCentral
7.
Zurück zum Zitat Segars WP, Norris H, Sturgeon GM, Zhang Y, Bond J, Minhas A, Tward DJ, Ratnanather J, Miller M, Frush D, Samei E (2015) The development of a population of 4d pediatric xcat phantoms for imaging research and optimization. Med Phys 42(8):4719–4726CrossRefPubMedPubMedCentral Segars WP, Norris H, Sturgeon GM, Zhang Y, Bond J, Minhas A, Tward DJ, Ratnanather J, Miller M, Frush D, Samei E (2015) The development of a population of 4d pediatric xcat phantoms for imaging research and optimization. Med Phys 42(8):4719–4726CrossRefPubMedPubMedCentral
8.
Zurück zum Zitat Yang G, Hu Y, Huang X, Shu H, Toumoulin C (2012) Simulation environment of X-ray rotational angiography using 3d+ t coronary tree model. In: 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE, pp 629–632 Yang G, Hu Y, Huang X, Shu H, Toumoulin C (2012) Simulation environment of X-ray rotational angiography using 3d+ t coronary tree model. In: 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE, pp 629–632
9.
Zurück zum Zitat Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2223–2232 Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2223–2232
10.
Zurück zum Zitat Qin Z, Liu Z, Zhu P, Ling W (2022) Style transfer in conditional gans for cross-modality synthesis of brain magnetic resonance images. Comput Biol Med 148:105928CrossRefPubMed Qin Z, Liu Z, Zhu P, Ling W (2022) Style transfer in conditional gans for cross-modality synthesis of brain magnetic resonance images. Comput Biol Med 148:105928CrossRefPubMed
11.
Zurück zum Zitat Liu Y, Chen A, Shi H, Huang S, Zheng W, Liu Z, Zhang Q, Yang X (2021) Ct synthesis from MRI using multi-cycle gan for head-and-neck radiation therapy. Comput Med Imaging Graph 91:101953CrossRefPubMed Liu Y, Chen A, Shi H, Huang S, Zheng W, Liu Z, Zhang Q, Yang X (2021) Ct synthesis from MRI using multi-cycle gan for head-and-neck radiation therapy. Comput Med Imaging Graph 91:101953CrossRefPubMed
12.
Zurück zum Zitat Paavilainen P, Akram SU, Kannala J (2021) Bridging the gap between paired and unpaired medical image translation. In: Deep Generative Models, and Data Augmentation, Labelling, and Imperfections, Springer, pp 35–44 Paavilainen P, Akram SU, Kannala J (2021) Bridging the gap between paired and unpaired medical image translation. In: Deep Generative Models, and Data Augmentation, Labelling, and Imperfections, Springer, pp 35–44
13.
Zurück zum Zitat Yi X, Walia E, Babyn P (2019) Generative adversarial network in medical imaging: a review. Med Image Anal 58:101552CrossRefPubMed Yi X, Walia E, Babyn P (2019) Generative adversarial network in medical imaging: a review. Med Image Anal 58:101552CrossRefPubMed
14.
Zurück zum Zitat Jin C-B, Kim H, Liu M, Jung W, Joo S, Park E, Ahn YS, Han IH, Lee JI, Cui X (2019) Deep CT to MR synthesis using paired and unpaired data. Sensors 19(10):2361CrossRefPubMedPubMedCentral Jin C-B, Kim H, Liu M, Jung W, Joo S, Park E, Ahn YS, Han IH, Lee JI, Cui X (2019) Deep CT to MR synthesis using paired and unpaired data. Sensors 19(10):2361CrossRefPubMedPubMedCentral
15.
Zurück zum Zitat Mahapatra D, Antony B, Sedai S, Garnavi R (2018) Deformable medical image registration using generative adversarial networks. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), IEEE, pp 1449–1453 Mahapatra D, Antony B, Sedai S, Garnavi R (2018) Deformable medical image registration using generative adversarial networks. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), IEEE, pp 1449–1453
16.
Zurück zum Zitat Kang E, Koo HJ, Yang DH, Seo JB, Ye JC (2019) Cycle-consistent adversarial denoising network for multiphase coronary CT angiography. Med Phys 46(2):550–562CrossRefPubMed Kang E, Koo HJ, Yang DH, Seo JB, Ye JC (2019) Cycle-consistent adversarial denoising network for multiphase coronary CT angiography. Med Phys 46(2):550–562CrossRefPubMed
17.
Zurück zum Zitat Perera P, Abavisani M, Patel VM (2018) In2i: unsupervised multi-image-to-image translation using generative adversarial networks. In: 2018 24th International Conference on Pattern Recognition (ICPR), IEEE, pp 140–146 Perera P, Abavisani M, Patel VM (2018) In2i: unsupervised multi-image-to-image translation using generative adversarial networks. In: 2018 24th International Conference on Pattern Recognition (ICPR), IEEE, pp 140–146
18.
Zurück zum Zitat Shaban MT, Baur C, Navab N, Albarqouni S (2019) Staingan: stain style transfer for digital histological images. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (Isbi 2019), IEEE, pp 953–956 Shaban MT, Baur C, Navab N, Albarqouni S (2019) Staingan: stain style transfer for digital histological images. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (Isbi 2019), IEEE, pp 953–956
19.
Zurück zum Zitat Tmenova O, Martin R, Duong L (2019) Cyclegan for style transfer in X-ray angiography. Int J Comput Assist Radiol Surg 14(10):1785–1794CrossRefPubMed Tmenova O, Martin R, Duong L (2019) Cyclegan for style transfer in X-ray angiography. Int J Comput Assist Radiol Surg 14(10):1785–1794CrossRefPubMed
20.
Zurück zum Zitat Zhang Y, Miao S, Mansi T, Liao R (2018) Task driven generative modeling for unsupervised domain adaptation: Application to X-ray image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, pp 599–607 Zhang Y, Miao S, Mansi T, Liao R (2018) Task driven generative modeling for unsupervised domain adaptation: Application to X-ray image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, pp 599–607
21.
Zurück zum Zitat Frangi AF, Niessen WJ, Vincken KL, Viergever MA (1998) Multiscale vessel enhancement filtering. In: International Conference on Medical Image Computing and Computer-assisted Intervention, Springer, pp 130–137 Frangi AF, Niessen WJ, Vincken KL, Viergever MA (1998) Multiscale vessel enhancement filtering. In: International Conference on Medical Image Computing and Computer-assisted Intervention, Springer, pp 130–137
22.
Zurück zum Zitat Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets, pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets, pp 2672–2680
Metadaten
Titel
Unsupervised synthesis of realistic coronary artery X-ray angiogram
verfasst von
Rémi Martin
Paul Segars
Ehsan Samei
Joaquim Miró
Luc Duong
Publikationsdatum
19.06.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 12/2023
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-02982-3

Weitere Artikel der Ausgabe 12/2023

International Journal of Computer Assisted Radiology and Surgery 12/2023 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.