Skip to main content
Erschienen in: Journal of Digital Imaging 1/2008

01.10.2008

Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets

verfasst von: Karl G. Baum, María Helguera, Andrzej Krol

Erschienen in: Journal of Imaging Informatics in Medicine | Sonderheft 1/2008

Einloggen, um Zugang zu erhalten

Abstract

A new application, Fusion Viewer, available for free, has been designed and implemented with a modular object-oriented design. The viewer provides both traditional and novel tools to fuse 3D data sets such as CT (computed tomography), MRI (magnetic resonance imaging), PET (positron emission tomography), and SPECT (single photon emission tomography) of the same subject, to create maximum intensity projections (MIP) and to adjust dynamic range. In many situations, it is desirable and advantageous to acquire biomedical images in more than one modality. For example, PET can be used to acquire functional data, whereas MRI can be used to acquire morphological data. In some situations, a side-by-side comparison of the images provides enough information, but in most of the cases it may be necessary to have the exact spatial relationship between the modalities presented to the observer. To accomplish this task, the images need to first be registered and then combined (fused) to create a single image. In this paper, we discuss the options for performing such fusion in the context of multimodal breast imaging. Additionally, a novel spline-based dynamic range technique is presented in detail. It has the advantage of obtaining a high level of contrast in the intensity range of interest without discarding the intensity information outside of this range while maintaining a user interface similar to the standard window/level windowing procedure.
Literatur
2.
Zurück zum Zitat Drolon H: FreeImage Documentation, Library Version 3.9.2, Oct. 29, 2006 Drolon H: FreeImage Documentation, Library Version 3.9.2, Oct. 29, 2006
3.
Zurück zum Zitat Lai SH, Fang M: A hierarchical neural network algorithm for robust and automatic windowing of MR images. Artif Intell Med 19:97–100, 2000PubMedCrossRef Lai SH, Fang M: A hierarchical neural network algorithm for robust and automatic windowing of MR images. Artif Intell Med 19:97–100, 2000PubMedCrossRef
4.
Zurück zum Zitat Jin Y, Fayad L, Laine A: Contrast enhancement by multi-scale adaptive histogram equalization. Wavelets: Applications in signal and image processing. Proc SPIE Int Soc Opt Eng 4478:206–213, 2000 Jin Y, Fayad L, Laine A: Contrast enhancement by multi-scale adaptive histogram equalization. Wavelets: Applications in signal and image processing. Proc SPIE Int Soc Opt Eng 4478:206–213, 2000
5.
Zurück zum Zitat Fayad L, Jin Y, Laine A, et al: Chest CT window settings with multiscale adaptive histogram equalization: Pilot study. Radiology 223(3):845–852, 2002PubMedCrossRef Fayad L, Jin Y, Laine A, et al: Chest CT window settings with multiscale adaptive histogram equalization: Pilot study. Radiology 223(3):845–852, 2002PubMedCrossRef
6.
Zurück zum Zitat Lai SH, Fang M: An adaptive window width/center adjustment system with online training capabilities for MR images. Artif Intell Med 33:89–101, 2005PubMedCrossRef Lai SH, Fang M: An adaptive window width/center adjustment system with online training capabilities for MR images. Artif Intell Med 33:89–101, 2005PubMedCrossRef
7.
Zurück zum Zitat Hara S, Shimura K, Nagata T: Generalized dynamic range compression algorithm for visualization of chest CT images. Medical imaging: Visualization, image-guided procedures, and display. Proc SPIE Int Soc Opt Eng 5367:578–585, 2004 Hara S, Shimura K, Nagata T: Generalized dynamic range compression algorithm for visualization of chest CT images. Medical imaging: Visualization, image-guided procedures, and display. Proc SPIE Int Soc Opt Eng 5367:578–585, 2004
8.
Zurück zum Zitat Gonzalez RC, Woods RE: Digital Image Processing, 2nd Edition. Upper Saddle River: Prentice Hall, NY, 2002 Gonzalez RC, Woods RE: Digital Image Processing, 2nd Edition. Upper Saddle River: Prentice Hall, NY, 2002
9.
Zurück zum Zitat Porter T, Duff T: Compositing Digital Images. In: SIGGRAPH ’84 Conference Proceedings (11th Annual Conference on Computer Graphics and Interactive Techniques), 1984, vol. 18, pp 253–259 Porter T, Duff T: Compositing Digital Images. In: SIGGRAPH ’84 Conference Proceedings (11th Annual Conference on Computer Graphics and Interactive Techniques), 1984, vol. 18, pp 253–259
10.
Zurück zum Zitat Spetsieris PG, Dhawan V, Ishikawa T, Eidelberg D: Interactive visualization of coregistered tomographic images. Presented at Biomedical Visualization Conference, Atlanta, GA, USA, 1995 Spetsieris PG, Dhawan V, Ishikawa T, Eidelberg D: Interactive visualization of coregistered tomographic images. Presented at Biomedical Visualization Conference, Atlanta, GA, USA, 1995
11.
Zurück zum Zitat Baum KG, Helguera M, Hornak JP, Kerekes JP, Montag ED, Unlu MZ, Feiglin DH, Krol A: Techniques for fusion of multimodal images: Application to breast imaging. In: Proceedings of IEEE International Conference on Image Processing, 2006, pp 2521–2524 Baum KG, Helguera M, Hornak JP, Kerekes JP, Montag ED, Unlu MZ, Feiglin DH, Krol A: Techniques for fusion of multimodal images: Application to breast imaging. In: Proceedings of IEEE International Conference on Image Processing, 2006, pp 2521–2524
12.
Zurück zum Zitat Russ JC: The Image Processing Handbook, 4th ed: CRC Press, Inc., 2002 Russ JC: The Image Processing Handbook, 4th ed: CRC Press, Inc., 2002
13.
Zurück zum Zitat Baum KG, Helguera M, Krol A: Genetic Algorithm Automated Generation of Multivariate Color Tables for Visualization of Multimodal Medical Data Sets. Proceedings of IS & T/SID’s 14th Color Imaging Conference, 2006, pp 138–143 Baum KG, Helguera M, Krol A: Genetic Algorithm Automated Generation of Multivariate Color Tables for Visualization of Multimodal Medical Data Sets. Proceedings of IS & T/SID’s 14th Color Imaging Conference, 2006, pp 138–143
14.
Zurück zum Zitat Agoston AT, Daniel BL, Herfkens RJ, Ikeda DM, Birdwell RL, Heiss SG, Sawyer-Glover AM: Intensity-modulated parametric mapping for simultaneous display of rapid dynamic and high-spatial-resolution breast MR imaging data. Radiographics 21:217–226, 2001PubMed Agoston AT, Daniel BL, Herfkens RJ, Ikeda DM, Birdwell RL, Heiss SG, Sawyer-Glover AM: Intensity-modulated parametric mapping for simultaneous display of rapid dynamic and high-spatial-resolution breast MR imaging data. Radiographics 21:217–226, 2001PubMed
15.
Zurück zum Zitat Sammi MK, Felder CA, Fowler JS, Lee JH, Levy AV, Li X, Logan J, Palyka I, Rooney WD, Volkow ND, Wang GJ, Springer CS Jr: Intimate combination of low- and high-resolution image data: I. Real-space PET and H2O MRI, PETAMRI. Magn Reson Med 42:345–360, 1999PubMedCrossRef Sammi MK, Felder CA, Fowler JS, Lee JH, Levy AV, Li X, Logan J, Palyka I, Rooney WD, Volkow ND, Wang GJ, Springer CS Jr: Intimate combination of low- and high-resolution image data: I. Real-space PET and H2O MRI, PETAMRI. Magn Reson Med 42:345–360, 1999PubMedCrossRef
16.
Zurück zum Zitat Rehm K, Strother SC, Anderson JR, Schaper KA, Rottenberg DA: Display of merged multimodality brain images using interleaved pixels with independent color scales. J Nucl Med 35:1815–1821, 1994PubMed Rehm K, Strother SC, Anderson JR, Schaper KA, Rottenberg DA: Display of merged multimodality brain images using interleaved pixels with independent color scales. J Nucl Med 35:1815–1821, 1994PubMed
17.
Zurück zum Zitat Lee JS, Kim B, Chee Y, Kwark C, Lee MC, Park KS: Fusion of coregistered cross-modality images using a temporally alternating display method. Med Biol Eng Comput 38:127–132, 2000PubMedCrossRef Lee JS, Kim B, Chee Y, Kwark C, Lee MC, Park KS: Fusion of coregistered cross-modality images using a temporally alternating display method. Med Biol Eng Comput 38:127–132, 2000PubMedCrossRef
18.
Zurück zum Zitat Baum KG, Helguera M, Krol A: A new application for displaying and fusing multimodal data sets. Proceedings of SPIE Biomedical Optics 6431:64310Y, 2007CrossRef Baum KG, Helguera M, Krol A: A new application for displaying and fusing multimodal data sets. Proceedings of SPIE Biomedical Optics 6431:64310Y, 2007CrossRef
Metadaten
Titel
Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets
verfasst von
Karl G. Baum
María Helguera
Andrzej Krol
Publikationsdatum
01.10.2008
Verlag
Springer-Verlag
Erschienen in
Journal of Imaging Informatics in Medicine / Ausgabe Sonderheft 1/2008
Print ISSN: 2948-2925
Elektronische ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-007-9082-z

Weitere Artikel der Sonderheft 1/2008

Journal of Digital Imaging 1/2008 Zur Ausgabe

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

„Nur wer sich gut aufgehoben fühlt, kann auch für Patientensicherheit sorgen“

13.04.2024 Klinik aktuell Kongressbericht

Die Teilnehmer eines Forums beim DGIM-Kongress waren sich einig: Fehler in der Medizin sind häufig in ungeeigneten Prozessen und mangelnder Kommunikation begründet. Gespräche mit Patienten und im Team können helfen.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.