Skip to main content
Log in

Fusion of coregistered cross-modality images using a temporally alternating display method

  • Published:
Medical and Biological Engineering and Computing Aims and scope Submit manuscript

Abstract

As an aid to the interpretation of functional images, cross-modality coregistration of functional and anatomical images has grown rapidly. Various ways of easily interpreting and visualising coregistered images have previously been investigated; for their display, an intensity-weighted temporally alternating method is used. For brain images, geometric registration involves the automatic alignment method, using the head scalp boundary extracted from the sinogram of a PET emission scan and a surface-matching algorithm; images of the chest or abdomen are registered semi-automatically using a paired point matching algorithm. For the simultaneous display of geometrically registered images, rapid image switching is applied; both images are written with independent colour scales. The rapidly alternating display of two images, synchronised with monitor scanning, induces the fusion of images in the human visual perception system. The accuracy of registration of PET and MRI images is within 2 mm for two point sets. A resulting image is intensified by weighting the display time and/or controlling the intensity map of each image with the degree of interest. This method may be useful for the interpretation and visualisation of coregistered images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Besl, P. J., andMcKay, N. D. (1992): ‘A method for registration of 3-D shape’,IEEE Trans. Pattern Anal. Mach. Intell.,14, pp. 239–256

    Article  Google Scholar 

  • Borgefors, G. (1988): ‘Hierachical chamfer matching: a parametric edge matching algorithm’,IEEE Trans. Pattern. Anal. Mach. Intell.,10, pp. 849–865

    Article  Google Scholar 

  • Farrel, J. E. (1991): ‘Fitting physical screen parameters to the human eye’ in:Roufs, J. A. J. (Ed.) ‘Vision and visual dysfunction, 15, The man-machine interface’ (The Macmillan Press Ltd, Hampshire)

    Google Scholar 

  • Grimson, W. E. L., Ettinger, G. J., White, S. J., Lozano-Pérez, T., Wells III, W. M., andKikinis, R. (1996): ‘An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization’,IEEE Trans. Med. Imag.,15, pp. 129–140

    Google Scholar 

  • Hallett, P. E. (1991): ‘Some limitations to human peripheral vision’ in:Kulikowski, J. J., Walsh, V., andMurray, I. J. (Ed.) ‘Vision and visual dysfunction, 5, Limits of vision’ (The Macmillan Press Ltd, Hampshire)

    Google Scholar 

  • Itti, L., Chang, L., Mangin, J-F., Darcourt, J., andErnst, T. (1997): ‘Robust multimodality registration for brain mapping’,Hum. Brain Mapping,5, pp. 3–17

    Google Scholar 

  • Lee, J. S., Kwark, C., Lee, D. S., Chung, J-K., Lee, M. C., andPark, K. S. (1998): ‘Development of an automatic 3D coregistration technique of brain PET and MR images’,Korean J. Nucl. Med.,32, pp. 414–424

    Google Scholar 

  • Levin, D. N., Hu, X., Tan, K. K., Galhotra, S., Pelizzari, C. A., Chen, G. T. Y., Beck, R. N., Chen, C-T., Cooper, M. D., Mullan, J. F., Hekmatpanah, J., andSpire, J-P. (1989): ‘The brain: integrated three-dimensional display of MR and PET images’,Radiology,172, pp. 783–789

    Google Scholar 

  • Meltzer, C. C., Zubieta, J. K., Links, J. M., Brakeman, P., Stumpf, M. J., andFrost, J. J. (1996): ‘MR-based correction of brain PET measurements for heterogeneous gray matter radioactivity distribution’,J. Cereb. Blood Flow Metab.,16, pp. 650–658

    Google Scholar 

  • Meyer, C. R., Leichtman, G. S., Brunberg, J. A., Wahl, R. L., andQuint, L. E. (1992): ‘Simultaneous usage of homologous points, lines, and planes for optimal, 3-D, linear registration of multimodality imaging data’,IEEE Trans. Med. Imag.,14, pp. 1–11

    Google Scholar 

  • Molina, V., Montz, R., Martin-Loeches, M., Jiménez-Vicioso, A., Carreras, J. L., andRubia, F. J. (1995): ‘Drug therapy and cerebral perfusion in obsessive-compulsive disorder’,J. Nucl. Med.,36, pp. 2234–2238

    Google Scholar 

  • Pelizzari, C. A., Chen, G. T. Y., Spelbring, D. R., Weichselbaum, R. R., andChen, C. (1989): ‘Accurate three-dimensional registration of CT, PET, and/or MR images of the brain’,J. Comput. Assist. Tomogr.,13, pp. 20–26

    Google Scholar 

  • Peters, T., Munger, P., Comeau, R., Evans, A., andOlivier, A. (1996): ‘Three-dimensional multimodal image-guidance for neurosurgery’,IEEE Trans. Med. Imag.,15, pp. 121–128

    Google Scholar 

  • Pietrzyk, U., Herholz, K., Fink, G., Jacobs, A., Mielke, R., Slansky, I., Würker, M., andHeiss, W-D. (1994): ‘An interactive technique for three-dimensional image registration: validation for PET, SPECT, MRI and CT brain studies’,J. Nucl. Med., 35, pp. 2011–2018

    Google Scholar 

  • Rehm, K., Strother, S. C., Anderson, J. R., Schaper, K. A., andRottenberg, D. A. (1994): ‘Display of merged multimodality brain images using interleaved pixels with independent color scales’,J. Nucl. Med.,35, pp. 1815–1821

    Google Scholar 

  • Taylor, R. H., Lavallee, S., Burdea, G. C., andMösges, R. (1996): ‘Computer-integrated surgery: technology and clinical application’ (MIT Press, Cambridge, Massachusetts), pp. 77–97

    Google Scholar 

  • Wahl, R. L., Quint, L. E., Cieslak, R. D., Aisen, A. M., Koeppe, R. A., andMeyer, C. R. (1993): ‘Anatometabolic tumor imaging: fusion of FDG PET with CT or MRI to localize foci of increased activity’,J. Nucl. Med.,34, pp. 1190–1197

    Google Scholar 

  • Wandell, B. A. (1995): ‘Foundations of vision’ (Sinauer Associates, Inc., Massachusetts)

    Google Scholar 

  • Watson, A. B., Ahumada Jr, A. J., andFarrell, J. E. (1986): ‘Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion display’,J. Opt. Soc. Am. A.,3, pp. 300–307

    Google Scholar 

  • Zubal, I. G., Spencer, S. S., Imam, K., Seibyl, J., Smith, E. O., Wisniewski, G., andHoffer, P. B. (1995): ‘Difference images calculated from ictal and interictal Technetium-99m-HMPAO SPECT scans of epilepsy’,J. Nucl. Med.,36, pp. 684–689

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to K. S. Park.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, J.S., Kim, B., Chee, Y. et al. Fusion of coregistered cross-modality images using a temporally alternating display method. Med. Biol. Eng. Comput. 38, 127–132 (2000). https://doi.org/10.1007/BF02344766

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02344766

Keywords

Navigation