Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 12/2016

01.12.2016 | Original Article

A comparative study of transformation models for the sequential mosaicing of long retinal sequences of slit-lamp images obtained in a closed-loop motion

verfasst von: Kristina Prokopetc, Adrien Bartoli

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 12/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Navigated panretinal photocoagulation is a standard care for proliferative diabetic retinopathy. Slit-lamp-based systems used for this treatment provide a narrow view of the retina. Retinal mosaics are used for view expansion and treatment planning. Mosaicing slit-lamp images is a hard task due to the absence of a physical model of the imaging process, large textureless regions and imaging artifacts, mostly reflections.

Methods

We present a comparative study of various geometric transformation models applied to retinal image mosaicing in computer-assisted slit-lamp imaging. We propose an efficient point correspondence-based framework for transformation model evaluation in a typical closed-loop motion scenario. We compare the performance of multiple linear and nonlinear models of different complexities and assess the effect of the number of points used for parameter estimation. We use a local fitting error (LFE) metric to estimate the models’ performance in pairwise registration. Because LFE alone is not conclusive regarding the problem of accumulated drift, we propose a loop closure error (LCE) metric to quantify the effect of accumulated local registration errors. We also provide a new normalization procedure for the quadratic transformation model, widely used in retinal image registration.

Results

In total, seven transformation models were evaluated on three datasets of long image sequences. LFE decreases with increasing complexity of the model, while LCE, in contrast, shows superior performance of simple models. Varying the number of point correspondences did not reveal a common trend for the LCE metric, showing an increase in the error for simple models and an unstable behavior of the complex models.

Conclusion

Our results show that simple models are less sensitive to drift and preferable for sequential mosaicing in slit-lamp imaging, while more complex models are the best choice for short-term registration.
Literatur
1.
Zurück zum Zitat Adal KM, Ensing RM, Couvert R, van Etten P, Martinez JP, Vermeer KA, van Vliet L (2014) A hierarchical coarse-to-fine approach for fundus image registration. In: Ourselin S, Modat M (ed) Biomedical image registration, Springer, pp 93–102 Adal KM, Ensing RM, Couvert R, van Etten P, Martinez JP, Vermeer KA, van Vliet L (2014) A hierarchical coarse-to-fine approach for fundus image registration. In: Ourselin S, Modat M (ed) Biomedical image registration, Springer, pp 93–102
2.
Zurück zum Zitat Asmuth J, Madjarov B, Sajda P, Berger JW (2001) Mosaicking and enhancement of slit lamp biomicroscopic fundus images. Br J Ophthalmol 85(5):563–565CrossRefPubMedPubMedCentral Asmuth J, Madjarov B, Sajda P, Berger JW (2001) Mosaicking and enhancement of slit lamp biomicroscopic fundus images. Br J Ophthalmol 85(5):563–565CrossRefPubMedPubMedCentral
3.
Zurück zum Zitat Bartoli A (2008) Maximizing the predictivity of smooth deformable image warps through cross-validation. J Math Imaging Vis 31(2–3):133–145CrossRef Bartoli A (2008) Maximizing the predictivity of smooth deformable image warps through cross-validation. J Math Imaging Vis 31(2–3):133–145CrossRef
4.
Zurück zum Zitat Broehan AM, Rudolph T, Amstutz CA, Kowal JH (2011) Real-time multimodal retinal image registration for a computer-assisted laser photocoagulation system. IEEE Trans Biomed Eng 58(10):2816–2824CrossRefPubMed Broehan AM, Rudolph T, Amstutz CA, Kowal JH (2011) Real-time multimodal retinal image registration for a computer-assisted laser photocoagulation system. IEEE Trans Biomed Eng 58(10):2816–2824CrossRefPubMed
5.
Zurück zum Zitat Can A, Stewart CV, Roysam B, Tanenbaum HL (2002) A feature-based technique for joint, linear estimation of high-order image-to-mosaic transformations: mosaicing the curved human retina. IEEE Trans Pattern Anal Mach Intell 24(3):412–419CrossRef Can A, Stewart CV, Roysam B, Tanenbaum HL (2002) A feature-based technique for joint, linear estimation of high-order image-to-mosaic transformations: mosaicing the curved human retina. IEEE Trans Pattern Anal Mach Intell 24(3):412–419CrossRef
6.
Zurück zum Zitat Chhablani J, Mathai A, Rani P, Gupta V, Arevalo JF, Kozak I (2014) Comparison of conventional pattern and novel navigated panretinal photocoagulation in proliferative diabetic retinopathy comparison of PASCAL and NAVILAS for PRP. Investig Ophthalmol Vis Sci 55(6):3432–3438CrossRef Chhablani J, Mathai A, Rani P, Gupta V, Arevalo JF, Kozak I (2014) Comparison of conventional pattern and novel navigated panretinal photocoagulation in proliferative diabetic retinopathy comparison of PASCAL and NAVILAS for PRP. Investig Ophthalmol Vis Sci 55(6):3432–3438CrossRef
7.
Zurück zum Zitat Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge university press, Cambridge Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge university press, Cambridge
8.
Zurück zum Zitat Irani M, Anandan P (1999) About direct methods. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 267–277 Irani M, Anandan P (1999) About direct methods. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 267–277
9.
Zurück zum Zitat Kernt M, Cheuteu R, Vounotrypidis E, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2011) Focal and panretinal photocoagulation with a navigated laser NAVILAS. Acta Ophthalmol 89(8):662–664CrossRef Kernt M, Cheuteu R, Vounotrypidis E, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2011) Focal and panretinal photocoagulation with a navigated laser NAVILAS. Acta Ophthalmol 89(8):662–664CrossRef
10.
Zurück zum Zitat Kernt M, Cheuteu RE, Cserhati S, Seidensticker F, Liegl RG, Lang J, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2012) Pain and accuracy of focal laser treatment for diabetic macular edema using a retinal navigated laser (Navilas). Clin Ophthalmol 6(1):289–296CrossRefPubMedPubMedCentral Kernt M, Cheuteu RE, Cserhati S, Seidensticker F, Liegl RG, Lang J, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2012) Pain and accuracy of focal laser treatment for diabetic macular edema using a retinal navigated laser (Navilas). Clin Ophthalmol 6(1):289–296CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat Laliberté F, Gagnon L, Sheng Y (2003) Registration and fusion of retinal images-an evaluation study. IEEE Trans Med Imaging 22(5):661–673CrossRefPubMed Laliberté F, Gagnon L, Sheng Y (2003) Registration and fusion of retinal images-an evaluation study. IEEE Trans Med Imaging 22(5):661–673CrossRefPubMed
13.
Zurück zum Zitat Lawson CL, Hanson RJ (1974) Solving least squares problems. Series in automatic computation, vol 161. Prentice-Hall, Englewood Cliffs Lawson CL, Hanson RJ (1974) Solving least squares problems. Series in automatic computation, vol 161. Prentice-Hall, Englewood Cliffs
14.
Zurück zum Zitat Lee S, Abràmoff MD, Reinhardt JM (2007) Validation of retinal image registration algorithms by a projective imaging distortion model. In: Engineering in Medicine and Biology Society, 2007. EMBS 2007. 29th Annual International Conference of the IEEE, pp 6471–6474 Lee S, Abràmoff MD, Reinhardt JM (2007) Validation of retinal image registration algorithms by a projective imaging distortion model. In: Engineering in Medicine and Biology Society, 2007. EMBS 2007. 29th Annual International Conference of the IEEE, pp 6471–6474
15.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
16.
Zurück zum Zitat McLauchlan PF, Jaenicke A (2002) Image mosaicing using sequential bundle adjustment. Image Vis Comput 20(9):751–759CrossRef McLauchlan PF, Jaenicke A (2002) Image mosaicing using sequential bundle adjustment. Image Vis Comput 20(9):751–759CrossRef
17.
Zurück zum Zitat Richa R, Linhares R, Comunello E, Von Wangenheim A, Schnitzler JY, Wassmer B, Guillemot C, Thuret G, Gain P, Hager G (2014) Fundus image mosaicking for information augmentation in computer-assisted slit-lamp imaging. IEEE Trans Med Imaging 33(6):1304–1312CrossRefPubMed Richa R, Linhares R, Comunello E, Von Wangenheim A, Schnitzler JY, Wassmer B, Guillemot C, Thuret G, Gain P, Hager G (2014) Fundus image mosaicking for information augmentation in computer-assisted slit-lamp imaging. IEEE Trans Med Imaging 33(6):1304–1312CrossRefPubMed
18.
Zurück zum Zitat Souza M, Richa R, Puel A, Caetano J, Comunello E, von Wangenheim A (2014) Robust visual tracking for retinal mapping in computer-assisted slit-lamp imaging. In: IEEE 27th International Symposium on Computer-Based Medical Systems (CBMS) 2014, pp 132–137 Souza M, Richa R, Puel A, Caetano J, Comunello E, von Wangenheim A (2014) Robust visual tracking for retinal mapping in computer-assisted slit-lamp imaging. In: IEEE 27th International Symposium on Computer-Based Medical Systems (CBMS) 2014, pp 132–137
19.
Zurück zum Zitat Stewart CV, Tsai CL, Roysam B (2003) The dual-bootstrap iterative closest point algorithm with application to retinal image registration. IEEE Trans Med Imaging 22(11):1379–1394CrossRefPubMed Stewart CV, Tsai CL, Roysam B (2003) The dual-bootstrap iterative closest point algorithm with application to retinal image registration. IEEE Trans Med Imaging 22(11):1379–1394CrossRefPubMed
20.
Zurück zum Zitat Szeliski R (2006) Image alignment and stitching: a tutorial. Found Trends Comput Graph Vis 2(1):1–104CrossRef Szeliski R (2006) Image alignment and stitching: a tutorial. Found Trends Comput Graph Vis 2(1):1–104CrossRef
21.
Zurück zum Zitat Torr PH, Zisserman A (1999) Feature based methods for structure and motion estimation. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 278–294 Torr PH, Zisserman A (1999) Feature based methods for structure and motion estimation. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 278–294
22.
Zurück zum Zitat Yang G, Stewart CV (2004) Covariance-driven mosaic formation from sparsely-overlapping image sets with application to retinal image mosaicing. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp I–804 Yang G, Stewart CV (2004) Covariance-driven mosaic formation from sparsely-overlapping image sets with application to retinal image mosaicing. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp I–804
23.
Zurück zum Zitat Zheng Y, Daniel E, Hunter AA, Xiao R, Gao J, Li H, Maguire MG, Brainard DH, Gee JC (2014) Landmark matching based retinal image alignment by enforcing sparsity in correspondence matrix. Med Image Anal 18(6):903–913CrossRefPubMed Zheng Y, Daniel E, Hunter AA, Xiao R, Gao J, Li H, Maguire MG, Brainard DH, Gee JC (2014) Landmark matching based retinal image alignment by enforcing sparsity in correspondence matrix. Med Image Anal 18(6):903–913CrossRefPubMed
Metadaten
Titel
A comparative study of transformation models for the sequential mosaicing of long retinal sequences of slit-lamp images obtained in a closed-loop motion
verfasst von
Kristina Prokopetc
Adrien Bartoli
Publikationsdatum
01.12.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 12/2016
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1439-7

Weitere Artikel der Ausgabe 12/2016

International Journal of Computer Assisted Radiology and Surgery 12/2016 Zur Ausgabe

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.