Skip to main content
Erschienen in: Journal of Digital Imaging 1/2018

24.08.2017

Medical Image Retrieval Using Multi-Texton Assignment

verfasst von: Qiling Tang, Jirong Yang, Xianfu Xia

Erschienen in: Journal of Imaging Informatics in Medicine | Ausgabe 1/2018

Einloggen, um Zugang zu erhalten

Abstract

In this paper, we present a multi-texton representation method for medical image retrieval, which utilizes the locality constraint to encode each filter bank response within its local-coordinate system consisting of the k nearest neighbors in texton dictionary and subsequently employs spatial pyramid matching technique to implement feature vector representation. Comparison with the traditional nearest neighbor assignment followed by texton histogram statistics method, our strategies reduce the quantization errors in mapping process and add information about the spatial layout of texton distributions and, thus, increase the descriptive power of the image representation. We investigate the effects of different parameters on system performance in order to choose the appropriate ones for our datasets and carry out experiments on the IRMA-2009 medical collection and the mammographic patch dataset. The extensive experimental results demonstrate that the proposed method has superior performance.
Literatur
1.
Zurück zum Zitat Madabhushi A, Agner S, Basavanhally A, Doyle S, Lee G: Computer-aided prognosis: Predicting patient and disease outcome via quantitative fusion of multi-scale, multi-modal data. Comput Med Imaging Graph 35(7–8):506–514, 2011CrossRefPubMed Madabhushi A, Agner S, Basavanhally A, Doyle S, Lee G: Computer-aided prognosis: Predicting patient and disease outcome via quantitative fusion of multi-scale, multi-modal data. Comput Med Imaging Graph 35(7–8):506–514, 2011CrossRefPubMed
2.
Zurück zum Zitat Zaidi H, Vees H, Wissmeyer M: Molecular PET/CT imaging-guided radiation therapy treatment planning. Acad Radiol 16(9):1108–1133, 2009CrossRefPubMed Zaidi H, Vees H, Wissmeyer M: Molecular PET/CT imaging-guided radiation therapy treatment planning. Acad Radiol 16(9):1108–1133, 2009CrossRefPubMed
3.
Zurück zum Zitat Marcus C, Ladam-Marcus V, Cucu C, Bouché O, Lucas L, Hoeffel C: Imaging techniques to evaluate the response to treatment in oncology: Current standards and perspectives. Crit Rev Oncol Hematol 72(3):217–238, 2009CrossRefPubMed Marcus C, Ladam-Marcus V, Cucu C, Bouché O, Lucas L, Hoeffel C: Imaging techniques to evaluate the response to treatment in oncology: Current standards and perspectives. Crit Rev Oncol Hematol 72(3):217–238, 2009CrossRefPubMed
4.
Zurück zum Zitat Greenspan H, Pinhas AT: Medical image categorization and retrieval for PACS using the GMM-KL framework. IEEE Trans Inf Technol Biomed 11(2):190–202, 2007CrossRefPubMed Greenspan H, Pinhas AT: Medical image categorization and retrieval for PACS using the GMM-KL framework. IEEE Trans Inf Technol Biomed 11(2):190–202, 2007CrossRefPubMed
5.
Zurück zum Zitat Dhara AK, Mukhopadhyay S, Dutta A, Garg M, Khandelwal N: Content-based image retrieval system for pulmonary nodules: assisting radiologists in self-learning and diagnosis of lung cancer. J Digit Imaging 30(1):63–77, 2017CrossRefPubMed Dhara AK, Mukhopadhyay S, Dutta A, Garg M, Khandelwal N: Content-based image retrieval system for pulmonary nodules: assisting radiologists in self-learning and diagnosis of lung cancer. J Digit Imaging 30(1):63–77, 2017CrossRefPubMed
6.
Zurück zum Zitat Camlica Z, Tizhoosh HR, Khalvatid F: Medical image classification via SVM using LBP features from saliency-based folded data. In: Proc IEEE Int Conf Mach Learn Appl, 2015. p. 128–132. Camlica Z, Tizhoosh HR, Khalvatid F: Medical image classification via SVM using LBP features from saliency-based folded data. In: Proc IEEE Int Conf Mach Learn Appl, 2015. p. 128–132.
7.
Zurück zum Zitat Tang Q, Liu Y, Liu H: Medical image classification via multiscale representation learning. Artif Intell Med 79:71–78, 2017 Tang Q, Liu Y, Liu H: Medical image classification via multiscale representation learning. Artif Intell Med 79:71–78, 2017
8.
Zurück zum Zitat Lin Z, Brandt J: A local bag-of-features model for large-scale object retrieval. In: Proc Eur Conf Comput Vis, 2010, p. 294–308 Lin Z, Brandt J: A local bag-of-features model for large-scale object retrieval. In: Proc Eur Conf Comput Vis, 2010, p. 294–308
9.
Zurück zum Zitat Lehmann TM, Deselaers T, Schubert H, Guld MO, Thies C, Fischer B, Spitzer K: IRMA–a content based approach to image retrieval in medical applications. In: IRMA Int Conf, 5033: 911–912, 2006. Lehmann TM, Deselaers T, Schubert H, Guld MO, Thies C, Fischer B, Spitzer K: IRMA–a content based approach to image retrieval in medical applications. In: IRMA Int Conf, 5033: 911–912, 2006.
10.
Zurück zum Zitat Puzicha J, Hofmann T, Buhmann JM: Non-parametric similarity measures for unsupervised texture segmentation and image retrieval. In: Proc IEEE Conf Comput Vis Pattern Recognit, 1997, pp 267–272 Puzicha J, Hofmann T, Buhmann JM: Non-parametric similarity measures for unsupervised texture segmentation and image retrieval. In: Proc IEEE Conf Comput Vis Pattern Recognit, 1997, pp 267–272
11.
Zurück zum Zitat Arandjelovic R, Zisserman A: Three things everyone should know to improve object retrieval. In: Proc IEEE Conf Comput Vis Pattern Recognit, 2012, pp 2911–2918 Arandjelovic R, Zisserman A: Three things everyone should know to improve object retrieval. In: Proc IEEE Conf Comput Vis Pattern Recognit, 2012, pp 2911–2918
12.
Zurück zum Zitat Kumar A, Kim J, Cai W, Fulham M, Feng D: Content-based medical image retrieval: A survey of applications to multidimensional and multimodality data. J Digit Imaging 26(6):1025–1039, 2013CrossRefPubMedPubMedCentral Kumar A, Kim J, Cai W, Fulham M, Feng D: Content-based medical image retrieval: A survey of applications to multidimensional and multimodality data. J Digit Imaging 26(6):1025–1039, 2013CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Gletsos M, Mougiakakou SG, Matsopoulos GK, Nikita KS, Nikita AS, Kelekis D: A computer-aided diagnostic system to characterize CT focal liver lesions: design and optimization of a neural network classifier. IEEE Trans Info Technol Biomed 7(3):153–162, 2003CrossRef Gletsos M, Mougiakakou SG, Matsopoulos GK, Nikita KS, Nikita AS, Kelekis D: A computer-aided diagnostic system to characterize CT focal liver lesions: design and optimization of a neural network classifier. IEEE Trans Info Technol Biomed 7(3):153–162, 2003CrossRef
14.
Zurück zum Zitat Lee C, Chen S, Tsai H, Chung P, Chiang Y: Discrimination of liver diseases from CT images based on Gabor filters. In: Proc IEEE Int Symp Biomed Comput-based Med Syst, 2006 Lee C, Chen S, Tsai H, Chung P, Chiang Y: Discrimination of liver diseases from CT images based on Gabor filters. In: Proc IEEE Int Symp Biomed Comput-based Med Syst, 2006
15.
Zurück zum Zitat Nanni L, Brahnam S, Lumini A: A very high performing system to discriminate tissues in mammograms as benign and malignant. Expert Syst Appl 39(2):1968–1971, 2012CrossRef Nanni L, Brahnam S, Lumini A: A very high performing system to discriminate tissues in mammograms as benign and malignant. Expert Syst Appl 39(2):1968–1971, 2012CrossRef
16.
Zurück zum Zitat Manik V, Andrew Z: A statistical approach to material classification using image patch exemplars. IEEE Trans Pattern Anal Mach Intell 31(11):2032–2047, 2009CrossRef Manik V, Andrew Z: A statistical approach to material classification using image patch exemplars. IEEE Trans Pattern Anal Mach Intell 31(11):2032–2047, 2009CrossRef
17.
Zurück zum Zitat Jégou H, Douze M, Schmid C: Improving bag-of-features for large scale image search. Int J Comput Vis 87(3):316–336, 2010CrossRef Jégou H, Douze M, Schmid C: Improving bag-of-features for large scale image search. Int J Comput Vis 87(3):316–336, 2010CrossRef
18.
Zurück zum Zitat Galaro J, Judkins AR, Ellison D, Baccon J, Madabhushi A: An integrated texton and bag of words Cclassifier for identifying anaplastic medulloblastomas. In: Conf Proc IEEE Eng Med Biol Soc, 2011, pp 3443–3446 Galaro J, Judkins AR, Ellison D, Baccon J, Madabhushi A: An integrated texton and bag of words Cclassifier for identifying anaplastic medulloblastomas. In: Conf Proc IEEE Eng Med Biol Soc, 2011, pp 3443–3446
19.
Zurück zum Zitat Riaz F, Silva FB, Ribeiro MD, Coimbra MT: Invariant Gabor Texture Descriptors for Classification of Gastroenterology Images. IEEE Trans Biomed Eng 59(10):2893–2904, 2012CrossRefPubMed Riaz F, Silva FB, Ribeiro MD, Coimbra MT: Invariant Gabor Texture Descriptors for Classification of Gastroenterology Images. IEEE Trans Biomed Eng 59(10):2893–2904, 2012CrossRefPubMed
20.
Zurück zum Zitat Li Y, Chen H, Rohde GK, Yao C, Cheng L: Texton analysis for mass classification in mammograms. Pattern Recognit Lett 52:87–93, 2015CrossRef Li Y, Chen H, Rohde GK, Yao C, Cheng L: Texton analysis for mass classification in mammograms. Pattern Recognit Lett 52:87–93, 2015CrossRef
21.
Zurück zum Zitat Fernández-Carrobles MM, Bueno G, Déniz O, Salido J, García-Rojo M, Gonzández-López L: Frequential versus spatial colour textons for breast TMA classification. Comput Med Imaging Graph 42:25–37, 2015CrossRefPubMed Fernández-Carrobles MM, Bueno G, Déniz O, Salido J, García-Rojo M, Gonzández-López L: Frequential versus spatial colour textons for breast TMA classification. Comput Med Imaging Graph 42:25–37, 2015CrossRefPubMed
22.
Zurück zum Zitat van Gemert JC, Veenman CJ, Smeulders AWM, Geusebroek J: Visual word ambiguity. IEEE Trans Pattern Anal Mach Intell 32(7):1271–1283, 2010CrossRefPubMed van Gemert JC, Veenman CJ, Smeulders AWM, Geusebroek J: Visual word ambiguity. IEEE Trans Pattern Anal Mach Intell 32(7):1271–1283, 2010CrossRefPubMed
23.
Zurück zum Zitat Julesz B: Textons, the elements of texture perception, and their interactions. Nature 290:91–97, 1981CrossRefPubMed Julesz B: Textons, the elements of texture perception, and their interactions. Nature 290:91–97, 1981CrossRefPubMed
24.
Zurück zum Zitat Leung T, Malik J: Representing and recognizing the visual appearance of materials using three-dimensional textons. Int J Comput Vis 43(1):29–44, 2001CrossRef Leung T, Malik J: Representing and recognizing the visual appearance of materials using three-dimensional textons. Int J Comput Vis 43(1):29–44, 2001CrossRef
25.
Zurück zum Zitat Tang Q, Sang N, Liu H: Contrast-dependent surround suppression models for contour detection. Pattern Recogn 60:51–61, 2016CrossRef Tang Q, Sang N, Liu H: Contrast-dependent surround suppression models for contour detection. Pattern Recogn 60:51–61, 2016CrossRef
26.
Zurück zum Zitat Xie J, Zhang L, You J, Shiu S: Effective texture classification by texton encoding induced statistical features. Pattern Recogn 48(2):447–457, 2015CrossRef Xie J, Zhang L, You J, Shiu S: Effective texture classification by texton encoding induced statistical features. Pattern Recogn 48(2):447–457, 2015CrossRef
27.
Zurück zum Zitat Shotton J, Winn J, Rother C, Criminisi A: Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context. Int J Comput Vis 81:2–23, 2009CrossRef Shotton J, Winn J, Rother C, Criminisi A: Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context. Int J Comput Vis 81:2–23, 2009CrossRef
28.
Zurück zum Zitat Li X, Williams S, Bottema MJ: Constructing and applying higher order textons: Estimating breast cancer risk. Pattern Recogn 47(3):1375–1382, 2014CrossRef Li X, Williams S, Bottema MJ: Constructing and applying higher order textons: Estimating breast cancer risk. Pattern Recogn 47(3):1375–1382, 2014CrossRef
29.
Zurück zum Zitat Petroudi S, Brady M: Breast density characterization using texton distributions. In: Conf Proc IEEE Eng Med Biol Soc, 2011, pp 5004–5007 Petroudi S, Brady M: Breast density characterization using texton distributions. In: Conf Proc IEEE Eng Med Biol Soc, 2011, pp 5004–5007
30.
Zurück zum Zitat Zhang L, Fisher M, Wang W: Retinal vessel segmentation using multi-scale textons derived from keypoints. Comput Med Imaging Graph 45:47–56, 2015CrossRefPubMed Zhang L, Fisher M, Wang W: Retinal vessel segmentation using multi-scale textons derived from keypoints. Comput Med Imaging Graph 45:47–56, 2015CrossRefPubMed
31.
Zurück zum Zitat Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y: Locality-constrained linear coding for image classification. In: Proc IEEE Conf Comput Vis Pattern Recognit, 2010, pp 3360–3367 Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y: Locality-constrained linear coding for image classification. In: Proc IEEE Conf Comput Vis Pattern Recognit, 2010, pp 3360–3367
32.
Zurück zum Zitat Zhang P, Wee C, Nieghammer M, Shen D, Yap P: Large deformation image classification using generalized locality-constrained linear coding. In: Proc Int Conf Med Image Comput Comput Assist Interv (MICCAI), 2013, pp 292–299 Zhang P, Wee C, Nieghammer M, Shen D, Yap P: Large deformation image classification using generalized locality-constrained linear coding. In: Proc Int Conf Med Image Comput Comput Assist Interv (MICCAI), 2013, pp 292–299
33.
Zurück zum Zitat Yang J, Yu K, Gong Y, Huang T: Linear spatial pyramid matching using sparse coding for image classification. In: Proc IEEE Conf Comput Vis Pattern Recognit, 2009, pp 1794–1801 Yang J, Yu K, Gong Y, Huang T: Linear spatial pyramid matching using sparse coding for image classification. In: Proc IEEE Conf Comput Vis Pattern Recognit, 2009, pp 1794–1801
34.
Zurück zum Zitat Lazebnik S, Schmid C, Ponce J: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proc. IEEE Conf. Comput. Vis. Pattern Recogn 2: 2169–2178, 2006. Lazebnik S, Schmid C, Ponce J: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proc. IEEE Conf. Comput. Vis. Pattern Recogn 2: 2169–2178, 2006.
35.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916, 2015CrossRefPubMed He K, Zhang X, Ren S, Sun J: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916, 2015CrossRefPubMed
36.
Zurück zum Zitat Meij E, Trieschnigg D, Rijke MD, Kraaij W: Conceptual language models for domain-specific retrieval. Inform Process Manag 46(4):448–469, 2010CrossRef Meij E, Trieschnigg D, Rijke MD, Kraaij W: Conceptual language models for domain-specific retrieval. Inform Process Manag 46(4):448–469, 2010CrossRef
37.
Zurück zum Zitat Tommasi T, Caputo B, Welter P, Guld MO, Deserno TM: Overview of the CLEF 2009 medical image annotation track. In: CLEF 2009 Workshop. Lect Notes Comput Sci 6242(85–93), 2010 Tommasi T, Caputo B, Welter P, Guld MO, Deserno TM: Overview of the CLEF 2009 medical image annotation track. In: CLEF 2009 Workshop. Lect Notes Comput Sci 6242(85–93), 2010
38.
Zurück zum Zitat Lehmann TM, Schubert H, Keysers D, Kohnen M, Wein BB: The IRMA code for unique classification of medical images. In: Proc SPIE-Med Imaging, 5033:440–451, 2003 Lehmann TM, Schubert H, Keysers D, Kohnen M, Wein BB: The IRMA code for unique classification of medical images. In: Proc SPIE-Med Imaging, 5033:440–451, 2003
39.
Zurück zum Zitat Rahman MM, Desai BC, Bhattacharya P: Medical image retrieval with probabilistic multiclass support vector machine classifiers and adaptive similarity fusion. Comput Med Imaging Graph 32(2):95–108, 2008CrossRefPubMed Rahman MM, Desai BC, Bhattacharya P: Medical image retrieval with probabilistic multiclass support vector machine classifiers and adaptive similarity fusion. Comput Med Imaging Graph 32(2):95–108, 2008CrossRefPubMed
40.
Zurück zum Zitat Jiang W, Er G, Dai Q, Gu J: Similarity based online feature selection in content-based image retrieval. IEEE Trans Image Process 15(3):702–712, 2006CrossRefPubMed Jiang W, Er G, Dai Q, Gu J: Similarity based online feature selection in content-based image retrieval. IEEE Trans Image Process 15(3):702–712, 2006CrossRefPubMed
41.
Zurück zum Zitat Avni U, Greenspan H, Konen E, Sharon M, Goldberger J: X-ray categorization and retrieval on the organ and pathology level, using patch-based visual words. IEEE Trans Med Imaging 30(3):733–746, 2011CrossRefPubMed Avni U, Greenspan H, Konen E, Sharon M, Goldberger J: X-ray categorization and retrieval on the organ and pathology level, using patch-based visual words. IEEE Trans Med Imaging 30(3):733–746, 2011CrossRefPubMed
42.
Zurück zum Zitat Liu X, Tizhoosh HR, Kofman J: Generating binary tags for fast medical image retrieval based on convolutional nets and radon transform. In: Proc IEEE Int Joint Conf Neural Networks, 2016, pp 2872–2878 Liu X, Tizhoosh HR, Kofman J: Generating binary tags for fast medical image retrieval based on convolutional nets and radon transform. In: Proc IEEE Int Joint Conf Neural Networks, 2016, pp 2872–2878
43.
Zurück zum Zitat Unay D, Soldea O, Ozogür-Akyuz S, Cetin M, Ercil A: Medical image retrieval and automatic annotation: VPA-SABANCI at imageCLEF 2009. Working Notes for CLEF 2009 Workshop, 2009. Unay D, Soldea O, Ozogür-Akyuz S, Cetin M, Ercil A: Medical image retrieval and automatic annotation: VPA-SABANCI at imageCLEF 2009. Working Notes for CLEF 2009 Workshop, 2009.
44.
Zurück zum Zitat de Oliveira JEE, Lopes APB, Camara-Chavez G, de Araújo A, Deserno TM, Mammo SVD: A content-based image retrieval system using a reference database of mammographies. In: Proc IEEE Int Symp Biomed Comput-based Med Syst, 2009, pp 1–4 de Oliveira JEE, Lopes APB, Camara-Chavez G, de Araújo A, Deserno TM, Mammo SVD: A content-based image retrieval system using a reference database of mammographies. In: Proc IEEE Int Symp Biomed Comput-based Med Syst, 2009, pp 1–4
45.
Zurück zum Zitat Crammer K, Singer Y: On the algorithmic implementation of multiclass kernel-based vector machines. J Mach Learn Res 2:265–292, 2001 Crammer K, Singer Y: On the algorithmic implementation of multiclass kernel-based vector machines. J Mach Learn Res 2:265–292, 2001
46.
Zurück zum Zitat Pinho E, Godinho T, Valente F, Costa C: A multimodal search engine for medical imaging studies. J Digit Imaging 30(1):39–48, 2017CrossRefPubMed Pinho E, Godinho T, Valente F, Costa C: A multimodal search engine for medical imaging studies. J Digit Imaging 30(1):39–48, 2017CrossRefPubMed
Metadaten
Titel
Medical Image Retrieval Using Multi-Texton Assignment
verfasst von
Qiling Tang
Jirong Yang
Xianfu Xia
Publikationsdatum
24.08.2017
Verlag
Springer International Publishing
Erschienen in
Journal of Imaging Informatics in Medicine / Ausgabe 1/2018
Print ISSN: 2948-2925
Elektronische ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-017-0017-z

Weitere Artikel der Ausgabe 1/2018

Journal of Digital Imaging 1/2018 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.