Christopher F. Beaulieu and Daniel L. Rubin contributed equally to this work.
We propose a computerized framework that, given a region of interest (ROI) circumscribing a lesion, not only predicts radiological observations related to the lesion characteristics with 83.2% average prediction accuracy but also derives explicit association between low-level imaging features and high-level semantic terms by exploiting their statistical correlation. Such direct association between semantic concepts and low-level imaging features can be leveraged to build a powerful annotation system for radiological images that not only allows the computer to infer the semantics from diverse medical images and run automatic reasoning for making diagnostic decision but also provides “human-interpretable explanation” of the system output to facilitate better end user understanding of computer-based diagnostic decisions. The core component of our framework is a radiological observation detection algorithm that maximizes the low-level imaging feature relevancy for each high-level semantic term. On a liver lesion CT dataset, we have implemented our framework by incorporating a large set of state-of-the-art low-level imaging features. Additionally, we included a novel feature that quantifies lesion(s) present within the liver that have a similar appearance as the primary lesion identified by the radiologist. Our framework achieved a high prediction accuracy (83.2%), and the derived association between semantic concepts and imaging features closely correlates with human expectation. The framework has been only tested on liver lesion CT images, but it is capable of being applied to other imaging domains.
Nixon MS, Aguado AS: Feature extraction & image processing for computer vision. Oxford: Academic Press, 2012
Gimenez F et al.: Automatic annotation of radiological observations in liver CT images. AMIA. Annual Symposium Proceeding 2012:257–263, 2012
R. M. Haralick, K. Shanmugam, and I. Dinstein: Textural features for image classification, IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-3, no. 6, pp. 610–621, 1973. CrossRef
Zhao CG, Cheng HY, Huo YL, Zhuang TG: Liver CT-image retrieval based on Gabor texture. In: 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2004. IEMBS ‘04, 2004, vol. 1, pp 1491–1494
J. Z. Wang, G. Wiederhold, O. Firschein, and S. X. Wei: Content-based image indexing and searching using Daubechies’ wavelets, International Journal on Digital Libraries, vol. 1, no. 4, pp. 311–328.
Duda R, Hart P: Pattern Classification and Scene Analysis. New York: Wiley, 1976
Hong B.-W, Prados E, Soatto S, Vese L: Shape representation based on integral kernels: application to image matching and segmentation. In: 2006 I.E. Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), 2006, vol. 1, pp 833–840
Rangayyan RM: Biomedical Image Analysis. London: CRC Press, 2004 CrossRef
T. Ojala, M. Pietikainen, and T. Maenpaa: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971–987, 2002. CrossRef
Mejino JLV, Rubin DL, Brinkley JF: FMA-RadLex: an application ontology of radiological anatomy derived from the foundational model of anatomy reference ontology. AMIA Annual Symposium Proceeding. AMIA Symp., 2008, pp 465–469
Y. Qiao, Q. Hu, G. Qian, S. Luo, and W. L. Nowinski: Thresholding based on variance and intensity contrast, Pattern Recognition, vol. 40, no. 2, pp. 596–608, 2007. CrossRef
H. Peng, F. Long, and C. Ding: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy, IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1226–1238, 2005. CrossRef
W. Li: Mutual information functions versus correlation functions, Journal of Statistical Physics, vol. 60, no. 5–6, pp. 823–837.
David MacKay: Information Theory, Inference, and Learning Algorithms: The Book. [Online]. Available: http://www.inference.phy.cam.ac.uk/mackay/itila/book.html. [Accessed: 26-Aug-2016]
Cristianini N, Shawe-Taylor J: An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge: Cambridge University Press, 2000 CrossRef
Liu S, Cai W, Song Y, Pujol S, Kikinis R, Feng D: A Bag of Semantic Words Model for Medical Content-based Retrieval, MICCAI Workshop—Medical Content-Based Retrieval for Clinical Decision Support, 2013
A. S. Barb, C.-R. Shyu, and Y. P. Sethi: Knowledge representation and sharing using visual semantic modeling for diagnostic medical image databases, IEEE Transactions on Information Technology and Biomedicine, vol. 9, no. 4, pp. 538–553, 2005. CrossRef
D. S. Raicu, E. Varutbangkul, J. D. Furst, and S. G. Armato III: Modelling semantics from image data: opportunities from LIDC, International Journal of Biomedical Engineering and Technology, vol. 3, no. 1–2, pp. 83–113, 2009.
- Computerized Prediction of Radiological Observations Based on Quantitative Feature Analysis: Initial Experience in Liver Lesions
Christopher F. Beaulieu
Daniel L. Rubin
- Springer International Publishing
Neu im Fachgebiet Radiologie
Meistgelesene Bücher aus der Radiologie
Mail Icon II