Skip to main content
Erschienen in: Journal of Digital Imaging 2/2009

01.04.2009

A Knowledge-Anchored Integrative Image Search and Retrieval System

verfasst von: Selnur Erdal, Umit V. Catalyurek, Philip R. O. Payne, Joel Saltz, Jyoti Kamal, Metin N. Gurcan

Erschienen in: Journal of Imaging Informatics in Medicine | Ausgabe 2/2009

Einloggen, um Zugang zu erhalten

Abstract

Clinical data that may be used in a secondary capacity to support research activities are regularly stored in three significantly different formats: (1) structured, codified data elements; (2) semi-structured or unstructured narrative text; and (3) multi-modal images. In this manuscript, we will describe the design of a computational system that is intended to support the ontology-anchored query and integration of such data types from multiple source systems. Additional features of the described system include (1) the use of Grid services-based electronic data interchange models to enable the use of our system in multi-site settings and (2) the use of a software framework intended to address both potential security and patient confidentiality concerns that arise when transmitting or otherwise manipulating potentially privileged personal health information. We will frame our discussion within the specific experimental context of the concept-oriented query and integration of correlated structured data, narrative text, and images for cancer research.
Literatur
1.
Zurück zum Zitat Cimino JJ: From data to knowledge through concept-oriented terminologies: experience with the Medical Entities Dictionary. J Am Med Inform Assoc 7(3):288–297, 2000PubMed Cimino JJ: From data to knowledge through concept-oriented terminologies: experience with the Medical Entities Dictionary. J Am Med Inform Assoc 7(3):288–297, 2000PubMed
2.
Zurück zum Zitat Sujansky W: Heterogeneous database integration in biomedicine. J Biomed Inform 34(4):285–298, 2001PubMedCrossRef Sujansky W: Heterogeneous database integration in biomedicine. J Biomed Inform 34(4):285–298, 2001PubMedCrossRef
3.
Zurück zum Zitat Kamal J, et al: Information warehouse as a tool to analyze computerized physician order entry order set utilization: opportunities for improvement. AMIA Annu Symp Proc 2003:336–340, 2003 Kamal J, et al: Information warehouse as a tool to analyze computerized physician order entry order set utilization: opportunities for improvement. AMIA Annu Symp Proc 2003:336–340, 2003
4.
Zurück zum Zitat Prather JC, et al: Medical data mining: knowledge discovery in a clinical data warehouse. Proc AMIA Annu Fall Symp 1997:101–105, 1997 Prather JC, et al: Medical data mining: knowledge discovery in a clinical data warehouse. Proc AMIA Annu Fall Symp 1997:101–105, 1997
5.
Zurück zum Zitat Brown M, et al: CAD in clinical trials: current role and architectural requirements. Comput Med Imaging Graph 31(4–5):332–337, 2007PubMedCrossRef Brown M, et al: CAD in clinical trials: current role and architectural requirements. Comput Med Imaging Graph 31(4–5):332–337, 2007PubMedCrossRef
6.
Zurück zum Zitat Kamauu AW, et al: Informatics in radiology (infoRAD): vendor-neutral case input into a server-based digital teaching file system. Radiographics 26(6):1877–1885, 2006PubMedCrossRef Kamauu AW, et al: Informatics in radiology (infoRAD): vendor-neutral case input into a server-based digital teaching file system. Radiographics 26(6):1877–1885, 2006PubMedCrossRef
8.
Zurück zum Zitat Sigal R: PACS as an e-academic tool International Congress series 2005, 1281, CARS 2005: Computer Assisted Radiology and Surgery, pp. 900–904 Sigal R: PACS as an e-academic tool International Congress series 2005, 1281, CARS 2005: Computer Assisted Radiology and Surgery, pp. 900–904
9.
Zurück zum Zitat Boochever SS: HIS/RIS/PACS integration: getting to the gold standard. Radiol Manage 26:16–24, 2004PubMed Boochever SS: HIS/RIS/PACS integration: getting to the gold standard. Radiol Manage 26:16–24, 2004PubMed
10.
Zurück zum Zitat Gruber TR: Toward principles for the design of ontologies used for knowledge sharing. In: Guarino N, Poli R Eds. Formal Ontology in Conceptual Analysis and Knowledge RepresentationNorwell: Kluwer, 1993 Gruber TR: Toward principles for the design of ontologies used for knowledge sharing. In: Guarino N, Poli R Eds. Formal Ontology in Conceptual Analysis and Knowledge RepresentationNorwell: Kluwer, 1993
11.
Zurück zum Zitat Joseph P, Bruce GB: Ontology-guided knowledge discovery in databases. In: Proceedings of the international conference on knowledge capture. Victoria, British Columbia, Canada: ACM Press, 2001 Joseph P, Bruce GB: Ontology-guided knowledge discovery in databases. In: Proceedings of the international conference on knowledge capture. Victoria, British Columbia, Canada: ACM Press, 2001
12.
Zurück zum Zitat Smith B, Kumar A: On controlled vocabularies in bioinformatics: a case study in the gene ontology. Biosilico: Drug Discovery Today 2(1):246–252, 2004CrossRef Smith B, Kumar A: On controlled vocabularies in bioinformatics: a case study in the gene ontology. Biosilico: Drug Discovery Today 2(1):246–252, 2004CrossRef
13.
Zurück zum Zitat Gurcan MN, et al: Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002PubMedCrossRef Gurcan MN, et al: Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002PubMedCrossRef
14.
Zurück zum Zitat Ebbert JO, Dupras DM, Erwin PJ: Searching the medical literature using PubMed: a tutorial. Mayo Clin Proc 78(1):87–91, 2003PubMedCrossRef Ebbert JO, Dupras DM, Erwin PJ: Searching the medical literature using PubMed: a tutorial. Mayo Clin Proc 78(1):87–91, 2003PubMedCrossRef
15.
Zurück zum Zitat Olson GM, et al: Collaboratories to support distributed science: the example of international HIV/AIDS research. In: Proceedings of SAICSIT, South Africa. Victoria, British Columbia, Canada: ACM Press, 2002 Olson GM, et al: Collaboratories to support distributed science: the example of international HIV/AIDS research. In: Proceedings of SAICSIT, South Africa. Victoria, British Columbia, Canada: ACM Press, 2002
17.
Zurück zum Zitat Marks RG, Conlon M, Ruberg SJ: Paradigm shifts in clinical trials enabled by information technology. Stat Med 20(17–18):2683–2696, 2001PubMedCrossRef Marks RG, Conlon M, Ruberg SJ: Paradigm shifts in clinical trials enabled by information technology. Stat Med 20(17–18):2683–2696, 2001PubMedCrossRef
18.
Zurück zum Zitat Payne PR, Greaves AW, Kipps TJ: CRC clinical trials management system (CTMS): an integrated information management solution for collaborative clinical research. AMIA Annu Symp Proc 2003:967, 2003 Payne PR, Greaves AW, Kipps TJ: CRC clinical trials management system (CTMS): an integrated information management solution for collaborative clinical research. AMIA Annu Symp Proc 2003:967, 2003
19.
Zurück zum Zitat Kuchenbecker J, et al: Use of internet technologies for data acquisition in large clinical trials. Telemed J E Health 7(1):73–76, 2001PubMedCrossRef Kuchenbecker J, et al: Use of internet technologies for data acquisition in large clinical trials. Telemed J E Health 7(1):73–76, 2001PubMedCrossRef
20.
Zurück zum Zitat Marks L, Power E: Using technology to address recruitment issues in the clinical trial process. Trends Biotechnol 20(3):105–109, 2002PubMedCrossRef Marks L, Power E: Using technology to address recruitment issues in the clinical trial process. Trends Biotechnol 20(3):105–109, 2002PubMedCrossRef
21.
Zurück zum Zitat Bates DW, et al: A proposal for electronic medical records in U.S. primary care. J Am Med Inform Assoc 10(1):1–10, 2003PubMedCrossRef Bates DW, et al: A proposal for electronic medical records in U.S. primary care. J Am Med Inform Assoc 10(1):1–10, 2003PubMedCrossRef
22.
Zurück zum Zitat Sung NS, et al: Central challenges facing the national clinical research enterprise. JAMA 289(10):1278–1287, 2003PubMedCrossRef Sung NS, et al: Central challenges facing the national clinical research enterprise. JAMA 289(10):1278–1287, 2003PubMedCrossRef
23.
Zurück zum Zitat Bates DW, et al: Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA 280(15):1311–1316, 1998PubMedCrossRef Bates DW, et al: Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA 280(15):1311–1316, 1998PubMedCrossRef
24.
Zurück zum Zitat Huang H, et al: Picture archiving and communication systems (PACS) in medicine, New York: Springer, 1991 Huang H, et al: Picture archiving and communication systems (PACS) in medicine, New York: Springer, 1991
25.
Zurück zum Zitat Duerinckx AJ, Pisa EJ: Filmless picture archiving and communication system (PACS) in diagnostic radiology. Proc SPIE 318:9–18, 1982 Duerinckx AJ, Pisa EJ: Filmless picture archiving and communication system (PACS) in diagnostic radiology. Proc SPIE 318:9–18, 1982
26.
Zurück zum Zitat Gurcan MN, et al: GridImage: a novel use of grid computing to support interactive human and computer-assisted detection decision support. J Digit Imaging 20:160–171, 2007PubMedCrossRef Gurcan MN, et al: GridImage: a novel use of grid computing to support interactive human and computer-assisted detection decision support. J Digit Imaging 20:160–171, 2007PubMedCrossRef
27.
Zurück zum Zitat Craver JM, Gold RS: Research collaboratories: their potential for health behavior researchers. Am J Health Behav 26(6):504–509, 2002PubMed Craver JM, Gold RS: Research collaboratories: their potential for health behavior researchers. Am J Health Behav 26(6):504–509, 2002PubMed
28.
Zurück zum Zitat Kukafka R, et al: Grounding a new information technology implementation framework in behavioral science: a systematic analysis of the literature on IT use. J Biomed Inform 36(3):218–227, 2003PubMedCrossRef Kukafka R, et al: Grounding a new information technology implementation framework in behavioral science: a systematic analysis of the literature on IT use. J Biomed Inform 36(3):218–227, 2003PubMedCrossRef
29.
Zurück zum Zitat Johnson MS, Gonzales MN, Bizila S: Responsible conduct of radiology research part V. The health insurance portability and accountability act and research. Radiology 237(3):757–764, 2005PubMedCrossRef Johnson MS, Gonzales MN, Bizila S: Responsible conduct of radiology research part V. The health insurance portability and accountability act and research. Radiology 237(3):757–764, 2005PubMedCrossRef
30.
Zurück zum Zitat Liu BJ, Zhou Z, Huang HK: A HIPAA-compliant architecture for securing clinical images. J Digit Imaging 19(2):172–180, 2006PubMedCrossRef Liu BJ, Zhou Z, Huang HK: A HIPAA-compliant architecture for securing clinical images. J Digit Imaging 19(2):172–180, 2006PubMedCrossRef
31.
Zurück zum Zitat Amendolia SR, et al: MammoGrid: a service oriented architecture based medical grid application. In: 3rd International Conference on Grid and Cooperative Computing, Wuhan, China, 2004 Amendolia SR, et al: MammoGrid: a service oriented architecture based medical grid application. In: 3rd International Conference on Grid and Cooperative Computing, Wuhan, China, 2004
32.
Zurück zum Zitat Blanquer I, et al: A Middleware grid for storing, retrieving and processing DICOM medical images. In: Workshop on Distributed Databases and Processing in Medical Image Computing (DIDAMIC), Rennes, France, 2004 Blanquer I, et al: A Middleware grid for storing, retrieving and processing DICOM medical images. In: Workshop on Distributed Databases and Processing in Medical Image Computing (DIDAMIC), Rennes, France, 2004
33.
Zurück zum Zitat Espert IB, Garcaa VH, Quilis JD: An OGSA middleware for managing medical images using ontologies. J Clin Monit Comput 19(4–5):295–305, 2005PubMedCrossRef Espert IB, Garcaa VH, Quilis JD: An OGSA middleware for managing medical images using ontologies. J Clin Monit Comput 19(4–5):295–305, 2005PubMedCrossRef
34.
Zurück zum Zitat Montagnat J, et al: Medical image content-based queries using the grid. In: HealthGrid’03, France, Lyon, 2003 Montagnat J, et al: Medical image content-based queries using the grid. In: HealthGrid’03, France, Lyon, 2003
35.
Zurück zum Zitat Power D, et al: A relational approach to the capture of DICOM files for Grid-enabled medical imaging databases. In: ACM symposium on applied computing, Cyprus, Nicosia, 2004, pp 272–279 Power D, et al: A relational approach to the capture of DICOM files for Grid-enabled medical imaging databases. In: ACM symposium on applied computing, Cyprus, Nicosia, 2004, pp 272–279
36.
Zurück zum Zitat Foster I, Kesselman C: The Grid 2: blueprint for a new computing infrastructure, 2nd edition. New York: Morgan Kaufman, 2003, p. 748 Foster I, Kesselman C: The Grid 2: blueprint for a new computing infrastructure, 2nd edition. New York: Morgan Kaufman, 2003, p. 748
37.
Zurück zum Zitat Payne PR, et al: Conceptual knowledge acquisition in biomedicine: a methodological review. J Biomed Inform 40:582–602, 2007PubMedCrossRef Payne PR, et al: Conceptual knowledge acquisition in biomedicine: a methodological review. J Biomed Inform 40:582–602, 2007PubMedCrossRef
39.
Zurück zum Zitat Bodenreider O: Using UMLS semantics for classification purposes. Proc AMIA Symp 2000:86–90, 2000 Bodenreider O: Using UMLS semantics for classification purposes. Proc AMIA Symp 2000:86–90, 2000
40.
Zurück zum Zitat Campbell KE, et al: Representing thoughts, words, and things in the UMLS. J Am Med Inform Assoc 5(5):421–431, 1998PubMed Campbell KE, et al: Representing thoughts, words, and things in the UMLS. J Am Med Inform Assoc 5(5):421–431, 1998PubMed
41.
Zurück zum Zitat Thomas BJ, et al: Automated computer-assisted categorization of radiology reports. Am J Roentgenol 184(2):687–690, 2005 Thomas BJ, et al: Automated computer-assisted categorization of radiology reports. Am J Roentgenol 184(2):687–690, 2005
42.
Zurück zum Zitat Tsui F-C, et al: Value of ICD-9-coded chief complaints for detection of epidemics. J Am Med Inform Assoc 9:S41–S47, 2002CrossRef Tsui F-C, et al: Value of ICD-9-coded chief complaints for detection of epidemics. J Am Med Inform Assoc 9:S41–S47, 2002CrossRef
43.
Zurück zum Zitat Friedman C, et al: Automated encoding of clinical documents based on natural language processing. J Am Med Inform Assoc 11(5):392–402, 2004PubMedCrossRef Friedman C, et al: Automated encoding of clinical documents based on natural language processing. J Am Med Inform Assoc 11(5):392–402, 2004PubMedCrossRef
44.
Zurück zum Zitat Srinivasan S, et al: Finding UMLS Metathesaurus concepts in MEDLINE. In: American Medical Informatics Association Annual Symposium, 2002, pp 727–731 Srinivasan S, et al: Finding UMLS Metathesaurus concepts in MEDLINE. In: American Medical Informatics Association Annual Symposium, 2002, pp 727–731
45.
Zurück zum Zitat Taira RK, Soderland SG, Jakobovits RM: Automatic structuring of radiology free-text reports. Radiographics 21:237–245, 2001PubMed Taira RK, Soderland SG, Jakobovits RM: Automatic structuring of radiology free-text reports. Radiographics 21:237–245, 2001PubMed
46.
Zurück zum Zitat Zou Q, et al: IndexFinder: a method of extracting key concepts from clinical texts for indexing. In: American Medical Informatics Association Annual Symposium, 2003, pp 763–767 Zou Q, et al: IndexFinder: a method of extracting key concepts from clinical texts for indexing. In: American Medical Informatics Association Annual Symposium, 2003, pp 763–767
50.
Zurück zum Zitat Ferrucci D, Lally A: Building an example application with the unstructured information management architecture. IBM Syst J 43(3):455–475, 2004CrossRef Ferrucci D, Lally A: Building an example application with the unstructured information management architecture. IBM Syst J 43(3):455–475, 2004CrossRef
51.
Zurück zum Zitat Baecker R, Small I, Mander R: Bringing icons to life. Proceedings of the SIGCHI conference on human factors in computing systems: reaching through technology. New Orleans, Louisiana, USA: ACM Press, 1991, pp 1–6 Baecker R, Small I, Mander R: Bringing icons to life. Proceedings of the SIGCHI conference on human factors in computing systems: reaching through technology. New Orleans, Louisiana, USA: ACM Press, 1991, pp 1–6
53.
Zurück zum Zitat Armato III, SG, et al: Lung image database consortium: developing a resource for the medical imaging research community. Radiology 232:739–748, 2004PubMedCrossRef Armato III, SG, et al: Lung image database consortium: developing a resource for the medical imaging research community. Radiology 232:739–748, 2004PubMedCrossRef
54.
Zurück zum Zitat Sigal R: PACS as an e-academic tool. In CARS 2005: computer assisted radiology and surgery. 2005 Sigal R: PACS as an e-academic tool. In CARS 2005: computer assisted radiology and surgery. 2005
55.
Zurück zum Zitat Toms AP, et al: Building an anonymized catalogued radiology museum in PACS: a feasibility study. Br J Radiol 79:661–671, 2006CrossRef Toms AP, et al: Building an anonymized catalogued radiology museum in PACS: a feasibility study. Br J Radiol 79:661–671, 2006CrossRef
56.
Zurück zum Zitat Cohen S, Gilboa F, Uri S: PACS and electronic health records, San Diego, CA: SPIE, 2002 Cohen S, Gilboa F, Uri S: PACS and electronic health records, San Diego, CA: SPIE, 2002
57.
Zurück zum Zitat Lehmann T, Wein B, Greenspan H: Integration of content-based image retrieval to picture archiving and communication systems. In: Medical Informatics Europe Conference, 2003 Lehmann T, Wein B, Greenspan H: Integration of content-based image retrieval to picture archiving and communication systems. In: Medical Informatics Europe Conference, 2003
58.
Zurück zum Zitat Traina A, Rosa NA, Traina C. Integrating images to patient electronic medical records through content-based retrieval techniques. In: 16th IEEE Symposium on Computer-Based Medical Systems, 2003 Traina A, Rosa NA, Traina C. Integrating images to patient electronic medical records through content-based retrieval techniques. In: 16th IEEE Symposium on Computer-Based Medical Systems, 2003
59.
Zurück zum Zitat Leoni L, et al: A virtual data grid architecture for medical data using SRB. In: EuroPACS-MIR 2004, Trieste, Italy, 2004 Leoni L, et al: A virtual data grid architecture for medical data using SRB. In: EuroPACS-MIR 2004, Trieste, Italy, 2004
60.
Zurück zum Zitat Erdal S, et al: Flexible patient information search and retrieval framework: pilot implementation. In: Proceedings of the SPIE Medical Imaging, San Diego, CA, 2007 Erdal S, et al: Flexible patient information search and retrieval framework: pilot implementation. In: Proceedings of the SPIE Medical Imaging, San Diego, CA, 2007
61.
Zurück zum Zitat Erdal S, et al: Information warehouse application of caGrid: a prototype implementation. In: caBIG 2007 Annual Meeting, Washington, DC, 2007 Erdal S, et al: Information warehouse application of caGrid: a prototype implementation. In: caBIG 2007 Annual Meeting, Washington, DC, 2007
62.
Zurück zum Zitat Erdal S, et al: Integrating a PACS system to grid: a de-identification and integration framework. In: Annual Meeting of the Society for Imaging Informatics in Medicine (SIIM) 2007, Providence, RI, 2007 Erdal S, et al: Integrating a PACS system to grid: a de-identification and integration framework. In: Annual Meeting of the Society for Imaging Informatics in Medicine (SIIM) 2007, Providence, RI, 2007
63.
Zurück zum Zitat Lindberg C: The unified medical language system (UMLS) of the national library of medicine. J Am Med Rec Assoc 61(5):40–42, 1990PubMed Lindberg C: The unified medical language system (UMLS) of the national library of medicine. J Am Med Rec Assoc 61(5):40–42, 1990PubMed
64.
Zurück zum Zitat Lindberg DA, Humphreys BL, McCray AT: The unified medical language system. Methods Inf Med 32(4):281–291, 1993PubMed Lindberg DA, Humphreys BL, McCray AT: The unified medical language system. Methods Inf Med 32(4):281–291, 1993PubMed
66.
Zurück zum Zitat Eckerson WW: Three tier client/server architecture: achieving scalability, performance, and efficiency in client server applications. Open Inf Syst 10:1–12, 1995 Eckerson WW: Three tier client/server architecture: achieving scalability, performance, and efficiency in client server applications. Open Inf Syst 10:1–12, 1995
67.
Zurück zum Zitat Gallaugher J, Ramanathan S: Choosing a client/server architecture. A comparison of two-tier and three-tier systems. Inf Syst Manage Mag 13(2):7–13 Gallaugher J, Ramanathan S: Choosing a client/server architecture. A comparison of two-tier and three-tier systems. Inf Syst Manage Mag 13(2):7–13
68.
Zurück zum Zitat Clunie DA: DICOM structured reporting, Bangor, Pennsylvania: PixelMed, 2000 Clunie DA: DICOM structured reporting, Bangor, Pennsylvania: PixelMed, 2000
69.
Zurück zum Zitat Payne PR, et al: Breaking the translational barriers: the value of integrating biomedical informatics and translational research. J Investig Med 53(4):192–200, 2005PubMedCrossRef Payne PR, et al: Breaking the translational barriers: the value of integrating biomedical informatics and translational research. J Investig Med 53(4):192–200, 2005PubMedCrossRef
Metadaten
Titel
A Knowledge-Anchored Integrative Image Search and Retrieval System
verfasst von
Selnur Erdal
Umit V. Catalyurek
Philip R. O. Payne
Joel Saltz
Jyoti Kamal
Metin N. Gurcan
Publikationsdatum
01.04.2009
Verlag
Springer-Verlag
Erschienen in
Journal of Imaging Informatics in Medicine / Ausgabe 2/2009
Print ISSN: 2948-2925
Elektronische ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-007-9086-8

Weitere Artikel der Ausgabe 2/2009

Journal of Digital Imaging 2/2009 Zur Ausgabe

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.