A Visual Information Retrieval System for Radiology Reports and the Medical Literature

Abstract

Abstract. The enormous amount of visual data in Picture Archival and Communication Systems (PACS) and in the medical literature is growing exponentially. In the proposed demo, the medical image search of the KHRESMOI project is presented to solve some of the challenges of medical data management and retrieval. The system allows searching for visual information by combining content-based image retrieval (CBIR) and text retrieval in several languages using semantic concepts. 3D visual retrieval in internal hospital sources is supported by marking volumes of interest (VOI) in the data and connection to the medical literature are established to allow further investigating interesting cases. The system is demonstrated on 5TB of radiology reports with associated images and articles of the biomedical literature with over 1.7M images.

A Multimodal Search Engine for Medical Imaging Studies

“…The main user interface is based on the ezDL project, but an alternate interface was developed, called Shambala [14]. Markonis et al [15] have covered the use of Khresmoi for the retrieval of medical images in a PACS archive and the biomedical literature. The search engines developed under this project are backed by ParaDISE [13], a CBIR system featuring an architecture with scalability and extensibility in mind, although lacking in details about how the complete system is orchestrated in a typical usage.…”