Optimization of PACS Data Persistency Using Indexed Hierarchical Data

Abstract

We present a new approach for the development of a data persistency layer for a Digital Imaging and Communications in Medicine (DICOM)-compliant Picture Archiving and Communications Systems employing a hierarchical database. Our approach makes use of the HDF5 hierarchical data storage standard for scientific data and overcomes limitations of hierarchical databases employing inverted indexing for secondary key management and for efficient and flexible access to data through secondary keys. This inverted indexing is achieved through a general purpose document indexing tool called Lucene. This approach was implemented and tested using real-world data against a traditional solution employing a relational database, in various store, search, and retrieval experiments performed repeatedly with different sizes of DICOM datasets. Results show that our approach outperforms the traditional solution on most of the situations, being more than 600 % faster in some cases.

Effects of data protection laws on data brokerage businesses

“…A data security breach occurs when there is a loss, theft or other unauthorized access to sensitive personally identifiable information that could result in the potential compromise of the confidentiality or integrity of data (Stevens, 2012). This fact represents a deep problem in many areas, such as [29,30,31,32,33,34,35,36]. Legislation that addresses such cases usually requires the events to be made public, and both the potentially affected individuals and regulatory agencies to be informed.…”

Intelligent generator of big data medical imaging repositories

“…However, their largest dataset might not be representative enough of the current scenario, since it contains only around 50 thousand images, approximately 4 times the daily CT production of our dataset C (see Section 4). More evidence of this issue is found in [11, 19, 20, 21].…”

“…Most of the traditional technologies are not prepared to handle the requirements raised by those big data environments. Recent research efforts have been made with the adoption of nonconventional database technologies, such as document stores and free text indexes, in PACS [7,11,12,13]. Concerning networks, several distributed architectures have been proposed, contemplating optimised communication processes, cache, and prefetch mechanisms to support those specific scenarios [3,14].…”