Impact of lossy compression of X-ray projections onto reconstructed tomographic slices

Abstract

Modern detectors used at synchrotron tomographic microscopy beamlines typically have sensors with more than 4–5 mega-pixels and are capable of acquiring 100–1000 frames per second at full frame. As a consequence, a data rate of a few TB per day can easily be exceeded, reaching peaks of a few tens of TB per day for time-resolved tomographic experiments. This data needs to be post-processed, analysed, stored and possibly transferred, imposing a significant burden onto the IT infrastructure. Compression of tomographic data, as routinely done for diffraction experiments, is therefore highly desirable. This study considers a set of representative datasets and investigates the effect of lossy compression of the original X-ray projections onto the final tomographic reconstructions. It demonstrates that a compression factor of at least three to four times does not generally impact the reconstruction quality. Potentially, compression with this factor could therefore be used in a transparent way to the user community, for instance, prior to data archiving. Higher factors (six to eight times) can be achieved for tomographic volumes with a high signal-to-noise ratio as it is the case for phase-retrieved datasets. Although a relationship between the dataset signal-to-noise ratio and a safe compression factor exists, this is not simple and, even considering additional dataset characteristics such as image entropy and high-frequency content variation, the automatic optimization of the compression factor for each single dataset, beyond the conservative factor of three to four, is not straightforward.

Data reduction in protein serial crystallography

“…Identifying a universal lossy compression scheme is thus difficult since the choice depends on what information must be retained and what can be discarded. For example, high-quality JPEG-type compression is widely used in medical imaging (Wiseman & Fredj, 2001), and compression factors of 6-8 can be obtained without affecting the diagnosis using conventional JPEG 2000 (Rabbani & Joshi, 2002;Marone et al, 2020) and JPEG XR (https://jpeg.org/jpegxr/index.html) compression methods. The appearance of compression artifacts after applying lossy compression is not so important here since JPEG is designed to preserve common visual features of such images.…”

Software and algorithms for high-throughput multimodal experiments at advanced synchrotron light sources

“…As mentioned above, the JPEG compression standard probably is one of the most studied and used techniques for still image compression. Marone et al 33 discussed their experiments on compression using three known techniques including the JPEG: the JPEG 2000, the JPEG XR and the bzip2. They used mean structural similarity index measure (MSSIM) as the evaluation metric and the results showed the MSSIM all decreased as the compression ratio increased, with the bzip2 decreased the fastest then the JPEG XR and JPEG 2000 decreased the slowest, meaning the JPEG 2000 performed the best among the three.…”