The struggle with image glut

Perkel, Jeffrey M.

doi:10.1038/533131a

Cited by 3 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Even though these methods bring undeniable advantages, the data production speed and experiment sizes ( Fig. 1a, Supplementary Table 1) are increasing in such a fast pace that in many cases data handling quickly becomes a bottleneck for new discoveries [12]- [14]. A straightforward solution to this problem is to perform image compression.…”

Section: Mainmentioning

confidence: 99%

A real-time compression library for microscopy images

Balint¹,

Deschamps²,

Albert³

et al. 2017

Preprint

View full text Add to dashboard Cite

Fluorescence imaging techniques such as single molecule localization microscopy, highcontent screening and light-sheet microscopy are producing ever-larger datasets, which poses increasing challenges in data handling and data sharing. Here, we introduce a realtime compression library that allows for very fast (beyond 1 GB/s) compression and decompression of microscopy datasets during acquisition. In addition to an efficient lossless mode, our algorithm also includes a lossy option, which limits pixel deviations to the intrinsic noise level of the image and yields compression ratio of up to 100-fold. We present a detailed performance analysis of the different compression modes for various biological samples and imaging modalities. opened new perspectives in biology by increasing the speed of imaging, the number of specimens or the resolution of the observed structures. Even though these methods bring undeniable advantages, the data production speed and experiment sizes (Fig. 1a, Supplementary Table 1) are increasing in such a fast pace that in many cases data handling quickly becomes a bottleneck for new discoveries [12]-[14]. A straightforward solution to this problem is to perform image compression. Nonetheless, this typically implies incompatibilities with certain software packages, slow compression speed, and only moderate file size reduction for lossless methods. Although the compression ratio (original size / compressed size) can be substantially increased with lossy compression algorithms, their use is often discouraged [15] as the degree of information loss heavily depends on the image content and cannot be explicitly controlled.To address these challenges, we developed a new compression library called B 3 D, which is capable of extremely fast compression and decompression of large microscopy datasets. Our library is built on the CUDA architecture [16] for GPU-based compression, which not only enables high processing speed, but also relieves load on the central processing unit, allowing compression directly during image acquisition. The algorithm has two main components. First, a prediction is made for each pixel based on the neighboring pixel values, and second, the prediction errors are run-length and Huffman encoded to effectively reduce the data size (Supplementary Note and Supplementary Fig. 1). We compared our algorithm's performance with TIFF (LZW), JPEG2000, and the speed-optimized KLB [17] by measuring compression speed, decompression speed and resulting file size (Fig. 1b). Only B³D is capable of handling the sustained high data rate of modern sCMOS cameras typically . CC-BY 4.0 International license not peer-reviewed) is the author/funder. It is made available under a

show abstract

Section: Mainmentioning

confidence: 99%

A real-time compression library for microscopy images

Balint¹,

Deschamps²,

Albert³

et al. 2017

Preprint

View full text Add to dashboard Cite

show abstract

Challenges in long-term imaging and quantification of single-cell dynamics

2016

View full text Add to dashboard Cite

Continuous analysis of single cells, over several cell divisions and for up to weeks at a time, is crucial to deciphering rare, dynamic and heterogeneous cell responses, which would otherwise be missed by population or single-cell snapshot analysis. Although the field of long-term single-cell imaging, tracking and analysis is constantly advancing, several technical challenges continue to hinder wider implementation of this important approach. This is a particular problem for mammalian cells, where in vitro observation usually remains the only possible option for uninterrupted long-term, single-cell observation. Efforts must focus not only on identifying and maintaining culture conditions that support normal cellular behavior while allowing high-resolution imaging over time, but also on developing computational methods that enable semiautomatic analysis of the data. Solutions in microscopy hard- and software, computer vision and specialized theoretical methods for analysis of dynamic single-cell data will enable important discoveries in biology and beyond.

show abstract