Ot2Rec: A semi-automatic, extensible, multi-software tomographic reconstruction workflow

Abstract

Electron cryo-tomography (cryo-ET) is an imaging technique for probing 3D structures with at the nanometre scale. This technique has been used extensively in the biomedical field to study the complex structures of proteins and other macromolecules. With the advancement in technology, microscopes are currently capable of producing images amounting to terabytes of data per day, posing great challenges for scientists as the speed of processing of the images cannot keep up with the ever-higher throughput of the microscopes. Therefore, automation is an essential and natural pathway on which image processing -from individual micrographs to full tomograms -is developing. In this paper, we present Ot2Rec, an open-source pipelining tool which aims to enable scientists to build their own processing workflows in a flexible and automatic manner. The basic building blocks of Ot2Rec are plugins which follow a unified API structure, making it simple for scientists to contribute to Ot2Rec by adding features which are not already available. In this paper, we also present three case studies of image processing using Ot2Rec, through which we demonstrate the speedup of using a semi-automatic workflow over a manual one, the possibility of writing and using custom (prototype) plugins, and the flexibility of Ot2Rec which enables the mix-and-match of plugins. We also demonstrate, in the supplementary information, a builtin reporting feature in Ot2Rec which aggregates the metadata from all process being run, and output them in the Jupyter Notebook and/or HTML formats for quick review of image processing quality. Ot2Rec can be found at https://github.com/rosalindfranklininstitute/ot2rec Impact StatementThe field of cryo electron tomography has grown substantially in recent years, bringing about new advances in hardware and software which enable visualisation of cell and tissue architecture and proteins found in their native context. These same advances have, in some ways, stratified the field into those with access and those without. On the software side, this has emphasised the need for open-source options that do not require high levels of computational literacy to access. Additionally, it has highlighted the need for ways to both mix-and-match software for easy prototyping and comparisons between parameters and methods. Ot2Rec addresses these needs through a simple, unified plugin structure allowing the addition of existing software or the development of new and does so in a way which democratises access.