Multi-modal image registration and machine learning for the generation of 3D virtual histology of bone implants

Abstract

In our correlative characterisation studies of biodegradable and permanent metal bone implants, we have performed both synchrotron-radiation microtomography (SR-µCT) and histology on the same samples. Histological staining is still the gold standard for tissue visualisation yet requires multiple time-consuming sample preparation steps (fixing, embedding, sectioning and staining) before imaging is performed on individual slices, in contrast to the non-invasive and 3D nature of tomography. In the process of correlating the corresponding data sets, we are able to combine advantages of both modalities by using machine learning methods to generate artificially stained 3D virtual histology datasets from SR-µCT datasets. For this we have developed an automated registration tool to find and fit the correct virtual tomographic plane to each histology slice. Preliminary results are promising after training a modified cycle generative adversarial network on our data, with two different histological stainings.