Deformable image registration between pathological images and MR image via an optical macro image

Abstract

Computed tomography (CT) and magnetic resonance (MR) imaging have been widely used for visualizing the inside of the human body. However, in many cases, pathological diagnosis is conducted through a biopsy or resection of an organ to evaluate the condition of tissues as definitive diagnosis. To provide more advanced information onto CT or MR image, it is necessary to reveal the relationship between tissue information and image signals. We propose a registration scheme for a set of PT images of divided specimens and a 3D-MR image by reference to an optical macro image (OM image) captured by an optical camera. We conducted a fundamental study using a resected human brain after the death of a brain cancer patient. We constructed two kinds of registration processes using the OM image as the base for both registrations to make conversion parameters between the PT and MR images. The aligned PT images had shapes similar to the OM image. On the other hand, the extracted cross-sectional MR image was similar to the OM image. From these resultant conversion parameters, the corresponding region on the PT image could be searched and displayed when an arbitrary pixel on the MR image was selected. The relationship between the PT and MR images of the whole brain can be analyzed using the proposed method. We confirmed that same regions between the PT and MR images could be searched and displayed using resultant information obtained by the proposed method. In terms of the accuracy of proposed method, the TREs were 0.56 ± 0.39 mm and 0.87 ± 0.42 mm. We can analyze the relationship between tissue information and MR signals using the proposed method.

Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation

“…inserting carbon rods 27 ) or ex vivo imaging of the surgical specimen 23, 28, 29 . The closest work to our approach is that of Li et al .…”

Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology

“…Coregistration of radiology images (eg, computed tomography, magnetic resonance imaging) and digitized slides from postmortem human brain specimens has been successfully mapped with an accuracy of 0.56 6 0.39 to 0.87 6 0.42 mm. 25 It remains to be seen if this can be improved with the HoloLens. The HoloLens also supports a wide variety of hands-free tasks (eg, voice commands, documentation, annotation, video recording) and digital imaging applications (eg, whole slide imaging).…”

Tensor Image Registration Library: Automated Non-Linear Registration of Sparsely Sampled Histological Specimens to Post-Mortem MRI of the Whole Human Brain

“…Unfortunately, the authors never made their implementation publicly available for reuse, prohibiting the test of novel texture-based cost functions, such as the Modality-Independent Neighbourhood Descriptor (MIND) [43]. The registration of small histological sections (as opposed to whole-hemisphere images) was studied by Ohnishi et al [44]. Using manual landmarks, they stitched together smaller histological images into a full hemisphere, and subsequently registered it to a photograph of the coronal section of the hemisphere, which was further registered to 3D MRI.…”