A rotation and translation invariant method for 3D organ image classification using deep convolutional neural networks

Abstract

Three-dimensional (3D) medical image classification is useful in applications such as disease diagnosis and content-based medical image retrieval. It is a challenging task due to several reasons. First, image intensity values are vastly different depending on the image modality. Second, intensity values within the same image modality may vary depending on the imaging machine and artifacts may also be introduced in the imaging process. Third, processing 3D data requires high computational power. In recent years, significant research has been conducted in the field of 3D medical image classification. However, most of these make assumptions about patient orientation and imaging direction to simplify the problem and/or work with the full 3D images. As such, they perform poorly when these assumptions are not met. In this paper, we propose a method of classification for 3D organ images that is rotation and translation invariant. To this end, we extract a representative two-dimensional (2D) slice along the plane of best symmetry from the 3D image. We then use this slice to represent the 3D image and use a 20-layer deep convolutional neural network (DCNN) to perform the classification task. We show experimentally, using multi-modal data, that our method is comparable to existing methods when the assumptions of patient orientation and viewing direction are met. Notably, it shows similarly high accuracy even when these assumptions are violated, where other methods fail. We also explore how this method can be used with other DCNN models as well as conventional classification approaches.

Rupture risk prediction of cerebral aneurysms using a novel convolutional neural network-based deep learning model

“…In the field of medical imaging, as the deep learning technique advances, data augmentation methods have been studied to generate large datasets from small datasets 23 24. However, the data augmentation method that has been used so far simply creates multiple identical images by rotating or translating a single image.…”

Convolutional neural network in upper limb functional motion analysis after stroke

“…The CNN is very efficient in image recognition, in which local spatial dependencies do exist, (Islam, Wijewickrema & OLeary, 2019). The same advantage can be usefully in motion analysis where the input data is organized into array represented with some snapshots of motion in form of activity image (Liu et al, 2016;Ijjina & Mohan, 2014).…”

Hippocampus’s volume calculation on coronal slice’s for strengthening the diagnosis of Alzheimer’s

“…Pelsmacker et al [12] explored the influence of message as a mediator in the processing of Alzheimer's consciousness with various arguments, strength, and valence. Islam et al [13] developed a classification method for 3D organ images are rotation and invariant translation. They extract a representative two-dimensional (2D) piece along the plane best symmetry of 3D images.…”