A deep learning based geographic attention model for body composition tissue segmentation

Abstract

Measurement of body composition, including multiple types of adipose tissue, skeletal tissue, and skeletal muscle, on computed tomography (CT) images is practical given the powerful anatomical structure visualization ability of CT, and is useful for clinical and research applications related to health care and underlying pathology. In recent years, deep learningbased methods have contributed significantly to the development of automatic body composition analysis (BCA). However, the unsatisfactory segmentation performance for indistinguishable boundaries of multiple body composition tissues and the need for large-scale datasets for training deep neural networks still need to be addressed. This paper proposes a deep learning-based approach, called Geographic Attention Network (GA-Net), for body composition tissue segmentation on body torso positron emission tomography/computed tomography (PET/CT) images which leverages the body area information. The representation ability of GA-Net is significantly enhanced with the body area information as it strongly correlates with the target body composition tissue. This method achieves precise segmentation performance for multiple body composition tissues, especially for boundaries that are hard to distinguish, and effectively reduces the data requirements for training the network. We evaluate the proposed model on a dataset that includes 50 body torso PET/CT scans for segmenting 4 key bodily tissuessubcutaneous adipose tissue (SAT), visceral adipose tissue (VAT), skeletal muscle tissue (SMT), and skeleton (Sk). Experiments show that our proposed method increases segmentation accuracy, especially with a limited training dataset, by providing geographic information of target body composition tissues.