Objectives This study aimed at developing a convolutional neural network (CNN) able to automatically quantify and characterize the level of degeneration of rotator cuff (RC) muscles from shoulder CT images including muscle atrophy and fatty infiltration. Methods One hundred three shoulder CT scans from 95 patients with primary glenohumeral osteoarthritis undergoing anatomical total shoulder arthroplasty were retrospectively retrieved. Three independent radiologists manually segmented the premorbid boundaries of all four RC muscles on standardized sagittal-oblique CT sections. This premorbid muscle segmentation was further automatically predicted using a CNN. Automatically predicted premorbid segmentations were then used to quantify the ratio of muscle atrophy, fatty infiltration, secondary bone formation, and overall muscle degeneration. These muscle parameters were compared with measures obtained manually by human raters. Results Average Dice similarity coefficients for muscle segmentations obtained automatically with the CNN (88% ± 9%) and manually by human raters (89% ± 6%) were comparable. No significant differences were observed for the subscapularis, supraspinatus, and teres minor muscles (p > 0.120), whereas Dice coefficients of the automatic segmentation were significantly higher for the infraspinatus (p < 0.012). The automatic approach was able to provide good-very good estimates of muscle atrophy (R 2 = 0.87), fatty infiltration (R 2 = 0.91), and overall muscle degeneration (R 2 = 0.91). However, CNN-derived segmentations showed a higher variability in quantifying secondary bone formation (R 2 = 0.61) than human raters (R 2 = 0.87). Conclusions Deep learning provides a rapid and reliable automatic quantification of RC muscle atrophy, fatty infiltration, and overall muscle degeneration directly from preoperative shoulder CT scans of osteoarthritic patients, with an accuracy comparable with that of human raters. Key Points • Deep learning can not only segment RC muscles currently available in CT images but also learn their pre-existing locations and shapes from invariant anatomical structures visible on CT sections. • Our automatic method is able to provide a rapid and reliable quantification of RC muscle atrophy and fatty infiltration from conventional shoulder CT scans. • The accuracy of our automatic quantitative technique is comparable with that of human raters.