Convolutional neural networks (CNNs) require large amounts of data for training, beyond what can be acquired for current radiomics models. We hypothesize that deep entropy features (DEFs) derived from existing CNNs can be applied to MRI images of prostate cancers (PCa) to reliably predict the Gleason score (GS) of PCa lesions. In this study, we analyzed 112 lesions acquired from 99 PCa patients, either pre-biopsy or pre-treatment, their associated GS, and multi-parametric MRI (mpMRI) sequences. Our approach is based on the extraction of DEF features produced in individual layers of 9 pre-trained CNN models. We first analyze DEFs from separate CNNs using the Wilcoxon test and Spearman correlation to find significant features associated with GS. In a multivariate analysis, we then use the combined DEFs of all CNNs as input to a random forest (RF) classifier for predicting the Gleason grade group of patients. Among the 9 pre-trained CNNs, the NASNet-mobile architecture offered the features most correlated to GS (ρ=0.47; p<0.05). From the 7,857 combined features, 11 DEFs could differentiate GS < 8 from GS ≥ 8 (corrected p < 0.05). Moreover, the RF classifier discerned GS of 6, 3+4, 4+3, 8 and ≥ 9 with an AUC (%) of 80.08, 85.77, 97.30, 98.20, and 86.51, respectively. Our results suggest that the DEFs can be used to differentiate GS of PCa lesions with the highest accuracy of GS ≥ 8 based on mpMRI. DEFs could improve diagnosis accuracy, reduce the risks of misclassification, help to better assess prognosis, and individualize patient care approaches.