Fruit that has reached maturity is ready to be harvested. The prediction of fruit maturity and quality is important not only for farmers or the food industry but also for small retail stores and supermarkets where fruits are sold and purchased. Fruit maturity classification is the process by which fruits are classified according to their maturity in their life cycle. Nowadays, deep learning (DL) has been applied in many applications of smart agriculture such as water and soil management, crop planting, crop disease detection, weed removal, crop distribution, strong fruit counting, crop harvesting, and production forecasting. This study aims to find the best deep learning algorithms which can be used for the prediction of fruit maturity and quality for the shelf life of fruit. In this study, two datasets of banana fruit are used, where we create the first dataset, and the second dataset is taken from Kaggle, named Fruit 360. Our dataset contains 2100 images in 3 categories: ripe, unripe, and over-ripe, each of 700 images. An image augmentation technique is used to maximize the dataset size to 18,900. Convolutional neural networks (CNN) and AlexNet techniques are used for building the model for both datasets. The original dataset achieved an accuracy of 98.25% for the CNN model and 81.75% for the AlexNet model, while the augmented dataset achieved an accuracy of 99.36% for the CNN model and 99.44% for the AlexNet model. The Fruit 360 dataset achieved an accuracy of 81.96% for CNN and 81.75% for the AlexNet model. We concluded that for all three datasets of banana images, the proposed CNN model is the best suitable DL algorithm for bananas’ fruit maturity classification and quality detection.