Classification of fruits is a growing research topic in image processing. Various papers propose various techniques to deal with the classification of apples. However, some traditional classification methods remain drawbacks to producing an effective result with the big dataset. Inspired by deep learning in computer vision, we propose a novel learning method to construct a classification model, which can classify types of apples quickly and accurately. To conduct our experiment, we collect datasets, do preprocessing, train our model, tune parameter settings to get the highest accuracy results, then test the model using new data. Based on the experimental results, the classification model of green apples and red apples can obtain good accuracy with little loss. Therefore, the proposed model can be a promising solution to deal with apple classification.