Garbage is an underutilized resource, and garbage classification is one of the effective ways to make full use of these resources. In order to realize the automation of garbage classification, some deep learning models are used for garbage images recognition. A novel garbage image recognition model Garbage Classification Net (GCNet) based on transfer learning and model fusion is proposed in this paper. After extracting garbage image features, EfficientNetv2, Vision Transformer, and DenseNet, respectively, are combined to construct the neural network model of GCNet. Data augmentation is used to expand the dataset and 41,650 garbage images are contained in the new dataset. Compared with other models through experiments, the results show that the proposed model has good convergence, high recall rate and accuracy, and short recognition time.