Accurate identification of individual tree species (ITS) is crucial to forest management. However, current ITS identification methods are mainly based on traditional image features or deep learning. Traditional image features are more interpretative, but the generalization and robustness of such methods are inferior. In contrast, deep learning based approaches are more generalizable, but the extracted features are not interpreted; moreover, the methods can hardly be applied to limited sample sets. In this study, to further improve ITS identification, typical spectral and texture image features were weighted to assist deep learning models for ITS identification. To validate the hybrid models, two experiments were conducted; one on the dense forests of the Huangshan Mountains, Anhui Province and one on the Gaofeng forest farm, Guangxi Province, China. The experimental results demonstrated that with the addition of image features, different deep learning ITS identification models, such as DenseNet, AlexNet, U-Net, and LeNet, with different limited sample sizes (480, 420, 360), were all enhanced in both study areas. For example, the accuracy of DenseNet model with a sample size of 480 were improved to 87.67% from 85.41% in Huangshan. This hybrid model can effectively improve ITS identification accuracy, especially for UAV aerial imagery or limited sample sets, providing the possibility to classify ITS accurately in sample-poor areas.