Genetic Programming (GP) algorithm has been successfully applied to classification tasks for many years, with a long history and remarkable effects. It is worth noting that GP tends to evolve biased classifiers when it is used for class imbalanced datasets. Biased classifiers are often unreliable and will seriously affect the classification performance. In addition, when GP is used to train the model to adapt to the high-dimensional imbalanced datasets, it is easy to be affected by the majority class and ignore the existence of the minority class. Therefore, classification tasks based on GP in high-dimensional and imbalanced datasets need to be further studied. In this paper, we propose a GP approach for imbalance classification tasks with the aim of improving the classification performance and minimizing the time consumption, named HGPWOA. A multi-objectivization fitness function is adopted to solve the problem, supplemented by Whale Optimization Algorithm (WOA) for feature selection, and then feature augmentation strategy is adopted to improve the classification efficiency. The method was tested on 5 imbalanced datasets. The experimental results show that this method is superior to the traditional classification algorithms, which provides a new way to study the class imbalance problems.