With the development of society and the promotion of science and technology, English, as the largest universal language in the world, is used by more and more people. In the life around us, there is information in English all the time. However, because the process of manual recognition of English letters is very labor-intensive and inefficient, the demand for computer recognition of English letters is increasing. This paper studies the influence of the parameters of BP neural network and genetic algorithm on the whole network, including the input, output, and number of hidden layer nodes. Finally, it improves and determines the settings and values of the relevant parameters. On this basis, it shows the rationality of the selected parameters through experiments. The results show that only GA-BP neural network and feature data mining algorithm can complete feature extraction and become the main function of feature classification at the same time. After enough initial data sample analysis training, the GA-BP neural network was found to have good data fault tolerance and feature recognition. The experimental results show that the genetic algorithm can find the best weights and thresholds and the weights and thresholds are given to the BP neural network. After training, the recognition of handwritten letters can be realized. Finally, the convergence of the two algorithms is compared through experiments, which shows that the overall performance of the BP neural network algorithm is improved after genetic algorithm optimization. It can be seen that the genetic algorithm has a good effect in improving the BP neural network and this method has a broad prospect in English feature recognition.