This study designs and implements a scoring system for open-spoken English using NN technology. The system scores the oral recording from the phonetic level and the text level, respectively, and can comprehensively evaluate its oral level. The system will separately score the spoken speech and the spoken content through different scoring models and add the scoring results as the final score, in which the spoken content is obtained by text transcription of the recording by an external speech recognition engine. An acoustic sensor is adopted to collect pronunciation signals of spoken English. Modern signal processing and automatic pattern recognition technology are used to distinguish the quality of spoken pronunciation. Similar semantic units are marked between acoustic feature sequences, which make use of the parallel algorithm processing mode of multi-computing cores of modern GPU and allow multiple units to independently execute the comparison algorithm at the same time. Experiments show that the model in this study achieves better comprehensive scoring performance. The scoring model is of great significance to the development of educational informatization and intelligence, and it also provides a reference for the construction of intelligent oral scoring system.