At the moment, the existing teaching evaluation system cannot be used for wireless data input and reception, limiting the system's application scope and making it less practical. As a result, a new system for evaluating college English teaching is being developed using a mobile terminal. The English teaching quality model is constructed using the Internet of Things mobile platform, and the network teaching structure is analyzed using the model parameters to monitor and control the teaching progress. A classification and evaluation system will be established in conjunction with the campus network and intelligent sensor networking technology. The development environment and overall design of the mobile terminal are used to create an evaluation system for English teaching in an Internet of Things environment. Create the critical architecture based on the B/S model. In the section on system software design, we mine data from English teaching resources, evaluate students’ progress toward English proficiency, and use convolutional neural networks to evaluate the quality of English teaching. The teaching results are output according to the distribution of convolutional layers, allowing us to analyze the level of English instruction in colleges and universities. Comparative experiments demonstrate that this research system has a higher information query efficiency, a lower convergent error of 4 ms, and a higher evaluation accuracy for oral English, English writing, and English reading.