Nowadays, the economic globalization is advancing day by day. As the most widely used language for international communication, English is becoming more and more important. English education is the most important part of the whole English basic education, and English teachers play an important role in developing the cause of English basic education. Job competency assessment is a technical method to assess the staff’s working ability, which can comprehensively and objectively evaluate the English teaching position competency. Based on the in-depth study of the relevant theories of the job competency model, the nonlinear random matrix is applied to the job competency evaluation, and the components of English teachers’ job competency are deeply explored. The competency evaluation elements are constructed from three levels of knowledge ability, technical ability, and potential ability. Based on the established job competency evaluation model, this paper evaluates and analyzes the English teachers’ job competency. The results showed that the model had good structural validity, and the correlation between factors and the scale was 0.3∽0.8, with no significant difference in each factor, which provided strong support for the assessment of English teaching competence.