At present, colleges and universities attach great importance to the assessment of teachers, strengthen the assessment of college teachers, and create a team of teachers with high quality, professionalism, and vitality, which can not only fully develop and allocate human resources in colleges and universities, but also promote colleges and universities. The reform of the personnel system will continuously optimize the proportion and structural allocation of teachers’ resources in colleges and universities, improve the quality and efficiency of running schools, enhance the competitiveness and attractiveness of schools, and better achieve the school’s school-running goals. In order to obtain higher signal reconstruction accuracy and satisfy random matrix with a relatively small compression ratio, this paper combines QR decomposition, which is used to increase the column independence of random matrix, and gradient descent method, which can reduce the cross-correlation between random matrix and sparse matrix. Based on the actual situation of a certain university, this paper studies and designs a set of perfect and reasonable teacher performance appraisal system that meets the requirements of the college, analyzes and researches the current situation of teacher performance appraisal in the college, and finds out the problem. Combining the advanced concept of being good at performance appraisal with the actual situation of the college, it analyzes the problems in the teacher performance appraisal system, summarizes the reasons for the formation of the problem, further redesigns the teacher performance appraisal index system, and gives the relevant implementation of the system. The basic characteristics presented in the organization of colleges and universities will not change. With the continuous adjustment of the organization of colleges and universities, the goals of colleges and universities are also being adjusted. Colleges and universities should continuously improve the performance appraisal system of teachers to make the goals of teachers consistent with the development goals of colleges and universities, so as to continuously improve the basic quality and realization of college teachers.