The application of non-cognitive factors represented by facial emotion in educational evaluation has attracted much attention in recent years. There are many existing studies on facial emotion assisted education evaluation, but most of them are based on virtual learning environments, which means that the research on facial emotion and learning effect in offline learning environments is sparse. In order to solve this problem, this study designed an emotion observation experiment based on the offline learning environment, obtained the type of learner facial emotion and learning effect of 127 college students, and further explored the relationship between the two. The results show that: 1) We obtained eight types of learner emotion through the combined description method: joy, relaxation, surprise, meekness, contempt, disgust, sadness, anxiety and their respective PAD emotional mean. 2) We obtained the correlation results of the six emotions of joy, relaxation, surprise, meekness, contempt, and anxiety with the learning effect and the predicted value of the learning effect. 3) We then constructed an explanatory model of learner emotion and learning effect based on the offline learning environment.