The number of image video is increasing at an amazing speed because of its intuitive image and strong information integration. The semantic analysis of image emotion has a broad application prospect and practical value. The purpose of this study is to conduct psychological counseling and personality analysis on the emotion expressed by computer images. In this study, the sun database image database data set is selected to establish a mathematical model of the data, through linear combination of multiple indicators, and convert them into several unrelated indicators, but it can maintain the large amount of information contained in the original indicators, the emotional semantic data is analyzed by principal component analysis, and then combined with classification algorithm to analyze the image emotion character.The results show that the accuracy of character analysis of image emotion reaches 73.55% on average when the binary tree depth = 3. The recognition rate is the highest when the threshold value is 0.8, and the recognition accuracy is 77.33%. It is concluded that the classification algorithm in this study has good accuracy and accuracy for image emotion recognition, and can provide psychological counseling and personality analysis for the emotion contained in the image. It has contributed to the character analysis and mental health of network users.