As people's requirements for applications are getting higher and higher, the recognition of facial features has been paid more and more attention. The current facial feature recognition algorithm not only takes a long time, but also has problems such as large system resource consumption and long running time in practical applications. Based on this, the research proposes a multi-task face recognition algorithm by combining multi-task deep learning on the basis of convolutional neural network, and analyzes its performance in four dimensions of face identity, age, gender, and fatigue state. The experimental results show that the multi-task face recognition algorithm model obtained through layer-by-layer progression takes less time than other models and can complete more tasks in the same training time. At the same time, comparing the best model M44 with other algorithms in four dimensions, it is found that the Mean Absolute Error lowest is 3.53, and the highest Accuracy value is 98.3%. On the whole, the multi-task face recognition algorithm proposed in the study can recognize facial features efficiently and quickly. At the same time, its training time is short, the calculation speed is fast, and the recognition accuracy is much higher than other algorithms. It is applied to intelligent driving behavior. Analysis, intelligent clothing navigation and other aspects have strong practical significance.