Nowadays, the fourth industrial revolution has achieved significant advancement in high technology, in which artificial intelligence has had vigorous development. In practice, facial recognition is one most essential tasks in the field of computer vision with various potential applications from security and attendance system to intelligent services. In this paper, we propose an efficient deep learning approach to facial recognition. The paper utilizes the architecture of improved FaceNet model based on MobileNetV2 backbone with SSD subsection. The improved architecture uses depth-wise separable convolution to reduce the model size and computational volume and achieve high accuracy and processing speed. To solve the problem of identifying a person entering and exiting an area and integrating on advanced mobile devices limits to (such as limited memory and on-device storage) highly mobile resources. Especially, our approach yields better results in practical application with more than 95% accuracy on a small dataset of the original face images. Obtained frame rate (25 FPS) is very favorable compared to the field of facial recognition using neural network. Besides, the deep learning based on solution could be applicable in many low-capacity hardware or optimize system’s resource. Finally, the smart automated attendance systems is successfully designed basing on the improved efficient facial recognition.