Real-time facial expression recognition is the basis for computers to understand human emotions and detect abnormalities in time. To effectively solve the problems of server overload and privacy information leakage, a real-time facial expression recognition method based on iterative transfer learning and efficient attention network (EAN) for edge resource-constrained scenes is proposed in this paper. Firstly, an EAN is designed with its parameter number and computation amount strictly limited by depth separable convolution and local channel attention mechanism. Then, the soft labels of facial expression data were obtained by EAN based on the idea of knowledge distillation, so as to provide more supervision information for the training process. Finally, an iterative transfer learning method of teacher-student (T-S) network was proposed; it refines the soft labels of the teacher network and further improves the recognition accuracy of the student network.The tests on the public datasets, FER2013 and RAF-DB, show that this method can significantly reduce the model complexity and achieve high recognition accuracy. Compared with other advanced methods, the proposed method strikes a good balance between complexity and accuracy, and well meets the real-time deployment requirements of facial expression recognition technology for edge resource-constrained scenes.
Overhead transmission lines are important lifelines in power systems, and the research and application of their intelligent patrol technology is one of the key technologies for building smart grids. The main reason for the low detection performance of fittings is the wide range of some fittings’ scale and large geometric changes. In this paper, we propose a fittings detection method based on multi-scale geometric transformation and attention-masking mechanism. Firstly, we design a multi-view geometric transformation enhancement strategy, which models geometric transformation as a combination of multiple homomorphic images to obtain image features from multiple views. Then, we introduce an efficient multiscale feature fusion method to improve the detection performance of the model for targets with different scales. Finally, we introduce an attention-masking mechanism to reduce the computational burden of model-learning multiscale features, thereby further improving model performance. In this paper, experiments have been conducted on different datasets, and the experimental results show that the proposed method greatly improves the detection accuracy of transmission line fittings.
Face‐based age estimation strongly depends on deep residual networks (ResNets), used as the backbone in the relevant research. However, ResNet‐based methods ignore the importance of some large‐scale facial information and other facial age attributes. Inspired by the attention mechanism, a multi‐task learning framework for face‐based age estimation called multi‐task multi‐scale attention is proposed. First, the authors embed the alternative strategy structure of dilated convolution into ResNet34 to construct a multi‐scale attention module (MSA) to improve the network's receptive field, which extracts local age‐sensitive information while obtaining multi‐scale features. The MSA can have a larger receptive field to extract both large‐scale and local detailed feature information. Second, multi‐task learning network structures are built to predict gender and race, which can share rigid network parameters to improve age estimation and improve the accuracy of age estimation by other age‐related parameters. Finally, the Kullback‐Leibler divergence loss is adopted between a Dirac delta label and a Gaussian prediction to guide the training. The numerical tests on the MORPH Album II and Adience datasets prove the superiority of the proposed method over other state‐of‐the‐art ones.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.