Multi-Scale Collaborative Network for Human Pose Estimation

Abstract

Human pose estimation is a fundamental but challenging task in computer vision. The estimation of human pose mainly depends on the global information of the keypoint type and the local information of the keypoint location. However, the consistency of the cascading process makes it difficult for each stacking network to form a differentiation and collaboration mechanism. In order to solve these problems, this paper introduces a new human pose estimation framework called Multi-Scale Collaborative (MSC) network. The pre-processing network forms feature maps of different sizes, and dispatches them to various locations of the stack network, with small-scale features reaching the front-end stacking network and large-scale features reaching the back-end stacking network. A new loss function is proposed for MSC network. Different keypoints have different weight coefficients of loss function at different scales, and the keypoint weight coefficients are dynamically adjusted from the top hourglass network to the bottom hourglass network. Experimental results show that the proposed method is competitive in MPII and LSP challenge leaderboard among the state-of-the-art methods.

A Hierarchical Children’s Dance Movement Pose Estimation Method Based on Sequence Multiscale Feature Fusion Representation

“…e rst usually detects the human body by looking for the frame in the picture according to the purpose and then calculates each human body to nd the frame that makes up the human body. Finally, joints are connected as a result of human imagination [3]. Some researchers have cited the Cascaded Pyramid Network (CPN) method as a way to calculate the nodes of the Pyramid and Re neNet networks.…”