This study aims to develop a cost-effective and reliable motion monitoring device capable of comprehensive fatigue analysis. It achieves this objective by integrating surface electromyography (sEMG) and accelerometer (ACC) signals through a feature fusion strategy. The study introduces a multi-level attention mechanism for classification, leveraging convolutional neural networks (CNNs). The preprocessing phase involves a local feature attention mechanism that enhances local waveform features using the amplitude envelope. A dual-scale attention mechanism, operating at both channel and neuron levels, is employed to enhance the model’s learning from high-dimensional fused data, improving feature extraction and generalization. The local feature attention mechanism significantly improves the model’s classification accuracy and convergence, as demonstrated in ablation experiments. The model, optimized with multi-level attention mechanisms, excels in accuracy and generalization, particularly in handling data with pseudo-artifacts. Computational analysis indicates that the proposed optimization algorithm has minimal impact on CNN’s training and testing times. The study achieves recognition accuracies of 92.52%, 92.38%, and 92.30%, as well as F1-scores of 91.92%, 92.13%, and 92.29% for the three fatigue states, affirming its reliability. This research provides technical support for the development of affordable and dependable wearable motion monitoring devices.