An Advanced Attention-Enhanced Hybrid Deep Learning Model for WBSNs’ Gait Pattern Recognition

Abstract

Background: The deep learning techniques have been attracted increasing attention on wireless body sensor networks (WBSNs) gait pattern recognition that has a great contribution to monitoring gait change in clinical application. However, in existing studies, there are some challenging issues such as low generalization performance and no potential interpretation for gait variability. It is necessary to search for the advanced deep learning models to resolve these issues. Method: A public WARD database including acceleration and gyroscope data acquired from each subject wearing five sensors was selected, and the gait with different combination of on-body multi-sensors is considered as a WBSNs’ gait pattern. An advanced attention-enhanced hybrid deep learning model of DCNN and LSTM for WBSNs’ gait pattern recognition was proposed. In our proposed technique, the combination model of DCNN with LSTM is firstly to discover the spatial-temporary gait correlation features. And then the attention mechanism is introduced to exploit the more valuable intrinsic nonlinear dynamic correlation gait characteristics associated with gait variability hidden in spatial-temporary gait space obtained. This significantly contributes to enhancing the generalization performance and taking insight on gait variability in a certain anatomical region. Results: The ten gait patterns are randomly selected from WARD database to evaluate the feasibility of our proposed method. Our experiments demonstrated the superior generalization ability of our method to some models such as CNN-LSTM, DCNN-LSTM. Our proposed model could classify ten gait patterns with the highest accuracy and F1-score of 91.48% and 91.46%, respectively. Moreover, we also found that the classification performance of a certain gait pattern was almost same best when the combinations of three or five on-body sensors were employed respectively, suggesting that our method possibly take insight on gait variability in a certain anatomical region. Conclusion: Our proposed technique could feasibly discover the more intrinsic nonlinear dynamic correlation gait characteristics associated with gait variability from on-body multi-sensors gait data, which greatly contributed to best generalization performance and potential clinical interpretation. Our proposed technique would hopefully become a powerful tool of monitoring gait change in clinical application.