Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors

Abstract

Human motion tracking is a fundamental building block for various applications including computer animation, human-computer interaction, healthcare, etc. To reduce the burden of wearing multiple sensors, human motion prediction from sparse sensor inputs has become a hot topic in human motion tracking. However, such predictions are non-trivial as i) the widely adopted data-driven approaches can easily collapse to average poses. ii) the predicted motions contain unnatural jitters. In this work, we address the aforementioned issues by proposing a novel framework which can accurately predict the human joint moving angles from the signals of only four flexible sensors, thereby achieving the tracking of human joints in multi-degrees of freedom. Specifically, we mitigate the collapse to average poses by implementing the model with a Bi-LSTM neural network that makes full use of short-time sequence information; we reduce jitters by adding a median pooling layer to the network, which smooths consecutive motions. Although being bio-compatible and ideal for improving the wearing experience, the flexible sensors are prone to aging which increases prediction errors. Observing that the aging of flexible sensors usually results in drifts of their resistance ranges, we further propose a novel dynamic calibration technique to rescale sensor ranges, which further improves the prediction accuracy. Experimental results show that our method achieves a low and stable tracking error of 4.51 degrees across different motion types with only four sensors.

Computational Design of Wiring Layout on Tight Suits with Minimal Motion Resistance

“…Design and Application of Smart Clothing. Smart clothing, as an emerging domain, integrates electronics with textiles to create functional solutions for physiological state monitor [Angelucci et al 2021], skeletal motion capture [Chen et al 2022] and body shape reconstruction Zhang et al 2020]. Its applications have been demonstrated in fields including rehabilitation [Ramachandran et al 2021], assistive walking [Kim et al 2019;Lee et al 2018] and interactive entertainment [Al Maimani and Roudaut 2017].…”

“…Its applications have been demonstrated in fields including rehabilitation [Ramachandran et al 2021], assistive walking [Kim et al 2019;Lee et al 2018] and interactive entertainment [Al Maimani and Roudaut 2017]. Its associated physical prototypes include full-body suit [Chen et al 2022], upper-body shirt Rognon et al 2018], jacket [Delazio et al 2018;Günther et al 2019], pants [Gholami et al 2019], sock [Zhang et al 2020], elbow pad [Chen et al 2023;Liu et al 2019], gloves [Cai et al 2019;Glauser et al 2019], etc.…”