Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Full-body human motion reconstruction with sparse joint tracking using flexible sensors

Chen, Xiaowei, Jiang, Xiao, Zhan, Lishuang, Guo, Shihui, Ruan, Qunsheng, Luo, Guoliang, Liao, Minghong and Qin, Yipeng ORCID: 2022. Full-body human motion reconstruction with sparse joint tracking using flexible sensors. ACM Transactions on Multimedia Computing, Communications, and Applications 10.1145/3564700

[thumbnail of preprint.pdf]
PDF - Accepted Post-Print Version
Download (16MB) | Preview


Human motion tracking is a fundamental building block for various applications including computer animation, human-computer interaction, healthcare, etc. To reduce the burden of wearing multiple sensors, human motion prediction from sparse sensor inputs has become a hot topic in human motion tracking. However, such predictions are non-trivial as i) the widely adopted data-driven approaches can easily collapse to average poses. ii) the predicted motions contain unnatural jitters. In this work, we address the aforementioned issues by proposing a novel framework which can accurately predict the human joint moving angles from the signals of only four flexible sensors, thereby achieving the tracking of human joints in multi-degrees of freedom. Specifically, we mitigate the collapse to average poses by implementing the model with a Bi-LSTM neural network that makes full use of short-time sequence information; we reduce jitters by adding a median pooling layer to the network, which smooths consecutive motions. Although being bio-compatible and ideal for improving the wearing experience, the flexible sensors are prone to aging which increases prediction errors. Observing that the aging of flexible sensors usually results in drifts of their resistance ranges, we further propose a novel dynamic calibration technique to rescale sensor ranges, which further improves the prediction accuracy. Experimental results show that our method achieves a low and stable tracking error of 4.51 degrees across different motion types with only four sensors.

Item Type: Article
Date Type: Published Online
Status: In Press
Schools: Computer Science & Informatics
Date of First Compliant Deposit: 30 September 2022
Date of Acceptance: 3 August 2022
Last Modified: 23 Nov 2022 23:56

Actions (repository staff only)

Edit Item Edit Item


Downloads per month over past year

View more statistics