Full-body human motion reconstruction with sparse joint tracking using flexible sensors

Chen, Xiaowei, Jiang, Xiao, Zhan, Lishuang, Guo, Shihui, Ruan, Qunsheng, Luo, Guoliang, Liao, Minghong and Qin, Yipeng ORCID: https://orcid.org/0000-0002-1551-9126 2024. Full-body human motion reconstruction with sparse joint tracking using flexible sensors. ACM Transactions on Multimedia Computing, Communications and Applications 20 (2) , 44. 10.1145/3564700

Preview

PDF - Accepted Post-Print Version Download (16MB) | Preview

Abstract

Human motion tracking is a fundamental building block for various applications including computer animation, human-computer interaction, healthcare, etc. To reduce the burden of wearing multiple sensors, human motion prediction from sparse sensor inputs has become a hot topic in human motion tracking. However, such predictions are non-trivial as i) the widely adopted data-driven approaches can easily collapse to average poses. ii) the predicted motions contain unnatural jitters. In this work, we address the aforementioned issues by proposing a novel framework which can accurately predict the human joint moving angles from the signals of only four flexible sensors, thereby achieving the tracking of human joints in multi-degrees of freedom. Specifically, we mitigate the collapse to average poses by implementing the model with a Bi-LSTM neural network that makes full use of short-time sequence information; we reduce jitters by adding a median pooling layer to the network, which smooths consecutive motions. Although being bio-compatible and ideal for improving the wearing experience, the flexible sensors are prone to aging which increases prediction errors. Observing that the aging of flexible sensors usually results in drifts of their resistance ranges, we further propose a novel dynamic calibration technique to rescale sensor ranges, which further improves the prediction accuracy. Experimental results show that our method achieves a low and stable tracking error of 4.51 degrees across different motion types with only four sensors.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Association for Computing Machinery (ACM)
ISSN:	1551-6857
Date of First Compliant Deposit:	30 September 2022
Date of Acceptance:	3 August 2022
Last Modified:	22 Mar 2024 17:00
URI:	https://orca.cardiff.ac.uk/id/eprint/152710

Citation Data

Cited 1 time in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item