Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Realtime reconstruction of an animating human body from a single depth camera

Chen, Yin, Cheng, Zhi-Quan, Lai, Chao, Martin, Ralph Robert and Dang, Gang 2016. Realtime reconstruction of an animating human body from a single depth camera. IEEE Transactions on Visualization and Computer Graphics 22 (8) , pp. 2000-2011. 10.1109/TVCG.2015.2478779

[thumbnail of LiveScape.pdf]
PDF - Accepted Post-Print Version
Download (5MB) | Preview


We present a method for realtime reconstruction of an animating human body, which produces a sequence of deforming meshes representing a given performance captured by a single commodity depth camera. We achieve realtime single-view mesh completion by enhancing the parameterized SCAPE model. Our method, which we call Realtime SCAPE, performs full-body reconstruction without the use of markers. In Realtime SCAPE, estimations of body shape parameters and pose parameters, needed for reconstruction, are decoupled. Intrinsic body shape is first precomputed for a given subject, by determining shape parameters with the aid of a body shape database. Subsequently, per-frame pose parameter estimation is performed by means of linear blending skinning (LBS); the problem is decomposed into separately finding skinning weights and transformations. The skinning weights are also determined offline from the body shape database, reducing online reconstruction to simply finding the transformations in LBS. Doing so is formulated as a linear variational problem; carefully designed constraints are used to impose temporal coherence and alleviate artifacts. Experiments demonstrate that our method can produce full-body mesh sequences with high fidelity.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Publisher: IEEE
ISSN: 1077-2626
Date of First Compliant Deposit: 30 March 2016
Date of Acceptance: 2014
Last Modified: 06 Oct 2021 12:26

Citation Data

Cited 10 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item Edit Item


Downloads per month over past year

View more statistics