Automatic unpaired shape deformation transfer

Gao, Lin, Yang, Jie, Qiao, Yi-Ling, Lai, Yu-Kun ORCID: https://orcid.org/0000-0002-2094-5680, Rosin, Paul L. ORCID: https://orcid.org/0000-0002-4965-3884, Xu, Weiwei and Xia, Shihong 2018. Automatic unpaired shape deformation transfer. ACM Transactions on Graphics 37 (6) , 237. 10.1145/3272127.3275028

Preview

PDF - Accepted Post-Print Version Download (3MB) | Preview

Abstract

Transferring deformation from a source shape to a target shape is a very useful technique in computer graphics. State-of-the-art deformation transfer methods require either point-wise correspondences between source and target shapes, or pairs of deformed source and target shapes with corresponding deformations. However, in most cases, such correspondences are not available and cannot be reliably established using an automatic algorithm. Therefore, substantial user effort is needed to label the correspondences or to obtain and specify such shape sets. In this work, we propose a novel approach to automatic deformation transfer between two unpaired shape sets without correspondences. 3D deformation is represented in a high-dimensional space. To obtain a more compact and effective representation, two convolutional variational autoencoders are learned to encode source and target shapes to their latent spaces. We exploit a Generative Adversarial Network (GAN) to map deformed source shapes to deformed target shapes, both in the latent spaces, which ensures the obtained shapes from the mapping are indistinguishable from the target shapes. This is still an under-constrained problem, so we further utilize a reverse mapping from target shapes to source shapes and incorporate cycle consistency loss, i.e. applying both mappings should reverse to the input shape. This VAE-Cycle GAN (VC-GAN) architecture is used to build a reliable mapping between shape spaces. Finally, a similarity constraint is employed to ensure the mapping is consistent with visual similarity, achieved by learning a similarity neural network that takes the embedding vectors from the source and target latent spaces and predicts the light field distance between the corresponding shapes. Experimental results show that our fully automatic method is able to obtain high-quality deformation transfer results with unpaired data sets, comparable or better than existing methods where strict correspondences are required.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Association for Computing Machinery (ACM)
ISSN:	0730-0301
Funders:	Royal Society
Date of First Compliant Deposit:	17 September 2018
Date of Acceptance:	14 September 2018
Last Modified:	29 Nov 2024 23:15
URI:	https://orca.cardiff.ac.uk/id/eprint/114997

Citation Data

Cited 21 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item