Generating animatable 3D cartoon faces from single portraits

Pan, Chuanyu, Yang, Guowei, Mu, Taijiang and Lai, Yukun ORCID: https://orcid.org/0000-0002-2094-5680 2024. Generating animatable 3D cartoon faces from single portraits. Virtual Reality & Intelligent Hardware 6 (4) , pp. 292-307. 10.1016/j.vrih.2023.06.010

Preview

PDF - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (2MB) | Preview

Abstract

Background With the development of virtual reality (VR) technology, there is a growing need for customized 3D avatars. However, traditional methods for 3D avatar modeling are either time-consuming or fail to retain the similarity to the person being modeled. This study presents a novel framework for generating animatable 3D cartoon faces from a single portrait image. Methods First, we transferred an input real-world portrait to a stylized cartoon image using StyleGAN. We then proposed a two-stage reconstruction method to recover a 3D cartoon face with detailed texture. Our two-stage strategy initially performs coarse estimation based on template models and subsequently refines the model by nonrigid deformation under landmark supervision. Finally, we proposed a semantic-preserving face-rigging method based on manually created templates and deformation transfer. Conclusions Compared with prior arts, the qualitative and quantitative results show that our method achieves better accuracy, aesthetics, and similarity criteria. Furthermore, we demonstrated the capability of the proposed 3D model for real-time facial animation.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Elsevier
ISSN:	2096-5796
Date of First Compliant Deposit:	20 September 2023
Date of Acceptance:	20 June 2023
Last Modified:	28 Aug 2024 14:28
URI:	https://orca.cardiff.ac.uk/id/eprint/162648

Actions (repository staff only)

Edit Item