Identity-preserving 3D facial completion under skull constraints

Yu, Longtao, Zhao, Junli, Duan, Fuqing, Lv, Chenlei, Li, Dantong, Pan, Zhenkuan and Zhou, Mingquan 2024. Identity-preserving 3D facial completion under skull constraints. Presented at: International Joint Conference on Biometrics (IJCB), Buffalo, NY, USA, 15-18 September 2024. Proceedings of International Joint Conference on Biometrics. IEEE, pp. 1-10. 10.1109/ijcb62174.2024.10744459

Full text not available from this repository.

Abstract

3D face shape completion is a necessary pre-process for various facial applications as they are often mutilated due to the acquiring environment or occlusion. However, it is challenging to ensure identity consistency when completing faces with large missing regions. Therefore, we introduce craniofacial information to supervise the completion of face shapes. Firstly, a novel dual encoder-decoder structure for face depth image inpainting is constructed by combining dilated convolution and the coherent semantic attention mechanism, guaranteed to generate smooth results with complete semantic information even in the presence of large missing regions in the face model. Then, we innovatively design a craniofacial superimposition module to determine the probability that the inpainted face and corresponding skull come from the same person, constraining the inpainting network to learn identity consistency information. Finally, extensive experimental results show that our method can effectively complete 3D face shapes containing large arbitrary missing regions while guaranteeing identity consistency.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Published Online
Status:	Published
Schools:	Engineering
Publisher:	IEEE
ISBN:	979-8-3503-6414-9
ISSN:	2474-9699
Last Modified:	20 Nov 2024 10:04
URI:	https://orca.cardiff.ac.uk/id/eprint/174157

Actions (repository staff only)

Edit Item