Subjective and objective quality assessment of multi-attribute retouched face images

Yue, Guanghui, Wu, Honglv, Yan, Weiqing, Zhou, Tianwei, Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481 and Zhou, Wei 2024. Subjective and objective quality assessment of multi-attribute retouched face images. IEEE Transactions on Broadcasting 70 (2) , pp. 570-583. 10.1109/TBC.2024.3374043

Preview

PDF - Accepted Post-Print Version Download (14MB) | Preview

Abstract

Facial retouching, aiming at enhancing an individual’s appearance digitally, has become popular in many parts of human life, such as personal entertainment, commercial advertising, etc. However, excessive use of facial retouching can affect public aesthetic values and accordingly induce issues of mental health. There is a growing need for comprehensive quality assessment of Retouched Face (RF) images. This paper aims to advance this topic from both subjective and objective studies. Firstly, we generate 2,500 RF images by retouching 250 high-quality face images from multiple attributes (i.e., eyes, nose, mouth, and facial shape) with different photo-editing tools. After that, we carry out a series of subjective experiments to evaluate the quality of multi-attribute RF images from various perspectives, and construct the Multi-Attribute Retouched Face Database (MARFD) with multi-labels. Secondly, considering that retouching alters the facial morphology, we introduce a multi-task learning based No-Reference (NR) Image Quality Assessment (IQA) method, named MTNet. Specifically, to capture high-level semantic information associated with geometric changes, MTNet treats the alteration degree estimation of retouching attributes as auxiliary tasks for the main task (i.e., the overall quality prediction). In addition, inspired by the perceptual effects of viewing distance, MTNet utilizes a multi-scale data augmentation strategy during network training to help the network better understand the distortions. Experimental results on MARFD show that our MTNet correlates well with subjective ratings and outperforms 16 state-of-the-art NR-IQA methods.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	0018-9316
Date of First Compliant Deposit:	29 April 2024
Date of Acceptance:	6 February 2024
Last Modified:	09 Nov 2024 15:45
URI:	https://orca.cardiff.ac.uk/id/eprint/167630

Actions (repository staff only)

Edit Item