Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Semi-supervised authentically distorted image quality assessment with consistency-preserving dual-branch convolutional neural network

Yue, Guanghui, Cheng, Di, Li, Leida, Zhou, Tianwei, Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481 and Wang, Tianfu 2023. Semi-supervised authentically distorted image quality assessment with consistency-preserving dual-branch convolutional neural network. IEEE Transactions on Multimedia 25 , pp. 6499-6511. 10.1109/TMM.2022.3209889

[thumbnail of Semi-Supervised_Authentically_Distorted_Image_Quality_Assessment.pdf]
Preview
PDF - Accepted Post-Print Version
Download (31MB) | Preview

Abstract

Recently, convolutional neural networks (CNNs) have provided a favoured prospect for authentically distorted image quality assessment (IQA). For good performance, most existing CNN-based methods rely on a large amount of labeled data for training, which is time-consuming and cumbersome to collect. By simultaneously exploiting few labeled data and many unlabeled data, we make a pioneering attempt to propose a semi-supervised framework (termed SSLIQA) with consistency-preserving dual-branch CNN for authentically distorted IQA in this paper. The proposed SSLIQA introduces a consistency-preserving strategy and transfers two kinds of consistency knowledge from the teacher branch to the student branch. Concretely, SSLIQA utilizes the sample prediction consistency to train the student to mimic output activations of individual examples represented by the teacher. Considering that subjects often refer to previous analogous cases to make scoring decisions, SSLIQA computes the semantic relation among different samples in a batch and encourages the consistency of sample semantic relation between two branches to explore extra quality-related information. Benefiting from the consistency-preserving strategy, we can exploit numerous unlabeled data to improve network's effectiveness and generalization. Experimental results on three authentically distorted IQA databases show that the proposed SSLIQA is stably effective under different student-teacher combinations and different labeled-to-unlabeled data ratios. In addition, it points out a new way on how to achieve higher performance with a smaller network.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Publisher: Institute of Electrical and Electronics Engineers
ISSN: 1520-9210
Date of First Compliant Deposit: 13 December 2022
Date of Acceptance: 22 September 2022
Last Modified: 15 Jan 2024 13:47
URI: https://orca.cardiff.ac.uk/id/eprint/154929

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics