Yue, Guanghui, Cheng, Di, Li, Leida, Zhou, Tianwei, Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481 and Wang, Tianfu 2023. Semi-supervised authentically distorted image quality assessment with consistency-preserving dual-branch convolutional neural network. IEEE Transactions on Multimedia 25 , pp. 6499-6511. 10.1109/TMM.2022.3209889 |
Preview |
PDF
- Accepted Post-Print Version
Download (31MB) | Preview |
Abstract
Recently, convolutional neural networks (CNNs) have provided a favoured prospect for authentically distorted image quality assessment (IQA). For good performance, most existing CNN-based methods rely on a large amount of labeled data for training, which is time-consuming and cumbersome to collect. By simultaneously exploiting few labeled data and many unlabeled data, we make a pioneering attempt to propose a semi-supervised framework (termed SSLIQA) with consistency-preserving dual-branch CNN for authentically distorted IQA in this paper. The proposed SSLIQA introduces a consistency-preserving strategy and transfers two kinds of consistency knowledge from the teacher branch to the student branch. Concretely, SSLIQA utilizes the sample prediction consistency to train the student to mimic output activations of individual examples represented by the teacher. Considering that subjects often refer to previous analogous cases to make scoring decisions, SSLIQA computes the semantic relation among different samples in a batch and encourages the consistency of sample semantic relation between two branches to explore extra quality-related information. Benefiting from the consistency-preserving strategy, we can exploit numerous unlabeled data to improve network's effectiveness and generalization. Experimental results on three authentically distorted IQA databases show that the proposed SSLIQA is stably effective under different student-teacher combinations and different labeled-to-unlabeled data ratios. In addition, it points out a new way on how to achieve higher performance with a smaller network.
Item Type: | Article |
---|---|
Date Type: | Publication |
Status: | Published |
Schools: | Computer Science & Informatics |
Publisher: | Institute of Electrical and Electronics Engineers |
ISSN: | 1520-9210 |
Date of First Compliant Deposit: | 13 December 2022 |
Date of Acceptance: | 22 September 2022 |
Last Modified: | 15 Jan 2024 13:47 |
URI: | https://orca.cardiff.ac.uk/id/eprint/154929 |
Actions (repository staff only)
Edit Item |