Blind quality assessment for image superresolution using deep two-stream convolutional networks

Zhou, Wei, Jiang, Qiuping, Wang, Yuwang, Chen, Zhibo and Li, Weiping 2020. Blind quality assessment for image superresolution using deep two-stream convolutional networks. Information Sciences 528 , pp. 205-218. 10.1016/j.ins.2020.04.030

Full text not available from this repository.

Abstract

Numerous image superresolution (SR) algorithms have been proposed for reconstructing high-resolution (HR) images from input images with lower spatial resolutions. However, effectively evaluating the perceptual quality of SR images remains a challenging research problem. In this paper, we propose a no-reference/blind deep neural network-based SR image quality assessor (DeepSRQ). To learn more discriminative feature representations of various distorted SR images, the proposed DeepSRQ is a two-stream convolutional network including two subcomponents for distorted structure and texture SR images. Different from traditional image distortions, the artifacts of SR images cause both image structure and texture quality degradation. Therefore, we choose the two-stream scheme that captures different properties of SR inputs instead of directly learning features from one image stream. Considering the human visual system (HVS) characteristics, the structure stream focuses on extracting features in structural degradations, while the texture stream focuses on the change in textural distributions. In addition, to augment the training data and ensure the category balance, we propose a stride-based adaptive cropping approach for further improvement. Experimental results on three publicly available SR image quality databases demonstrate the effectiveness and generalization ability of our proposed DeepSRQ method compared with state-of-the-art image quality assessment algorithms.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Elsevier
ISSN:	0020-0255
Date of Acceptance:	14 April 2020
Last Modified:	26 Sep 2023 16:15
URI:	https://orca.cardiff.ac.uk/id/eprint/162163

Actions (repository staff only)

Edit Item