Distortion-independent pairwise underwater image perceptual quality comparison

Yang, Miao, Xie, Zhuoran, Dong, Jinnai, Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481, Wang, Haiwen and Shen, Mengjiao 2023. Distortion-independent pairwise underwater image perceptual quality comparison. IEEE Transactions on Instrumentation and Measurement 72 , 5024415. 10.1109/TIM.2023.3307754

Preview

PDF - Accepted Post-Print Version Download (9MB) | Preview

Abstract

Ranking underwater images according to their quality is a key indicator comparing the performance of different methodologies and therefore is critical in the field of instrumentation and measurement. Perceiving differences in the quality of underwater images is a challenging task that has received relatively less attention, primarily due to mixed distortion, diversified image content, and the absence of high-quality reference images. Thus, based on the pairwise underwater image quality voting data, we develop a novel ternary classification transformer to predict a quality comparison of underwater images without reference. This is the first attempt to model the quality discrimination of an image pair. The proposed model combines the perception of convolutional neural networks and transformer encoder to explore local quality features and visual perceptual connections between different patch tokens. Experimental results reveal that the proposed pairwise underwater image quality comparison (PUIQC) scheme predicts noticeable quality differences correlating well with subjective perception. The quantification of complex distortions in underwater images compared to other learning-based methods is a compelling feature of this technology. It delivers competitive results in ranking the different enhancement outputs. In addition, we reveal the self-attention of local quality features within the two images and capture their responsive contribution to the quality decision, which explains the underlying subjective quality-sensitive mechanism during image quality comparison.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	0018-9456
Date of First Compliant Deposit:	8 September 2023
Date of Acceptance:	28 July 2023
Last Modified:	07 Nov 2023 12:10
URI:	https://orca.cardiff.ac.uk/id/eprint/162337

Actions (repository staff only)

Edit Item