A full-reference stereoscopic image quality measurement via hierarchical deep feature degradation fusion

Jiang, Qiuping, Zhou, Wei, Chai, Xiongli, Yue, Guanghui, Shao, Feng and Chen, Zhibo 2020. A full-reference stereoscopic image quality measurement via hierarchical deep feature degradation fusion. IEEE Transactions on Instrumentation and Measurement 69 (12) , pp. 9784-9796. 10.1109/TIM.2020.3005111

Full text not available from this repository.

Abstract

For the problem of stereoscopic image quality measurement (SIQM), it is difficult to design an efficient yet reliable full reference (FR) SIQM method due to our limited knowledge about the properties of human binocular vision. Inspired by the fact that the input visual information is hierarchically processed in our human brain, we consider different levels of distortion in an image cause individual degradations on hierarchical features, and propose to fuse the degradations on hierarchical features to facilitate the task of FR-SIQM. As one of the most classical convolutional neural network (CNN) architectures, the VGG-16 network is first applied to each view of the stereopair to build hierarchical deep feature representations based on which monocular quality estimation (MQE) and binocular quality fusion (BQF) are then performed. Specifically, the MQE stage estimates a set of layer-wise monocular quality scores by measuring the similarity between the hierarchical feature maps of the distorted monocular view and those of the reference monocular view. The BQF stage estimates a set of layer-wise binocular quality scores via a weighted average of the corresponding layer-wise monocular quality scores. The adaptive weights are determined by a modified hierarchical feature energy-based Gain-Control model. Finally, the layer-wise binocular quality scores across all layers are fused into an overall binocular quality score via regression. Experiments on three benchmark databases validate the state-of-the-art performance of our method.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	1557-9662
Date of Acceptance:	3 June 2020
Last Modified:	21 Aug 2023 16:30
URI:	https://orca.cardiff.ac.uk/id/eprint/161684

Actions (repository staff only)

Edit Item