Study of saliency in objective video quality assessment

Zhang, Wei and Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481 2017. Study of saliency in objective video quality assessment. IEEE Transactions on Image Processing 26 (3) , pp. 1275-1288. 10.1109/TIP.2017.2651410

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (4MB) | Preview

Abstract

Reliably predicting video quality as perceived by humans remains challenging and is of high practical relevance. A significant research trend is to investigate visual saliency and its implications for video quality assessment. Fundamental problems regarding how to acquire reliable eye-tracking data for the purpose of video quality research and how saliency should be incorporated in objective video quality metrics (VQMs) are largely unsolved. In this paper, we propose a refined methodology for reliably collecting eye-tracking data, which essentially eliminates bias induced by each subject having to view multiple variations of the same scene in a conventional experiment. We performed a large-scale eye-tracking experiment that involved 160 human observers and 160 video stimuli distorted with different distortion types at various degradation levels. The measured saliency was integrated into several best known VQMs in the literature. With the assurance of the reliability of the saliency data, we thoroughly assessed the capabilities of saliency in improving the performance of VQMs, and devised a novel approach for optimal use of saliency in VQMs. We also evaluated to what extent the state-of-the-art computational saliency models can improve VQMs in comparison to the improvement achieved by using “ground truth” eye-tracking data. The eye-tracking database is made publicly available to the research community.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Additional Information:	This work is licensed under a Creative Commons Attribution 3.0 License
Publisher:	Institute of Electrical and Electronics Engineers (IEEE)
ISSN:	1057-7149
Date of First Compliant Deposit:	3 May 2017
Date of Acceptance:	26 December 2016
Last Modified:	03 May 2023 18:52
URI:	https://orca.cardiff.ac.uk/id/eprint/98515

Citation Data

Cited 36 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item