The application of visual saliency models in objective image quality assessment: a statistical evaluation

Zhang, Wei, Borji, Ali, Wang, Zhou, Le Callet, Patrick and Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481 2016. The application of visual saliency models in objective image quality assessment: a statistical evaluation. IEEE Transactions on Neural Networks and Learning Systems 27 (6) , pp. 1266-1278. 10.1109/TNNLS.2015.2461603

Preview

PDF - Accepted Post-Print Version Download (5MB) | Preview

Abstract

Advances in image quality assessment have shown the potential added value of including visual attention aspects in its objective assessment. Numerous models of visual saliency are implemented and integrated in different image quality metrics (IQMs), but the gain in reliability of the resulting IQMs varies to a large extent. The causes and the trends of this variation would be highly beneficial for further improvement of IQMs, but are not fully understood. In this paper, an exhaustive statistical evaluation is conducted to justify the added value of computational saliency in objective image quality assessment, using 20 state-of-the-art saliency models and 12 best-known IQMs. Quantitative results show that the difference in predicting human fixations between saliency models is sufficient to yield a significant difference in performance gain when adding these saliency models to IQMs. However, surprisingly, the extent to which an IQM can profit from adding a saliency model does not appear to have direct relevance to how well this saliency model can predict human fixations. Our statistical analysis provides useful guidance for applying saliency models in IQMs, in terms of the effect of saliency model dependence, IQM dependence, and image distortion dependence. The testbed and software are made publicly available to the research community.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Publisher:	IEEE
ISSN:	2162-237X
Date of First Compliant Deposit:	22 April 2016
Date of Acceptance:	18 July 2015
Last Modified:	02 Dec 2024 01:00
URI:	https://orca.cardiff.ac.uk/id/eprint/89649

Citation Data

Cited 104 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item