Peng, Yanding, Xu, Jiahua, Luo, Ziyuan, Zhou, Wei and Chen, Zhibo 2021. Multi-metric fusion network for image quality assessment. Presented at: Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Nashville, TN, USA, 19-25 June 2021. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, pp. 1857-1860. 10.1109/CVPRW53098.2021.00205 |
Abstract
With the fast proliferation of multimedia applications, the reliable prediction of image/video quality is urgently needed. Many quality assessment metrics have been proposed in the past decades with various complexity and consistency with human ratings. The metrics are designed from different aspects, e.g., pixel level fidelity, structural similarity, information theory and data-driven. In this paper, we design a Multi-Metric Fusion Network (MMFN) for aggregating the quality scores predicted by diverse metrics to generate more accurate results. To be specific, we utilize the image features extracted from the pretrained network to adaptively rescale the predicted quality from different metrics, and leverage the fully-connected layers to regress a single scalar as the final score. Pairwise images can be further integrated into the training procedure by adding a Score2Prob layer. Experimental results on the validation and test sets demonstrate that our proposed MMFN achieves better prediction accuracy compared with other metrics.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Date Type: | Published Online |
Status: | Published |
Schools: | Computer Science & Informatics |
Publisher: | IEEE |
ISBN: | 978-1-6654-4900-7 |
ISSN: | 2160-7508 |
Last Modified: | 27 Sep 2023 16:15 |
URI: | https://orca.cardiff.ac.uk/id/eprint/162065 |
Actions (repository staff only)
Edit Item |