Xu, Jiahua, Zhou, Wei, Chen, Zhibo, Ling, Suiyi and Le Callet, Patrick 2020. Binocular rivalry oriented predictive autoencoding network for blind stereoscopic image quality measurement. IEEE Transactions on Instrumentation and Measurement 70 , 5001413. 10.1109/TIM.2020.3026443 |
Abstract
Stereoscopic image quality measurement (SIQM) has become increasingly important for guiding stereo image processing and commutation systems due to the widespread usage of 3-D contents. Compared with conventional methods that are relied on handcrafted features, deep-learning-oriented measurements have achieved remarkable performance in recent years. However, most existing deep SIQM evaluators are not specifically built for stereoscopic contents and consider little prior domain knowledge of the 3-D human visual system (HVS) in network design. In this article, we develop a Predictive Auto-encoDing Network (PAD-Net) for blind/no-reference SIQM. In the first stage, inspired by the predictive coding theory that the cognition system tries to match bottom-up visual signal with top-down predictions, we adopt the encoder-decoder architecture to reconstruct the distorted inputs. Besides, motivated by the binocular rivalry phenomenon, we leverage the likelihood and prior maps generated from the predictive coding process in the Siamese framework for assisting SIQM. In the second stage, a quality regression network is applied to the fusion image for acquiring the perceptual quality prediction. The performance of PAD-Net has been extensively evaluated on three benchmark databases and the superiority has been well validated on both symmetrically and asymmetrically distorted stereoscopic images under various distortion types.
Item Type: | Article |
---|---|
Date Type: | Publication |
Status: | Published |
Schools: | Computer Science & Informatics |
Publisher: | Institute of Electrical and Electronics Engineers |
ISSN: | 0018-9456 |
Date of Acceptance: | 13 September 2020 |
Last Modified: | 23 Aug 2023 09:01 |
URI: | https://orca.cardiff.ac.uk/id/eprint/161691 |
Actions (repository staff only)
Edit Item |