Distortion-induced saliency shifts in video

Wu, Xinbo, Lou, Jianxun, Dong, Zhengyan, Zhang, Fan, Rosin, Paul ORCID: https://orcid.org/0000-0002-4965-3884 and Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481 2025. Distortion-induced saliency shifts in video. IEEE Transactions on Multimedia 10.1109/TMM.2025.3599087

PDF - Accepted Post-Print Version Download (25MB)

Abstract

Visual saliency modelling is of fundamental importance in modern video processing and its applications. Our previous eye-tracking study revealed that signal distortions caused by editing, compression, or transmission alter gaze patterns and consequently induce saliency shifts in both spatial and temporal domains. Saliency shifts provide crucial insights into viewers' behavioural responses to video distortions, facilitating the perception-based optimisation of video algorithms. However, the spatio-temporal saliency shifts and their measurable effects on perception related applications remain largely unexplored. In this paper, we first investigate the measurement of distortion-induced saliency shifts (DSS) in videos and analyse DSS behaviours as functions of video content, time order and critical distortion disruption. Second, based on our findings, we construct three vision models to quantitatively simulate distinct DSS behaviours and integrate them into a comprehensive DSS behaviour model. Finally, we demonstrate that the computational DSS model can enhance emerging video technologies.

Item Type:	Article
Date Type:	Published Online
Status:	In Press
Schools:	Schools > Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	1520-9210
Date of First Compliant Deposit:	15 August 2025
Date of Acceptance:	6 February 2025
Last Modified:	18 Aug 2025 12:00
URI:	https://orca.cardiff.ac.uk/id/eprint/180454

Actions (repository staff only)

Edit Item