Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Machine-oriented visual media quality assessment

Li, Chunyi, Qing, Rui, Zhang, Jianbo, Han, Yufei, Liu, Shiyu, Zhang, Yuanzhong, Zhang, Zicheng, Duan, Huiyu, Zhou, Chris Wei, Zimmermann, Roger, Lin, Weisi and Zhai, Guangtao 2026. Machine-oriented visual media quality assessment. Presented at: MM '26: The 34th ACM International Conference on Multimedia, Rio de Janeiro, Brazil, 10 - 14 November 2026. MM '26: Proceedings of the 34th ACM International Conference on Multimedia. ACM International Conference on Multimedia (ACM MM). New York: ACM, pp. 17681-17685. 10.1145/3767308.3836624

[thumbnail of 3767308.3836624.pdf] PDF - Published Version
Available under License Creative Commons Attribution Non-commercial Share Alike.

Download (3MB)

Abstract

With the development of Embodied AI, machines have replaced humans as the main consumers of visual media, yet existing Image Quality Assessment (IQA) metrics remain focused on humans and overlook machine preference (a domain where quality depends on task utility rather than perceptual fidelity alone). To address this gap, we introduce the Machine-oriented Image Quality Assessment (MoIQA) Challenge, emphasizing simulation comprehension and real-world execution. The challenge comprises three tasks: 1) MoIQA-Absolute, primarily evaluating the consistency between IQA models and the performance of mainstream Vision-Language Models (VLMs) in simulation software; 2) MoIQA-Relative, measuring the consistency between IQA models and the variance of VLM inference after distortion, also in simulation; and 3) MoIQA-Real, focusing on whether IQA models match the results of the latest Vision-Language-Action Models (VLAs) in the Real-world. This challenge aims to advance reliable image understanding for machine preference and support robust Embodied AI applications. This grand challenge attracted 142 high-level teams around the world, and the relevant resources are open-sourced at: Homepage: https://m-vqa-challenge.github.io/M-VQA/

Item Type: Conference or Workshop Item - published (Paper)
Date Type: Published Online
Status: Published
Schools: Schools > Computational & Mathematical Sciences
Schools > Computer Science & Informatics
Publisher: ACM
ISBN: 9798400722134
Date of First Compliant Deposit: 13 November 2026
Last Modified: 13 Nov 2026 12:32
URI: https://orca.cardiff.ac.uk/id/eprint/190903

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics