Evaluating perceptual color preferences in smartphone photography: dataset and challenges

Wang, Zhihua, Zhang, Weixia, Zhou, Wei, Liu, Xiaohong, Zhai, Guangtao and Callet, Patrick Le 2025. Evaluating perceptual color preferences in smartphone photography: dataset and challenges. Presented at: MM '25:The 33rd ACM International Conference on Multimedia, Dublin, Ireland, 31 October 2025. IXR '25: Proceedings of the 3rd International Workshop on Interactive eXtended Reality. Dublin: ACM, pp. 12844-12850. 10.1145/3746027.3758227

Full text not available from this repository.

Abstract

In smartphone image signal processing (ISP), different parameter settings can yield diverse color renditions, even when images have similar color accuracy and aesthetic quality. A key yet underexplored question is: which rendition does a specific user or demographic prefer? This is difficult to answer due to the subjective nature of preference. Existing assessments focus on color fidelity or aesthetics using visibly degraded images, limiting their ability to capture subtle color preferences in similar image sets. Averaged metric predictions further obscure individual perceptual differences. To address these gaps, we present the Smartphone Photography Color Preference (SPCP) dataset-the largest of its kind-designed to evaluate color preferences arising from ISP-induced variations. The SPCP dataset comprises 12,000 images derived from 1,000 diverse scenes, with each scene rendered into 12 distinct variants. These variants include (i) real-world captures from six flagship smartphones and (ii) synthetic images generated through systematic variation of key ISP parameters. To obtain reliable ground-truth annotations, we conduct a large-scale psychophysical study involving 20 subjects under controlled laboratory conditions. Subjects perform exhaustive pairwise comparisons among the 12 variants for each scene, yielding fine-grained human preference data. Using this dataset, we identify three key challenges in modeling color preferences and outline the corresponding desiderata for the development of effective computational color preference models. The dataset is publicly available at: https://huggingface.co/datasets/zwx8981/SPCP_dataset.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Publication
Status:	Published
Schools:	Schools > Computer Science & Informatics
Publisher:	ACM
ISBN:	979-8-4007-2051-2
Last Modified:	06 Nov 2025 10:45
URI:	https://orca.cardiff.ac.uk/id/eprint/182177

Actions (repository staff only)

Edit Item