SemEval-2023 Task 1: Visual word sense disambiguation

Raganato, Alessandro, Calixto, Iacer, Ushio, Asahi, Camacho Collados, Jose ORCID: https://orcid.org/0000-0003-1618-7239 and Pilehvar, Mohammad Taher 2023. SemEval-2023 Task 1: Visual word sense disambiguation. Presented at: 17th International Workshop on Semantic Evaluation (SemEval-2023), Toronto, ON, Canada, 13-14 July 2023. Published in: Bouamar, Houda, Pino, Juan and Bali, Kalika eds. Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023). Association for Computational Linguistics, 2227–2234. 10.18653/v1/2023.semeval-1.308

PDF - Published Version Available under License Creative Commons Attribution. Download (4MB)

Abstract

This paper presents the Visual Word Sense Disambiguation (Visual-WSD) task. The objective of Visual-WSD is to identify among a set of ten images the one that corresponds to the intended meaning of a given ambiguous word which is accompanied with minimal context. The task provides datasets for three different languages: English, Italian, and Farsi. We received a total of 96 different submissions. Out of these, 40 systems outperformed a strong zero-shot CLIPbased baseline (Radford et al., 2021). Participating systems proposed different zero- and few-shot approaches, often involving generative models and data augmentation. More information can be found on the task’s website: https://raganato.github.io/vwsd/.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Association for Computational Linguistics
Related URLs:	https://raganato.github.io/vwsd/
Date of First Compliant Deposit:	12 June 2024
Last Modified:	12 Jun 2024 09:15
URI:	https://orca.cardiff.ac.uk/id/eprint/168942

Actions (repository staff only)

Edit Item