Grijalba, Jorge Osés, Ureña-López, Luis Alfonso, Cámara, Eugenio Martínez and Camacho-Collados, Jose ORCID: https://orcid.org/0000-0003-1618-7239
2025.
SemEval-2025 Task 8: Question answering over tabular data.
Presented at: 19th International Workshop on Semantic Evaluation (SemEval-2025),
Vienna, Austria,
31July - 1 August 2025.
Proceedings of the The 19th International Workshop on Semantic Evaluation (SemEval-2025).
Association for Computational Linguistics,
2512–2522.
|
|
PDF
- Published Version
Available under License Creative Commons Attribution. Download (209kB) |
Abstract
We introduce the findings and results of SemEval-2025 Task 8: Question Answering over Tabular Data. We featured two subtasks, DataBench and DataBench Lite. DataBench consists on question answering over tabular data, and DataBench Lite small comprising small datasets that might be easier to manage by current models by for example fitting them into a prompt. The task was open for any approach, but their answer has to conform to a required typing format. In this paper we present the task, analyze a number of system submissions and discuss the results. The results show how approaches leveraging LLMs dominated the task, with larger models exhibiting a considerably superior performance compared to small models.
| Item Type: | Conference or Workshop Item - published (Paper) |
|---|---|
| Date Type: | Publication |
| Status: | Published |
| Schools: | Schools > Computational & Mathematical Sciences Schools > Computer Science & Informatics |
| Publisher: | Association for Computational Linguistics |
| ISBN: | 979-8-89176-273-2 |
| Date of First Compliant Deposit: | 16 November 2026 |
| Last Modified: | 16 Nov 2026 12:30 |
| URI: | https://orca.cardiff.ac.uk/id/eprint/190950 |
Actions (repository staff only)
![]() |
Edit Item |





Download Statistics
Download Statistics