Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

SemEval-2025 Task 8: Question answering over tabular data

Grijalba, Jorge Osés, Ureña-López, Luis Alfonso, Cámara, Eugenio Martínez and Camacho-Collados, Jose ORCID: https://orcid.org/0000-0003-1618-7239 2025. SemEval-2025 Task 8: Question answering over tabular data. Presented at: 19th International Workshop on Semantic Evaluation (SemEval-2025), Vienna, Austria, 31July - 1 August 2025. Proceedings of the The 19th International Workshop on Semantic Evaluation (SemEval-2025). Association for Computational Linguistics, 2512–2522.

[thumbnail of 2025.semeval-1.324.pdf] PDF - Published Version
Available under License Creative Commons Attribution.

Download (209kB)

Abstract

We introduce the findings and results of SemEval-2025 Task 8: Question Answering over Tabular Data. We featured two subtasks, DataBench and DataBench Lite. DataBench consists on question answering over tabular data, and DataBench Lite small comprising small datasets that might be easier to manage by current models by for example fitting them into a prompt. The task was open for any approach, but their answer has to conform to a required typing format. In this paper we present the task, analyze a number of system submissions and discuss the results. The results show how approaches leveraging LLMs dominated the task, with larger models exhibiting a considerably superior performance compared to small models.

Item Type: Conference or Workshop Item - published (Paper)
Date Type: Publication
Status: Published
Schools: Schools > Computational & Mathematical Sciences
Schools > Computer Science & Informatics
Publisher: Association for Computational Linguistics
ISBN: 979-8-89176-273-2
Date of First Compliant Deposit: 16 November 2026
Last Modified: 16 Nov 2026 12:30
URI: https://orca.cardiff.ac.uk/id/eprint/190950

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics