Alva Manchego, Fernando Emilio and Rosa, João Luís G. 2012. Semantic role labeling for Brazilian Portuguese: A benchmark. Presented at: Advances in Artificial Intelligence – IBERAMIA 2012, 13-16 November 2012. Published in: Pavon, Juan, Duque-Mendez, Nestor D. and Fuentes-Fernandez, Ruben eds. Advances in Artificial Intelligence – IBERAMIA 2012: 13th Ibero-American Conference on AI, Cartagena de Indias, Colombia, November 13-16, 2012. Proceedings. Lecture Notes in Computer Science. Lecture Notes in Computer Science , vol.7637 Springer, pp. 481-490. 10.1007/978-3-642-34654-5_49 |
Abstract
One of the main research challenges in Semantic Role Labeling (SRL) is the development of systems for languages other than English. For Brazilian Portuguese, a corpus with appropriate manually-annotated data, PropBank.Br, has recently become available. Proposals for implementing SRL systems using this corpus have already been made, but no standard way of comparing their results is available. We present a benchmark for comparing SRL systems for Brazilian Portuguese, based on the CoNLL Shared Tasks on SRL for English. Training and test data sets, evaluation metrics and a baseline system are provided as part of this benchmark. These resources have been used to implement a supervised SRL system which outperforms the baseline (17 points better in F 1 measure). Most importantly, the benchmark proved to be useful for evaluating the performance of SRL systems for Brazilian Portuguese.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Status: | Published |
Schools: | Computer Science & Informatics |
Publisher: | Springer |
ISBN: | 9783642346538 |
ISSN: | 0302-9743 |
Last Modified: | 04 Apr 2022 09:45 |
URI: | https://orca.cardiff.ac.uk/id/eprint/147267 |
Citation Data
Cited 7 times in Scopus. View in Scopus. Powered By Scopus® Data
Actions (repository staff only)
Edit Item |