RoboClean: Contextual language grounding for human-robot interactions in specialised low-resource environments

Fuentes, Carolina ORCID: https://orcid.org/0000-0002-0871-939X, Porcheron, Martin and Fischer, Joel E. 2023. RoboClean: Contextual language grounding for human-robot interactions in specialised low-resource environments. Presented at: 5th International Conference on Conversational User Interfaces, Eindhoven, Netherlands, 19-21 July 2023. Published in: Lee, M., Munteanu, C., Porcheron, M., Trippas, J. and Volkel, S. T. eds. Proceedings of the 5th International Conference on Conversational User Interfaces. New York, NY, US: Association for Computing Machinery, 10.1145/3571884.3597137

Full text not available from this repository.

Abstract

Building effective voice interfaces for the instruction of service robots in specialised environments is difficult due to the local knowledge of workers, such as specific terminology for objects and space, leading to limited data to train language models (known as ‘low-resource’ domains) and challenges in language grounding. We present a language grounding study in which we a) elicit spoken natural language of context experts in situ through a Wizard of Oz study and compile a dataset, b) qualitatively examine linguistic properties of the resulting instructions to reveal referential categories and parameters employed to construct instructions in context. We discuss how our language grounding protocol may be applied to bootstrap a language model in its targeted use context. Our work contributes a linguistic understanding of robot instructions that can be applied by designers and researchers to develop spoken language understanding for human-robot interactions in specialised, low-resource environments.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Association for Computing Machinery
ISBN:	9798400700149
Last Modified:	19 Dec 2023 13:22
URI:	https://orca.cardiff.ac.uk/id/eprint/164651

Actions (repository staff only)

Edit Item