Multimodal corpora

Fitzgerald, C., Knight, Dawn ORCID: https://orcid.org/0000-0002-4745-6502 and Adolphs, S. 2026. Multimodal corpora. Reppen, R., Goulart, R. and Biber, D., eds. The Cambridge Handbook of English Corpus Linguistics, Cambridge University Press, pp. 247-264. (10.1017/9781009477888.013)

Full text not available from this repository.

Abstract

This chapter provides an overview of multimodal corpora, highlighting their significance in analyzing communication that integrates various modes such as speech, gesture, and gaze. The chapter defines both a mode and a multimodal corpus before introducing key types of multimodal corpora, including video-recorded interactions, corpora of signed languages, and datasets combining text and images. Prominent examples of multimodal corpora such as the ViMELF, FreMIC, and AMI corpora showcase the variety of multimodal corpora that exist and the various techniques employed to construct multimodal corpora. Challenges in constructing and annotating multimodal corpora are discussed, including temporal alignment, manual annotation efforts, and data-sharing limitations due to privacy concerns. The chapter emphasizes the importance of tailoring multimodal corpora to specific research questions while acknowledging the trade-offs of specialization. Advancements in technology, such as automated tagging and collaborative tools, are proposed as potential solutions to enhance accessibility and interoperability. A case study on turn management in virtual meetings illustrates the application of multimodal analysis, offering insights into how participants request and allocate turns in mediated contexts. The chapter serves as a guide for researchers navigating the methodological complexities of multimodal corpus-based studies.

Item Type:	Book Section
Date Type:	Publication
Status:	Published
Schools:	Schools > Modern Languages
Publisher:	Cambridge University Press
ISBN:	9781009477864
Last Modified:	11 Aug 2026 14:27
URI:	https://orca.cardiff.ac.uk/id/eprint/185552

Actions (repository staff only)

Edit Item