4D Cardiff Conversation Database (4D CCDb): A 4D database of natural,dyadic conversations

Marshall, Andrew David ORCID: https://orcid.org/0000-0003-2789-1395, Rosin, Paul L. ORCID: https://orcid.org/0000-0002-4965-3884, Vandeventer, Jason and Aubrey, Andrew 2015. 4D Cardiff Conversation Database (4D CCDb): A 4D database of natural,dyadic conversations. Presented at: FAAVSP - The 1st Joint Conference on Facial Analysis, Animation, and Auditory-Visual Speech Processing, Vienna, Austria, 11-13 September 2015. FAAVSP-2015. Auditory-Visual Speech Processing, {AVSP} 2015. ISCA, pp. 157-162.

Preview

PDF - Accepted Post-Print Version Download (9MB) | Preview

Abstract

The 4D Cardiff Conversation Database (4D CCDb) is the first 4D (3D Video) audio-visual database containing natural conversations between pairs of people. This publicly available database contains 17 conversations which have been fully annotated for speaker and listener activity: conversational facial expressions, head motion, and verbal/non-verbal utterances. It can be accessed at http://www.cs.cf.ac.uk/CCDb. In this paper we describe the data collection and annotation process. We also provide results of a baseline classification experiment distinguishing frontchannel from backchannel smiles, using 3D Active Appearance Models for feature extraction, polynomial fitting for representing the data as 4D sequences, and Support Vector Machines for classification. We believe this expression-rich, audio-visual database of natural conversations will make a useful contribution to the computer vision, affective computing, and cognitive science communities by providing raw data, features, annotations, and baseline comparisons.

Item Type:	Conference or Workshop Item (Paper)
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Publisher:	ISCA
Date of First Compliant Deposit:	13 May 2016
Last Modified:	18 Nov 2024 12:30
URI:	https://orca.cardiff.ac.uk/id/eprint/89745

Actions (repository staff only)

Edit Item