An interaction framework for designing systems for virtual home assistants and people with dysarthria

Jaddoh, Aisha, Loizides, Fernando ORCID: https://orcid.org/0000-0003-0531-6760, Lee, Jimin and Rana, Omer ORCID: https://orcid.org/0000-0003-3597-2646 2023. An interaction framework for designing systems for virtual home assistants and people with dysarthria. Universal Access in the Information Society 10.1007/s10209-023-01037-3

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (972kB) | Preview

Abstract

People with speech impairments usually use assistive technology devices to assist them with communication and daily tasks. These devices can be controlled using different modalities, such as touch, eye gaze, gestures, and others. This article proposes a standardized methodology for designing non-verbal voice cue interactive systems that enable people with dysarthria to vocally interact with virtual home assistants (VHAs). We adopted a qualitative data-gathering approach to gain insights into users’ experiences and requirements and to determine crucial design elements for designing interactive voice assistants for people with dysarthria. Nineteen participants with varying levels of dysarthria took part in the study to create the framework. A system was then built using the proposed framework, and an additional test was performed with a further seven participants to validate the created system, thus inferring the validity of the framework. Our work empirically demonstrates how an informed, structured design of a fast, direct (verbal rather than forcing users to change modalities or using an intermediate device) method of communication improves the usability of VHAs for people with dysarthria while simultaneously allowing for a more authentic experience. The current data also highlighted that using non-verbal voice cues would be a convenient option. By providing a reproducible framework for developing non-verbal interactive systems for VHAs, we can increase the accessibility of said devices, their usability, and their user experience.

Item Type:	Article
Date Type:	Published Online
Status:	In Press
Schools:	Computer Science & Informatics
Publisher:	Springer
ISSN:	1615-5289
Date of First Compliant Deposit:	23 August 2023
Date of Acceptance:	17 August 2023
Last Modified:	04 Dec 2023 11:19
URI:	https://orca.cardiff.ac.uk/id/eprint/161924

Actions (repository staff only)

Edit Item