Model-based, multimodal interaction in document browsing

Eslambolchilar, Parisa ORCID: https://orcid.org/0000-0003-4610-1643 and Murray-Smith, Roderick 2006. Model-based, multimodal interaction in document browsing. Lecture Notes in Computer Science 4299 , pp. 1-12. 10.1007/11965152_1

Full text not available from this repository.

Abstract

In this paper we introduce a dynamic system approach to the design of multimodal interactive systems. We use an example where we support human behavior in browsing a document, by adapting the dynamics of navigation and the visual feedback (using a focus-in-context (F+C) method) to support the current inferred task. We also demonstrate non-speech audio feedback, based on a language model. We argue that to design interaction we need models of key aspects of the process, here for example, we need models for the dynamic system, language model and sonification. We show how the user’s intention is coupled to the visualization technique via the dynamic model, and how the focus-in-context method couples details in context to audio samples via the language identification system. We present probabilistic audio feedback as an example of a multimodal approach to sensing different languages in a multilingual text. This general approach is well suited to mobile and wearable applications, and shared displays.

Item Type:	Article
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Publisher:	Springer
ISSN:	0302-9743
Last Modified:	21 Oct 2022 07:11
URI:	https://orca.cardiff.ac.uk/id/eprint/99315

Citation Data

Cited 6 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item