In-transit analytics on distributed clouds: applications and architecture

Rana, Omer Farooq ORCID: https://orcid.org/0000-0003-3597-2646 2015. In-transit analytics on distributed clouds: applications and architecture. Presented at: Australian Computer Science Week (ASCW), Sydney, Australia, 27-30 January 2015.

Full text not available from this repository.

Abstract

The increasing deployment of sensor network infrastructures (in a variety of applications, ranging from environmental monitoring, "Smart Cities", energy demand forecasting, social media analysis to emergency response) has led to large volumes of data becoming available, leading to new challenges in storing, processing, analysing and transferring such data. This is especially true when data from multiple sensors is pre-processed prior to delivery to users. Where such data is processed in-transit (i.e. from data capture to delivery to a user) over a shared distributed computing infrastructure, it is necessary to provide some Quality of Service (QoS) guarantees to each user. This talk provides: (i) a survey of applications that have these types of characteristics; (ii) a computational architecture for supporting QoS for multiple concurrent scientific workflow data streams being processed (prior to delivery to a user) over a shared infrastructure. The architecture is used to demonstrate how a streaming pipeline, with intermediate data size variation (inflation/deflation), can be supported and managed using a dynamic control strategy at each node. Such a strategy supports end-to-end QoS with variations in data size between the various nodes involved in the workflow enactment process.

Item Type:	Conference or Workshop Item (Keynote)
Date Type:	Completion
Status:	Unpublished
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA76 Computer software T Technology > T Technology (General)
Last Modified:	28 Oct 2022 09:36
URI:	https://orca.cardiff.ac.uk/id/eprint/75035

Actions (repository staff only)

Edit Item