Rana, Omer Farooq ORCID: https://orcid.org/0000-0003-3597-2646 2015. In-transit analytics on distributed clouds - applications and architecture. Presented at: CLOSER 2015: 5th Int. Conf. on Cloud Computing and Services Science, Lisbon, Portugal, 20-22 May 2015. |
Abstract
The increasing deployment of sensor network infrastructures (in a variety of applications, ranging from environmental monitoring, "Smart Cities", energy demand forecasting, social media analysis to emergency response) has led to large volumes of data becoming available, leading to new challenges in storing, processing, analysing and transferring such data. This is especially true when data from multiple sensors is pre-processed prior to delivery to users. Where such data is processed in-transit (i.e. from data capture to delivery to a user) over a shared distributed computing infrastructure, and due to the increasing availability of software defined networks, it is necessary to provide some Quality of Service (QoS) guarantees to each user. This talk provides: (i) scenarios of applications that have these types of characteristics; (ii) a computational architecture for supporting QoS for multiple concurrent scientific workflow data streams being processed (prior to delivery to a user) over a shared infrastructure. The architecture is used to demonstrate how a streaming pipeline, with intermediate data size variation (inflation/deflation), can be supported and managed using a dynamic control strategy at each node. Such a strategy supports end-to-end QoS with variations in data size between the various nodes involved in the workflow enactment process.
Item Type: | Conference or Workshop Item (Keynote) |
---|---|
Date Type: | Completion |
Status: | Unpublished |
Schools: | Computer Science & Informatics |
Subjects: | Q Science > QA Mathematics > QA76 Computer software T Technology > T Technology (General) |
Last Modified: | 28 Oct 2022 09:36 |
URI: | https://orca.cardiff.ac.uk/id/eprint/75033 |
Actions (repository staff only)
Edit Item |