End-to-End QoS on Shared Clouds for Highly Dynamic, Large-Scale Sensing Data Streams

Tolosana-Calasanz, Rafael, Bañares, José Ángel, Pham, Congduc and Rana, Omer Farooq ORCID: https://orcid.org/0000-0003-3597-2646 2012. End-to-End QoS on Shared Clouds for Highly Dynamic, Large-Scale Sensing Data Streams. Presented at: 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), 2012, Ottawa, Canada, 13-16 May 2012. Published in: Balaji, P., Buyya, Rajkumar, Majumdar, S. and Pandey, Sunil eds. Proceedings of the 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. Los Alamitos, CA: IEEE, pp. 904-911. 10.1109/CCGrid.2012.67

Full text not available from this repository.

Abstract

The increasing deployment of sensor network infrastructures has led to large volumes of data becoming available, leading to new challenges in storing, processing and transmitting such data. This is especially true when data from multiple sensors is pre-processed prior to delivery to users. Where such data is processed in-transit (i.e. from data capture to delivery to a user) over a shared distributed computing infrastructure, it is necessary to provide some Quality of Service (QoS) guarantees to each user. We propose an architecture for supporting QoS for multiple concurrent scientific workflow data streams being processed (prior to delivery to a user) over a shared infrastructure. We consider such an infrastructure to be composed of a number of nodes, each of which has multiple processing units and data buffers. We utilize the ``token bucket" model for regulating, on a per workflow stream basis, the data injection rate into such a node. We subsequently demonstrate how a streaming pipeline, with intermediate data size variation (inflation/deflation), can be supported and managed using a dynamic control strategy at each node. Such a strategy supports end-to-end QoS with variations in data size between the various nodes involved in the workflow enactment process.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics Engineering
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Uncontrolled Keywords:	Token bucket control , in-transit analysis , multi-tenancy architecture
Publisher:	IEEE
ISBN:	9781467313957
Last Modified:	21 Oct 2022 09:13
URI:	https://orca.cardiff.ac.uk/id/eprint/35615

Citation Data

Cited 11 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item