Feedback-control & queueing theory-based resource management for streaming applications

Tolosana-Calasanz, Rafael, Diaz-Montes, Javier, Rana, Omer F. ORCID: https://orcid.org/0000-0003-3597-2646 and Parashar, Manish 2017. Feedback-control & queueing theory-based resource management for streaming applications. IEEE Transactions on Parallel and Distributed Systems 28 (4) , pp. 1061-1075. 10.1109/TPDS.2016.2603510

Preview

PDF - Accepted Post-Print Version Download (1MB) | Preview

Abstract

Recent advances in sensor technologies and instrumentation have led to an extraordinary growth of data sources and streaming applications. A wide variety of devices, from smart phones to dedicated sensors, have the capability of collecting and streaming large amounts of data at unprecedented rates. A number of distinct streaming data models have been proposed. Typical applications for this include smart cites & built environments for instance, where sensor-based infrastructures continue to increase in scale and variety. Understanding how such streaming content can be processed within some time threshold remains a non-trivial and important research topic. We investigate how a cloud-based computational infrastructure can autonomically respond to such streaming content, offering Quality of Service guarantees. We propose an autonomic controller (based on feedback control and queueing theory) to elastically provision virtual machines to meet performance targets associated with a particular data stream. Evaluation is carried out using a federated Cloud-based infrastructure (implemented using CometCloud) – where the allocation of new resources can be based on: (i) differences between sites, i.e. types of resources supported (e.g. GPU vs. CPU only), (ii) cost of execution; (iii) failure rate and likely resilience, etc. In particular, we demonstrate how Little’s Law –a widely used result in queuing theory– can be adapted to support dynamic control in the context of such resource provisioning.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics Data Innovation Research Institute (DIURI)
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Uncontrolled Keywords:	feedback control, Elastic resource provisioning, autonomic systems
Additional Information:	Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works
Publisher:	Institute of Electrical and Electronics Engineers (IEEE)
ISSN:	1045-9219
Date of First Compliant Deposit:	11 April 2017
Date of Acceptance:	22 August 2016
Last Modified:	25 Nov 2024 23:00
URI:	https://orca.cardiff.ac.uk/id/eprint/96043

Citation Data

Cited 16 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item