Resource management for bursty streams on multi-tenancy cloud environments

Tolosana-Calasanz, Rafael, Bañares, José Ángel, Pham, Congduc and Rana, Omer F. ORCID: https://orcid.org/0000-0003-3597-2646 2016. Resource management for bursty streams on multi-tenancy cloud environments. Future Generation Computer Systems 55 , pp. 444-459. 10.1016/j.future.2015.03.012

Full text not available from this repository.

Abstract

The number of applications that need to process data continuously over long periods of time has increased significantly over recent years. The emerging Internet of Things and Smart Cities scenarios also confirm the requirement for real time, large scale data processing. When data from multiple sources are processed over a shared distributed computing infrastructure, it is necessary to provide some Quality of Service (QoS) guarantees for each data stream, specified in a Service Level Agreement (SLA). SLAs identify the price that a user must pay to achieve the required QoS, and the penalty that the provider will pay the user in case of QoS violation. Assuming maximization of revenue as a Cloud provider’s objective, then it must decide which streams to accept for storage and analysis; and how many resources to allocate for each stream. When the real-time requirements demand a rapid reaction, dynamic resource provisioning policies and mechanisms may not be useful, since the delays and overheads incurred might be too high. Alternatively, idle resources that were initially allocated for other streams could be re-allocated, avoiding subsequent penalties. In this paper, we propose a system architecture for supporting QoS for concurrent data streams to be composed of self-regulating nodes. Each node features an envelope process for regulating and controlling data access and a resource manager to enable resource allocation, and selective SLA violations, while maximizing revenue. Our resource manager, based on a shared token bucket, enables: (i) the re-distribution of unused resources amongst data streams; and (ii) a dynamic re-allocation of resources to streams likely to generate greater profit for the provider. We extend previous work by providing a Petri-net based model of system components, and we evaluate our approach on an OpenNebula-based Cloud infrastructure.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software
Uncontrolled Keywords:	Data stream processing; Cloud computing; Profit-based resource management; SLA management; Admission control; QoS provisioning
Additional Information:	Available online 19 March 2015
Publisher:	Elsevier
ISSN:	0167-739X
Date of First Compliant Deposit:	30 March 2016
Date of Acceptance:	11 March 2015
Last Modified:	28 Oct 2022 09:28
URI:	https://orca.cardiff.ac.uk/id/eprint/74663

Citation Data

Cited 21 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item