Tolosana-Calasanz, Rafael, Bañares, José Ángel, Pham, Congduc and Rana, Omer Farooq ORCID: https://orcid.org/0000-0003-3597-2646 2012. Enforcing QoS in scientific workflow systems enacted over Cloud infrastructures. Journal of Computer and System Sciences 78 (5) , pp. 1300-1315. 10.1016/j.jcss.2011.12.015 |
Abstract
The ability to support Quality of Service (QoS) constraints is an important requirement in some scientific applications. With the increasing use of Cloud computing infrastructures, where access to resources is shared, dynamic and provisioned on-demand, identifying how QoS constraints can be supported becomes an important challenge. However, access to dedicated resources is often not possible in existing Cloud deployments and limited QoS guarantees are provided by many commercial providers (often restricted to error rate and availability, rather than particular QoS metrics such as latency or access time). We propose a workflow system architecture which enforces QoS for the simultaneous execution of multiple scientific workflows over a shared infrastructure (such as a Cloud environment). Our approach involves multiple pipeline workflow instances, with each instance having its own QoS requirements. These workflows are composed of a number of stages, with each stage being mapped to one or more physical resources. A stage involves a combination of data access, computation and data transfer capability. A token bucket-based data throttling framework is embedded into the workflow system architecture. Each workflow instance stage regulates the amount of data that is injected into the shared resources, allowing for bursts of data to be injected while at the same time providing isolation of workflow streams. We demonstrate our approach by using the Montage workflow, and develop a Reference net model of the workflow.
Item Type: | Article |
---|---|
Date Type: | Publication |
Status: | Published |
Schools: | Computer Science & Informatics |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Uncontrolled Keywords: | Scientific workflows; Cloud computing; Petri nets; QoS |
Publisher: | Elsevier |
ISSN: | 0022-0000 |
Last Modified: | 21 Oct 2022 09:13 |
URI: | https://orca.cardiff.ac.uk/id/eprint/35620 |
Citation Data
Cited 48 times in Scopus. View in Scopus. Powered By Scopus® Data
Actions (repository staff only)
Edit Item |