Autonomic streaming pipeline for scientific workflows

Tolosana-Calasanz, Rafael, Bañares, Jose A. and Rana, Omer Farood ORCID: https://orcid.org/0000-0003-3597-2646 2011. Autonomic streaming pipeline for scientific workflows. Concurrency and computation: practice and experience 23 (16) , pp. 1868-1892. 10.1002/cpe.1744

Full text not available from this repository.

Abstract

Interest in data streaming within scientific workflow has increased significantly over the recent years—mainly due to the emergence of data-driven applications. Such applications can include data streaming from sensors and data coupling between scientific simulations. To support resource management to enact such streaming-based workflow, autonomic computing techniques for transmission have been combined with in-transit processing, so that data elements may be processed in advance, enroute, prior to arrival at the destination. We propose the integration of an autonomic data streaming service (ADSS) with in-transit processing into a workflow specification. This integration may imply that the associated runtime resource allocation is dependent on environmental conditions and can change for different enactments of the same workflow. In our proposal, our workflow specifications are independent of the constraints imposed by the resource allocation. We express our solutions in terms of Reference nets. We also implement an ADSS utilizing a timed Reference net simulation for predicting future states of the ADSS. There are two advantages: the Reference net which implements the ADSS and the timed model are coincident, and second, token distribution obtained from the Petri net implementation can be utilized to better understand the demand for particular types of resources in the system.

Item Type:	Article
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Uncontrolled Keywords:	scientific workflows;streaming pipeline;petri nets
Publisher:	John Wiley & Sons
ISSN:	1532-0626
Last Modified:	20 Oct 2022 08:11
URI:	https://orca.cardiff.ac.uk/id/eprint/27526

Citation Data

Cited 17 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item