loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: César Acevedo ; Porfidio Hernandez ; Antonio Espinosa and Víctor Méndez

Affiliation: Univ. Autonoma de Barcelona, Spain

Keyword(s): Multiple, Multiworkflows, Data-Aware, Cluster.

Related Ontology Subjects/Areas/Topics: Bioinformatics ; Biomedical Engineering ; Biomedical Signal Processing

Abstract: Previous scheduling research work is based on the analysis of the computational time of application workflows. Current use of clusters deals with the execution of multiworkflows that may share applications and input files. In order to reduce the makespan of such multiworkflows adequate data allocation policies should be applied to reduce input data latency. We propose a scheduling strategy for multiworkflows that considers the data location of shared input files in different locations of the storage system of the cluster. For that, we first merge all workflows in a study and evaluate the global design pattern obtained. Then, we apply a classic list scheduling heuristic considering the location of the input files in the storage system to reduce the communication overhead of the applications. We have evaluated our proposal with an initial set of experimental environments showing promising results of up to 20% makespan improvement.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.162.130.75

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Acevedo, C.; Hernandez, P.; Espinosa, A. and Méndez, V. (2016). A Data-Aware MultiWorkflow Cluster Scheduler. In Proceedings of the 1st International Conference on Complex Information Systems - COMPLEXIS; ISBN 978-989-758-181-6; ISSN 2184-5034, SciTePress, pages 95-102. DOI: 10.5220/0005932000950102

@conference{complexis16,
author={César Acevedo. and Porfidio Hernandez. and Antonio Espinosa. and Víctor Méndez.},
title={A Data-Aware MultiWorkflow Cluster Scheduler},
booktitle={Proceedings of the 1st International Conference on Complex Information Systems - COMPLEXIS},
year={2016},
pages={95-102},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005932000950102},
isbn={978-989-758-181-6},
issn={2184-5034},
}

TY - CONF

JO - Proceedings of the 1st International Conference on Complex Information Systems - COMPLEXIS
TI - A Data-Aware MultiWorkflow Cluster Scheduler
SN - 978-989-758-181-6
IS - 2184-5034
AU - Acevedo, C.
AU - Hernandez, P.
AU - Espinosa, A.
AU - Méndez, V.
PY - 2016
SP - 95
EP - 102
DO - 10.5220/0005932000950102
PB - SciTePress