loading
Papers

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Paul Marshall 1 ; Henry Tufo 2 ; Kate Keahey 3 ; David La Bissoniere 3 and Matthew Woitaszek 4

Affiliations: 1 University of Colorado, United States ; 2 University of Colorado at Boulder and National Center for Atmospheric Research, United States ; 3 Argonne National Laboratory and University of Chicago, United States ; 4 National Center for Atmospheric Research, United States

ISBN: 978-989-8565-19-8

Keyword(s): Infrastructure-as-a-Service, Cloud Computing, Elastic Computing, Recontextualization.

Related Ontology Subjects/Areas/Topics: Agents ; Artificial Intelligence ; Context ; Context Sensitive Applications ; Paradigm Trends ; Service Technology and Infrastructure Issues ; Services ; Services Applications ; Software Engineering

Abstract: Infrastructure-as-a-service (IaaS) clouds, such as Amazon EC2, offer pay-for-use virtual resources on-demand. This allows users to outsource computation and storage when needed and create elastic computing environments that adapt to changing demand. However, existing services, such as cluster resource managers (e.g. Torque), do not include support for elastic environments. Furthermore, no recontextualization services exist to reconfigure these environments as they continually adapt to changes in demand. In this paper we present an architecture for a large-scale elastic cluster environment. We extend an open-source elastic IaaS manager, the Elastic Processing Unit (EPU), to support the Torque batch-queue scheduler. We also develop a lightweight REST-based recontextualization broker that periodically reconfigures the cluster as nodes join or leave the environment. Our solution adds nodes dynamically at runtime and supports MPI jobs across dis-tributed resources. For experimental evaluat ion, we deploy our solution using both NSF FutureGrid and Amazon EC2. We demonstrate the ability of our solution to create multi-cloud deployments and run batch-queued jobs, recontextualize 256 node clusters within one second of the recontextualization period, and scale to over 475 nodes in less than 15 minutes. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.205.176.85

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Marshall, P.; Tufo, H.; Keahey, K.; La Bissoniere, D. and Woitaszek, M. (2012). Architecting a Large-scale Elastic Environment - Recontextualization and Adaptive Cloud Services for Scientific Computing.In Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT, ISBN 978-989-8565-19-8, pages 409-418. DOI: 10.5220/0004081704090418

@conference{icsoft12,
author={Paul Marshall. and Henry Tufo. and Kate Keahey. and David La Bissoniere. and Matthew Woitaszek.},
title={Architecting a Large-scale Elastic Environment - Recontextualization and Adaptive Cloud Services for Scientific Computing},
booktitle={Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT,},
year={2012},
pages={409-418},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004081704090418},
isbn={978-989-8565-19-8},
}

TY - CONF

JO - Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT,
TI - Architecting a Large-scale Elastic Environment - Recontextualization and Adaptive Cloud Services for Scientific Computing
SN - 978-989-8565-19-8
AU - Marshall, P.
AU - Tufo, H.
AU - Keahey, K.
AU - La Bissoniere, D.
AU - Woitaszek, M.
PY - 2012
SP - 409
EP - 418
DO - 10.5220/0004081704090418

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.