Deployment Service for Scalable Distributed Deep Learning Training on Multiple Clouds

Javier Jorge, Germán Moltó, Damian Segrelles, João Fontes, Miguel Guevara

2021

Abstract

This paper introduces a platform based on open-source tools to automatically deploy and provision a distributed set of nodes that conduct the training of a deep learning model. To this end, the deep learning framework TensorFlow will be used, as well as the Infrastructure Manager service to deploy complex infrastructures programmatically. The provisioned infrastructure addresses: data handling, model training using these data, and the persistence of the trained model. For this purpose, public Cloud platforms such as Amazon Web Services (AWS) and General-Purpose Computing on Graphics Processing Units (GPGPU) are employed to dynamically and efficiently perform the workflow of tasks related to training deep learning models. This approach has been applied to real-world use cases to compare local training versus distributed training on the Cloud. The results indicate that the dynamic provisioning of GPU-enabled distributed virtual clusters in the Cloud introduces great flexibility to cost-effectively train deep learning models.

Paper Citation

in Harvard Style

Jorge J., Moltó G., Segrelles D., Fontes J. and Guevara M. (2021). Deployment Service for Scalable Distributed Deep Learning Training on Multiple Clouds. In Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-510-4, pages 135-142. DOI: 10.5220/0010359601350142

in Bibtex Style

@conference{closer21,
author={Javier Jorge and Germán Moltó and Damian Segrelles and João Fontes and Miguel Guevara},
title={Deployment Service for Scalable Distributed Deep Learning Training on Multiple Clouds},
booktitle={Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2021},
pages={135-142},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010359601350142},
isbn={978-989-758-510-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Deployment Service for Scalable Distributed Deep Learning Training on Multiple Clouds
SN - 978-989-758-510-4
AU - Jorge J.
AU - Moltó G.
AU - Segrelles D.
AU - Fontes J.
AU - Guevara M.
PY - 2021
SP - 135
EP - 142
DO - 10.5220/0010359601350142