Thoth: Automatic Resource Management with Machine Learning for Container-based Cloud Platform

Akkarit Sangpetch, Orathai Sangpetch, Nut Juangmarisakul, Supakorn Warodom

Abstract

Platform-as-a-Service (PaaS) providers often encounter fluctuation in computing resource usage due to workload changes, resulting in performance degradation. To maintain acceptable service quality, providers may need to manually adjust resource allocation according to workload dynamics. Unfortunately, this approach will not scale well as the number of applications grows. We thus propose Thoth, a dynamic resource management system for PaaS using Docker container technology. Thoth automatically monitors resource usage and dynamically adjusts appropriate amount of resources for each application. To implement the automatic-scaling algorithm, we select three algorithms, namely Neural Network, Q-Learning and our rule-based algorithm, to study and evaluate. The experimental results suggest that Q-Learning can the best adapt to the load changes, followed by a rule-based algorithm and NN. With Q-Learning, Thoth can save computing resources by 28.95% and 21.92%, compared to Neural Network and the rule-based algorithm respectively, without compromising service quality.

References

  1. Dawoud, W., Takouna, I. and Meinel, C. (2012) Elastic virtual machine for fine-grained cloud resource provisioning. In: Global Trends in Computing and Communication Systems, Springer Berline Heidelberg, pp. 11-25.
  2. Deis.io, (2017). Deis builds powerful, open source tools that make it easy for teams to create and manage applications on Kubernetes. [online] Available at: https://deis.io.
  3. Dougherty, B., White, J. and Schmidt, D.C. (2012) Modeldriven auto-scaling of green cloud computing infrastructure. In: Future Generation Computer Systems, 28, no 2., pp.371-378.
  4. Dutreilh, X., Kirgizov, S., Melekhova O., Malenfant, J., Rivierre, N. and Truck, I. (2011) Using Reinforcement Learning for Autonomic Resource Allocation in Clouds: Toward a Fully Automated Workflow. In: the 7th International Conference on Autonomic and Autonomous Systems, Venice, Italy: ICAS, pp.67-74.
  5. Flynn.io, (2017). Throw away the duct tape. Say hello to Flynn. [online] Avaiable at: https://flynn.io/
  6. Jamshidi, P., Sharifloo, A., Pahl, C., Arabnejad, H., Metzger, A. and Estrada, G. (2016) Fuzzy SelfLearning Controllers for Elasticity Management in Dynamic Cloud Architectures. In: the 12th International ACM SIGSOFT Conference on Quality of Software Architectures, Venice: QoSA, pp. 70-79.
  7. Jiang, J., Lu, J., Zhang, G. and Long, G. (2013) Optimal Cloud Resource Auto-Scaling for Web Applications. In: the 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, Delft: CCGrid, pp. 58-65.
  8. Jiang, Y., Perng, C.S., Li, T. and Chang, R. (2011) ASAP: A Self-Adaptive Prediction System for Instant Cloud Resource Demand Provisioning. In: IEEE 11th International Conference on Data Mining, Vancouver, BC, pp. 1104-1109.
  9. Kubernetes.io, (2017). Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. [online] Available at: https://kubernetes.io/
  10. Mao, M., Li, J. and Humphrey, M. (2010) Cloud autoscaling with deadline and budget constraints. In: the 11th IEEE/ACM International Conference on Grid Computing, Brussels, pp. 41-48.
  11. Rao, J., Bu, X., Xu, C.Z., Wang, L., and Yin, G. (2009). VCONF: a reinforcement learning approach to virtual machine auto-configuration. In: the 6th International Conference on Autonomic Computing, Barcelona, Spain: ICAC, pp. 137-146.
Download


Paper Citation


in Harvard Style

Sangpetch A., Sangpetch O., Juangmarisakul N. and Warodom S. (2017). Thoth: Automatic Resource Management with Machine Learning for Container-based Cloud Platform . In Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-243-1, pages 103-111. DOI: 10.5220/0006254601030111


in Bibtex Style

@conference{closer17,
author={Akkarit Sangpetch and Orathai Sangpetch and Nut Juangmarisakul and Supakorn Warodom},
title={Thoth: Automatic Resource Management with Machine Learning for Container-based Cloud Platform},
booktitle={Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2017},
pages={103-111},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006254601030111},
isbn={978-989-758-243-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Thoth: Automatic Resource Management with Machine Learning for Container-based Cloud Platform
SN - 978-989-758-243-1
AU - Sangpetch A.
AU - Sangpetch O.
AU - Juangmarisakul N.
AU - Warodom S.
PY - 2017
SP - 103
EP - 111
DO - 10.5220/0006254601030111