Authors:
Paulo Souza
1
;
Miguel Neves
2
;
Carlos Kayser
1
;
Felipe Rubin
1
;
Conrado Boeira
2
;
João Moreira
1
;
Bernardo Bordin
1
and
Tiago Ferreto
1
Affiliations:
1
School of Technology, Pontifical Catholic University of Rio Grande do Sul, Porto Alegre, Brazil
;
2
Faculty of Computer Science, Dalhousie University, Halifax, Canada
Keyword(s):
Cloud Computing, Containers, Service Level Agreement, Deep Learning, Time Series Forecasting.
Abstract:
Container-based virtualization represents a low-overhead and easy-to-manage alternative to virtual machines. On the other hand, containers are more prone to performance interference and unpredictability. Consequently, there is growing interest in predicting and avoiding performance issues in containerized environments. Existing solutions tackle this challenge through proactive elasticity mechanisms based on workload variation predictions. Although this approach may yield satisfactory results in some scenarios, external factors such as resource contention can cause performance losses regardless of workload variations. This paper presents Flavor, a machine-learning-based system for predicting and avoiding performance issues in containerized applications. Rather than relying on workload variation prediction as existing approaches, Flavor predicts application-level metrics (e.g., query latency and throughput) through a deep neural network implemented using Tensorflow and scales applicati
ons accordingly. We evaluate Flavor by comparing it against a state-of-the-art resource scaling approach that relies solely on workload prediction. Our results show that Flavor can predict performance deviations effectively while assisting operators to wisely scale their services by increasing/decreasing the number of application containers to avoid performance issues and resource underutilization.
(More)