SimFaaS: A Performance Simulator for Serverless Computing Platforms

Nima Mahmoudi, Hamzeh Khazaei

2021

Abstract

Developing accurate and extendable performance models for serverless platforms, aka Function-as-a-Service (FaaS) platforms, is a very challenging task. Also, implementation and experimentation on real serverless platforms is both costly and time-consuming. However, at the moment, there is no comprehensive simulation tool or framework to be used instead of the real platform. As a result, in this paper, we fill this gap by proposing a simulation platform, called SimFaaS, which assists serverless application developers to develop optimized Function-as-a-Service applications in terms of cost and performance. On the other hand, SimFaaS can be leveraged by FaaS providers to tailor their platforms to be workload-aware so that they can increase profit and quality of service at the same time. Also, serverless platform providers can evaluate new designs, implementations, and deployments on SimFaaS in a timely and cost-efficient manner. SimFaaS is open-source, well-documented, and publicly available, making it easily usable and extendable to incorporate more use case scenarios in the future. Besides, it provides performance engineers with a set of tools that can calculate several characteristics of serverless platform internal states, which is otherwise hard (mostly impossible) to extract from real platforms. In previous studies, temporal and steady-state performance models for serverless computing platforms have been developed. However, those models are limited to Markovian processes. We designed SimFaaS as a tool that can help overcome such limitations for performance and cost prediction in serverless computing. We show how SimFaaS facilitates the prediction of essential performance metrics such as average response time, probability of cold start, and the average number of instances reflecting the infrastructure cost incurred by the serverless computing provider. We evaluate the accuracy and applicability of SimFaaS by comparing the prediction results with real-world traces from Amazon AWS Lambda.

Paper Citation

in Harvard Style

Mahmoudi N. and Khazaei H. (2021). SimFaaS: A Performance Simulator for Serverless Computing Platforms. In Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-510-4, pages 23-33. DOI: 10.5220/0010376500230033

in Bibtex Style

@conference{closer21,
author={Nima Mahmoudi and Hamzeh Khazaei},
title={SimFaaS: A Performance Simulator for Serverless Computing Platforms},
booktitle={Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2021},
pages={23-33},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010376500230033},
isbn={978-989-758-510-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - SimFaaS: A Performance Simulator for Serverless Computing Platforms
SN - 978-989-758-510-4
AU - Mahmoudi N.
AU - Khazaei H.
PY - 2021
SP - 23
EP - 33
DO - 10.5220/0010376500230033