Simulating User Interactions: A Model and Tool for Semi-realistic Load Testing of Social App Backend Web Services

Philipp Brune

2017

Abstract

Many mobile apps today support interactions between their users and/or the provider within the app. Therefore, these apps commonly call a web service backend system hosted by the app provider. For the implementation of such service backends, load tests are required to ensure their performance and scalability. However, existing tools like JMeter are not able to simulate “out of the box” a load distribution with the complex time evolution of heterogeneous, real and interacting users of a social app, which e.g. would be necessary to detect critical performance bottlenecks. Therefore, in this paper a probabilistic model for simulating interacting users of a social app is proposed and evaluated by implementing it in a prototype load testing tool and using it to test a backend of new real-world social app currently under development.

References

  1. Albonico, M., Mottu, J.-M., and Sunyé, G. (2016). Automated workload generation for testing elastic web applications.
  2. Awad, M. A. and Khalil, I. (2012). Prediction of user's web-browsing behavior: Application of markov model. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42(4):1131-1142.
  3. Balachandran, A., Voelker, G. M., Bahl, P., and Rangan, P. V. (2002). Characterizing user behavior and network performance in a public wireless lan. In Proceedings of the 2002 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS 7802, pages 195-205, New York, NY, USA. ACM.
  4. Benevenuto, F., Rodrigues, T., Cha, M., and Almeida, V. (2009). Characterizing user behavior in online social networks. In Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference, IMC 7809, pages 49-62, New York, NY, USA. ACM.
  5. Bonabeau, E. (2002). Agent-based modeling: Methods and techniques for simulating human systems. Proceedings of the National Academy of Sciences, 99(suppl 3):7280-7287.
  6. Busari, M. and Williamson, C. (2002). Prowgen: a synthetic workload generation tool for simulation evaluation of web proxy caches. Computer Networks, 38(6):779- 794.
  7. Calheiros, R. N., Netto, M. A., De Rose, C. A., and Buyya, R. (2013). Emusim: an integrated emulation and simulation environment for modeling, evaluation, and validation of performance of cloud computing applications. Software: Practice and Experience, 43(5):595-612.
  8. Calzarossa, M. C. and Tucci, S. (2002). Performance Evaluation of Complex Systems: Techniques and Tools: Performance 2002. Tutorial Lectures, volume 2459. Springer Science & Business Media.
  9. Chen, F., Grundy, J., Schneider, J.-G., Yang, Y., and He, Q. (2015). Stresscloud: a tool for analysing performance and energy consumption of cloud applications. In Proceedings of the 37th International Conference on Software Engineering-Volume 2, pages 721-724. IEEE Press.
  10. Chen, Y., Ganapathi, A. S., Griffith, R., and Katz, R. H. (2010). Towards understanding cloud performance tradeoffs using statistical workload analysis and replay. University of California at Berkeley, Technical Report No. UCB/EECS-2010-81.
  11. Folkerts, E., Alexandrov, A., Sachs, K., Iosup, A., Markl, V., and Tosun, C. (2012). Benchmarking in the cloud: What it should, can, and cannot be. In Technology Conference on Performance Evaluation and Benchmarking, pages 173-188. Springer.
  12. Gonc¸alves, G. D., Drago, I., Vieira, A. B., da Silva, A. P. C., Almeida, J. M., and Mellia, M. (2016). Workload models and performance evaluation of cloud storage services. Computer Networks.
  13. Hashemian, R., Krishnamurthy, D., and Arlitt, M. (2012). Web workload generation challenges-an empirical investigation. Software: Practice and Experience, 42(5):629-647.
  14. Heinrich, R., Jung, R., Schmieders, E., Metzger, A., Hasselbring, W., Reussner, R., and Pohl, K. (2015). Architectural run-time models for operator-in-the-loop adaptation of cloud applications.
  15. Hlavacs, H., Hotop, E., and Kotsis, G. (2000). Workload generation by modeling user behavior. In In Proceedings OPNETWORKS 2000.
  16. Hsiao, C.-H., Chang, J.-J., and Tang, K.-Y. (2016). Exploring the influential factors in continuance usage of mobile social apps: Satisfaction, habit, and customer value perspectives. Telematics and Informatics, 33(2):342 - 355.
  17. Lehn, M., Triebel, T., Rehner, R., Guthier, B., Kopf, S., Buchmann, A., and Effelsberg, W. (2014). On synthetic workloads for multiplayer online games: a methodology for generating representative shooter game workloads. Multimedia Systems, 20(5):609-620.
  18. Magalha˜es, D., Calheiros, R. N., Buyya, R., and Gomes, D. G. (2015). Workload modeling for resource usage analysis and simulation in cloud computing. Computers & Electrical Engineering, 47:69-81.
  19. Maia, M., Almeida, J., and Almeida, V. (2008). Identifying user behavior in online social networks. In Proceedings of the 1st workshop on Social network systems, pages 1-6. ACM.
  20. Mell, P. and Grance, T. (2011). The nist definition of cloud computing.
  21. Moreno, I. S., Garraghan, P., Townend, P., and Xu, J. (2013). An approach for characterizing workloads in google cloud to derive realistic resource utilization models. In Service Oriented System Engineering (SOSE), 2013 IEEE 7th International Symposium on, pages 49-60. IEEE.
  22. Radinsky, K., Svore, K., Dumais, S., Teevan, J., Bocharov, A., and Horvitz, E. (2012). Modeling and predicting behavioral dynamics on the web. In Proceedings of the 21st International Conference on World Wide Web, WWW 7812, pages 599-608, New York, NY, USA. ACM.
  23. Shams, M., Krishnamurthy, D., and Far, B. (2006). A model-based approach for testing the performance of web applications. In Proceedings of the 3rd international workshop on Software quality assurance, pages 54-61. ACM.
  24. Shyaamini, M. B. and Senthilkumar, M. (2015). A novel approach for performance testing on web application services. International Journal of Applied Engineering Research, 10(18):38679-38683.
  25. Sliwko, L. and Getov, V. (2016). Agocs-accurate google cloud simulator framework.
  26. Terevinto, P. N., Pont, A., Gil, J. A., and Domenech, J. (2016). A flexible workload model based on roles of interactive users in social networks. In 2016 IFIP Networking Conference (IFIP Networking) and Workshops, pages 524-529.
  27. V ögele, C., Robert, H., Robert, H., van Hoorn, A., and Krcmar, H. (2015). Modeling complex user behavior with the palladio component model.
  28. Weigle, M. C., Adurthi, P., Hernández-Campos, F., Jeffay, K., and Smith, F. D. (2006). Tmix: a tool for generating realistic tcp application workloads in ns-2. ACM SIGCOMM Computer Communication Review, 36(3):65-76.
  29. Xu, Z., Zhang, Y., Wu, Y., and Yang, Q. (2012). Modeling user posting behavior on social media. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 7812, pages 545-554, New York, NY, USA. ACM.
  30. Yu, H., Zheng, D., Zhao, B. Y., and Zheng, W. (2006). Understanding user behavior in large-scale video-ondemand systems. In ACM SIGOPS Operating Systems Review, volume 40, pages 333-344. ACM.
  31. Zhang, W., Huang, X., Chen, N., Wang, W., and Zhong, H. (2012). Paas-oriented performance modeling for cloud computing. In 2012 IEEE 36th Annual Computer Software and Applications Conference, pages 395- 404. IEEE.
Download


Paper Citation


in Harvard Style

Brune P. (2017). Simulating User Interactions: A Model and Tool for Semi-realistic Load Testing of Social App Backend Web Services . In Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-758-246-2, pages 235-242. DOI: 10.5220/0006248202350242


in Bibtex Style

@conference{webist17,
author={Philipp Brune},
title={Simulating User Interactions: A Model and Tool for Semi-realistic Load Testing of Social App Backend Web Services},
booktitle={Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2017},
pages={235-242},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006248202350242},
isbn={978-989-758-246-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - Simulating User Interactions: A Model and Tool for Semi-realistic Load Testing of Social App Backend Web Services
SN - 978-989-758-246-2
AU - Brune P.
PY - 2017
SP - 235
EP - 242
DO - 10.5220/0006248202350242