Performance Testing of an Internet of Things Platform

John Esquiagola, Laisa Costa, Pablo Calcina, Geovane Fedrecheski, Marcelo Zuffo

2017

Abstract

The Internet of Things (IoT) is a network of physical objects, or things, with embedded electronics, software, sensors, and connectivity. The connection of all these things leverages value generation, by offering new services and strategic information. In order to make the Internet of Things possible, the integration of many technologies is necessary, such as machine-to-machine and cyber-physical systems. The process of testing IoT applications introduces new challenges because it does not only includes typical test strategies and methodologies. Testing an IoT system depends on its the specific configuration, and it also needs to consider the hardware platform and the network environment. Currently, industry and academy efforts are focusing on usability and connectivity tests, such as: simulating the environment where the device is to be used, and ensuring information is exchanged in a secure manner. In this paper, we use the current version of our IoT platform to perform stress testing of our IoT platform under different conditions. Our test methodology for IoT applications is also presented. Three different hardware platforms have been used for performing the stress testing of our platform.

References

  1. Adjih, C., Baccelli, E., Fleury, E., Harter, G., Mitton, N., Noel, T., Pissard-Gibollet, R., Saint-Marcel, F., Schreiner, G., Vandaele, J., and Watteyne, T. (2016). FIT IoT-LAB: A large scale open experimental IoT testbed. In IEEE World Forum on Internet of Things, WF-IoT 2015 - Proceedings, pages 459-464.
  2. Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., and Ayyash, M. (2015). Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications. IEEE Communications Surveys and Tutorials, 17(4):2347-2376.
  3. Belli, L., Cirani, S., Davoli, L., Gorrieri, A., Mancin, M., and Picone, M. (2015). Design and Deployment Oriented Testbed. IEEE Computer, 48(9):32-40.
  4. Bloem, J. (2016). IoTMap - Testing in an IoT environment. Sogeti Publisher.
  5. Cognizant (2016). The internet of things: Qa unleashed. https://www.cognizant.com/InsightsWhitepapers/theinternet-of-things-qa-unleashed-codex1233.pdf. Last accessed: November 2016.
  6. Colitti, W., Steenhaut, K., and De Caro, N. (2011). Integrating wireless sensor networks with the web. Extending the Internet to Low Power and Lossy Networks (IP+SN 2011).
  7. Costa, L. (2015). Swarm os control plane: An architecture proposal for heterogeneous and organic networks. 2015 IEEE International Conference on Consumer Electronics (ICCE), pages 245-246.
  8. Lunardi, W. T., de Matos, E., Tiburski, R., Amaral, L. A., Marczak, S., and Hessel, F. (2015). Context-based search engine for industrial iot: Discovery, search, selection, and usage of devices. In 2015 IEEE 20th Conference on Emerging Technologies Factory Automation (ETFA), pages 1-8.
  9. Mineraud, J., Mazhelis, O., Su, X., and Tarkoma, S. (2015). A gap analysis of internet-of-things platforms. CoRR, abs/1502.01181.
  10. Rabaey, J. M. (2011). The swarm at the edge of the cloud-a new perspective on wireless. In VLSI Circuits (VLSIC), 2011 Symposium on, pages 6-8. IEEE.
  11. RCR-Wireless (2016). Testing the internet of things: Making the iot work.
  12. Reetz, E. S., Kuemper, D., Moessner, K., and Toenjes, R. (2013). How to test iot-based services before deploying them into real world. In Wireless Conference (EW), Proceedings of the 2013 19th European, pages 1-6.
  13. Sanchez, L., Mu??oz, L., Galache, J. A., Sotres, P., Santana, J. R., Gutierrez, V., Ramdhany, R., Gluhak, A., Krco, S., Theodoridis, E., and Pfisterer, D. (2014). SmartSantander: IoT experimentation over a smart city testbed. Computer Networks, 61:217-238.
  14. Thangavel, D., Ma, X., Valera, A., Tan, H. X., and Tan, C. K. Y. (2014). Performance evaluation of mqtt and coap via a common middleware. In Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2014 IEEE Ninth International Conference on, pages 1-6.
  15. Vandikas, K. and Tsiatsis, V. (2014). Performance evaluation of an iot platform. Proceedings - 2014 8th International Conference on Next Generation Mobile Applications, Services and Technologies, NGMAST 2014, pages 141-146.
  16. W3C-Group (2016). Direct to device connectivity in the internet of things. https://www.w3.org/WoT/. Last checked: January 2016.
Download


Paper Citation


in Harvard Style

Esquiagola J., Costa L., Calcina P., Fedrecheski G. and Zuffo M. (2017). Performance Testing of an Internet of Things Platform . In Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-245-5, pages 309-314. DOI: 10.5220/0006304503090314


in Bibtex Style

@conference{iotbds17,
author={John Esquiagola and Laisa Costa and Pablo Calcina and Geovane Fedrecheski and Marcelo Zuffo},
title={Performance Testing of an Internet of Things Platform},
booktitle={Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2017},
pages={309-314},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006304503090314},
isbn={978-989-758-245-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - Performance Testing of an Internet of Things Platform
SN - 978-989-758-245-5
AU - Esquiagola J.
AU - Costa L.
AU - Calcina P.
AU - Fedrecheski G.
AU - Zuffo M.
PY - 2017
SP - 309
EP - 314
DO - 10.5220/0006304503090314