Testing Environment Emulation - A Model-based Approach

Jian Liu, John Grundy, Mohamed Abdelrazek, Iman Avazpour


Modern enterprise software systems often need to interact with a large number of distributed and heterogeneous systems. As a result, integration testing has become a critical step in their software development lifecycle. Service virtualization is an emerging technique for creating testing environments with realistic executable models of server side production-like behaviours. However, building models in existing service virtualization approaches is very challenging, requiring either significant human effort or the availability of interactive tracing records. In this paper, we present a domain-specific modeling approach to generate complex, virtualized testing environments. Our approach allows domain experts to use a suite of domain-specific visual modeling languages to model key interface layers of applications at a high level of abstraction. These layered models are then transformed into a testing runtime environment for application integration testing. We have conducted a technical comparison with two other existing approaches and also carried out a user study. The user study demonstrated the acceptance of our new testing environment emulation approach from software testing experts and developers.


  1. Abouzahra, A., Bézivin, J., Del Fabro, M. D., Jouault, F., 2005. A Practical Approach to Bridging Domain Specific Languages with UML Profiles. Proceedings of The Best Practices For Model Driven Software Development At Oopsla, Citeseer.
  2. Brooke, J., 1996. Sus-A Quick and Dirty Usability Scale. Usability Evaluation in Industry, 189, 4-7.
  3. Davis, F. D., 1989. Perceived Usefulness, Perceived Ease Of Use, And User Acceptance Of Information Technology. Mis Quarterly, 319-340.
  4. Du, M., Schneider, J.-G., Hine, C., Grundy, J. & Versteeg, S., 2013. Generating Service Models by Trace Subsequence Substitution. Proceedings of the 9th International Acm Sigsoft Conference on Quality of Software Architectures. Canada: Acm.
  5. Dumas, M., Terhofstede, A., 2001. Uml Activity Diagrams as a Workflow Specification Language. « Uml» 2001-The Unified Modeling Language. Modeling Languages, Concepts, and Tools. Springer.
  6. Freeman, S., Mackinnon, T., Pryce, N., Walnes, J., 2004. Mock Roles, Objects. In Companion to the 19th Annual Acm Sigplan Conference on Object-Oriented Programming Systems, Languages, and Applications. Canada: Acm.
  7. Ghosh, S., Mathur, A. P., 1999. Issues in Testing Distributed Component-Based Systems. First Icse Workshop on Testing Distributed Component-Based Systems, Citeseer.
  8. Gibbons, P. B., 1987. A Stub Generator for Multilanguage Rpc in Heterogeneous Environments. Ieee Transactions On Software Engineering, 13, 77-87.
  9. Giudice, D. L., 2014. The Forrester Wave™: Service Virtualization and Testing Solutions. In: Forrester (Ed.).
  10. Han, J., 2000. Rich Interface Specification for Software Components. Peninsula School of Computing and Information Technology Monash University, Mcmahons Road Frankston, Australia.
  11. Hine, C., Schneider, J.-G., Han, J., Versteeg, S., 2009. Scalable Emulation Of Enterprise Systems. Software Engineering Conference, Australian, Ieee, 142-151.
  12. Jayasinghe, D., 2008. Quickstart Apache Axis2, Packt Publishing Ltd.
  13. Kim, C. H., Grundy, J., Hosking, J., 2015. A Suite of Visual Languages for Model-Driven Development of Statistical Surveys and Services. Journal of Visual Languages & Computing, 26, 99-125.
  14. Li, L., Grundy, J., Hosking, J., 2014. A Visual Language and Environment for Enterprise System Modelling and Automation. Journal of Visual Languages & Computing, 25, 253-277.
  15. Liu, J., Grundy, J., Avazpour, I., Abdelrazek, M., 2016. A Domain-Specific Visual Modeling Language for Testing Environment Emulation. Ieee Symposium on Visual Languages and Human-Centric Computing. Cambridge, Uk.
  16. Moody, D. L., 2009. The “Physics” Of Notations: Towards A Scientific Basis For Constructing Visual Notations In Software Engineering. Software Engineering, Ieee Transactions On, 35, 756-779.
  17. Pact., 2016. Enables Consumer Driven Contract Testing [Online]. Available: Https://Github.Com/RealestateCom-Au/Pact [Accessed].
  18. Poole, J. D., 2001. Model-Driven Architecture: Vision, Standards and Emerging Technologies. Workshop on Metamodeling and Adaptive Object Models, Ecoop.
  19. Schieferdecker, I., Dai, Z. R., Grabowski, J., Rennoch, A., 2003. The Uml 2.0 Testing Profile and Its Relation to Ttcn-3. Testing Of Communicating Systems. Springer.
  20. Selic, B., 2003. The Pragmatics of Model-Driven Development. Ieee Software, 20, 19.
  21. Sousa, T. B., 2012. Dataflow Programming Concept, Languages and Applications. Doctoral Symposium on Informatics Engineering.
  22. Visser, E., 2008. Webdsl: A Case Study in DomainSpecific Language Engineering. Generative and Transformational Techniques in Software Engineering Ii. Springer Berlin Heidelberg.
  23. Yu, J., Han, J., Schneider, J.-G., Hine, C., Versteeg, S., 2012. A Virtual Deployment Testing Environment for Enterprise Software Systems. Proceedings of the 8th International Acm Sigsoft Conference on Quality of Software Architectures. Italy: Acm.
  24. Zhang, S. J., Liu, Y., 2010. An Automatic Approach to Model Checking Uml State Machines. Fourth International Conference on Secure Software Integration and Reliability Improvement Companion (Ssiri-C), 1-6.

Paper Citation

in Harvard Style

Liu J., Grundy J., Abdelrazek M. and Avazpour I. (2017). Testing Environment Emulation - A Model-based Approach . In Proceedings of the 5th International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD, ISBN 978-989-758-210-3, pages 112-124. DOI: 10.5220/0006194601120124

in Bibtex Style

author={Jian Liu and John Grundy and Mohamed Abdelrazek and Iman Avazpour},
title={Testing Environment Emulation - A Model-based Approach},
booktitle={Proceedings of the 5th International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,},

in EndNote Style

JO - Proceedings of the 5th International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,
TI - Testing Environment Emulation - A Model-based Approach
SN - 978-989-758-210-3
AU - Liu J.
AU - Grundy J.
AU - Abdelrazek M.
AU - Avazpour I.
PY - 2017
SP - 112
EP - 124
DO - 10.5220/0006194601120124