Carmen Castro-Cabrera, Inmaculada Medina-Bulo


Nowadays, Web Service (WS) compositions play an important role in business processes. Languages for composing web services, such as the OASISWS-BPEL 2.0 standard, open a new field for large-scale programming. However, they also present a challenge for traditional quality assurance because of the inclusion of specific instructions for concurrency, fault compensation, and dynamic service discovery and invocation. Metamorphic Testing (MT) has proved useful to test and improve the quality of traditional imperative programs. This paper discusses how to use MT to test WS compositions in WS-BPEL. Although MT has not been previously applied to this area, promising results have been obtained in a number of different applications. A component diagram for a testing framework implementing this approach is included.


  1. ActiveVOS (2009). ActiveBPEL WS-BPEL Engine.
  2. Andrews, J. H., Briand, L. C., and Labiche, Y. (2005). Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering (ICSE 2005), pages 402- 411. ACM Press.
  3. Beizer, B. (1990). Software Testing Techniques, 2nd Edition. International Thomson Computer Press, 2 sub edition.
  4. Bozkurt, M., Harman, M., and Hassoun, Y. (2010). TR-10- 01: testing web services: A survey. Technical Report TR-10-01, King's College, London.
  5. Chan, W. K., Cheung, S., and Leung, K. (2006). Towards a metamorphic testing methodology for serviceoriented software applications. In Quality Software, 2005.(QSIC 2005). Fifth International Conference on, pages 470-476.
  6. Chan, W. K., Cheung, S. C., and Leung, K. R. (2007). A metamorphic testing approach for online testing of service-oriented software applications. International Journal of Web Services Research, 4(2):61-81.
  7. Chen, T. Y. (1998). Metamorphic testing: A new approach for generating next test cases. HKUSTCS98-01.
  8. Chen, T. Y. (2010). Metamorphic testing: A simple approach to alleviate the oracle problem. In Proceedings of the 5th IEEE International Symposium on Service Oriented System Engineering. IEEE Computer Society.
  9. Chen, T. Y., Feng, J., and Tse, T. H. (2002). Metamorphic testing of programs on partial differential equations: A case study. In Proceedings of the 26th International Computer Software and Applications Conference on Prolonging Software Life: Development and Redevelopment, COMPSAC 7802, pages 327-333, Washington, DC, USA. IEEE Computer Society.
  10. Chen, T. Y., Huang, D. H., Tse, T. H., and Zhou, Z. Q. (2004). Case studies on the selection of useful relations in metamorphic testing. In Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering (JIISIC 2004), pages 569-583.
  11. Domínguez-Jiménez, J. J., Estero-Botaro, A., GarcíaDomínguez, A., and Medina-Bulo, I. (2009). GAmera: An automatic mutant generation system for WSBPEL compositions. In ECOWS 2009: Seventh IEEE European Conference on Web Services, pages 97-106, Eindhoven, The Netherlands. IEEE Computer Society.
  12. García-Fanjul, J., Tuya, J., and de la Riva, C. (2007). Generación sistemática de pruebas para composiciones de servicios utilizando criterios de suficiencia basados en transiciones. In JISBD 2007: Actas de las XII Jornadas de Ingeniería del Software y Bases de Datos.
  13. Gotlieb, A. and Botella, B. (2003). Automated metamorphic testing. Computer Software and Applications Conference, Annual International, 0:34-40.
  14. IDC (2008). Research reports.
  15. Mayer, P. and L übke, D. (2006). Towards a BPEL unit testing framework. In TAV-WEB'06: Proceedings of the 2006 workshop on Testing, Analysis, and Verification of Web Services and Applications, pages 33-42, New York, NY, USA. ACM.
  16. Murphy, C., Kaiser, G., Hu, L., and Wu, L. (2008). Properties of machine learning applications for use in metamorphic testing. In Proc. of the 20th international conference on software engineering and knowledge engineering (SEKE), pages 867-872.
  17. Murphy, C., Shen, K., and Kaiser, G. (2009). Using JML runtime assertion checking to automate metamorphic testing in applications without test oracles. In Software Testing Verification and Validation, 2009. ICST'09. International Conference on, pages 436- 445.
  18. Myers, G.J., Sandler, C., Badgett, T., and Thomas, T. M. (2004). The Art of Software Testing, 2nd ed. Wiley - Interscience.
  19. OASIS (2007). Web Services Business Process Execution Language 2.0. Organization for the Advancement of Structured Information Standards.
  20. Segura, S., Hierons, R. M., Benavides, D., and Ruiz-Cortes, A. (2010). Automated test data generation on the analyses of feature models: A metamorphic testing approach. Software Testing, Verification, and Validation, 2008 International Conference on, 0:35-44.
  21. UCASE Research Group (2010a).˜gamera.
  22. UCASE Research Group (2010b). Takuan home site.
  23. Weyuker, E. (1982). On testing Non-Testable programs. The Computer Journal, 25(4):465-470.
  24. Yan, J., Li, Z., Yuan, Y., Sun, W., and Zhang, J. (2006). BPEL4WS unit testing: Test case generation using a concurrent path analysis approach. In ISSRE 2006: 17th International Symposium on Software Reliability Engineering, pages 75-84, Raleigh, North Carolina, USA. IEEE Computer Society.
  25. Zhang, Z.-Y., Chan, W. K., Tse, T. H., and Hu, P.-F. (2009). An experimental study to compare the use of metamorphic testing and assertion checking. Journal of Software, 20(10):2637-2654.
  26. Zheng, Y., Zhou, J., and Krause, P. (2007). An automatic test case generation framework for web services. Journal of Software, 2(3):64-77.
  27. Zhou, Z. Q., Huang, D. H., Tse, T. H., Yang, Z., Huang, H., and Chen, T. Y. (2004). Metamorphic testing and its applications. In Proceedings of the 8th International Symposium on Future Software Technology (ISFST 2004). Software Engineers Association.

Paper Citation

in Harvard Style

Castro-Cabrera C. and Medina-Bulo I. (2011). AN APPROACH TO METAMORPHIC TESTING FOR WS-BPEL COMPOSITIONS . In Proceedings of the International Conference on e-Business - Volume 1: ICE-B, (ICETE 2011) ISBN 978-989-8425-70-6, pages 137-142. DOI: 10.5220/0003611401370142

in Bibtex Style

author={Carmen Castro-Cabrera and Inmaculada Medina-Bulo},
booktitle={Proceedings of the International Conference on e-Business - Volume 1: ICE-B, (ICETE 2011)},

in EndNote Style

JO - Proceedings of the International Conference on e-Business - Volume 1: ICE-B, (ICETE 2011)
SN - 978-989-8425-70-6
AU - Castro-Cabrera C.
AU - Medina-Bulo I.
PY - 2011
SP - 137
EP - 142
DO - 10.5220/0003611401370142