SOFTWARE PRODUCT LINE TESTING - A Systematic Review

Beatriz Pérez Lamancha, Macario Polo Usaola, Mario Piattini Velthius

2009

Abstract

Software product lines constitute a new paradigm where industrial production techniques are adapted and applied to software development. Reuse and the maintenance of traceability between the different artefacts in the line are fundamental requirements in this paradigm, articulating the best practices for software development in an environment that is perfectly controlled by software engineering methods. This article presents a systematic review of the literature which deals with testing in software product lines. The objective is to analyse the existing approaches to testing in software product lines, discussing the significant issues related to this area of knowledge and providing an up-to-date state of the art which can serve as a basis for innovative research activities. The paper also analyses how SPL research can contribute and dynamise the research in software testing.

References

  1. Ajila, S. and Dumitrescu, R. (2007). Experimental use of code delta, code churn, and rate of change to understand software product line evolution. The Journal of Systems and Software, 80(1):74-91.
  2. Ardis, M., Daley, N., Hoffman, D., Siy, H., and Weiss, D. (2000). Software product lines: a case study. Software Practice and Experience, 30(7):825-847.
  3. Baerisch, S. (2007). Model-driven test-case construction. Foundations of Software Engineering, pages 587-590.
  4. Bertolino, A. (2007). Software testing research: Achievements, challenges, dreams. In Internation Conference on Software Engineering, pages 85-103. IEEE Computer Society.
  5. Bertolino, A., Gnesi, S., and di Pisa, A. (2004). Pluto: A test methodology for product families. Software Productfamily Engineering: 5th International Workshop, PFE 2003, Siena, Italy, November 4-6, 2003: Revised Papers.
  6. Biolchini, J., Mian, P., Natali, A., and Travassos, G. (2005). Systematic review in software engineering. System Engineering and Computer Science Department COPPE/UFRJ, Technical Report ES, 679(05).
  7. Clements, P. and Northrop, L. (2007). A framework for software product line practice, version 5.0.
  8. Clements, P. C. and Northrop, L. M. (2002). Salion, inc.: A software product line case study. Technical Report CMU/SEI-2002-TR-038.
  9. Cohen, M., Dwyer, M., and Shi, J. (2006). Coverage and adequacy in software product line testing. Proceedings of the ISSTA 2006 workshop on Role of software architecture for testing and analysis, pages 53-63.
  10. Denger, C. and Kolb, R. (2006). Testing and inspecting reusable product line components: first empirical results. Proceedings of the 2006 ACM/IEEE international symposium on International symposium on empirical software engineering, pages 184-193.
  11. Duen˜as, J., Mellado, J., Cern, J., Arciniegas, J., Ruiz, J., and Capilla, R. (2004). Model driven testing in product family context. Technical Report ISSN 1381 - 3625, University of Twente.
  12. Geppert, B., Li, J., RoBler, F., and Weiss, D. (2004). Towards generating acceptance tests for product lines. Software Reuse: 8th International Conference, ICSR 2004, Madrid, Spain, July 5-9, 2004: Proceedings.
  13. Kang, S., Lee, J., Kim, M., and Lee, W. (2007). Towards a formal framework for product line test development. Computer and Information Technology, 2007. CIT 2007. 7th IEEE International Conference on, pages 921-926.
  14. Kauppinen, R., Taina, J., and Tevanlinna, A. (2004). Hook and template coverage criteria for testing frameworkbased software product families. Proceedings of the International Workshop on Software Product Line Testing, pages 7-12.
  15. Kim, K., Kim, H., Ahn, M., Seo, M., Chang, Y., and Kang, K. (2006). Asadal: a tool system for co-development of software and test environment based on product line engineering. International Conference on Software Engineering, pages 783-786.
  16. Kishi, T. and Noda, N. (2006). Formal verification and software product lines. Communications of the ACM, 49(12):73-77.
  17. Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele University, UK, Technical Report TR/SE-0401-ISSN, pages 1353-7776.
  18. Kolb, R. and Muthig, D. (2006). Making testing product lines more efficient by improving the testability of product line architectures. Proceedings of the ISSTA 2006 workshop on Role of software architecture for testing and analysis, pages 22-27.
  19. Krueger, C. (2006). The emerging practice of software product line development. Military Embedded Systems, (2nd semester):34-36.
  20. McGregor, J. (2001). Testing a Software Product Line. Carnegie Mellon University, Software Engineering Institute.
  21. McGregor, J., Northrop, L., Jarrad, S., and K, K. P. (2002). Initiating software product lines. IEEE Software, 19(4):24-27.
  22. Nebut, C., Fleurey, F., Le Traon, Y., Jezequel, J., and de Beaulieu, C. (2004). A requirement-based approach to test product families. Software Productfamily Engineering: 5th International Workshop, PFE 2003, Siena, Italy, November 4-6, 2003: Revised Papers.
  23. Nebut, C., Pickin, S., Le Traon, Y., and Jezequel, J. (2003). Automated requirements-based generation of test cases for product families. Automated Software Engineering, 2003. Proceedings. 18th IEEE International Conference on, pages 263-266.
  24. Olimpiew, E. and Gomaa, H. (2005). Model-based testing for applications derived from software product lines. Proceedings of the 2005 workshop on Advances in model-based testing, pages 1-7.
  25. (2008). Meta object facility (mof) 2.0 query/view/transformation, v1.0. Technical Report formal/2008-04-03.
  26. Pesonen, J., Katara, M., and Mikkonen, T. (2006). Production-testing of embedded systems with aspects. LECTURE NOTES IN COMPUTER SCIENCE, 3875:90.
  27. Pino, F., Garcia, F., and Piattini, M. (2007). Software process improvement in small and medium software enterprises: A systematic review. Software Quality Journal.
  28. Pohl, K., Bckle, G., and van der Linden, F. (2005). Software Product Line Engineering: Foundations, Principles, and Techniques. Springer.
  29. Pohl, K. and Metzger, A. (2006). Software product line testing. Communications of the ACM, 49(12):78-81.
  30. Reuys, A., Kamsties, E., Pohl, K., and Reis, S. (2005). Model-based system testing of software product families. Pastor, O.; Falcao e Cunha, J.(Eds.): Advanced Information Systems Engineering, CAiSE, pages 519- 534.
  31. Tevanlinna, A. (2004). Product family testing with rita. Proceedings of the Eleventh Nordic Workshop on Programming and Software Development Tools and Techniques (NWPER'2004), pages 251-265.
  32. Trew, T. (2005). Enabling the smooth integration of core assets: Defining and packaging architectural rules for a family of embedded products. LECTURE NOTES IN COMPUTER SCIENCE, 3714:137.
  33. van der Linden, F. (2002). Software product families in europe: the esaps and cafe projects. Software, IEEE, 19(4):41-49. TY - JOUR.
  34. White, J. and Schmidt, D. (2006). Fireant: A tool for reducing enterprise product line architecture deployment, configuration, and testing costs. Engineering of Computer Based Systems, 2006. ECBS 2006. 13th Annual IEEE International Symposium and Workshop on, pages 507-508.
Download


Paper Citation


in Harvard Style

Pérez Lamancha B., Polo Usaola M. and Piattini Velthius M. (2009). SOFTWARE PRODUCT LINE TESTING - A Systematic Review . In Proceedings of the 4th International Conference on Software and Data Technologies - Volume 1: ICSOFT, ISBN 978-989-674-009-2, pages 23-30. DOI: 10.5220/0002248400230030


in Bibtex Style

@conference{icsoft09,
author={Beatriz Pérez Lamancha and Macario Polo Usaola and Mario Piattini Velthius},
title={SOFTWARE PRODUCT LINE TESTING - A Systematic Review},
booktitle={Proceedings of the 4th International Conference on Software and Data Technologies - Volume 1: ICSOFT,},
year={2009},
pages={23-30},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002248400230030},
isbn={978-989-674-009-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Software and Data Technologies - Volume 1: ICSOFT,
TI - SOFTWARE PRODUCT LINE TESTING - A Systematic Review
SN - 978-989-674-009-2
AU - Pérez Lamancha B.
AU - Polo Usaola M.
AU - Piattini Velthius M.
PY - 2009
SP - 23
EP - 30
DO - 10.5220/0002248400230030