TESTING-BASED COMPONENT ASSESSMENT FOR SUBSTITUTABILITY

Andres Flores, Macario Polo Usaola

2008

Abstract

Updating systems assembled from components demand a careful treatment due to stability risks. Replacement components must be properly evaluated to identify the required similar behaviour. Our proposal complements the regular compatibility analysis with black-box testing criteria to reinforce reliability. The aim is to analyze functions of data transformation encapsulated on components, i.e. their behaviour. This complies with the observability testing metric. A Component Behaviour Test Suite is built concerning the integration level to be later applied on candidate upgrades. The approach is supported through a tool developed on our group, testooj, which is focused on Java components.

References

  1. Alexander, R. and Blackburn, M. (1999). Component Assessment Using Specification-Based Analysis and Testing. Technical Report SPC-98095-CMC, Software Productivity Consortium, Herndon, Virginia, USA.
  2. Ammann, P. and Offutt, A. (1994). Using Formal Methods to derive Test Frames in Category-Partition Testing. In 9th IEEE COMPASS, pages 69-80, Gaithersburg, MD, USA.
  3. Binder, R. (2000). Testing Object Oriented Systems - Models, Patterns and Tools. Addison-Wesley.
  4. Cechich, A. and Piattini, M. (2007). Early detection of COTS component functional suitability. Information and Software Technology, 49(2):108-121.
  5. Cechich, A., Piattini, M., and Vallecillo, A. (2003). Component-based Software Quality: Methods and Techniques, volume 2693 of LNCS. Springer-Verlag.
  6. Czerwonka, J. (2006). Pairwise Testing in Real World. In 24th PNSQC, pages 419-430, Portland, OR, US.
  7. Delamaro, M., Maldonado, J., and Mathur, A. (2001). Interface Mutation: An Approach for Integration Testing. IEEE Transactions on Software Engineering, 27(3):228-247.
  8. Flores, A. and Polo, M. (2007). Software Component Substitutability through Black-Box Testing. In 5th Intl Workshop STV'07, during ICSSEA'07, Paris, France.
  9. Freedman, R. S. (1991). Testability of Software Components. IEEE Transactions on Software Engineering, 17(6):553-564.
  10. Gamma, E., Helm, R., Johnson, R., and Vlissides, J. (1995). Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley.
  11. Gosh, S. and Mathur, A. P. (2001). Interface Mutation. Software Testing, Verification and Reliability, 11:227- 247. http://www.interscience.wiley.com.
  12. Gosling, J., Joy, B., Steele, G., and Bracha, G. (2005). JavaT M Language Specification. Sun Microsystems, Inc. Addison-Wesley, US, 3rd. edition. http://java.sun.com/docs/books/jls/third edition/html/ j3TOC.html.
  13. Grindal, M., Offutt, A., and Andler, S. (2005). Combination Testing Strategies: a survey. Software Testing, Verification and Reliability, 15(3):167-199. http://www.interscience.wiley.com.
  14. Heineman, G. and Council, W. (2001). Component-Based Software Engineering - Putting the Pieces Together. Addison-Wesley.
  15. Jaffar-Ur Rehman, M., Jabeen, F., Bertolino, A., and Polini, A. (2007). Testing Software Components for Integration: a Survey of Issues and Techniques. Software Testing, Verification and Reliability, 17(2):95- 133. http://www.interscience.wiley.com.
  16. Malaiya, Y. (1995). Antirandom Testing: Getting the most out of Black-box Testing. In IEEE ISSRE, pages 86- 95, Toulouse, France.
  17. Mariani, L., Papagiannakis, S., and Pezzè (2007). Compatibility and Regression Testing of COTS-componentbased software. In IEEE ICSE, pages 85-95, Minneapolis, USA.
  18. Mariani, L., Pezze, M., and Willmor, D. (2004). Generation of Integration Tests for Self-Testing Components. In Workshop ITM-FORTE, LNCS 3236, pages 337-350, Toledo, Spain. Springer-Verlag.
  19. OMG (2005). UML Testing Profile - Version 1.0. Technical Report formal/05-07-07, Object Management Group, Inc. http://www.omg.org.
  20. Orso, A., Do, H., Rothermel, G., Harrold, M. J., and Rosenblum, D. (2007). Using Component Metadata to Regression Test Component-based Software. Software Testing, Verification and Reliability, 17:61-94. http://www.interscience.wiley.com.
  21. Polo, M., Tendero, S., and Piattini, M. (2007). Integrating Techniques and Tools for Testing Automation. Software Testing, Verification and Reliability, 16(1):1-37. http://www.interscience.wiley.com.
  22. Warboys, B., Snowdon, B., Greenwood, R., Seet, W., Robertson, I., Morrison, R., Balasubramaniam, D., Kirby, G., and Mickan, K. (2005). An ActiveArchitecture Approach to COTS Integration. IEEE Software, pages 20-27.
  23. Wu, Y., Pan, D., and Chen, M.-H. (2000). Techniques of Maintaining Evolving Component-based Software. In 16th IEEE ICSM, page 236, San Jose, CA, USA.
  24. Wu, Y., Pan, D., and Chen, M.-H. (2001). Techniques for Testing Component-based Software. In 7th IEEE ICECCS, pages 222-232, Skovde, Sweden.
  25. Zaremski, A. M. and Wing, J. (1997). Specification Matching of Software Components. ACM Transactions on Software Engineering and Methodology, 6(4).
Download


Paper Citation


in Harvard Style

Flores A. and Polo Usaola M. (2008). TESTING-BASED COMPONENT ASSESSMENT FOR SUBSTITUTABILITY . In Proceedings of the Tenth International Conference on Enterprise Information Systems - Volume 6: ICEIS, ISBN 978-989-8111-38-8, pages 386-393. DOI: 10.5220/0001714103860393


in Bibtex Style

@conference{iceis08,
author={Andres Flores and Macario Polo Usaola},
title={TESTING-BASED COMPONENT ASSESSMENT FOR SUBSTITUTABILITY},
booktitle={Proceedings of the Tenth International Conference on Enterprise Information Systems - Volume 6: ICEIS,},
year={2008},
pages={386-393},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001714103860393},
isbn={978-989-8111-38-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Tenth International Conference on Enterprise Information Systems - Volume 6: ICEIS,
TI - TESTING-BASED COMPONENT ASSESSMENT FOR SUBSTITUTABILITY
SN - 978-989-8111-38-8
AU - Flores A.
AU - Polo Usaola M.
PY - 2008
SP - 386
EP - 393
DO - 10.5220/0001714103860393