Zhiyong Zhang, John Thangarajah, Lin Padgham



Although agent technology is gaining world wide popularity, a hindrance to its uptake is the lack of proper testing mechanisms for agent based systems. While many traditional software testing methods can be generalized to agent systems, there are many aspects that are different and which require an understanding of the underlying agent paradigm. In this paper we present certain aspects of a testing framework that we have developed for agent based systems. The testing framework is a model based approach using the design models of the Prometheus agent development methodology. In this paper we focus on unit testing and identify the appropriate units, present mechanisms for generating suitable test cases and for determining the order in which the units are to be tested, present a brief overview of the unit testing process and an example. Although we use the design artefacts from Prometheus the approach is suitable for any plan and event based agent system.


  1. Apfelbaum, L. and Doyle, J. (1997). Model Based Testing. In the 10th International Software Quality Week Conference, CA, USA.
  2. Binder, R. V. (1999). Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
  3. Bresciani, P., Perini, A., Giorgini, P., Giunchiglia, F., and Mylopoulos, J. (2004). Tropos: An Agent-Oriented Software Development Methodology. Autonomous Agents and Multi-Agent Systems, 8(3):203-236.
  4. Busetta, P., Rönnquist, R., Hodgson, A., and Lucas, A. (1999). JACK Intelligent Agents - Components for Intelligent Agents in Java. Technical report, Agent Oriented Software Pty. Ltd, Melbourne, Australia.
  5. Caire, G., Cossentino, M., Negri, A., Poggi, A., and Turci, P. (2004). Multi-Agent Systems Implementation and Testing. In the Fourth International Symposium: From Agent Theory to Agent Implementation, Vienna.
  6. Coelho, R., Kulesza, U., von Staa, A., and Lucena, C. (2006). Unit Testing in Multi-Agent Systems using Mock Agents and Aspects. In Proceedings of the 2006 International Workshop on Software Engineering for Large-Scale Multi-Agent Systems, pages 83-90.
  7. Cohen, D. M., Dalal, S. R., Fredman, M. L., and Patton, G. C. (1997). The AETG system: An Approach to Testing Based on Combinatiorial Design. Software Engineering, 23(7):437-444.
  8. Deloach, S. A. (2001). Analysis and Design using MaSE and agentTool. In the 12th Midwest Artificial Intelligence and Cognitive Science Conference (MAICS 2001), Miami University, Oxford, Ohio.
  9. El-Far, I. K. and Whittaker, J. A. (2001). Encyclopedia of Software Engineering, chapter Model-Based Software Testing, pages 825-837. Wiley.
  10. Padgham, L. and Winikoff, M. (2004). Developing Intelligent Agent Systems: A practical guide. Wiley Series in Agent Technology. John Wiley and Sons.
  11. Padgham, L., Winikoff, M., and Poutakidis, D. (2005). Adding Debugging Support to the Prometheus Methodology. Engineering Applications of Artificial Intelligence, special issue on Agent-Oriented Software Development, 18(2):173-190.
  12. Patton, R. (2005). Software Testing (Second Edition). Sams, Indianapolis, IN, USA.
  13. Rao, A. S. and Georgeff, M. P. (1995). BDI Agents: From Theory to Practice. In Lesser, V., editor, the First International Conference on Multi-Agent Systems, pages 312-319, San Francisco.
  14. Rouff, C. (2002). A Test Agent for Testing Agents and their Communities. Aerospace Conference Proceedings, 2002. IEEE, 5:2638.
  15. Seo, H.-S., Araragi, T., and Kwon, Y. R. (2004). Modeling and Testing Agent Systems Based on Statecharts. volume 3236, pages 308 - 321.
  16. Thangarajah, J., Padgham, L., and Winikoff, M. (2005). Prometheus design tool. In the 4th International Joint Conference on Autonomous Agents and Multi-Agent Systems, pages 127-128, Utrecht, The Netherlands.
  17. Zheng, M. and Alagar, V. S. (2005). Conformance Testing of BDI Properties in Agent-based Software Systems. In APSEC 7805: Proceedings of the 12th Asia-Pacific Software Engineering Conference (APSEC'05), pages 457-464, Washington. IEEE Computer Society.

Paper Citation

in Harvard Style

Zhang Z., Thangarajah J. and Padgham L. (2007). AUTOMATED UNIT TESTING FOR AGENT SYSTEMS . In Proceedings of the Second International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-8111-10-4, pages 10-18. DOI: 10.5220/0002585900100018

in Bibtex Style

author={Zhiyong Zhang and John Thangarajah and Lin Padgham},
booktitle={Proceedings of the Second International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},

in EndNote Style

JO - Proceedings of the Second International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
SN - 978-989-8111-10-4
AU - Zhang Z.
AU - Thangarajah J.
AU - Padgham L.
PY - 2007
SP - 10
EP - 18
DO - 10.5220/0002585900100018