A Generic Agent Architecture for Cooperative Multi-agent Games

João Marinheiro, Henrique Lopes Cardoso


Traditional search techniques are difficult to apply to cooperative negotiation games, due to the often enormous search trees and the difficulty in calculating the value of a players position or move. We propose a generic agent architecture that ensembles negotiation, trust and opponent modeling, simplifying the development of agents capable of playing these games effectively by introducing modules to handle these challenges. We demonstrate the application of this modular architecture by instantiating it in two different games and testing the designed agents in a variety of scenarios; we also assess the role of the negotiation, trust and opponent modeling modules in each of the games. Results show that the architecture is generic enough to be applied in a wide variety of games. Furthermore, we conclude that the inclusion of the three modules allows for more effective agents to be built.


  1. Calhamer, A. B. (2000). The Rules of Diplomacy. Avalon Hill, 4th edition.
  2. Corporation, Z. D. (2016). Zillions of Games. http://www.zillions-of-games.com/. Accessed: 23-11- 2016.
  3. de Jonge, D. (2015). Negotiations over Large Agreement Spaces. Phd thesis, Universitat Auton òma de Barcelona.
  4. des Pallières, P. and Marly, H. (2009). Werewolves of Miller's Hollow: The Village. Lui-meˆme.
  5. Drogoul, A. (1995). When ants play chess (or can strategies emerge from tactical behaviours?). In Castelfranchi, C. and M üller, J.-P., editors, From Reaction to Cognition: 5th European Workshop on Modelling Autonomous Agents in a Multi-Agent World, MAAMAW 7893 Neuchaˆtel, Switzerland, August 25-27, 1993 Selected Papers, pages 11-27. Springer.
  6. Fabregues, A. and Sierra, C. (2011). DipGame: A challenging negotiation testbed. Engineering Applications of Artificial Intelligence, 24(7):1137-1146.
  7. Ferreira, A. (2014). Dipblue: a diplomacy agent with strategic and trust reasoning. Master thesis, Universidade do Porto.
  8. Ferreira, A., Lopes Cardoso, H., and Reis, L. P. (2015). Strategic negotiation and trust in diplomacy - the dipblue approach. In Nguyen, N. T., Kowalczyk, R., Duval, B., van den Herik, J., Loiseau, S., and Filipe, J., editors, Transactions on Computational Collective Intelligence XX, pages 179-200. Springer International Publishing, Cham.
  9. Genesereth, M., Love, N., and Pell, B. (2005). General Game Playing: Overview of the AAAI Competition. AI Magazine, 26(2):62-72.
  10. Heinrich, J. and Silver, D. (2016). Deep reinforcement learning from self-play in imperfect-information games. In Proceedings of the Third Deep Reinforcement Learning Workshop, NIPS-DRL.
  11. Johansson, S. and Olsson, F. (2005). Mars - a multi-agent system playing risk. In Proceedings of Pacific Rim International Workshop on Multi-agents (PRIMA).
  12. Johansson, S. J. and Ha°a°rd, F. (2005). Tactical Coordination in No-press Diplomacy. In Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 7805, pages 423-430, New York, NY, USA. ACM.
  13. Kraus, S., Gan, R., and Lehmann, D. (1995). Designing and Building a Negotiating Automated Agent. Computational Intelligence, 11(972):132-171.
  14. Kraus, S., Lehmann, D., and Ephrati, E. (1989). An automated diplomacy player. In Levy, D. and Beal, D., editors, Heuristic Programming in Artificial Intelligence: The 1st Computer Olympiad, pages 136-153. Ellis Horwood Limited, Chinester, UK.
  15. Nash, J. (1951). Non-cooperative games. The Annals of Mathematics, 54(2):286-295.
  16. Norman, D. (2013). David Norman's DumbBot. http://www.daide.org.uk/index.php?title=DumbBot Algorithm. Accessed: 12-07-2013.
  17. Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., and Hassabis, D. (2016). Mastering the game of go with deep neural networks and tree search. Nature, 529:484-503.

Paper Citation

in Harvard Style

Marinheiro J. and Lopes Cardoso H. (2017). A Generic Agent Architecture for Cooperative Multi-agent Games . In Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-219-6, pages 107-118. DOI: 10.5220/0006253101070118

in Bibtex Style

author={João Marinheiro and Henrique Lopes Cardoso},
title={A Generic Agent Architecture for Cooperative Multi-agent Games},
booktitle={Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},

in EndNote Style

JO - Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - A Generic Agent Architecture for Cooperative Multi-agent Games
SN - 978-989-758-219-6
AU - Marinheiro J.
AU - Lopes Cardoso H.
PY - 2017
SP - 107
EP - 118
DO - 10.5220/0006253101070118