Framework for Enabling Scalable Learning Game AI

Gabriel Iuhasz, Victor Ion Munteanu, Viorel Negru

2013

Abstract

The video game industry is a multibillion-dollar industry in which, due to general short deadlines, game visuals as well as gameplay elements are worked in parallel up until the very last minute. This means that even if the AI system has been designed in parallel with the other game elements, once a change has been made in the late stages of the game development, the AI may prove to be inadequate to the given job. Our article covers some of the existing frameworks for game AI and proposes a multi-agent system which serves as a framework for scalable learning game AI through integration of existing machine learning techniques.

References

  1. Aha, D. W., Molineaux, M., and Ponsen, M. (2005). Learning to win: case-based plan selection in a real-time strategy game. In Proceedings of the 6th international conference on Case-Based Reasoning Research and Development, ICCBR'05, pages 5-20, Berlin, Heidelberg. Springer-Verlag.
  2. Buro, M. (2003). Real-time strategy gaines: a new ai research challenge. In Proceedings of the 18th international joint conference on Artificial intelligence, IJCAI'03, pages 1534-1535, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
  3. Choi, D. (2011). Reactive goal management in a cognitive architecture. Cogn. Syst. Res., 12(3-4):293-308.
  4. Claypool, M. and Claypool, K. (2006). Latency and player actions in online games. Commun. ACM, 49(11):40- 45.
  5. Fagan, M. and Cunningham, P. (2003). Case-based plan recognition in computer games. In Proceedings of the Fifth ICCBR, pages 161-170. Springer.
  6. Gabriel, I., Negru, V., and Zaharie, D. (2012). Neuroevolution based multi-agent system for micromanagement in real-time strategy games. In Proceedings of the Fifth Balkan Conference in Informatics, BCI 7812, pages 32-39, New York, NY, USA. ACM.
  7. Jaidee, U., Mun˜oz Avila, H., and Aha, D. W. (2011). Integrated learning for goal-driven autonomy. In Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three, IJCAI'11, pages 2450-2455. AAAI Press.
  8. Josyula, D. P. (2005). A unified theory of acting and agency for a universal interfacing agent. PhD thesis, College Park, MD, USA. AAI3202442.
  9. Langley, P. and Choi, D. (2006). A unified cognitive architecture for physical agents. In proceedings of the 21st national conference on Artificial intelligence - Volume 2, AAAI'06, pages 1469-1474. AAAI Press.
  10. Lehman, J. F., Laird, J., and Rosenbloom, P. (1996). A gentle introduction to soar, an architecture for human cognition. In In S. Sternberg & D. Scarborough (Eds), Invitation to Cognitive Science. MIT Press.
  11. Lewis, J. M., Trinh, P., and Kirsh, D. (2011). A corpus analysis of strategy video game play in starcraft: Brood war. In Proceedings of the 33rd Annual Conference of the Cognitive Science Society.
  12. Loyall, A. B. (1997). Believable agents: building interactive personalities. PhD thesis, Pittsburgh, PA, USA. AAI9813841.
  13. Lucas, S. M., Rohlfshagen, P., and Perez, D. (2012). Towards more intelligent adaptive video game agents: a computational intelligence perspective. In Proceedings of the 9th conference on Computing Frontiers, CF 7812, pages 293-298, New York, NY, USA. ACM.
  14. Millington, I. and Funge, J. (2009). Artificial Intelligence for Games, Second Edition. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2nd edition.
  15. Molineaux, M., Klenk, M., and Aha, D. W. (2010). Goaldriven autonomy in a navy strategy simulation. In in Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence. AAAI Press.
  16. Mun˜oz Avila, H., Jaidee, U., Aha, D. W., and Carter, E. (2010). Goal-driven autonomy with case-based reasoning. In Proceedings of the 18th international conference on Case-Based Reasoning Research and Development, ICCBR'10, pages 228-241, Berlin, Heidelberg. Springer-Verlag.
  17. Mun˜oz-Avila, H., Aha, D. W., Jaidee, U., Klenk, M., and Molineaux, M. (2010). Proceedings of the twentythird international florida artificial intelligence research society conference, may 19-21, 2010, daytona beach, florida. In Guesgen, H. W. and Murray, R. C., editors, FLAIRS Conference. AAAI Press.
  18. Ontan, S., Mishra, K., Sugandh, N., and Ram, A. (2008). Learning from demonstration and case-based planning for real-time strategy games. In Prasad, B., editor, Soft Computing Applications in Industry, volume 226 of Studies in Fuzziness and Soft Computing, pages 293-310. Springer Berlin Heidelberg.
  19. Pryor, L. and Collins, G. (1996). Planning for contingencies: a decision-based approach. volume 4, pages 287-339, USA. AI Access Foundation.
  20. Russell, S. J. and Norvig, P. (2003). Artificial Intelligence: A Modern Approach. Pearson Education, 2 edition.
  21. Shannon, C. E. (1988). Computer chess compendium. chapter Programming a computer for playing chess, pages 2-13. Springer-Verlag New York, Inc., New York, NY, USA.
  22. Shantia, A., Begue, E., and Wiering, M. (2011). Connectionist reinforcement learning for intelligent unit micro management in starcraft. In IJCNN, pages 1794- 1801.
  23. Synnaeve, G. and Bessière, P. (2011). A bayesian model for plan recognition in rts games applied to starcraft. In AIIDE.
  24. Synnaeve, G. and Bessière, P. (2012). Special tactics: A bayesian approach to tactical decision-making. In CIG, pages 409-416.
  25. Szczepanski, T. and Aamodt, A. (2009). Case-based reasoning for improved micromanagement in real-time strategy games. Proceedings of the Workshop on CaseBased Reasoning for Computer Games, 8th International Conference on Case-Based Reasoning, ICCBR 2009, pages 139-148.
  26. Zhang, Z. and Zhang, C. (2004). Agent-Based Hybrid Intelligent Systems. SpringerVerlag.
Download


Paper Citation


in Harvard Style

Iuhasz G., Ion Munteanu V. and Negru V. (2013). Framework for Enabling Scalable Learning Game AI . In Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-8565-62-4, pages 189-196. DOI: 10.5220/0004449301890196


in Bibtex Style

@conference{enase13,
author={Gabriel Iuhasz and Victor Ion Munteanu and Viorel Negru},
title={Framework for Enabling Scalable Learning Game AI},
booktitle={Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},
year={2013},
pages={189-196},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004449301890196},
isbn={978-989-8565-62-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
TI - Framework for Enabling Scalable Learning Game AI
SN - 978-989-8565-62-4
AU - Iuhasz G.
AU - Ion Munteanu V.
AU - Negru V.
PY - 2013
SP - 189
EP - 196
DO - 10.5220/0004449301890196