CONTINUOUS PREFERENCES FOR ACTION SELECTION

Emmanuelle Grislin-Le Strugeon, Patricia Everaere

Abstract

We have investigated the use of continuous alternatives for action selection by a behavior-oriented agent. Such an agent is made of concurrent ``behaviors"; each of these behaviors reacts to specific stimuli and provides a response according to a low-level goal. Since the behaviors are specialized, they can provide concurrent responses and conflicts among them must be solved to perform a coherent global behavior of the agent. In this context, voting methods allow to select only one of the responses of the behaviors, while taking into account their preferences and respecting all of their constraints. Previous works are based on action spaces limited to few discrete values and have shown difficulties in determining the behaviors weights for the vote. Furthermore, these works generally not allow to express the indifference of a behavior on a alternative's component, i.e. the fact that a behavior has no preference on the value of one component of an alternative. We propose in this article a method to use continuous values for the alternatives and a fair vote based on one alternative proposition per behavior. Our framework also allows the expression of indifference between alternatives. This proposition has been tested and compared, and the results show that our approach is better than previous propositions to avoid locked situations.

References

  1. Antonelli, G., Arrichiello, F., and Chiaverini, S. (2008). The null-space-based behavioral control for autonomous robotic systems. Intelligent Service Robotics, 1(1):27- 39.
  2. Arkin, H. (1998). Behavior-based robotics. The MIT Press, Cambridge.
  3. Brooks, R. (1986). A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, RA-2:14-23.
  4. Bryson, J. (2002). The behavior-oriented design of modular agent intelligence. In Int. Workshop on Agent Technology and Software Engineering (AgeS).
  5. Bryson, J. and Thorisson, K. R. (2000). Dragons, bats and evil knights: A three-layer design approach to character-based creative play. VirtuaI Reality, 5:57- 71.
  6. Cross, V. V. and Sudkamp, T. A. (2002). Similarity and compatibility in fuzzy set theory: assessment and applications. Physica-Verlag GmbH, Heidelberg, Germany, Germany.
  7. Dorer, K. (1999). Behavior networks for continuous domains using situation-dependent motivations. In Proc. 16th Int. Joint Conf. on Artificial Intelligence (IJCAI), pages 1233-1238. Morgan Kaufmann.
  8. Flacher, F. and Sigaud, O. (2003). Coordination spatiale émergente par champs de potentiel. RSTI - TSI, Vie artificielle(22):171-195.
  9. Hanon, D., Grislin-Le Strugeon, E., and Mandiau, R. (2005). A behaviour based decisional model using vote. In Mohammadian, M., editor, Proceedings IAWTIC'2005 International Conference on Intelligent Agents, Web Technologies and Internet Commerce, ISBN 1740-88247-4.
  10. Hostetler, T. and Karrney, J. (2002). Strolling down the avenue with a few close friends. In Eurographics Ireland 2002 Workshop Proceedings, pages 7-14, Dublin, Ireland.
  11. Kwong, T. C., Shamsudin, H. A., Rosbi, M., and Jozsef, K. T. (2002). Using voting technique in mobile robot behavior coordination for goal-directed navigation. Jurnal Teknologi, 36(D):55-70.
  12. Maes, P. (1989). The dynamics of action selection. In Proceedings of the International Joint Conference on Artificial Intelligence-IJCAI'89. Morgan Kaufmann, Detroit.
  13. Maes, P. and Brooks, R. (1990). Learning to coordinate behaviors. In AAAI, pages 796-802, Boston, MA.
  14. Mataric, M. (1992). Behavior-based control: Main properties and implications. In Proceedings IEEE International Conference on Robotics and Automation, Workshop on Architectures for Intelligent Control Systems, pages 46-54.
  15. Moulin, H. (1988). Axioms of cooperative decision making. Econometric society monographs. Cambridge University Press.
  16. Pirjanian, P. (1999). Behaviour coordination mechanisms - state-of-the-art. Research report, Robotics Research Laboratory, University of Southern California.
  17. Pirjanian, P. and Mataric, M. (1999). Multiple objective vs. fuzzy behavior coordination. In Lecture Notes in Computer Science on Fuzzy Logic Techniques for Autonomous Vehicle Navigation, pages 235-253. Springer-Verlag.
  18. Reynolds, C. (1999). Steering behaviors for autonomous characters. In Game Developers Conference.
  19. Rosenblatt, J. (1996). DAMN: A Distributed Architecture for Mobile Navigation. PhD thesis, Carnegie Mellon University, Pittsburgh, USA.
  20. Rosenblatt, J., Williams, S., and Durrant-Whyte, H. (2002). A behavior-based architecture for autonomous underwater exploration. International Journal of Information Sciences, 145(1):69-87.
  21. Scheutz, M. and Andronache, V. (2004). Architectural mechanisms for dynamic changes of behavior selection strategies in behavior-based systems. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 34(6):2377-2395.
  22. Selekwa, M. F., Dunlap, D. D., Shi, D., and Jr., E. G. C. (2008). Robot navigation in very cluttered environments by preference-based fuzzy behaviors. Robotics and Autonomous Systems, 56(3):231-246.
  23. Tunstel, E. (1995). Coordination of distributed fuzzy behaviors in mobile robot control. In IEEE International Conference on Systems, Man,and Cybernetics, pages 4009-4014.
  24. Weber, R. (1978). Reproducing Voting Systems. Cowles Foundation.
  25. Wilensky, U. (1999). Netlogo. http://ccl.northwestern.edu/ netlogo/. Center for Connected Learning and Computer-Based Modeling. Northwestern University. Evanston, IL.
Download


Paper Citation


in Harvard Style

Grislin-Le Strugeon E. and Everaere P. (2011). CONTINUOUS PREFERENCES FOR ACTION SELECTION . In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-8425-41-6, pages 54-63. DOI: 10.5220/0003148800540063


in Bibtex Style

@conference{icaart11,
author={Emmanuelle Grislin-Le Strugeon and Patricia Everaere},
title={CONTINUOUS PREFERENCES FOR ACTION SELECTION},
booktitle={Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2011},
pages={54-63},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003148800540063},
isbn={978-989-8425-41-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - CONTINUOUS PREFERENCES FOR ACTION SELECTION
SN - 978-989-8425-41-6
AU - Grislin-Le Strugeon E.
AU - Everaere P.
PY - 2011
SP - 54
EP - 63
DO - 10.5220/0003148800540063