A MARKOV-CHAIN-BASED MODEL FOR SUCCESS PREDICTION OF EVOLUTION IN COMPLEX ENVIRONMENTS

Lukas König, Sanaz Mostaghim, Hartmut Schmeck

Abstract

In this paper, a theoretical and experimental study of the influence of environments on the selection process in evolutionary swarm robotics is conducted. The theoretical selection model is based on Markov chains. It is proposed to predict the success rate of evolutionary runs which are based on a selection mechanism depending on implicit environmental properties as well as an explicit fitness function. In the experiments, the interaction of explicit and implicit selection is studied and a comparison with the model prediction is performed. The results indicate that the model prediction is accurate for the studied cases.

References

  1. Arnold, D. V. (2001). Evolution strategies in noisy environments- a survey of existing work, pages 239- 250. Springer-Verlag, London, UK.
  2. Bredeche, N. and Montanier, J.-M. (2010). Environmentdriven embodied evolution in a population of autonomous agents. In Parallel Problem Solving from Nature, pages 290-299, Berlin Heidelberg. Springer.
  3. Eiben, A. E., Hinterding, R., and Michalewicz, Z. (2000). Parameter control in evolutionary algorithms. IEEE Transactions on Evolutionary Computation, 3:124- 141.
  4. Grinstead, C. and Snell, L. (1997). Introduction to Probability. American Mathematical Society.
  5. Gross, R. and Dorigo, M. (2009). Towards group transport by swarms of robots. Int. J. Bio-Inspired Comput., 1:1-13.
  6. Holland, J. (1975). Adaptation in Natural and Artificial Systems. University of Michigan Press.
  7. Kessler, D., Levine, H., Ridgway, D., and Tsimring, L. (1997). Evolution on a smooth landscape. Journal of Statistical Physics, 87:519-543.
  8. Kimura, M. (1985). The Neutral Theory of Molecular Evolution. Cambridge University Press.
  9. Kö nig, L., Mostaghim, S., and Schmeck, H. (2009). Decentralized evolution of robotic behavior using finite state machines. Int. Journal of Intelligent Computing and Cybernetics, 2(4):695-723.
  10. Kö nig, L. and Schmeck, H. (2008). Evolving collision avoidance on autonomous robots. In Biologically Inspired Collaborative Computing (Proceedings of BICC 2008), pages 85-94.
  11. Nolfi, S. and Floreano, D. (2001). Evolutionary Robotics. The Biology, Intelligence, and Technology of SelfOrganizing Machines. MIT Press.
  12. Pietro, A. D., While, L., and Barone, L. (2004). Applying evolutionary algorithms to problems with noisy, timeconsuming fitness functions.
  13. Prü gel-Bennett, A. and Rogers, A. (2001). Modelling genetic algorithm dynamics, pages 59-85. SpringerVerlag, London, UK.
  14. Sober, E. (2001). The two faces of fitness. In Singh, R., Paul, D., Krimbas, C., and Beatty, J., editors, Thinking about Evolution: Historical, Philosophical, and Political Perspectives.
  15. Watson, R., Ficici, S., and Pollack, J. (2002). Embodied evolution: Distributing an evolutionary algorithm in a population of robots. In Robotics and Autonomous Systems, pages 1-18.
  16. Weyns, D., Schumacher, M., Ricci, A., Viroli, M., and Holvoet, T. (2005). Environments in multiagent systems. The Knowledge Engineering Review, 20(02):127-141.
Download


Paper Citation


in Harvard Style

König L., Mostaghim S. and Schmeck H. (2011). A MARKOV-CHAIN-BASED MODEL FOR SUCCESS PREDICTION OF EVOLUTION IN COMPLEX ENVIRONMENTS . In Proceedings of the International Conference on Evolutionary Computation Theory and Applications - Volume 1: ECTA, (IJCCI 2011) ISBN 978-989-8425-83-6, pages 90-102. DOI: 10.5220/0003677700900102


in Bibtex Style

@conference{ecta11,
author={Lukas König and Sanaz Mostaghim and Hartmut Schmeck},
title={A MARKOV-CHAIN-BASED MODEL FOR SUCCESS PREDICTION OF EVOLUTION IN COMPLEX ENVIRONMENTS},
booktitle={Proceedings of the International Conference on Evolutionary Computation Theory and Applications - Volume 1: ECTA, (IJCCI 2011)},
year={2011},
pages={90-102},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003677700900102},
isbn={978-989-8425-83-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Evolutionary Computation Theory and Applications - Volume 1: ECTA, (IJCCI 2011)
TI - A MARKOV-CHAIN-BASED MODEL FOR SUCCESS PREDICTION OF EVOLUTION IN COMPLEX ENVIRONMENTS
SN - 978-989-8425-83-6
AU - König L.
AU - Mostaghim S.
AU - Schmeck H.
PY - 2011
SP - 90
EP - 102
DO - 10.5220/0003677700900102