PATH PLANNING WITH MARKOVIAN PROCESSES

Istvan Szoke, Gheorghe Lazea, Levente Tamas, Mircea Popa, Andras Majdik

2009

Abstract

This paper describes the path planning for the mobile robots, based on the Markov Decision Problems. The presented algorithms are developed for resolving problems with partially observable states. The algorithm is applied in an office environment and tested with a skid-steered robot. The created map combines two mapping theory, the topological respectively the metric method. The main goal of the robot is to reach from the home point to the door of the indoor environment using algorithms which are based on Markovian decisions.

References

  1. Cassandra, T., Kaelbing L., Kurien, J., 1996. Acting under uncertainty: Discrete bayesian models for mobilerobot navigation. IEEE/RSJ International Conference on Intelligent Robots and Systems.
  2. Fox, D., Hightower J., 2003. Bayesian Filtering for Location Estimation. IEEE Pervasive Computing, vol. 2, no. 3, pp. 24-33, doi:10.1109/MPRV.2003.1228524.
  3. LaValle, S., 2006. Planning algorithms. Cambridge University Press.
  4. Littman, M,. 1994. The Whitness algorithm: Solving partially observable Markov decision processes. Tech. Rep. CS-94-04
  5. Littman, M. L., 2009. A tutorial on partially observable Markov decision processes. Journal of Mathematical Psychology.
  6. Regan, K., 2005. The advisor-POMDP: A principled Approach to Ttrust through Reputation in Electronic Markets. Proceedings of the third annual conference on privacy, security and trust, PST..
  7. Thrun, S., 2003. Learning Occupancy Grid Maps with Forward Sensor Models. Autonomous Robots, v.15 n.2, p.111-127.
  8. Thrun, S., Burgard, W., 2004. A Probabilistic Approach to Concurrent Mapping and Localization for Mobile Robots. Springer Netherlands.
Download


Paper Citation


in Harvard Style

Szoke I., Lazea G., Tamas L., Popa M. and Majdik A. (2009). PATH PLANNING WITH MARKOVIAN PROCESSES . In Proceedings of the 6th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-674-000-9, pages 479-482. DOI: 10.5220/0002209704790482


in Bibtex Style

@conference{icinco09,
author={Istvan Szoke and Gheorghe Lazea and Levente Tamas and Mircea Popa and Andras Majdik},
title={PATH PLANNING WITH MARKOVIAN PROCESSES},
booktitle={Proceedings of the 6th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2009},
pages={479-482},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002209704790482},
isbn={978-989-674-000-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - PATH PLANNING WITH MARKOVIAN PROCESSES
SN - 978-989-674-000-9
AU - Szoke I.
AU - Lazea G.
AU - Tamas L.
AU - Popa M.
AU - Majdik A.
PY - 2009
SP - 479
EP - 482
DO - 10.5220/0002209704790482