LONG-TERM VS. GREEDY ACTION PLANNING FOR COLOR LEARNING ON A MOBILE ROBOT

Mohan Sridharan, Peter Stone

2008

Abstract

A major challenge to the deployment of mobile robots is the ability to function autonomously, learning appropriate models for environmental features and adapting those models in response to environmental changes. This autonomous operation in turn requires autonomous selection/planning of an action sequence that facilitates learning and adaptation. Here we focus on color modeling/learning and analyze two algorithms that enable a mobile robot to plan action sequences that facilitate color learning: a long-term action selection approach that maximizes color learning opportunities while minimizing localization errors over an entire action sequence, and a greedy/heuristic action selection approach that plans incrementally, one step at a time, to maximize the benefits based on the current state of the world. The long-term action selection results in a more principled solution that requires minimal human supervision, while better failure recovery is achieved by incorporating features of the greedy planning approach. All algorithms are fully implemented and tested on the Sony AIBO robots.

References

  1. Anzani, F., Bosisio, D., Matteucci, M., and Sorrenti, D. (2005). On-line color calibration in non-stationary environments. In RoboCup Symposium.
  2. Bishop, C. M. (1995). Neural Networks for Pattern Recognition. Oxford University Press.
  3. Boutillier, C., Dean, T., and S.Hanks (1999). Decision theoretic planning: structural assumptions and computational leverage. Journal of AI Research, 11:1-94.
  4. Cameron, D. and Barnes, N. (2003). Knowledge-based autonomous dynamic color calibration. In The International RoboCup Symposium.
  5. Cohen, D., Ooi, Y. H., Vernaza, P., and Lee, D. D. (2004). UPenn TDP, RoboCup-2003: RoboCup Competitions and Conferences.
  6. Comaniciu, D. and Meer, P. (2002). Mean shift: A robust approach toward feature space analysis. PAMI.
  7. Ghallab, M., Nau, D., and Traverso, P. (2004). Automated Planning: Theory and Practice. Morgan Kaufmann, San Francisco, CA 94111.
  8. Jensfelt, P., Folkesson, J., Kragic, D., and Christensen, H. I. (2006). Exploiting distinguishable image features in robotic mapping and localization. In The European Robotics Symposium (EUROS).
  9. Jungel, M. (2004). Using layered color precision for a self-calibrating vision system. In The International RoboCup Symposium.
  10. Maloney, L. T. and Wandell, B. A. (1986). Color Constancy: A Method for Recovering Surface Spectral Reflectance. Opt. Soc. of Am. A, 3(1):29-33.
  11. Minten, B. W., Murphy, R. R., Hyams, J., and Micire, M. (2001). Low-order-complexity vision-based docking. IEEE Transactions on Robotics and Automation, 17(6):922-930.
  12. Pineau, J., Montemerlo, M., Pollack, M., Roy, N., and Thrun, S. (2003). Towards robotic assistants in nursing homes: Challenges and results. RAS Special Issue on Socially Interactive Robots.
  13. Rosenberg, C., Hebert, M., and Thrun, S. (2001). Color constancy using kl-divergence. In The IEEE International Conference on Computer Vision (ICCV).
  14. Schulz, D. and Fox, D. (2004). Bayesian color estimation for adaptive vision-based robot localization. In IROS.
  15. Shi, J. and Malik, J. (2000). Normalized cuts and image segmentation. In IEEE Transactions on PAMI.
  16. Sridharan, M. and Stone, P. (2007). Color learning on a mobile robot: Towards full autonomy under changing illumination. In IJCAI.
  17. Thrun, S. (2006). Stanley: The Robot that Won the DARPA Grand Challenge. Journal of Field Robotics, 23(9):661-692.
Download


Paper Citation


in Harvard Style

Sridharan M. and Stone P. (2008). LONG-TERM VS. GREEDY ACTION PLANNING FOR COLOR LEARNING ON A MOBILE ROBOT . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 682-685. DOI: 10.5220/0001088606820685


in Bibtex Style

@conference{visapp08,
author={Mohan Sridharan and Peter Stone},
title={LONG-TERM VS. GREEDY ACTION PLANNING FOR COLOR LEARNING ON A MOBILE ROBOT},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={682-685},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001088606820685},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - LONG-TERM VS. GREEDY ACTION PLANNING FOR COLOR LEARNING ON A MOBILE ROBOT
SN - 978-989-8111-21-0
AU - Sridharan M.
AU - Stone P.
PY - 2008
SP - 682
EP - 685
DO - 10.5220/0001088606820685