loading
Papers

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Robert Wright and Nathaniel Gemelli

Affiliation: Air Force Research Laboratory, United States

ISBN: 978-989-8111-66-1

Keyword(s): Reinforcement learning, NeuroEvolution, Evolutionary algorithms, State aggregation.

Related Ontology Subjects/Areas/Topics: Artificial Intelligence ; Biomedical Engineering ; Biomedical Signal Processing ; Computational Intelligence ; Evolutionary Computing ; Health Engineering and Technology Applications ; Human-Computer Interaction ; Knowledge Discovery and Information Retrieval ; Knowledge-Based Systems ; Machine Learning ; Methodologies and Methods ; Neural Networks ; Neurocomputing ; Neurotechnology, Electronics and Informatics ; Pattern Recognition ; Physiological Computing Systems ; Sensor Networks ; Signal Processing ; Soft Computing ; Symbolic Systems ; Theory and Methods

Abstract: In this paper, we present a new machine learning algorithm, RL-SANE, which uses a combination of neuroevolution (NE) and traditional reinforcement learning (RL) techniques to improve learning performace. RL-SANE is an innovative combination of the neuroevolutionary algorithm NEAT(Stanley, 2004) and the RL algorithm Sarsa(l)(Sutton and Barto, 1998). It uses the special ability of NEAT to generate and train customized neural networks that provide a means for reducing the size of the state space through state aggregation. Reducing the size of the state space through aggregation enables Sarsa(l) to be applied to much more difficult problems than standard tabular based approaches. Previous similar work in this area, such as in Whiteson and Stone (Whiteson and Stone, 2006) and Stanley and Miikkulainen (Stanley and Miikkulainen, 2001), have shown positive and promising results. This paper gives a brief overview of neuroevolutionary methods, introduces the RL-SANE algorithm, presents a compar ative analysis of RL-SANE to other neuroevolutionary algorithms, and concludes with a discussion of enhancements that need to be made to RL-SANE. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.231.226.211

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Wright R.; Gemelli N. and (2009). STATE AGGREGATION FOR REINFORCEMENT LEARNING USING NEUROEVOLUTION.In Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8111-66-1, pages 45-52. DOI: 10.5220/0001658800450052

@conference{icaart09,
author={Robert Wright and Nathaniel Gemelli},
title={STATE AGGREGATION FOR REINFORCEMENT LEARNING USING NEUROEVOLUTION},
booktitle={Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2009},
pages={45-52},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001658800450052},
isbn={978-989-8111-66-1},
}

TY - CONF

JO - Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - STATE AGGREGATION FOR REINFORCEMENT LEARNING USING NEUROEVOLUTION
SN - 978-989-8111-66-1
AU - Wright, R.
AU - Gemelli, N.
PY - 2009
SP - 45
EP - 52
DO - 10.5220/0001658800450052

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.