loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Wenzel Pilar von Pilchau 1 ; Anthony Stein 2 and Jörg Hähner 1

Affiliations: 1 Organic Computing Group, University of Augsburg, Am Technologiezentrum 8, Augsburg, Germany ; 2 Artificial Intelligence in Agricultural Engineering, University of Hohenheim, Garbenstraße 9, Hohenheim, Germany

Keyword(s): Experience Replay, Deep Q-Network, Deep Reinforcement Learning, Interpolation, Machine Learning.

Abstract: The concept of Experience Replay is a crucial element in Deep Reinforcement Learning algorithms of the DQN family. The basic approach reuses stored experiences to, amongst other reasons, overcome the problem of catastrophic forgetting and as a result stabilize learning. However, only experiences that the learner observed in the past are used for updates. We anticipate that these experiences posses additional valuable information about the underlying problem that just needs to be extracted in the right way. To achieve this, we present the Interpolated Experience Replay technique that leverages stored experiences to create new, synthetic ones by means of interpolation. A previous proposed concept for discrete-state environments is extended to work in continuous problem spaces. We evaluate our approach on the MountainCar benchmark environment and demonstrate its promising potential.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 44.192.94.177

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pilar von Pilchau, W.; Stein, A. and Hähner, J. (2022). Interpolated Experience Replay for Continuous Environments. In Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - NCTA; ISBN 978-989-758-611-8; ISSN 2184-3236, SciTePress, pages 237-248. DOI: 10.5220/0011326900003332

@conference{ncta22,
author={Wenzel {Pilar von Pilchau}. and Anthony Stein. and Jörg Hähner.},
title={Interpolated Experience Replay for Continuous Environments},
booktitle={Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - NCTA},
year={2022},
pages={237-248},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011326900003332},
isbn={978-989-758-611-8},
issn={2184-3236},
}

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - NCTA
TI - Interpolated Experience Replay for Continuous Environments
SN - 978-989-758-611-8
IS - 2184-3236
AU - Pilar von Pilchau, W.
AU - Stein, A.
AU - Hähner, J.
PY - 2022
SP - 237
EP - 248
DO - 10.5220/0011326900003332
PB - SciTePress