loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Author: Qi Li

Affiliation: University College London, 105 Gower Street, London, U.K.

Keyword(s): Reinforcement Learning, Model Free Policy Search, Robust Agents.

Abstract: While Reinforcement Learning (RL) often operates in idealized Markov Decision Processes (MDPs), their applications in real-world tasks often encounter noise such as in uncertain initial state distributions, noisy dynamics models. Further noise can also be introduced in actions, rewards, and the observations. In this paper we specifically focus on the problem of making agents act in a robust manner under different observation noise distributions for during training and for during testing. Such characterization of training and testing distributions is not common in RL as it is more common to train and deploy the agent on the same MDP. In this work, two methods of improving agent robustness to observation noise - training on noisy environments and modifying the reward function directly to encourage stable policies, are proposed and evaluated. We show that by training on noisy observation distributions, even if the distribution is different from the one in test, can benefit agent perform ance in test, while the reward modifications are less generally applicable, only improving the optimisation in some cases. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.133.79.70

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Li, Q. (2020). Search for Robust Policies in Reinforcement Learning. In Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART; ISBN 978-989-758-395-7; ISSN 2184-433X, SciTePress, pages 421-428. DOI: 10.5220/0008917404210428

@conference{icaart20,
author={Qi Li.},
title={Search for Robust Policies in Reinforcement Learning},
booktitle={Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART},
year={2020},
pages={421-428},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008917404210428},
isbn={978-989-758-395-7},
issn={2184-433X},
}

TY - CONF

JO - Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART
TI - Search for Robust Policies in Reinforcement Learning
SN - 978-989-758-395-7
IS - 2184-433X
AU - Li, Q.
PY - 2020
SP - 421
EP - 428
DO - 10.5220/0008917404210428
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic