loading
Papers

Research.Publish.Connect.

Paper

Authors: Simyung Chang 1 ; YoungJoon Yoo 2 ; Jaeseok Choi 3 and Nojun Kwak 3

Affiliations: 1 Seoul National University, Seoul, Korea, Samsung Electronics, Suwon and Korea ; 2 Clova AI Research, NAVER Corp, Seongnam and Korea ; 3 Seoul National University, Seoul and Korea

ISBN: 978-989-758-351-3

Keyword(s): BOOK, Book Learning, Reinforcement Learning.

Abstract: We introduce a novel method to train agents of reinforcement learning (RL) by sharing knowledge in a way similar to the concept of using a book. The recorded information in the form of a book is the main means by which humans learn knowledge. Nevertheless, the conventional deep RL methods have mainly focused either on experiential learning where the agent learns through interactions with the environment from the start or on imitation learning that tries to mimic the teacher. Contrary to these, our proposed book learning shares key information among different agents in a book-like manner by delving into the following two characteristic features: (1) By defining the linguistic function, input states can be clustered semantically into a relatively small number of core clusters, which are forwarded to other RL agents in a prescribed manner. (2) By defining state priorities and the contents for recording, core experiences can be selected and stored in a small container. We call this contai ner as ‘BOOK’. Our method learns hundreds to thousand times faster than the conventional methods by learning only a handful of core cluster information, which shows that deep RL agents can effectively learn through the shared knowledge from other agents. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.205.60.226

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Chang, S.; Yoo, Y.; Choi, J. and Kwak, N. (2019). BOOK: Storing Algorithm-Invariant Episodes for Deep Reinforcement Learning.In Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-351-3, pages 73-82. DOI: 10.5220/0007308000730082

@conference{icpram19,
author={Simyung Chang. and YoungJoon Yoo. and Jaeseok Choi. and Nojun Kwak.},
title={BOOK: Storing Algorithm-Invariant Episodes for Deep Reinforcement Learning},
booktitle={Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2019},
pages={73-82},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007308000730082},
isbn={978-989-758-351-3},
}

TY - CONF

JO - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - BOOK: Storing Algorithm-Invariant Episodes for Deep Reinforcement Learning
SN - 978-989-758-351-3
AU - Chang, S.
AU - Yoo, Y.
AU - Choi, J.
AU - Kwak, N.
PY - 2019
SP - 73
EP - 82
DO - 10.5220/0007308000730082

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.