loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Yuki Nakamura 1 and Takeshi Shibuya 2

Affiliations: 1 Graduate School of Systems and Information Engineering, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Japan ; 2 Faculty of Engineering, Information and Systems, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Japan

Keyword(s): Reinforcement Learning, Topological Data Analysis, TDA Mapper, Visualization.

Abstract: Reinforcement learning is a learning framework applied in various fields in which agents autonomously acquire control rules. Using this method, the designer constructs a state space and reward function and sets various parameters to obtain ideal performance. The actual performance of the agent depends on the design. Accordingly, a poor design causes poor performance. In that case, the designer needs to examine the cause of the poor performance; to do so, it is important for the designer to understand the current agent control rules. In the case where the state space is less than or equal to two dimensions, visualizing the landscape of the value function and the structure of the state space is the most powerful method to understand these rules. However, in other cases, there is no method for such a visualization. In this paper, we propose a method to visualize the landscape of the value function and the structure of the state space even when the state space has a high number of dimens ions. Concretely, we employ topological data analysis for the visualization. We confirm the effectiveness of the proposed method via several numerical experiments. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 44.193.208.105

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Nakamura, Y. and Shibuya, T. (2020). Topological Visualization Method for Understanding the Landscape of Value Functions and Structure of the State Space in Reinforcement Learning. In Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART; ISBN 978-989-758-395-7; ISSN 2184-433X, SciTePress, pages 370-377. DOI: 10.5220/0008913303700377

@conference{icaart20,
author={Yuki Nakamura. and Takeshi Shibuya.},
title={Topological Visualization Method for Understanding the Landscape of Value Functions and Structure of the State Space in Reinforcement Learning},
booktitle={Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART},
year={2020},
pages={370-377},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008913303700377},
isbn={978-989-758-395-7},
issn={2184-433X},
}

TY - CONF

JO - Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART
TI - Topological Visualization Method for Understanding the Landscape of Value Functions and Structure of the State Space in Reinforcement Learning
SN - 978-989-758-395-7
IS - 2184-433X
AU - Nakamura, Y.
AU - Shibuya, T.
PY - 2020
SP - 370
EP - 377
DO - 10.5220/0008913303700377
PB - SciTePress