Explainable Reinforcement Learning for Longitudinal Control

Roman Liessner, Jan Dohmen, Marco Wiering

2021

Abstract

Deep Reinforcement Learning (DRL) has the potential to surpass the existing state of the art in various practical applications. However, as long as learned strategies and performed decisions are difficult to interpret, DRL will not find its way into safety-relevant fields of application. SHAP values are an approach to overcome this problem. It is expected that the addition of these values to DRL provides an improved understanding of the learned action-selection policy. In this paper, the application of a SHAP method for DRL is demonstrated by means of the OpenAI Gym LongiControl Environment. In this problem, the agent drives an autonomous vehicle under consideration of speed limits in a single lane route. The controls learned with a DDPG algorithm are interpreted by a novel approach combining learned actions and SHAP values. The proposed RL-SHAP representation makes it possible to observe in every time step which features have a positive or negative effect on the selected action and which influences are negligible. The results show that RL-SHAP values are a suitable approach to interpret the decisions of the agent.

Paper Citation

in Harvard Style

Liessner R., Dohmen J. and Wiering M. (2021). Explainable Reinforcement Learning for Longitudinal Control.In Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-484-8, pages 874-881. DOI: 10.5220/0010256208740881

in Bibtex Style

@conference{icaart21,
author={Roman Liessner and Jan Dohmen and Marco Wiering},
title={Explainable Reinforcement Learning for Longitudinal Control},
booktitle={Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2021},
pages={874-881},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010256208740881},
isbn={978-989-758-484-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Explainable Reinforcement Learning for Longitudinal Control
SN - 978-989-758-484-8
AU - Liessner R.
AU - Dohmen J.
AU - Wiering M.
PY - 2021
SP - 874
EP - 881
DO - 10.5220/0010256208740881