Reinforcement Learning Approach for Cooperative Control of Multi-Agent Systems

Valeria Javalera-Rincon, Vicenc Puig Cayuela, Bernardo Morcego Seix, Fernando Orduña-Cabrera

2019

Abstract

Reinforcement Learning (RL) systems are trial-and-error learners. This feature altogether with delayed reward, makes RL flexible, powerful and widely accepted. However, RL could not be suitable for control of critical systems where the learning of the control actions by trial and error is not an option. In the RL literature, the use of simulated experience generated by a model is called planning. In this paper, the planningByInstruction and planningByExploration techniques are introduced, implemented and compared to coordinate, a heterogeneous multi-agent architecture for distributed Large Scale Systems (LSS). This architecture was proposed by (Javalera 2016). The models used in this approach are part of a distributed architecture of agents. These models are used to simulate the behavior of the system when some coordinated actions are applied. This experience is learned by the so-called, LINKER agents, during an off-line training. An exploitation algorithm is used online, to coordinate and optimize the value of overlapping control variables of the agents in the distributed architecture in a cooperative way. This paper also presents a technique that offers a solution to the problem of the number of learning steps required to converge toward an optimal (or can be sub-optimal) policy for distributed control systems. An example is used to illustrate the proposed approach, showing exciting and promising results regarding the applicability to real systems.

Paper Citation

in Harvard Style

Javalera-Rincon V., Cayuela V., Seix B. and Orduña-Cabrera F. (2019). Reinforcement Learning Approach for Cooperative Control of Multi-Agent Systems.In Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-350-6, pages 80-91. DOI: 10.5220/0007349000800091

in Bibtex Style

@conference{icaart19,
author={Valeria Javalera-Rincon and Vicenc Cayuela and Bernardo Seix and Fernando Orduña-Cabrera},
title={Reinforcement Learning Approach for Cooperative Control of Multi-Agent Systems},
booktitle={Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2019},
pages={80-91},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007349000800091},
isbn={978-989-758-350-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Reinforcement Learning Approach for Cooperative Control of Multi-Agent Systems
SN - 978-989-758-350-6
AU - Javalera-Rincon V.
AU - Cayuela V.
AU - Seix B.
AU - Orduña-Cabrera F.
PY - 2019
SP - 80
EP - 91
DO - 10.5220/0007349000800091