Authors:
Khaled Alomari
;
Ricardo Carrillo Mendoza
;
Daniel Goehring
and
Raúl Rojas
Affiliation:
Dahlem Center for Machine Learning and Robotics - Freie Universität Berlin, Arnimallee 7, 14195 Berlin, Germany
Keyword(s):
Deep Reinforcement Learning, Deep Deterministic Policy Gradient, Path-following, Advanced Driver Assistance Systems, Autonomous Vehicles.
Abstract:
Path-following for autonomous vehicles is a challenging task. Choosing the appropriate controller to apply typical linear/nonlinear control theory methods demands intensive investigation on the dynamics and kinematics of the system. Furthermore, the non-linearity of the system’s dynamics, the complication of its analytical description, disturbances, and the influence of sensor noise, raise the need for adaptive control methods for reaching optimal performance. In the context of this paper, a Deep Reinforcement Learning (DRL) approach with Deep Deterministic Policy Gradient (DDPG) is employed for path tracking of an autonomous model vehicle. The RL agent is trained in a 3D simulation environment. It interacts with the unknown environment and accumulates experiences to update the Deep Neural Network. The algorithm learns a policy (sequence of control actions) that solves the designed optimization objective. The agent is trained to calculate heading angles to follow a path with minimal
cross-track error. In the final evaluation, to prove the trained policy’s dynamic, we analyzed the learned steering policy strength to respond to more extensive and smaller steering values with keeping the cross-track error as small as possible. In conclusion, the agent could drive around the track for several loops without exceeding the maximum tolerated deviation, moreover, with reasonable orientation error.
(More)