Authors:
Erik A. Billing
;
Thomas Hellström
and
Lars-Erik Janlert
Affiliation:
Umeå University, Sweden
Keyword(s):
Learning from demonstration, Prediction, Robot imitation, Motor control, Model-free learning.
Related
Ontology
Subjects/Areas/Topics:
Agents
;
Artificial Intelligence
;
Cognitive Robotics
;
Cognitive Systems
;
Computational Intelligence
;
Evolutionary Computing
;
Informatics in Control, Automation and Robotics
;
Mobile Agents
;
Reactive AI
;
Robotics and Automation
;
Soft Computing
;
Symbolic Systems
Abstract:
A novel robot learning algorithm called Predictive Sequence Learning (PSL) is presented and evaluated. PSL is a model-free prediction algorithm inspired by the dynamic temporal difference algorithm S-Learning. While S-Learning has previously been applied as a reinforcement learning algorithm for robots, PSL is here applied to a Learning from Demonstration problem. The proposed algorithm is evaluated on four tasks using a Khepera II robot. PSL builds a model from demonstrated data which is used to repeat the demonstrated behavior. After training, PSL can control the robot by continually predicting the next action, based on the sequence of passed sensor and motor events. PSL was able to successfully learn and repeat the first three (elementary) tasks, but it was unable to successfully repeat the fourth (composed) behavior. The results indicate that PSL is suitable for learning problems up to a certain complexity, while higher level coordination is required for learning more complex beh
aviors.
(More)