Authors:
Stephan Pareigis
1
;
Jesus Hermosilla-Diaz
2
;
Jeeangh Reyes-Montiel
2
;
Fynn Maaß
3
;
Helen Haase
1
;
Maximilian Mang
1
and
Antonio Marin-Hernandez
2
Affiliations:
1
Department of Computer Science, HAW Hamburg, Berliner Tor 7, 20099 Hamburg, Germany
;
2
Artificial Intelligence Research Institute, Universidad Veracruzana, Calle Paseo No. 112, Xalapa, Mexico
;
3
Department of Computer Science, Graz University, 8010 Graz, Inffeldgasse 16, Austria
Keyword(s):
Offline Reinforcement Learning, Pouring Liquid, Artificial Neural Network, Robust Control, UR5 Robot Manipulator.
Abstract:
A method for the creation of a liquid pouring controller is proposed, based on experimental data gathered from a small number of experiments. In a laboratory configuration, a UR5 robot arm equipped with a camera near the end effector holds a container. The camera captures the liquid pouring from the container as the robot adjusts its turning angles to achieve a specific pouring target volume. The proposed controller applies image analysis in a preprocessing stage to determine the liquid volume pouring from the container at each frame. This calculated volume, in conjunction with an estimated target volume in the receiving container, serves as input for a policy that computes the necessary turning angles for precise liquid pouring. The data received on the physical system is used as Monte-Carlo episodes for training an artificial neural network using a policy gradient method. Experiments with the proposed method are conducted using a simple simulation. Convergence proves to be fast and
the achieved policy is independent of initial and goal volumes.
(More)