Bridging the Reality Gap: Investigation of Deep Convolution Neural Networks Ability to Learn from a Combination of Real and Synthetic Data

Omar Gamal, Keshavraj Rameshbabu, Mohamed Imran, Hubert Roth

2020

Abstract

Recent advances in data-driven approaches especially deep learning and its application on visual imagery have drawn a lot of attention in recent years. The lack of training data, however, highly affects the model accuracy and its ability to generalize to unseen scenarios. Simulators are emerging as a promising alternative source of data, especially for vision-based applications. Nevertheless, they still lack the visual and physical properties of the real world. Recent works have shown promising approaches to close the reality gap and transfer the knowledge obtained in simulation to the real world. This paper investigates Convolution Neural Networks (CNNs) ability to generalize and learn from a mixture of real and synthetic data to overcome dataset scarcity and domain transfer problems. The evaluation results indicate that the CNN models trained with real and simulation data generalize to both simulation and real environments. However, models trained with only real or simulation data fails drastically when it is transferred to an unseen target environment. Furthermore, the utilization of simulation data has improved model accuracy significantly.

Paper Citation

in Harvard Style

Gamal O., Rameshbabu K., Imran M. and Roth H. (2020). Bridging the Reality Gap: Investigation of Deep Convolution Neural Networks Ability to Learn from a Combination of Real and Synthetic Data.In Proceedings of the 17th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-758-442-8, pages 446-454. DOI: 10.5220/0009830804460454

in Bibtex Style

@conference{icinco20,
author={Omar Gamal and Keshavraj Rameshbabu and Mohamed Imran and Hubert Roth},
title={Bridging the Reality Gap: Investigation of Deep Convolution Neural Networks Ability to Learn from a Combination of Real and Synthetic Data},
booktitle={Proceedings of the 17th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2020},
pages={446-454},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009830804460454},
isbn={978-989-758-442-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - Bridging the Reality Gap: Investigation of Deep Convolution Neural Networks Ability to Learn from a Combination of Real and Synthetic Data
SN - 978-989-758-442-8
AU - Gamal O.
AU - Rameshbabu K.
AU - Imran M.
AU - Roth H.
PY - 2020
SP - 446
EP - 454
DO - 10.5220/0009830804460454