An Adversarial Training based Framework for Depth Domain Adaptation

Jigyasa Katrolia, Lars Krämer, Jason Rambach, Bruno Mirbach, Didier Stricker, Didier Stricker

Abstract

In absence of sufficient labeled training data, it is common practice to resort to synthetic data with readily available annotations. However, some performance gap still exists between deep learning models trained on synthetic versus on real data. Using adversarial training based generative models, it is possible to translate images from synthetic to real domain and train on them easily generalizable models for real-world datasets, but the efficiency of this method is limited in the presence of large domain shifts such as between synthetic and real depth images characterized by depth sensor and scene dependent artifacts in the image. In this paper, we present an adversarial training based framework for adapting depth images from synthetic to real domain. We use a cyclic loss together with an adversarial loss to bring the two domains of synthetic and real depth images closer by translating synthetic images to real domain, and demonstrate the usefulness of synthetic images modified this way for training deep neural networks that can perform well on real images. We demonstrate our method for the application of person detection and segmentation in real-depth images captured in a car for in-cabin person monitoring. We also show through experiments the effect of using target domain image sets captured using different types of depth sensors on this domain adaptation approach.

Download


Paper Citation


in Harvard Style

Katrolia J., Krämer L., Rambach J., Mirbach B. and Stricker D. (2021). An Adversarial Training based Framework for Depth Domain Adaptation.In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, ISBN 978-989-758-488-6, pages 353-361. DOI: 10.5220/0010252403530361


in Bibtex Style

@conference{visapp21,
author={Jigyasa Katrolia and Lars Krämer and Jason Rambach and Bruno Mirbach and Didier Stricker},
title={An Adversarial Training based Framework for Depth Domain Adaptation},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,},
year={2021},
pages={353-361},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010252403530361},
isbn={978-989-758-488-6},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,
TI - An Adversarial Training based Framework for Depth Domain Adaptation
SN - 978-989-758-488-6
AU - Katrolia J.
AU - Krämer L.
AU - Rambach J.
AU - Mirbach B.
AU - Stricker D.
PY - 2021
SP - 353
EP - 361
DO - 10.5220/0010252403530361