CrowdSim2: An Open Synthetic Benchmark for Object Detectors

Paweł Foszner, Agnieszka Szczęsna, Luca Ciampi, Nicola Messina, Adam Cygan, Bartosz Bizoń, Michał Cogiel, Dominik Golba, Elżbieta Macioszek, Michał Staniszewski

2023

Abstract

Data scarcity has become one of the main obstacles to developing supervised models based on Artificial Intelligence in Computer Vision. Indeed, Deep Learning-based models systematically struggle when applied in new scenarios never seen during training and may not be adequately tested in non-ordinary yet crucial real-world situations. This paper presents and publicly releases CrowdSim2, a new synthetic collection of images suitable for people and vehicle detection gathered from a simulator based on the Unity graphical engine. It consists of thousands of images gathered from various synthetic scenarios resembling the real world, where we varied some factors of interest, such as the weather conditions and the number of objects in the scenes. The labels are automatically collected and consist of bounding boxes that precisely localize objects belonging to the two object classes, leaving out humans from the annotation pipeline. We exploited this new benchmark as a testing ground for some state-of-the-art detectors, showing that our simulated scenarios can be a valuable tool for measuring their performances in a controlled environment.

Paper Citation

in Harvard Style

Foszner P., Szczęsna A., Ciampi L., Messina N., Cygan A., Bizoń B., Cogiel M., Golba D., Macioszek E. and Staniszewski M. (2023). CrowdSim2: An Open Synthetic Benchmark for Object Detectors. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 676-683. DOI: 10.5220/0011692500003417

in Bibtex Style

@conference{visapp23,
author={Paweł Foszner and Agnieszka Szczęsna and Luca Ciampi and Nicola Messina and Adam Cygan and Bartosz Bizoń and Michał Cogiel and Dominik Golba and Elżbieta Macioszek and Michał Staniszewski},
title={CrowdSim2: An Open Synthetic Benchmark for Object Detectors},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP},
year={2023},
pages={676-683},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011692500003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP
TI - CrowdSim2: An Open Synthetic Benchmark for Object Detectors
SN - 978-989-758-634-7
AU - Foszner P.
AU - Szczęsna A.
AU - Ciampi L.
AU - Messina N.
AU - Cygan A.
AU - Bizoń B.
AU - Cogiel M.
AU - Golba D.
AU - Macioszek E.
AU - Staniszewski M.
PY - 2023
SP - 676
EP - 683
DO - 10.5220/0011692500003417
PB - SciTePress