Toolchain Development for Automated Scene Reconstruction using Artificial Neural Network Object Detection and Photogrammetry for the Application in Driving Simulators

Maximilian Jarofka, Stephan Schweig, Niko Maas, Dieter Schramm


This paper presents an automated process chain for the reconstruction of characteristic 3D objects, which can be used in a simulation environment. The process chain can distinguish between recurring objects such as trees and cars and specific objects like buildings. To acquire this, it detects and classifies objects in images from a previously recorded video. In contrast to the specific objects, which are reconstructed during the workflow of the process chain, the recurrent objects are loaded from already existing models and are placed multiple times into the simulation environment. In terms of quality a visual comparison between the two integrated programs for the reconstruction (Metashape and Meshroom) is carried out. Furthermore the accuracy of the positioning of standard objects in the Unity game engine is examined.


Paper Citation