Generative Narrative-Driven Game Mechanics for Procedural Driving Simulators

Nelson Rodrigues, Nelson Rodrigues, António Coelho, António Coelho, Rosaldo J. F. Rossetti, Rosaldo J. F. Rossetti

2025

Abstract

Driving simulators are essential tools for training, education, research, and scientific experimentation. However, the diversity and quality of virtual environments in simulations is limited by the specialized human resources availability for authoring the content, leading to repetitive scenarios and low complexity of real-world scenes. This work introduces a pipeline that can process text-based narratives outlining driving experiments to procedurally generate dynamic traffic simulation scenarios. The solution uses Retrieval-Augmented Generation alongside local open-source Large Language Models to analyse unstructured textual information and produce a knowledge graph that encapsulates the world scene described in the experiment. Additionally, a context-based formal grammar is generated through inverse procedural modelling, reflecting the game mechanics related to the interactions among the world entities in the virtual environment supported by CARLA driving simulator. The proposed pipeline aims to simplify the generation of virtual environments for traffic simulation based on descriptions from scientific experiment, even for users without expertise in computer graphics.

Paper Citation

in Harvard Style

Rodrigues N., Coelho A. and Rossetti R. (2025). Generative Narrative-Driven Game Mechanics for Procedural Driving Simulators. In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP; ISBN 978-989-758-728-3, SciTePress, pages 339-346. DOI: 10.5220/0013311000003912

in Bibtex Style

@conference{grapp25,
author={Nelson Rodrigues and António Coelho and Rosaldo Rossetti},
title={Generative Narrative-Driven Game Mechanics for Procedural Driving Simulators},
booktitle={Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP},
year={2025},
pages={339-346},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013311000003912},
isbn={978-989-758-728-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP
TI - Generative Narrative-Driven Game Mechanics for Procedural Driving Simulators
SN - 978-989-758-728-3
AU - Rodrigues N.
AU - Coelho A.
AU - Rossetti R.
PY - 2025
SP - 339
EP - 346
DO - 10.5220/0013311000003912
PB - SciTePress