Bringing Systems Engineering Models to Large Language Models: An Integration of OPM with an LLM for Design Assistants

Ramón María García Alarcia, Pietro Russo, Alfredo Renga, Alessandro Golkar

2024

Abstract

Although showing remarkable zero-shot and few-shot capabilities across a wide variety of tasks, Large Language Models (LLMs) are still not mature enough for off-the-shelf use in engineering design tasks. Organizations implementing model-based systems engineering practices into their product development processes can leverage on ontologies, models, and procedures to enhance LLMs applied to engineering design tasks. We present a methodology to integrate an Object-Process Methodology model of a space system into an LLM-based spacecraft design assistant and show a performance improvement, as compared to a conventional LLM. The benchmark is evaluated through subjective expert-assessed and an objective cosine-similarity-based criteria. The results motivate additional efforts in integrating Model-Based Systems Engineering practice into LLMs as means to improve their performance and reduce shortcomings such as hallucinations and black-box, untraceable behavior.

Paper Citation

in Harvard Style

García Alarcia R., Russo P., Renga A. and Golkar A. (2024). Bringing Systems Engineering Models to Large Language Models: An Integration of OPM with an LLM for Design Assistants. In Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - Volume 1: MBSE-AI Integration; ISBN 978-989-758-682-8, SciTePress, pages 334-345. DOI: 10.5220/0012621900003645

in Bibtex Style

@conference{mbse-ai integration24,
author={Ramón María García Alarcia and Pietro Russo and Alfredo Renga and Alessandro Golkar},
title={Bringing Systems Engineering Models to Large Language Models: An Integration of OPM with an LLM for Design Assistants},
booktitle={Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - Volume 1: MBSE-AI Integration},
year={2024},
pages={334-345},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012621900003645},
isbn={978-989-758-682-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - Volume 1: MBSE-AI Integration
TI - Bringing Systems Engineering Models to Large Language Models: An Integration of OPM with an LLM for Design Assistants
SN - 978-989-758-682-8
AU - García Alarcia R.
AU - Russo P.
AU - Renga A.
AU - Golkar A.
PY - 2024
SP - 334
EP - 345
DO - 10.5220/0012621900003645
PB - SciTePress