Comparative Evaluation of NLP Approaches for Requirements Formalisation

Shekoufeh Kolahdouz Rahimi, Kevin Lano, Sobhan Tehrani, Chenghua Lin, Yiqi Liu, Muhammad Umar

2024

Abstract

Many approaches have been proposed for the automated formalisation of software requirements from semi-formal or informal requirements documents. However this research field lacks established case studies upon which different approaches can be compared, and there is also a lack of accepted criteria for comparing the results of formalisation approaches. As a consequence, it is difficult to determine which approaches are more appropriate for different kinds of formalisation task. In this paper we define benchmark case studies and a framework for comparative evaluation of requirements formalisation approaches, thus contributing to improving the rigour of this research field. We apply the approach to compare four example requirements formalisation methods.

Paper Citation

in Harvard Style

Kolahdouz Rahimi S., Lano K., Tehrani S., Lin C., Liu Y. and Umar M. (2024). Comparative Evaluation of NLP Approaches for Requirements Formalisation. In Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - Volume 1: MODELSWARD; ISBN 978-989-758-682-8, SciTePress, pages 125-132. DOI: 10.5220/0012318700003645

in Bibtex Style

@conference{modelsward24,
author={Shekoufeh Kolahdouz Rahimi and Kevin Lano and Sobhan Tehrani and Chenghua Lin and Yiqi Liu and Muhammad Umar},
title={Comparative Evaluation of NLP Approaches for Requirements Formalisation},
booktitle={Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - Volume 1: MODELSWARD},
year={2024},
pages={125-132},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012318700003645},
isbn={978-989-758-682-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - Volume 1: MODELSWARD
TI - Comparative Evaluation of NLP Approaches for Requirements Formalisation
SN - 978-989-758-682-8
AU - Kolahdouz Rahimi S.
AU - Lano K.
AU - Tehrani S.
AU - Lin C.
AU - Liu Y.
AU - Umar M.
PY - 2024
SP - 125
EP - 132
DO - 10.5220/0012318700003645
PB - SciTePress