Harnessing LLM Conversations for Goal Model Generation from User Reviews

Shuaicai Ren, Hiroyuki Nakagawa, Tatsuhiro Tsuchiya

2024

Abstract

User reviews are a valuable resource for developers, as the reviews contain requests for new features and bug reports. By conducting the requirements analysis of user reviews, developers can gain timely insights for the application, which is crucial for continuously enhancing user satisfaction. The goal model is a commonly used model during requirements analysis. Utilizing reviews to generate goal models can assist developers in understanding user requirements comprehensively. However, given the vast number of reviews, manually collecting reviews and creating goal models is a significant challenge. A method for clustering user reviews and automatically generating goal models has been proposed. Nevertheless, the accuracy of the goal models generated by this method is limited. To address these limitations of the existing method and enhance precision of goal model generation, we propose a goal-generation process based on Large Language Models (LLMs). This process does not directly generate goal models from user reviews; instead, it treats goal model generation as a clustering problem, allowing for the visualization of the relationship between reviews and goals. Experiments demonstrate that compared to the existing method, our LLM-based goal model generation process enhance the precision of goal model generation.

Paper Citation

in Harvard Style

Ren S., Nakagawa H. and Tsuchiya T. (2024). Harnessing LLM Conversations for Goal Model Generation from User Reviews. In Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART; ISBN 978-989-758-680-4, SciTePress, pages 385-392. DOI: 10.5220/0012352200003636

in Bibtex Style

@conference{icaart24,
author={Shuaicai Ren and Hiroyuki Nakagawa and Tatsuhiro Tsuchiya},
title={Harnessing LLM Conversations for Goal Model Generation from User Reviews},
booktitle={Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART},
year={2024},
pages={385-392},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012352200003636},
isbn={978-989-758-680-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART
TI - Harnessing LLM Conversations for Goal Model Generation from User Reviews
SN - 978-989-758-680-4
AU - Ren S.
AU - Nakagawa H.
AU - Tsuchiya T.
PY - 2024
SP - 385
EP - 392
DO - 10.5220/0012352200003636
PB - SciTePress