Authors:
Maria Chernigovskaya
1
;
Damanpreet Walia
2
;
Ksenia Neumann
2
;
André Hardt
1
;
Abdulrahman Nahhas
1
and
Klaus Turowski
1
Affiliations:
1
MRCC VLBA, Otto-von-Guericke University, Universitaetsplatz 2, Magdeburg, Germany
;
2
BIRD Lab, Otto-von-Guericke University, Universitaetsplatz 2, Magdeburg, Germany
Keyword(s):
LLM, Large Language Model Operations, LLMOps, Standardization, Process Model, BPMN.
Abstract:
The generalization and standardization of the Large Language Model Operations (LLMOps) life cycle is crucial for the effective adoption and management of Large Language Models (LLMs) in a business context. Researchers and practitioners propose various LLMOps processes however they all tend to lack formalization in their design. In this paper, we address the absence of a standard LLMOps model for enterprises and propose a generalized approach to adopting LLMOps into existing enterprise system landscapes. We start by identifying the state-of-the-art LLMOps processes through a systematic literature review of peer-reviewed research literature and gray literature. Considering the scarcity of relevant publications and research in the area discovered during the initial stage of the research, we propose a generic, use-case-agnostic, and tool-agnostic LLMOps business process model. The proposed model is designed using the Business Process Model and Notation (BPMN) and aims to contribute to th
e effective adoption of LLM-powered applications in the industry. To the best of our knowledge, this paper is the first attempt to systematically address the identified research gap. The presented methods and proposed model constitute the initial stage of the research on the topic and should be regarded as a starting point toward the standardization of the LLMOps process.
(More)