
tailored to computer vision applications in industrial
settings.
2 RELATED WORK
Our analysis focuses on three key research do-
mains: Computer Vision methodologies, manufac-
turing AI integration, and MLOps. The field of AI
has established foundational concepts and method-
ologies, as fully documented in the standard refer-
ence work (Russell and Norvig, 2020). Similarly,
the domains of data mining and ML have under-
gone a significant evolution since the introduction of
standardized methodologies. The CRISP-DM frame-
work (Wirth and Hipp, 2000), for instance, emerged
as a hierarchical process model structured across four
levels of abstraction, ranging from general phases to
specific process instances. This methodology pro-
vided a robust and comprehensive approach for ex-
ecuting data mining projects, remaining independent
of both industry sectors and the technologies em-
ployed. However, recent research has highlighted
limitations in the original CRISP-DM framework,
particularly in its applicability to modern ML use
cases. The traditional model lacks explicit guidance
on quality assurance methodologies and does not ad-
equately address scenarios where ML models must
make real-time decisions over extended periods. To
overcome these deficiencies, Cross-Industry Standard
Process for Machine Learning with Quality Assur-
ance (CRISP-ML(Q)) (Studer et al., 2021) was in-
troduced, incorporating quality assurance practices
across six well-defined phases while preserving its
neutrality with respect to industries and applications.
This evolution has proven critical, as surveys indicate
that 75-85 % of practical ML projects fail to meet
sponsor expectations. In manufacturing contexts,
the adoption of data-driven approaches presents dis-
tinct challenges. For example, (Tripathi et al., 2020)
demonstrated that applying robust, industry-specific
knowledge discovery models often encounters numer-
ous obstacles related to data and model development.
These challenges include experimental design con-
siderations, managing model complexity, addressing
class imbalance issues, and mitigating concerns re-
lated to data dimensionality. Moreover, the manufac-
turing sector requires systematic and efficient coordi-
nation between different phases of the knowledge dis-
covery process to ensure success. The emergence of
MLOps as a discipline has introduced new paradigms
for implementing ML systems in manufacturing en-
vironments. For instance, (Beck et al., 2020) exam-
ines processes for developing, integrating, and oper-
ating ML systems effectively. In addition, (Faubel and
Schmid, 2024) conducted multiple case studies on
implementing MLOps within Industry 4.0 contexts,
emphasizing the processes, tools, and organizational
structures necessary for reliable model deployment.
Recent advancements (Jon Bokrantz and Skoogh,
2024) have further extended the CRISP-DM frame-
work specifically for manufacturing applications by
introducing an “Operation and Maintenance” phase.
This extension underscores the importance of man-
aging AI drift while ensuring that domain expertise,
data science proficiency, and data engineering com-
petency are maintained throughout all process phases.
In particular, it highlights the critical role of data en-
gineering, a component often overlooked in conven-
tional AI workflows. In the realm of computer vision,
significant progress has been made since (Krizhevsky
et al., 2012) demonstrated breakthrough performance
in image classification using deep convolutional neu-
ral networks. Current industrial implementations fo-
cus on practical considerations such as build versus
buy decisions for vision-based AI software in man-
ufacturing environments (Robovision, 2024). Addi-
tionally, (Schneider et al., 2024) explored integration
challenges within Industry 4.0 ecosystems, identify-
ing four key areas: system integration, data-related
issues, workforce adaptation concerns, and ensuring
trustworthy AI implementation.
3 PROPOSED WORKFLOW
We introduce a structured framework designed to
guide computer vision projects in manufacturing en-
vironments. Divided into five distinct phases, the
workflow addresses critical aspects of project devel-
opment and implementation.
3.1 The Five Phases
Our proposed workflow is structured in five phases as
follows:
Phase 1: Planning Phase The foundational plan-
ning phase establishes the groundwork necessary for
achieving project success. During this stage, stake-
holders engage in comprehensive requirements en-
gineering to clearly define the scope and objectives.
Collaborative sessions facilitate the creation of de-
tailed documentation outlining resource allocation,
timeline constraints, and key success factors. Quan-
tifiable quality metrics and well-defined acceptance
criteria are developed to serve as benchmarks for sub-
sequent phases.
A Decision Framework for AI/MLOps Toolchain Selection in Manufacturing
441