Using BPMN for ETL Conceptual Modelling: A Case Study

Bruno Oliveira, Óscar Oliveira, Orlando Belo

2021

Abstract

One of the most important parts of a Data Warehousing System is the Extract-Transform-Load (ETL) component. It is responsible for extracting, transforming, conciliating, and loading data for supporting decision-making requirements. Usually, due to the complexity of managing heterogeneous data, this component is responsible for consuming most of the resources required for implementing a Data Warehousing System, representing a critical component that compromises the adequacy of the system. Despite their importance, the ETL development method is essentially ad-hoc, which does not always follow or embodies the best practices. With the emergence of Big Data and associated tools, script-based ETL became, even more, a common approach. In the last years, BPMN – Business Process Model and Notation – have been proposed and used to support ETL conceptual models. Still, as an expressive language, it provides different approaches for representing the same requirements. In this paper, we explore the use of BPMN for ETL conceptual modelling, analyzing existing approaches, and proposing a set of guidelines for using this notation in a more consistent way.

Paper Citation

in Harvard Style

Oliveira B., Oliveira Ó. and Belo O. (2021). Using BPMN for ETL Conceptual Modelling: A Case Study. In Proceedings of the 10th International Conference on Data Science, Technology and Applications - Volume 1: DATA, ISBN 978-989-758-521-0, pages 267-274. DOI: 10.5220/0010575702670274

in Bibtex Style

@conference{data21,
author={Bruno Oliveira and Óscar Oliveira and Orlando Belo},
title={Using BPMN for ETL Conceptual Modelling: A Case Study},
booktitle={Proceedings of the 10th International Conference on Data Science, Technology and Applications - Volume 1: DATA,},
year={2021},
pages={267-274},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010575702670274},
isbn={978-989-758-521-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 10th International Conference on Data Science, Technology and Applications - Volume 1: DATA,
TI - Using BPMN for ETL Conceptual Modelling: A Case Study
SN - 978-989-758-521-0
AU - Oliveira B.
AU - Oliveira Ó.
AU - Belo O.
PY - 2021
SP - 267
EP - 274
DO - 10.5220/0010575702670274