loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Qishan Yang 1 ; Mouzhi Ge 2 and Markus Helfert 1

Affiliations: 1 Dublin City University, Ireland ; 2 Masaryk University, Czech Republic

Keyword(s): Data Quality, Data Integration, TPC-DI Benchmark, ETL.

Related Ontology Subjects/Areas/Topics: Coupling and Integrating Heterogeneous Data Sources ; Data Warehouses and OLAP ; Databases and Information Systems Integration ; Enterprise Information Systems ; Performance Evaluation and Benchmarking

Abstract: Nowadays, many business intelligence or master data management initiatives are based on regular data integration, since data integration intends to extract and combine a variety of data sources, it is thus considered as a prerequisite for data analytics and management. More recently, TPC-DI is proposed as an industry benchmark for data integration. It is designed to benchmark the data integration and serve as a standardisation to evaluate the ETL performance. There are a variety of data quality problems such as multi-meaning attributes and inconsistent data schemas in source data, which will not only cause problems for the data integration process but also affect further data mining or data analytics. This paper has summarised typical data quality problems in the data integration and adapted the traditional data quality dimensions to classify those data quality problems. We found that data completeness, timeliness and consistency are critical for data quality management in data integ ration, and data consistency should be further defined in the pragmatic level. In order to prevent typical data quality problems and proactively manage data quality in ETL, we proposed a set of practical guidelines for researchers and practitioners to conduct data quality management in data integration. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 44.200.32.31

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Yang, Q.; Ge, M. and Helfert, M. (2017). Guildlines of Data Quality Issues for Data Integration in the Context of the TPC-DI Benchmark. In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS; ISBN 978-989-758-247-9; ISSN 2184-4992, SciTePress, pages 135-144. DOI: 10.5220/0006334301350144

@conference{iceis17,
author={Qishan Yang. and Mouzhi Ge. and Markus Helfert.},
title={Guildlines of Data Quality Issues for Data Integration in the Context of the TPC-DI Benchmark},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS},
year={2017},
pages={135-144},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006334301350144},
isbn={978-989-758-247-9},
issn={2184-4992},
}

TY - CONF

JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 1: ICEIS
TI - Guildlines of Data Quality Issues for Data Integration in the Context of the TPC-DI Benchmark
SN - 978-989-758-247-9
IS - 2184-4992
AU - Yang, Q.
AU - Ge, M.
AU - Helfert, M.
PY - 2017
SP - 135
EP - 144
DO - 10.5220/0006334301350144
PB - SciTePress