What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline

Gian Jesi; Nicola Spazzoli; Andrea Odorizzi; Gianluca Mazzini

Research.Publish.Connect.

*Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Country:
Subject:

Advanced Search Affiliations Search

If you're looking for an exact phrase use quotation marks on text fields.

Proceedings

Proceedings Search *Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

Papers

Papers Search *Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

Authors

Authors Search *Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

Advanced Search

Paper

What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline

Topics: Big Data, Data Science and Analytics; Organisational Issues on Systems Integration

In Proceedings of the 26th International Conference on Enterprise Information Systems - Volume 1: ICEIS, 209-215, 2024 , Angers, France

Authors: Gian Jesi ; Nicola Spazzoli ; Andrea Odorizzi and Gianluca Mazzini

Affiliation: Lepida ScpA, Via della Liberazione 15, 40128 Bologna, Italy

Keyword(s): Big-Data, Ingestion.

Abstract: Privacy is an increasingly important concern especially in the European Union (EU). With the growing use of technology individuals’ personal information is being collected and processed by companies and organizations on a massive scale. In order to be compliant with Privacy regulations and General Data Protection Regulation (GDPR) in particular, we could no longer use a software tool, LOGGIT, for several reasons. This tool was a cornerstone in one of our Big-data pipeline ingestion. We did our best to comply with this requirement as soon as possible. In this work, we discuss how we refactor our pipeline architecture several times in order to find a balance between our requirements in terms of reliability and the regulations of the GDPR.

CC BY-NC-ND 4.0

Guest: Register as new SciTePress user now for free.

SciTePress user: please login.

My Papers

You are not signed in, therefore limits apply to your IP address 3.132.213.171

In the current month:

Recent papers: 100 available of 100 total

2⁺ years older papers: 200 available of 200 total

Paper citation in several formats:

Jesi, G.; Spazzoli, N.; Odorizzi, A. and Mazzini, G. (2024). What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline. In Proceedings of the 26th International Conference on Enterprise Information Systems - Volume 1: ICEIS; ISBN 978-989-758-692-7; ISSN 2184-4992, SciTePress, pages 209-215. DOI: 10.5220/0012554800003690

@conference{iceis24,
author={Gian Jesi. and Nicola Spazzoli. and Andrea Odorizzi. and Gianluca Mazzini.},
title={What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline},
booktitle={Proceedings of the 26th International Conference on Enterprise Information Systems - Volume 1: ICEIS},
year={2024},
pages={209-215},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012554800003690},
isbn={978-989-758-692-7},
issn={2184-4992},
}

TY - CONF

JO - Proceedings of the 26th International Conference on Enterprise Information Systems - Volume 1: ICEIS
TI - What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline
SN - 978-989-758-692-7
IS - 2184-4992
AU - Jesi, G.
AU - Spazzoli, N.
AU - Odorizzi, A.
AU - Mazzini, G.
PY - 2024
SP - 209
EP - 215
DO - 10.5220/0012554800003690
PB - SciTePress