loading
Documents

Research.Publish.Connect.

Paper

Authors: Cristiano Cortez da Rocha 1 ; Márcio Parise Boufleur 1 ; Leandro da Silva Fornasier 1 ; Júlio César Narciso 2 ; Andrea Schwertner Charão 3 ; Vinícius Maran 3 ; João Carlos D. Lima 3 and Benhur O. Stein 3

Affiliations: 1 Centro de Informática e Automação do Estado de Santa Catarina (CIASC), Brazil ; 2 Secretaria de Estado da Fazenda de Santa Catarina, Brazil ; 3 Universidade Federal de Santa Maria (UFSM), Brazil

ISBN: 978-989-758-298-1

Keyword(s): Large Database, Query Performance, Data Management, Business-critical Data.

Abstract: Hadoop clusters have established themselves as a foundation for various applications and experiments in the field of high-performance processing of large datasets. In this context, SQL-on-Hadoop emerged as trend that combines the popularity of SQL with the performance of Hadoop. In this work, we analyze the performance of SQL queries on Hadoop, using the Impala engine, comparing it with a RDBMS-based approach. The analysis focuses on a large set of electronic invoice data, representing an important application to support fiscal audit operations. The experiments performed included frequent queries in this context, which were implemented with and without data partitioning in both RDBMS and Impala/Hadoop. The results show speedups from 2.7 to 14x with Impala/Hadoop for the queries considered, on a lower cost hardware/software platform.

PDF ImageFull Text

Download
Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.235.143.190

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Cortez da Rocha, C.; Parise Boufleur, M.; da Silva Fornasier, L.; César Narciso, J.; Schwertner Charão, A.; Maran, V.; D. Lima, J. and O. Stein, B. (2018). SQL Query Performance on Hadoop: An Analysis Focused on Large Databases of Brazilian Electronic Invoices.In Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-298-1, pages 29-37. DOI: 10.5220/0006690400290037

@conference{iceis18,
author={Cristiano Cortez da Rocha. and Márcio Parise Boufleur. and Leandro da Silva Fornasier. and Júlio César Narciso. and Andrea Schwertner Charão. and Vinícius Maran. and João Carlos D. Lima. and Benhur O. Stein.},
title={SQL Query Performance on Hadoop: An Analysis Focused on Large Databases of Brazilian Electronic Invoices},
booktitle={Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2018},
pages={29-37},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006690400290037},
isbn={978-989-758-298-1},
}

TY - CONF

JO - Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - SQL Query Performance on Hadoop: An Analysis Focused on Large Databases of Brazilian Electronic Invoices
SN - 978-989-758-298-1
AU - Cortez da Rocha, C.
AU - Parise Boufleur, M.
AU - da Silva Fornasier, L.
AU - César Narciso, J.
AU - Schwertner Charão, A.
AU - Maran, V.
AU - D. Lima, J.
AU - O. Stein, B.
PY - 2018
SP - 29
EP - 37
DO - 10.5220/0006690400290037

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.