loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Rodrigo Rocha Silva 1 ; Celso Massaki Hirata 1 and Joubert de Castro Lima 2

Affiliations: 1 Aeronautics Institute of Technology, Brazil ; 2 Federal University of Ouro Preto, Brazil

Keyword(s): OLAP, Data Cube, Inverted Index, High Dimension, and External Memory.

Related Ontology Subjects/Areas/Topics: Data Engineering ; Data Warehouses and OLAP ; Databases and Data Security ; Databases and Information Systems Integration ; Enterprise Information Systems ; Large Scale Databases

Abstract: Approaches based on inverted indexes, such as Frag-Cubing, are considered efficient in terms of runtime and main memory usage for high dimension cube computation and query. These approaches do not compute all aggregations a priori. They index information about occurrences of attributes in a manner that it is time efficient to answer multidimensional queries. As any other main memory based cube solution, Frag-Cubing is limited to main memory available, thus if the size of the cube exceeds main memory capacity, external memory is required. The challenge of using external memory is to define criteria to select which fragments of the cube should be in main memory. In this paper, we implement and test an approach that is an extension of Frag-Cubing, named H-Frag, which selects fragments of the cube, according to attribute frequencies and dimension cardinalities, to be stored in main memory. In our experiment, H-Frag outperforms Frag-Cubing in both query response time and main memory usage . A massive cube with 60 dimensions and 109 tuples was computed by H-Frag sequentially using 110 GB of RAM and 286 GB of external memory, taking 64 hours. This data cube answers complex queries in less than 40 seconds. Frag- Cubing could not compute such a cube in the same machine. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.159.116.24

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Silva, R.; Hirata, C. and Lima, J. (2015). A Hybrid Memory Data Cube Approach for High Dimension Relations. In Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS; ISBN 978-989-758-096-3; ISSN 2184-4992, SciTePress, pages 139-149. DOI: 10.5220/0005371601390149

@conference{iceis15,
author={Rodrigo Rocha Silva. and Celso Massaki Hirata. and Joubert de Castro Lima.},
title={A Hybrid Memory Data Cube Approach for High Dimension Relations},
booktitle={Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS},
year={2015},
pages={139-149},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005371601390149},
isbn={978-989-758-096-3},
issn={2184-4992},
}

TY - CONF

JO - Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS
TI - A Hybrid Memory Data Cube Approach for High Dimension Relations
SN - 978-989-758-096-3
IS - 2184-4992
AU - Silva, R.
AU - Hirata, C.
AU - Lima, J.
PY - 2015
SP - 139
EP - 149
DO - 10.5220/0005371601390149
PB - SciTePress