loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Mohamad Al Hajj Hassan and Mostafa Bamha

Affiliation: LIFO, University of Orléans, France

Keyword(s): PDBMS (Parallel Database Management Systems), Intra-transaction parallelism, Parallel joins, Multi-joins, Data skew, Dynamic load balancing.

Related Ontology Subjects/Areas/Topics: Distributed and Mobile Software Systems ; Energy and Economy ; Load Balancing in Smart Grids ; Parallel and High Performance Computing ; Smart Grids ; Software Engineering

Abstract: Pipelined parallelism was largely studied and successfully implemented, on shared nothing machines, in several join algorithms in the presence of ideal conditions of load balancing between processors and in the absence of data skew. The aim of pipelining is to allow flexible resource allocation while avoiding unnecessary disk input/output for intermediate join results in the treatment of multi-join queries. The main drawback of pipelining in existing algorithms is that communication and load balancing remain limited to the use of static approaches (generated during query optimization phase) based on hashing to re-distribute data over the network and therefore cannot solve data skew problem and load imbalance between processors on heterogeneous multi-processor architectures where the load of each processor may vary in a dynamic and unpredictable way. In this paper, we present a new parallel join algorithm allowing to solve the problem of data skew while guaranteeing perfect balancing properties, on heterogeneous multi-processor Shared Nothing architectures. The performance of this algorithm is analyzed using the scalable portable BSP (Bulk Synchronous Parallel) cost model. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.89.163.156

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Al Hajj Hassan, M. and Bamha, M. (2008). PIPELINED PARALLELISM IN MULTI-JOIN QUERIES ON HETEROGENEOUS SHARED NOTHING ARCHITECTURES. In Proceedings of the Third International Conference on Software and Data Technologies - Volume 1: ICSOFT; ISBN 978-989-8111-51-7; ISSN 2184-2833, SciTePress, pages 127-134. DOI: 10.5220/0001889901270134

@conference{icsoft08,
author={Mohamad {Al Hajj Hassan}. and Mostafa Bamha.},
title={PIPELINED PARALLELISM IN MULTI-JOIN QUERIES ON HETEROGENEOUS SHARED NOTHING ARCHITECTURES},
booktitle={Proceedings of the Third International Conference on Software and Data Technologies - Volume 1: ICSOFT},
year={2008},
pages={127-134},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001889901270134},
isbn={978-989-8111-51-7},
issn={2184-2833},
}

TY - CONF

JO - Proceedings of the Third International Conference on Software and Data Technologies - Volume 1: ICSOFT
TI - PIPELINED PARALLELISM IN MULTI-JOIN QUERIES ON HETEROGENEOUS SHARED NOTHING ARCHITECTURES
SN - 978-989-8111-51-7
IS - 2184-2833
AU - Al Hajj Hassan, M.
AU - Bamha, M.
PY - 2008
SP - 127
EP - 134
DO - 10.5220/0001889901270134
PB - SciTePress