loading
Documents

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Anh Pham and Mohamed Eltabakh

Affiliation: Worcester Polytechnic Institute (WPI), United States

ISBN: 978-989-758-035-2

Keyword(s): Caching Techniques, Expensive User-defined Functions, Scientific Applications, Query Processing.

Related Ontology Subjects/Areas/Topics: Data Engineering ; Data Management and Quality ; Data Structures and Data Management Algorithms ; Databases and Data Security ; Query Processing and Optimization

Abstract: Expensive user-defined functions impose unique challenges to database management systems at query time. This is mostly due to the black-box nature of these functions, the in-ability to optimize their internals, and the potential inefficiency of the common optimization heuristics, e.g., “selection-push-down’. Moreover, the in- creasing diversity of modern scientific applications that depend on DBMSs and, at the same time, extensively use expensive UDFs is mandating the design and development of efficient techniques to support these expensive functions. In this paper, we propose the “FunctionGuard” system that leverages disk-based persistent caching in novel ways to achieve across-queries optimizations for expensive UDFs. The unique features of FunctionGuard include: (1) Dynamic extraction of dependencies between the UDFs and the data sources and identifying the potential cacheable functions, (2) Cache-aware query optimization through newly introduced query operators, (3) Proactive cach e refreshing that partially migrates the cost of the expensive calls from the query time to the idle and under-utilized times, and (4) Integration with the state-of-art techniques that generate efficient query plans under the presence of expensive functions. The system is implemented within PostgreSQL DBMS, and the results show the effectiveness of the proposed algorithms and optimizations. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 100.26.182.28

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pham, A. and Eltabakh, M. (2014). FunctionGuard - A Query Engine for Expensive Scientific Functions in Relational Databases.In Proceedings of 3rd International Conference on Data Management Technologies and Applications - Volume 1: DATA, ISBN 978-989-758-035-2, pages 95-106. DOI: 10.5220/0004992300950106

@conference{data14,
author={Anh Pham. and Mohamed Eltabakh.},
title={FunctionGuard - A Query Engine for Expensive Scientific Functions in Relational Databases},
booktitle={Proceedings of 3rd International Conference on Data Management Technologies and Applications - Volume 1: DATA,},
year={2014},
pages={95-106},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004992300950106},
isbn={978-989-758-035-2},
}

TY - CONF

JO - Proceedings of 3rd International Conference on Data Management Technologies and Applications - Volume 1: DATA,
TI - FunctionGuard - A Query Engine for Expensive Scientific Functions in Relational Databases
SN - 978-989-758-035-2
AU - Pham, A.
AU - Eltabakh, M.
PY - 2014
SP - 95
EP - 106
DO - 10.5220/0004992300950106

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.