loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Aleksey Burdakov 1 ; Uriy Grigorev 1 ; Andrey Ploutenko 2 and Oleg Ermakov 1

Affiliations: 1 Bauman Moscow State Technical University, Moscow, Russia ; 2 Amur State University, Blagoveschensk, Russia

Keyword(s): Lambda Architecture, Stream Processing, Approximate Query Processing, Sapprox.

Abstract: The lambda architecture is widely used to implement streaming data processing systems. These systems create batch views (subsets of data) at the Serving Layer to speed up queries. This operation takes significant time. The article proposes a novel approach to lambda architecture implementation. A new method for Approximate Query Processing in a system with Lambda Architecture (LA-AQP) significantly reduces aggregate (sum, count, avg) calculation error. This is achieved by using a new way of calculating the reading segments probabilities. The developed method is compared with the modern Sapprox method for processing large distributed data. Experiments demonstrate that LA-AQP almost equals Sapprox in terms of volume and time characteristics. The introduced accuracy measures (δ-accuracy and ε-accuracy) are up to two times better than Sapprox for total aggregate calculation. Aggregate values can vary greatly from segment to segment. It is shown that in this case the LA-AQP method gives a small error in the total aggregate calculation in contrast to Sapprox. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.142.35.75

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Burdakov, A.; Grigorev, U.; Ploutenko, A. and Ermakov, O. (2021). Approximate Query Processing for Lambda Architecture. In Proceedings of the 6th International Conference on Internet of Things, Big Data and Security - IoTBDS; ISBN 978-989-758-504-3; ISSN 2184-4976, SciTePress, pages 253-261. DOI: 10.5220/0010465802530261

@conference{iotbds21,
author={Aleksey Burdakov. and Uriy Grigorev. and Andrey Ploutenko. and Oleg Ermakov.},
title={Approximate Query Processing for Lambda Architecture},
booktitle={Proceedings of the 6th International Conference on Internet of Things, Big Data and Security - IoTBDS},
year={2021},
pages={253-261},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010465802530261},
isbn={978-989-758-504-3},
issn={2184-4976},
}

TY - CONF

JO - Proceedings of the 6th International Conference on Internet of Things, Big Data and Security - IoTBDS
TI - Approximate Query Processing for Lambda Architecture
SN - 978-989-758-504-3
IS - 2184-4976
AU - Burdakov, A.
AU - Grigorev, U.
AU - Ploutenko, A.
AU - Ermakov, O.
PY - 2021
SP - 253
EP - 261
DO - 10.5220/0010465802530261
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic