loading
Documents

Research.Publish.Connect.

Paper

Authors: Parijat Shukla 1 and Arun K. Somani 2

Affiliations: 1 Xillinx, Inc., HITEC City, Hyderbad and India ; 2 Dept. of Electrical and Computer Engineering, Iowa State University, Ames, Iowa and U.S.A.

ISBN: 978-989-758-330-8

Keyword(s): Deduplication, Semi-structured Data, NoSQL, Big Data, Parallel Processing, GPGPU, Data Shaping.

Abstract: Several Big Data problems involve computing similarities between entities, such as records, documents, etc., in timely manner. Recent studies point that similarity-based deduplication techniques are efficient for document databases. Delta encoding-like techniques are commonly leveraged to compute similarities between documents. Operational requirements dictate low latency constraints. The previous researches do not consider parallel computing to deliver low latency delta encoding solutions. This paper makes two-fold contribution in context of delta encoding problem occurring in document databases: (1) develop a parallel processing-based technique to compute similarities between documents, and (2) design a GPU-based document cache framework to accelerate the performance of delta encoding pipeline. We experiment with real datasets. We achieve throughput of more than 500 similarity computations per millisecond. And the similarity compuatation framework achieves a throughput in the range of 237-312 MB per second which is up to 10X higher throughput when compared to the hashing-based approaches. (More)

PDF ImageFull Text

Download
Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.229.76.193

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Shukla, P. and Somani, A. (2018). Fast Document Similarity Computations using GPGPU.In Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, ISBN 978-989-758-330-8, pages 323-331. DOI: 10.5220/0006960303230331

@conference{kdir18,
author={Parijat Shukla. and Arun K. Somani.},
title={Fast Document Similarity Computations using GPGPU},
booktitle={Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR,},
year={2018},
pages={323-331},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006960303230331},
isbn={978-989-758-330-8},
}

TY - CONF

JO - Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR,
TI - Fast Document Similarity Computations using GPGPU
SN - 978-989-758-330-8
AU - Shukla, P.
AU - Somani, A.
PY - 2018
SP - 323
EP - 331
DO - 10.5220/0006960303230331

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.