Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices

David Ding, Ivan Carvalho, Ramon Lawrence

2023

Abstract

Efficiently querying data on embedded sensor and IoT devices is challenging given the very limited memory and CPU resources. With the increasing volumes of collected data, it is critical to process, filter, and manipulate data on the edge devices where it is collected to improve efficiency and reduce network transmissions. Existing embedded index structures do not adapt to the data distribution and characteristics. This paper demonstrates how applying learned indexes that develop space efficient summaries of the data can dramatically improve the query performance and predictability. Learned indexes based on linear approximations can reduce the query I/O by 50 to 90% and improve query throughput by a factor of 2 to 5, while only requiring a few kilobytes of RAM. Experimental results on a variety of time series data sets demonstrate the advantages of learned indexes that considerably improve over the state-of-the-art index algorithms.

Paper Citation

in Harvard Style

Ding D., Carvalho I. and Lawrence R. (2023). Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices. In Proceedings of the 12th International Conference on Sensor Networks - Volume 1: SENSORNETS, ISBN 978-989-758-635-4, pages 23-31. DOI: 10.5220/0011692900003399

in Bibtex Style

@conference{sensornets23,
author={David Ding and Ivan Carvalho and Ramon Lawrence},
title={Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices},
booktitle={Proceedings of the 12th International Conference on Sensor Networks - Volume 1: SENSORNETS,},
year={2023},
pages={23-31},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011692900003399},
isbn={978-989-758-635-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Sensor Networks - Volume 1: SENSORNETS,
TI - Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices
SN - 978-989-758-635-4
AU - Ding D.
AU - Carvalho I.
AU - Lawrence R.
PY - 2023
SP - 23
EP - 31
DO - 10.5220/0011692900003399