loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Affiliation

Select a Subject

Ghent University – imec – IDLab, Department of Electronics and Information Systems, Ghent and Belgium
Context (please use complete words only)
Field
Sort by

1 Papers

Eliminating Noise in the Matrix Profile

Topics: Information Retrieval; Advanced Learning Methods; Data Mining and Algorithms for Big Data

Authors: Dieter De Paepe , Olivier Janssens and Sofie Van Hoecke

Affiliation: Ghent University – imec – IDLab, Department of Electronics and Information Systems, Ghent and Belgium

Digital Object Identifier: 10.5220/0007314100830093

Proceedings of ICPRAM 2019, ISBN: 978-989-758-351-3

Collapse Button Quick Abstract
As companies are increasingly measuring their products and services, the amount of time series data is rising and techniques to extract usable information are needed. One recently developed data mining technique for time series is the Matrix Profile. It consists of the smallest z-normalized Euclidean distance of each subsequence of a time series to all other subsequences of another series. It has been used for motif and discord discovery, for segmentation and as building block for other techniques. One side effect of the z-normalization used is that small fluctuations on flat signals are upscaled. This can lead to high and unintuitive distances for very similar subsequences from noisy data. We determined an analytic method to estimate and remove the effects of this noise, adding only a single, intuitive parameter to the calculation of the Matrix Profile. This paper explains our method and demonstrates it by performing discord discovery on the Numenta Anomaly Benchmark and by segmenting the PAMAP2 activity dataset. We find that our technique results in a more intuitive Matrix Profile and provides improved results in both usecases for series containing many flat, noisy subsequences. Since our technique is an extension of the Matrix Profile, it can be applied to any of the various tasks that could be solved by it, improving results where data contains flat and noisy sequences.
Collapse Button Related Ontology Subjects/Areas/Topics (6)
Applications

Information Retrieval

Pattern Recognition

Data Engineering

Ontologies and the Semantic Web

Software Engineering

Topic(s):

Filter listed results, by

Author
Locate Author in list below
Add Author(s) to filter:

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic