loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Eden Pereira da Silva 1 ; Eliaquim Monteiro Ramos 1 ; Leandro Tavares da Silva 2 ; 1 ; Jaime S. Cardoso 3 and Gilson A. Giraldi 1

Affiliations: 1 National Laboratory for Scientific Computing, Petrópolis, Brazil ; 2 Federal Center of Technology Education Celso Suckow da Fonseca, Petrópolis, Brazil ; 3 INESC TEC and University of Porto, Porto, Portugal

Keyword(s): Summarization, Cosine Similarity Metric, Total Variation, Autoencoder, K-means.

Abstract: Video summarization is an important tool considering the amount of data to analyze. Techniques in this area aim to yield synthetic and useful visual abstraction of the videos contents. Hence, in this paper we present a new summarization algorithm, based on image features, which is composed by the following steps: (i) Query video processing using cosine similarity metric and total variation smoothing to identify classes in the query sequence; (ii) With this result, build a labeled training set of frames; (iii) Generate the unlabeled training set composed by samples of the video database; (iv) Training a deep semi-supervised autoencoder; (v) Compute the K-means for each video separately, in the encoder space, with the number of clusters set as a percentage of the video size; (vi) Select key-frames in the K-means clusters to define the summaries. In this methodology, the query video is used to incorporate prior knowledge in the whole process through the obtained labeled data. The step ( iii) aims to include unknown patterns useful for the summarization process. We evaluate the methodology using some videos from OPV video database. We compare the performance of our algorithm with the VSum. The results indicate that the pipeline was well succeed in the summarization presenting a F-score value superior to VSum. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.159.116.24

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pereira da Silva, E.; Ramos, E.; Tavares da Silva, L.; Cardoso, J. and Giraldi, G. (2020). Video Summarization through Total Variation, Deep Semi-supervised Autoencoder and Clustering Algorithms. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP; ISBN 978-989-758-402-2; ISSN 2184-4321, SciTePress, pages 315-322. DOI: 10.5220/0008969303150322

@conference{visapp20,
author={Eden {Pereira da Silva}. and Eliaquim Monteiro Ramos. and Leandro {Tavares da Silva}. and Jaime S. Cardoso. and Gilson A. Giraldi.},
title={Video Summarization through Total Variation, Deep Semi-supervised Autoencoder and Clustering Algorithms},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP},
year={2020},
pages={315-322},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008969303150322},
isbn={978-989-758-402-2},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP
TI - Video Summarization through Total Variation, Deep Semi-supervised Autoencoder and Clustering Algorithms
SN - 978-989-758-402-2
IS - 2184-4321
AU - Pereira da Silva, E.
AU - Ramos, E.
AU - Tavares da Silva, L.
AU - Cardoso, J.
AU - Giraldi, G.
PY - 2020
SP - 315
EP - 322
DO - 10.5220/0008969303150322
PB - SciTePress