loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Marshal Arijona Sinaga ; T. Basarrudin and Adila Alfa Krisnadhi

Affiliation: Faculty of Computer Science, University of Indonesia, Depok, Indonesia

Keyword(s): Representation Learning, Transformation-Equivariant, Mutual Information Estimation, Barber-Agakov, InfoNCE.

Abstract: The success of deep learning on computer vision tasks is due to the convolution layer being equivariant to the translation. Several works attempt to extend the notion of equivariance into more general transformations. Autoencoding variational transformation (AVT) achieves state of art by approaching the problem from the information theory perspective. The model involves the computation of mutual information, which leads to a more general transformation-equivariant representation model. In this research, we investigate the alternatives of AVT called variational transformation-equivariant (VTE). We utilize the Barber-Agakov and information noise contrastive mutual information estimation to optimize VTE. Furthermore, we also propose a sequential mechanism that involves a self-supervised learning model called predictive-transformation to train our VTE. Results of experiments demonstrate that VTE outperforms AVT on image classification tasks.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.119.107.96

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Sinaga, M.; Basarrudin, T. and Krisnadhi, A. (2022). Transformation-Equivariant Representation Learning with Barber-Agakov and InfoNCE Mutual Information Estimation. In Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - ICPRAM; ISBN 978-989-758-549-4; ISSN 2184-4313, SciTePress, pages 99-109. DOI: 10.5220/0010880400003122

@conference{icpram22,
author={Marshal Arijona Sinaga. and T. Basarrudin. and Adila Alfa Krisnadhi.},
title={Transformation-Equivariant Representation Learning with Barber-Agakov and InfoNCE Mutual Information Estimation},
booktitle={Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - ICPRAM},
year={2022},
pages={99-109},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010880400003122},
isbn={978-989-758-549-4},
issn={2184-4313},
}

TY - CONF

JO - Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - ICPRAM
TI - Transformation-Equivariant Representation Learning with Barber-Agakov and InfoNCE Mutual Information Estimation
SN - 978-989-758-549-4
IS - 2184-4313
AU - Sinaga, M.
AU - Basarrudin, T.
AU - Krisnadhi, A.
PY - 2022
SP - 99
EP - 109
DO - 10.5220/0010880400003122
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic