Mask-guided Image Classification with Siamese Networks

Hiba Alqasir, Damien Muselet, Christophe Ducottet

2020

Abstract

This paper deals with a CNN-based image classification task where the class of each image depends on a small detail in the image. Our original idea consists in providing a binary mask to the network so that it knows where is located the important information. This mask as well as the color image are provided as inputs to a siamese network. A contrastive loss function controls the projection of the network outputs in an embedding space enforcing the extraction of image features at the location proposed by the mask. This solution is tested on a real application whose aim is to secure the boarding on ski chairlifts by checking if the safety bar of the carrier is open or closed. Each chairlift has its own safety bar masks (open and close) and we propose to exploit this additional data to help the image classification between close or open safety bar. We show that the use of a siamese network allows to learn a single model that performs very well on 20 different skilifts.

Paper Citation

in Harvard Style

Alqasir H., Muselet D. and Ducottet C. (2020). Mask-guided Image Classification with Siamese Networks. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 536-543. DOI: 10.5220/0009180005360543

in Bibtex Style

@conference{visapp20,
author={Hiba Alqasir and Damien Muselet and Christophe Ducottet},
title={Mask-guided Image Classification with Siamese Networks},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP},
year={2020},
pages={536-543},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009180005360543},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP
TI - Mask-guided Image Classification with Siamese Networks
SN - 978-989-758-402-2
AU - Alqasir H.
AU - Muselet D.
AU - Ducottet C.
PY - 2020
SP - 536
EP - 543
DO - 10.5220/0009180005360543
PB - SciTePress