Image-based Classification of Swiss Traditional Costumes using Contextual Features

Artem Khatchatourov, Christoph Stamm

2020

Abstract

In this work we propose a method for feature-based clothing recognition, and prove its applicability by performing image-based recognition of Swiss traditional costumes. We employ an estimation of a simplified human skeleton (a poselet) to extract visually indistinguishable but reproducible features. The descriptors of those features are constructed, while accounting for possible displacement of clothes along human body. The similarity metrics mean squared error and correlation coefficient are surveyed, and color spaces YIQ and CIELAB are investigated for their ability to isolate scene brightness in a separate channel. We show that the model trained with mean squared error performs best in the CIELAB color space and achieves an F0.5-score of 0.77. Furthermore, we show that omission of the brightness channel produces less biased, but overall poorer descriptors.

Paper Citation

in Harvard Style

Khatchatourov A. and Stamm C. (2020). Image-based Classification of Swiss Traditional Costumes using Contextual Features. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 412-420. DOI: 10.5220/0009102404120420

in Bibtex Style

@conference{visapp20,
author={Artem Khatchatourov and Christoph Stamm},
title={Image-based Classification of Swiss Traditional Costumes using Contextual Features},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP},
year={2020},
pages={412-420},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009102404120420},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP
TI - Image-based Classification of Swiss Traditional Costumes using Contextual Features
SN - 978-989-758-402-2
AU - Khatchatourov A.
AU - Stamm C.
PY - 2020
SP - 412
EP - 420
DO - 10.5220/0009102404120420
PB - SciTePress