Image-based Classification of Swiss Traditional Costumes using Contextual Features

Artem Khatchatourov, Christoph Stamm

Abstract

In this work we propose a method for feature-based clothing recognition, and prove its applicability by performing image-based recognition of Swiss traditional costumes. We employ an estimation of a simplified human skeleton (a poselet) to extract visually indistinguishable but reproducible features. The descriptors of those features are constructed, while accounting for possible displacement of clothes along human body. The similarity metrics mean squared error and correlation coefficient are surveyed, and color spaces YIQ and CIELAB are investigated for their ability to isolate scene brightness in a separate channel. We show that the model trained with mean squared error performs best in the CIELAB color space and achieves an F0.5-score of 0.77. Furthermore, we show that omission of the brightness channel produces less biased, but overall poorer descriptors.

Download


Paper Citation


in Harvard Style

Khatchatourov A. and Stamm C. (2020). Image-based Classification of Swiss Traditional Costumes using Contextual Features.In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, ISBN 978-989-758-402-2, pages 412-420. DOI: 10.5220/0009102404120420


in Bibtex Style

@conference{visapp20,
author={Artem Khatchatourov and Christoph Stamm},
title={Image-based Classification of Swiss Traditional Costumes using Contextual Features},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,},
year={2020},
pages={412-420},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009102404120420},
isbn={978-989-758-402-2},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,
TI - Image-based Classification of Swiss Traditional Costumes using Contextual Features
SN - 978-989-758-402-2
AU - Khatchatourov A.
AU - Stamm C.
PY - 2020
SP - 412
EP - 420
DO - 10.5220/0009102404120420