Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning

Marco Filax, Tim Gonschorek, Frank Ortmeier

Abstract

Recognizing grocery products at scale is an open issue for computer-vision systems due to their subtle visual differences. Typically the problem is addressed as a classification problem, e.g., by learning a CNN, for which all classes that are to be distinguished need to be known at training time. We instead observe that the products within stores change over time. Sometimes new products are put on shelves, or existing appearances of products are changed. In this work, we demonstrate the use of deep metric learning for grocery recognition, whereby classes during inference are unknown while training. We also propose a new triplet mining strategy that uses all known classes during training while preserving the ability to perform cross-folded validation. We demonstrate the applicability of the proposed mining strategy using different, publicly available real-world grocery datasets. The proposed approach preserves the ability to distinguish previously unseen groceries while increasing the precision by up to 5 percent.

Download


Paper Citation


in Harvard Style

Filax M., Gonschorek T. and Ortmeier F. (2021). Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning.In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, ISBN 978-989-758-488-6, pages 498-505. DOI: 10.5220/0010322304980505


in Bibtex Style

@conference{visapp21,
author={Marco Filax and Tim Gonschorek and Frank Ortmeier},
title={Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,},
year={2021},
pages={498-505},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010322304980505},
isbn={978-989-758-488-6},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP,
TI - Grocery Recognition in the Wild: A New Mining Strategy for Metric Learning
SN - 978-989-758-488-6
AU - Filax M.
AU - Gonschorek T.
AU - Ortmeier F.
PY - 2021
SP - 498
EP - 505
DO - 10.5220/0010322304980505