How Quality Affects Deep Neural Networks in Fine-Grained Image Classification

Joseph Smith, Zheming Zuo, Jonathan Stonehouse, Boguslaw Obara

2024

Abstract

In this paper, we propose a No-Reference Image Quality Assessment (NRIQA) guided cut-off point selection (CPS) strategy to enhance the performance of a fine-grained classification system. Scores given by existing NRIQA methods on the same image may vary and not be as independent of natural image augmentations as expected, which weakens their connection and explainability to fine-grained image classification. Taking the three most commonly adopted image augmentation configurations – cropping, rotating, and blurring – as the entry point, we formulate a two-step mechanism for selecting the most discriminative subset from a given image dataset by considering both the confidence of model predictions and the density distribution of image qualities over several NRIQA methods. Concretely, the cut-off points yielded by those methods are aggregated via majority voting to inform the process of image subset selection. The efficacy and efficiency of such a mechanism have been confirmed by comparing the models being trained on high-quality images against a combination of high- and low-quality ones, with a range of 0.7% to 4.2% improvement on a commercial product dataset in terms of mean accuracy through four deep neural classifiers. The robustness of the mechanism has been proven by the observations that all the selected high-quality images can work jointly with 70% low-quality images with 1.3% of classification precision sacrificed when using ResNet34 in an ablation study.

Paper Citation

in Harvard Style

Smith J., Zuo Z., Stonehouse J. and Obara B. (2024). How Quality Affects Deep Neural Networks in Fine-Grained Image Classification. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 448-457. DOI: 10.5220/0012359200003660

in Bibtex Style

@conference{visapp24,
author={Joseph Smith and Zheming Zuo and Jonathan Stonehouse and Boguslaw Obara},
title={How Quality Affects Deep Neural Networks in Fine-Grained Image Classification},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP},
year={2024},
pages={448-457},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012359200003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP
TI - How Quality Affects Deep Neural Networks in Fine-Grained Image Classification
SN - 978-989-758-679-8
AU - Smith J.
AU - Zuo Z.
AU - Stonehouse J.
AU - Obara B.
PY - 2024
SP - 448
EP - 457
DO - 10.5220/0012359200003660
PB - SciTePress