Improving Pseudo-Labelling and Enhancing Robustness for Semi-Supervised Domain Generalization

Adnan Khan, Mai A. Shaaban, Muhammad Haris Khan

2024

Abstract

Beyond attaining domain generalization (DG), visual recognition models should also be data-efficient during learning by leveraging limited labels. We study the problem of Semi-Supervised Domain Generalization (SSDG) which is crucial for real-world applications like automated healthcare. SSDG requires learning a cross-domain generalizable model when the given training data is only partially labelled. Empirical investigations reveal that the DG methods tend to underperform in SSDG settings, likely because they are unable to exploit the unlabelled data. Semi-supervised learning (SSL) shows improved but still inferior results compared to fully-supervised learning. A key challenge, faced by the best performing SSL-based SSDG methods, is selecting accurate pseudo-labels under multiple domain shifts and reducing overfitting to source domains under limited labels. In this work, we propose new SSDG approach, which utilizes a novel uncertainty-guided pseudo-labelling with model averaging (UPLM). Our uncertainty-guided pseudo-labelling (UPL) uses model uncertainty to improve pseudo-labelling selection, addressing poor model calibration under multi-source unla-belled data. The UPL technique, enhanced by our novel model averaging (MA) strategy, mitigates overfitting to source domains with limited labels. Extensive experiments on key representative DG datasets suggest that our method demonstrates effectiveness against existing methods. Our code and chosen labelled data seeds are available on GitHub: https://github.com/Adnan-Khan7/UPLM.

Paper Citation

in Harvard Style

Khan A., Shaaban M. and Khan M. (2024). Improving Pseudo-Labelling and Enhancing Robustness for Semi-Supervised Domain Generalization. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 293-300. DOI: 10.5220/0012269400003660

in Bibtex Style

@conference{visapp24,
author={Adnan Khan and Mai A. Shaaban and Muhammad Haris Khan},
title={Improving Pseudo-Labelling and Enhancing Robustness for Semi-Supervised Domain Generalization},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP},
year={2024},
pages={293-300},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012269400003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP
TI - Improving Pseudo-Labelling and Enhancing Robustness for Semi-Supervised Domain Generalization
SN - 978-989-758-679-8
AU - Khan A.
AU - Shaaban M.
AU - Khan M.
PY - 2024
SP - 293
EP - 300
DO - 10.5220/0012269400003660
PB - SciTePress