Authors:
Paul-Dumitru Orășan
;
Alexandra-Ioana Albu
and
Gabriela Czibula
Affiliation:
Department of Computer Science, Babeş-Bolyai University, M. Kogalniceanu nr. 1, Cluj-Napoca, Romania
Keyword(s):
Semi-Supervised Learning, Generative Models, Diffusion Models, Image Classification.
Abstract:
Diffusion models have revolutionized the field of generative machine learning due to their effectiveness in capturing complex, multimodal data distributions. Semi-supervised learning represents a technique that allows the extraction of information from a large corpus of unlabeled data, assuming that a small subset of labeled data is provided. While many generative methods have been previously used in semi-supervised learning tasks, only few approaches have integrated diffusion models in such a context. In this work, we are adapting state-of-the-art generative diffusion models to the problem of semi-supervised image classification. We propose Diff-SySC, a new semi-supervised, pseudo-labeling pipeline which uses a diffusion model to learn the conditional probability distribution characterizing the label generation process. Experimental evaluations highlight the robustness of Diff-SySC when evaluated on image classification benchmarks and show that it outperforms related work approaches
on CIFAR-10 and STL-10, while achieving competitive performance on CIFAR-100. Overall, our proposed method outperforms the related work in 90.74% of the cases.
(More)