loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Jonas Ricker 1 ; Simon Damm 1 ; Thorsten Holz 2 and Asja Fischer 1

Affiliations: 1 Ruhr University Bochum, Bochum, Germany ; 2 CISPA Helmholtz Center for Information Security, Saarbrücken, Germany

Keyword(s): Deepfake Detection, Diffusion Models, Generative Adversarial Networks, Frequency Analysis.

Abstract: In the course of the past few years, diffusion models (DMs) have reached an unprecedented level of visual quality. However, relatively little attention has been paid to the detection of DM-generated images, which is critical to prevent adverse impacts on our society. In contrast, generative adversarial networks (GANs), have been extensively studied from a forensic perspective. In this work, we therefore take the natural next step to evaluate whether previous methods can be used to detect images generated by DMs. Our experiments yield two key findings: (1) state-of-the-art GAN detectors are unable to reliably distinguish real from DM-generated images, but (2) re-training them on DM-generated images allows for almost perfect detection, which remarkably even generalizes to GANs. Together with a feature space analysis, our results lead to the hypothesis that DMs produce fewer detectable artifacts and are thus more difficult to detect compared to GANs. One possible reason for this is the absence of grid-like frequency artifacts in DM-generated images, which are a known weakness of GANs. However, we make the interesting observation that diffusion models tend to underestimate high frequencies, which we attribute to the learning objective. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.239.151.124

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Ricker, J.; Damm, S.; Holz, T. and Fischer, A. (2024). Towards the Detection of Diffusion Model Deepfakes. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP; ISBN 978-989-758-679-8; ISSN 2184-4321, SciTePress, pages 446-457. DOI: 10.5220/0012422000003660

@conference{visapp24,
author={Jonas Ricker. and Simon Damm. and Thorsten Holz. and Asja Fischer.},
title={Towards the Detection of Diffusion Model Deepfakes},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP},
year={2024},
pages={446-457},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012422000003660},
isbn={978-989-758-679-8},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP
TI - Towards the Detection of Diffusion Model Deepfakes
SN - 978-989-758-679-8
IS - 2184-4321
AU - Ricker, J.
AU - Damm, S.
AU - Holz, T.
AU - Fischer, A.
PY - 2024
SP - 446
EP - 457
DO - 10.5220/0012422000003660
PB - SciTePress