Privacy Preservation in Image Classification Using Seam Doppelganger

Nishitha Prakash, James Pope

2024

Abstract

Cloud storage usage continues to increase and many cloud storage sites use advanced machine learning models to classify user’s images for various purposes, possibly malicious in nature. This introduces very serious privacy concerns where users want to store and view their images on the cloud storage but do not want the models to be able to accurately classify their images. This is a difficult problem and there are many proposed solutions including the seam doppelganger algorithm. Seam Doppelganger uses the seam carving content-aware resizing approach to modify the image in a way that is still human-understandable and has been shown to reduce model accuracy. However, the approach was not tested with different classifiers, is not able to provide complete restoration, and uses a limited dataset. We propose several modifications to the Seam Doppelganger algorithm to better enhance the privacy of the image while keeping it human-readable and able to be fully restored. We modify the energy function to use a histogram of gradients, comprehensively compare seam selection, and evaluate with several pre-trained (on ImageNet and Kaggle datasets) image classification models. We use the structural similarity index measure (SSIM) to determine the degree of distortion as a proxy for human understanding. The approach degrades the classification performance by 70% and guarantees 100% restoration of the original image.

Paper Citation

in Harvard Style

Prakash N. and Pope J. (2024). Privacy Preservation in Image Classification Using Seam Doppelganger. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 342-349. DOI: 10.5220/0012316100003660

in Bibtex Style

@conference{visapp24,
author={Nishitha Prakash and James Pope},
title={Privacy Preservation in Image Classification Using Seam Doppelganger},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP},
year={2024},
pages={342-349},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012316100003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP
TI - Privacy Preservation in Image Classification Using Seam Doppelganger
SN - 978-989-758-679-8
AU - Prakash N.
AU - Pope J.
PY - 2024
SP - 342
EP - 349
DO - 10.5220/0012316100003660
PB - SciTePress