Facial Exposure Quality Estimation for Aesthetic Evaluation

Mathias Gudiksen, Sebastian Falk, Lasse Nymark Hansen, Frederik Brønnum Jensen, Andreas Møgelmose

2021

Abstract

In recent years, computer vision systems have excelled in detection and classification problems. Many vision tasks, however, are not easily reduced to such a problem. Often, more subjective measures must be taken into account. Such problems have seen significantly less research. In this paper, we tackle the problem of aesthetic evaluation of photographs, particularly with respect to exposure. We propose and compare three methods for estimating the exposure value of a photograph using regression: SVM on handcrafted features, NN using image histograms, and the VGG19 CNN. A dataset containing 844 images with different exposure values was created. The methods were tested on both the full photographs and a cropped version of the dataset. Our methods estimate the exposure value of our test set with an MAE of 0.496 using SVM, an MAE of 0.498 using NN, and an MAE of 0.566 using VGG19, on the cropped dataset. Without a face detector we achieve an MAE of 0.702 for SVM, 0.766 using NN, and 1.560 for VGG19. The models based on handcrafted features or histograms both outperform the CNN in the case of simpler scenes, with the histogram outperforming the handcrafted features slightly. However, on more complicated scenes, the CNN shows promise. In most cases, handcrafted features seem to be the better option, despite this, the use of CNNs cannot be ruled out entirely.

Paper Citation

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP
TI - Facial Exposure Quality Estimation for Aesthetic Evaluation
SN - 978-989-758-488-6
AU - Gudiksen M.
AU - Falk S.
AU - Hansen L.
AU - Jensen F.
AU - Møgelmose A.
PY - 2021
SP - 247
EP - 255
DO - 10.5220/0010141102470255
PB - SciTePress

in Harvard Style

Gudiksen M., Falk S., Hansen L., Jensen F. and Møgelmose A. (2021). Facial Exposure Quality Estimation for Aesthetic Evaluation. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 247-255. DOI: 10.5220/0010141102470255

in Bibtex Style

@conference{visapp21,
author={Mathias Gudiksen and Sebastian Falk and Lasse Nymark Hansen and Frederik Brønnum Jensen and Andreas Møgelmose},
title={Facial Exposure Quality Estimation for Aesthetic Evaluation},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP},
year={2021},
pages={247-255},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010141102470255},
isbn={978-989-758-488-6},
}