Authors:
Patrik Huber
1
;
Guosheng Hu
2
;
Rafael Tena
1
;
Pouria Mortazavian
3
;
Willem P. Koppen
1
;
William J. Christmas
1
;
Matthias Rätsch
4
and
Josef Kittler
1
Affiliations:
1
University of Surrey, United Kingdom
;
2
INRIA Grenoble Rhône-Alpes, France
;
3
Samsung Electronics Research Institute, United Kingdom
;
4
Reutlingen University, Germany
Keyword(s):
3D Morphable Face Model, 3D Face Reconstruction, Face Model Fitting, Pose Estimation, Shape Reconstruction, Open Source Software.
Related
Ontology
Subjects/Areas/Topics:
Applications
;
Applications and Services
;
Computer Vision, Visualization and Computer Graphics
;
Enterprise Information Systems
;
Geometry and Modeling
;
Human and Computer Interaction
;
Human-Computer Interaction
;
Image and Video Analysis
;
Image-Based Modeling
;
Pattern Recognition
;
Shape Representation and Matching
;
Software Engineering
Abstract:
3D Morphable Face Models are a powerful tool in computer vision. They consists of a PCA model of face
shape and colour information and allow to reconstruct a 3D face from a single 2D image. 3D Morphable
Face Models are used for 3D head pose estimation, face analysis, face recognition, and, more recently, facial
landmark detection and tracking. However, they are not as widely used as 2D methods - the process of building
and using a 3D model is much more involved.
In this paper, we present the Surrey Face Model, a multi-resolution 3D Morphable Model that we make
available to the public for non-commercial purposes. The model contains different mesh resolution levels
and landmark point annotations as well as metadata for texture remapping. Accompanying the model is a
lightweight open-source C++ library designed with simplicity and ease of integration as its foremost goals. In
addition to basic functionality, it contains pose estimation and face frontalisation algorithms. With th
e tools
presented in this paper, we aim to close two gaps. First, by offering different model resolution levels and fast
fitting functionality, we enable the use of a 3D Morphable Model in time-critical applications like tracking.
Second, the software library makes it easy for the community to adopt the 3D Morphable Face Model in their
research, and it offers a public place for collaboration.
(More)