Authors:
Claudio Ferrari
;
Stefano Berretti
;
Pietro Pala
and
Alberto Del Bimbo
Affiliation:
Media Integration and Communication Center, University of Florence, Florence and Italy
Keyword(s):
3DMM Construction, 3DMM Fitting, 3D Face Analysis.
Related
Ontology
Subjects/Areas/Topics:
Applications
;
Biomedical Engineering
;
Biomedical Signal Processing
;
Biometrics
;
Biometrics and Pattern Recognition
;
Multimedia
;
Multimedia Signal Processing
;
Pattern Recognition
;
Shape Representation
;
Software Engineering
;
Telecommunications
Abstract:
3D cameras for face capturing are quite common today thanks to their ease of use and affordable cost. The depth information they provide is mainly used to enhance face pose estimation and tracking, and face-background segmentation, while applications that require finer face details are usually not possible due to the low-resolution data acquired by such devices. In this paper, we propose a framework that allows us to derive high-quality 3D models of the face starting from corresponding low-resolution depth sequences acquired with a depth camera. To this end, we start by defining a solution that exploits temporal redundancy in a short-sequence of adjacent depth frames to remove most of the acquisition noise and produce an aggregated point cloud output with intermediate level details. Then, using a 3DMM specifically designed to support local and expression-related deformations of the face, we propose a two-steps 3DMM fitting solution: initially the model is deformed under the effect of
landmarks correspondences; subsequently, it is iteratively refined using points closeness updating guided by a mean-square optimization. Preliminary results show that the proposed solution is able to derive 3D models of the face with high visual quality; quantitative results also evidence the superiority of our approach with respect to methods that use one step fitting based on landmarks.
(More)