Authors:
Jon Goenetxea
1
;
Luis Unzueta
1
;
Unai Elordi
1
;
Oihana Otaegui
1
and
Fadi Dornaika
2
;
3
Affiliations:
1
Vicomtech, Parque Científico y Tecnológico de Gipuzkoa, Donostia, San Sebastian, Spain
;
2
Computer Engineering Faculty, University of the Basque Country EHU/UPV, Manuel de Lardizabal, 1, 20018 Donostia, Spain
;
3
Ikerbasque, Basque Foundation for Science, Alameda Urquijo, 36-5, Plaza Bizkaia, 48011 Bilbao, Spain
Keyword(s):
Facial Feature Point Detection, Gesture Recognition, Multi-task Learning.
Abstract:
The communication between persons includes several channels to exchange information between individuals. The non-verbal communication contains valuable information about the context of the conversation and it is a key element to understand the entire interaction. The facial expressions are a representative example of this kind of non-verbal communication and a valuable element to improve human-machine interaction interfaces. Using images captured by a monocular camera, automatic facial analysis systems can extract facial expressions to improve human-machine interactions. However, there are several technical factors to consider, including possible computational limitations (e.g. autonomous robots), or data throughput (e.g. centralized computation server). Considering the possible limitations, this work presents an efficient method to detect a set of 68 facial feature points and a set of key facial gestures at the same time. The output of this method includes valuable information to un
derstand the context of communication and improve the response of automatic human-machine interaction systems.
(More)