Authors:
Maarten Dumont
1
;
Steven Maesen
1
;
Sammy Rogmans
2
and
Philippe Bekaert
1
Affiliations:
1
Hasselt University – tUL – IBBT, Expertise centre for Digital Media, Belgium
;
2
Hasselt University – tUL – IBBT, Expertise centre for Digital Media; Multimedia Group, IMEC, Belgium
Keyword(s):
Prototype, practical, video chat, eye-gaze correction, GPU, real-time.
Related
Ontology
Subjects/Areas/Topics:
Design and Implementation of Signal Processing Systems
;
IPTV, VoIP, Web Conferencing
;
Multimedia
;
Multimedia and Communications
;
Multimedia Systems and Applications
;
Telecommunications
Abstract:
We present a fully functional prototype to convincingly restore eye contact between two video chat participants, with a minimal amount of constraints. The proposed six-fold camera setup is easily integrated into the monitor frame, and is used to interpolate an image as if its virtual camera captured the image through a transparent screen. The peer user has a large freedom of movement, resulting in system specifications that enable genuine practical usage. Our software framework thereby harnesses the powerful computational resources inside graphics hardware, to achieve real-time performance up to 30 frames per second for 800 × 600 resolution images. Furthermore, an optimal set of finetuned parameters are presented, that optimizes the end-to-end performance of the application, and therefore is still able to achieve high subjective visual quality.