loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Catarina Runa Miranda and Verónica Costa Orvalho

Affiliation: Universidade do Porto, Portugal

Keyword(s): Facial Motion Capture, Emotion and Expressions recognition, Virtual Reality.

Related Ontology Subjects/Areas/Topics: Applications and Services ; Computer Vision, Visualization and Computer Graphics ; Enterprise Information Systems ; Features Extraction ; Human and Computer Interaction ; Human-Computer Interaction ; Image and Video Analysis ; Motion, Tracking and Stereo Vision ; Optical Flow and Motion Analyses

Abstract: Humans rely on facial expressions to transmit information, like mood and intentions, usually not provided by the verbal communication channels. The recent advances in Virtual Reality (VR) at consumer-level (Oculus VR 2014) created a shift in the way we interact with each other and digital media. Today, we can enter a virtual environment and communicate through a 3D character. Hence, to the reproduction of the users’ facial expressions in VR scenarios, we need the on-the-fly animation of the embodied 3D characters. However, current facial animation approaches with Motion Capture (MoCap) are disabled due to persistent partial occlusions produced by the VR headsets. The unique solution available for this occlusion problem is not suitable for consumer-level applications, depending on complex hardware and calibrations. In this work, we propose consumer-level methods for facial MoCap under VR environments. We start by deploying an occlusions-support method for generic facial MoCap systems. Then, we extract facial features to create Random Forests algorithms that accurately estimate emotions and movements in occluded facial regions. Through our novel methods, MoCap approaches are able to track non-occluded facial movements and estimate movements in occluded regions, without additional hardware or tedious calibrations. We deliver and validate solutions to facilitate face-to-face communication through facial expressions in VR environments. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.236.86.184

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Runa Miranda, C. and Costa Orvalho, V. (2016). Assessing Facial Expressions in Virtual Reality Environments. In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2016) - Volume 3: VISAPP; ISBN 978-989-758-175-5; ISSN 2184-4321, SciTePress, pages 486-497. DOI: 10.5220/0005716604860497

@conference{visapp16,
author={Catarina {Runa Miranda}. and Verónica {Costa Orvalho}.},
title={Assessing Facial Expressions in Virtual Reality Environments},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2016) - Volume 3: VISAPP},
year={2016},
pages={486-497},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005716604860497},
isbn={978-989-758-175-5},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2016) - Volume 3: VISAPP
TI - Assessing Facial Expressions in Virtual Reality Environments
SN - 978-989-758-175-5
IS - 2184-4321
AU - Runa Miranda, C.
AU - Costa Orvalho, V.
PY - 2016
SP - 486
EP - 497
DO - 10.5220/0005716604860497
PB - SciTePress