Authors:
Adam Riečický
1
;
Martin Madaras
2
;
Michal Piovarci
3
and
Roman Durikovic
4
Affiliations:
1
Comenius University and Skeletex Research, Slovak Republic
;
2
University of Technology, Comenius University and Skeletex Research, Austria
;
3
Saarland University and Skeletex Research, Germany
;
4
Comenius University, Slovak Republic
Keyword(s):
Motion Capture, Inertial Suit, Optical System, Optical-inertial Synchronization, Silhouette Tracking.
Related
Ontology
Subjects/Areas/Topics:
Animation and Simulation
;
Augmented, Mixed and Virtual Environments
;
Computer Vision, Visualization and Computer Graphics
;
Human Figure Animation
;
Interactive Environments
;
Virtual Tours
Abstract:
We propose a method for synchronization of an inertial motion capture suit and a single camera optical setup.
Proposed synchronization is based on an iterative optimization of an energy potential in image space, minimizing
the error between the camera image and a rendered virtual representation of the scene. For each frame,
an input skeleton pose from the mocap suit is used to render a silhouette of a subject. Moreover, the local
neighborhood around the last known position is searched by matching the silhouette to the distance transform
representation of the camera image based on Chamfer matching. Using the combination of the camera tracking
and the inertial motion capture suit, it is possible to retrieve the position of the joints that are hidden from the
camera view. Moreover, it is possible to capture the position even if it cannot be captured by the suit sensors.
Our system can be used for both real-time tracking and off-line post-processing of already captured mocap
data.