Authors:
Changan Zhu
;
Taryn Laurendeau
and
Chris Joslin
Affiliation:
School of Information Technology, Carleton University, 1125 Colonel By Drive, Ottawa, Canada
Keyword(s):
Stereo Vision, Disparity Enhancement, Image and Video Processing, Post Production, Visual Effects.
Abstract:
Extracting the live-action elements from videos has been a time-consuming process in the post-production pipeline. The disparity map, however, shows the order of elements in a scene by indicating the distance between the elements and the camera, which could potentially become an effective tool for separating videos into ordered layers and preserving the 3D structure of the elements. In this research, we explored the possibility of simplifying the live-action video element extraction technique with disparity sequences. We developed a five-view disparity estimation and enhancement system with a two-axis setup that helps reduce the occlusions in stereo vision. The system is independent from temporal reconstruction hence is compatible with both dynamic and stationary camera paths. Our results show that the disparities from our system have visually and quantitatively better performance than the traditional binocular stereo method, and its element extraction result is comparable with the e
xisting mature matting techniques in most cases. Ideally, the system design could be applied in cinematography by replacing the center camera with a cinematographic camera, and the output can be used for video object extraction, visual effects composition, video’s 2D to 3D conversion, or producing the training data for neural-network-based depth estimation research.
(More)