Authors:
Katsuya Sugawara
1
;
Ryosuke Tsuruga
2
;
Toru Abe
2
and
Takuo Suganuma
2
Affiliations:
1
NTT Resonant Inc., Japan
;
2
Tohoku University, Japan
Keyword(s):
Region Extraction, Multiple Moving Objects, Image Sequence, Depth Sequence.
Related
Ontology
Subjects/Areas/Topics:
Computer Vision, Visualization and Computer Graphics
;
Image and Video Analysis
;
Motion, Tracking and Stereo Vision
;
Segmentation and Grouping
;
Tracking and Visual Navigation
Abstract:
This paper proposes a novel method for extracting the regions of multiple moving objects with an image and a depth sequence. In addition to image features, diverse types of features, such as depth and image-depth-derived 3D motion, have been used in existing methods for improving the accuracy and robustness of object region extraction. Most of the existing methods determine individual object regions according to the spatial-temporal similarities of such features, i.e., they regard a spatial-temporal area of uniform features as a region sequence corresponding to the same object. Consequently, the depth features in a moving object region, where the depth varies with frames, and the motion features in a nonrigid or articulated object region, where the motion varies with parts, cannot be effectively used for object region extraction. To deal with these difficulties, our proposed method extracts the region sequences of individual moving objects according to depth feature similarity adjust
ed by each object movement and motion feature similarity computed only in adjacent parts. Through the experiments on scenes where a person moves a box, we demonstrate the effectiveness of the proposed method in extracting the regions of multiple moving objects.
(More)