loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Aloisio Dourado 1 ; Hansung Kim 2 ; Teofilo E. de Campos 1 and Adrian Hilton 2

Affiliations: 1 University of Brasilia, Brasilia, Brazil ; 2 CVSSP, University of Surrey, Surrey, U.K.

Keyword(s): Semantic Scene Completion, 360-Degree Scene Reconstruction, Scene Understanding, 360-Degree Stereo Images.

Abstract: We present a method for Semantic Scene Completion (SSC) of complete indoor scenes from a single 360◦ RGB image and corresponding depth map using a Deep Convolution Neural Network that takes advantage of existing datasets of synthetic and real RGB-D images for training. Recent works on SSC only perform occupancy prediction of small regions of the room covered by the field-of-view of the sensor in use, which implies the need of multiple images to cover the whole scene, being an inappropriate method for dynamic scenes. Our approach uses only a single 360◦ image with its corresponding depth map to infer the occupancy and semantic labels of the whole room. Using one single image is important to allow predictions with no previous knowledge of the scene and enable extension to dynamic scene applications. We evaluated our method on two 360◦ image datasets: a high-quality 360◦ RGB-D dataset gathered with a Matterport sensor and low-quality 360◦ RGB-D images generated with a pair of commercial 360◦ cameras and stereo matching. The experiments showed that the proposed pipeline performs SSC not only with Matterport cameras but also with more affordable 360◦ cameras, which adds a great number of potential applications, including immersive spatial audio reproduction, augmented reality, assistive computing and robotics. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.97.14.87

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Dourado, A. ; Kim, H. ; E. de Campos, T. and Hilton, A. (2020). Semantic Scene Completion from a Single 360-Degree Image and Depth Map. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP; ISBN 978-989-758-402-2; ISSN 2184-4321, SciTePress, pages 36-46. DOI: 10.5220/0008877700360046

@conference{visapp20,
author={Aloisio Dourado and Hansung Kim and Teofilo {E. de Campos} and Adrian Hilton},
title={Semantic Scene Completion from a Single 360-Degree Image and Depth Map},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP},
year={2020},
pages={36-46},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008877700360046},
isbn={978-989-758-402-2},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP
TI - Semantic Scene Completion from a Single 360-Degree Image and Depth Map
SN - 978-989-758-402-2
IS - 2184-4321
AU - Dourado, A.
AU - Kim, H.
AU - E. de Campos, T.
AU - Hilton, A.
PY - 2020
SP - 36
EP - 46
DO - 10.5220/0008877700360046
PB - SciTePress