Using Local Refinements on 360 Stitching from Dual-fisheye Cameras

Rafael Roberto, Daniel Perazzo, João Lima, Veronica Teichrieb, Jonysberg Quintino, Fabio B. da Silva, Andre Santos, Helder Pinho

Abstract

Full panoramic images have several applications, ranging from virtual reality to 360º broadcasting. Such visualization method is growing, especially after the popularization of dual-fisheye cameras, which are compact and easy-to-use 360º imaging devices, and low-cost platforms that allow immersive experiences. However, low-quality registration and compositing in which artifacts are noticeable in the stitching area can harm the user experience. Although it is challenging to compose such images due to their narrow overlap area, recent works can provide good results when performing a global alignment. Nevertheless, they often cause artifacts since global alignment is not able to address every aspect of an image. In this work, we present a stitching method that performs local refinements to improve the registration and compositing quality of 360º images and videos. It builds on a feature clustering approach for global alignment. The proposed technique applies seam estimation and rigid moving least squares to remove undesired artifacts locally. Finally, we evaluate both to select the best result between them using a seam evaluation metric. Experiments showed that our method reduced the stitching error in at least 42.56% for images and 49.45% for videos when compared with existing techniques. Moreover, it provided the best results in all tested images and in 94.52% of the video frames.

Download


Paper Citation


in Harvard Style

Roberto R., Perazzo D., Lima J., Teichrieb V., Quintino J., B. da Silva F., Santos A. and Pinho H. (2020). Using Local Refinements on 360 Stitching from Dual-fisheye Cameras.In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, ISBN 978-989-758-402-2, pages 17-26. DOI: 10.5220/0008874100170026


in Bibtex Style

@conference{visapp20,
author={Rafael Roberto and Daniel Perazzo and João Lima and Veronica Teichrieb and Jonysberg Quintino and Fabio B. da Silva and Andre Santos and Helder Pinho},
title={Using Local Refinements on 360 Stitching from Dual-fisheye Cameras},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP,},
year={2020},
pages={17-26},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008874100170026},
isbn={978-989-758-402-2},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP,
TI - Using Local Refinements on 360 Stitching from Dual-fisheye Cameras
SN - 978-989-758-402-2
AU - Roberto R.
AU - Perazzo D.
AU - Lima J.
AU - Teichrieb V.
AU - Quintino J.
AU - B. da Silva F.
AU - Santos A.
AU - Pinho H.
PY - 2020
SP - 17
EP - 26
DO - 10.5220/0008874100170026