Using Extended Light Sources for Relighting from a Small Number of Images

Toshiki Hirao, Ryo Kawahara, Takahiro Okabe

2024

Abstract

Relighting real scenes/objects is useful for applications such as augmented reality and mixed reality. In general, relighting of glossy objects requires a large number of images, because specular reflection components are sensitive to light source positions/directions, and then the linear interpolation with sparse light sources does not work well. In this paper, we make use of not only point light sources but also extended light sources for efficiently capturing specular reflection components and achieve relighting from a small number of images. Specifically, we propose a CNN-based method that simultaneously learns the illumination module (illumination condition), i.e. the linear combinations of the point light sources and the extended light sources under which a small number of input images are taken and the reconstruction module which recovers the images under arbitrary point light sources from the captured images in an end-to-end manner. We conduct a number of experiments using real images captured with a display-camera system, and confirm the effectiveness of our proposed method.

Paper Citation

in Harvard Style

Hirao T., Kawahara R. and Okabe T. (2024). Using Extended Light Sources for Relighting from a Small Number of Images. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 607-615. DOI: 10.5220/0012421500003660

in Bibtex Style

@conference{visapp24,
author={Toshiki Hirao and Ryo Kawahara and Takahiro Okabe},
title={Using Extended Light Sources for Relighting from a Small Number of Images},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP},
year={2024},
pages={607-615},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012421500003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP
TI - Using Extended Light Sources for Relighting from a Small Number of Images
SN - 978-989-758-679-8
AU - Hirao T.
AU - Kawahara R.
AU - Okabe T.
PY - 2024
SP - 607
EP - 615
DO - 10.5220/0012421500003660
PB - SciTePress