A Long-range Vision System for Projection Mapping of Stereoscopic Content in Outdoor Areas

Behnam Maneshgar, Leila Sujir, Sudhir P. Mudur, Charalambos Poullis

Abstract

Spatial Augmented Reality, or its more commonly known name Projection Mapping (PM), is a projection technique which transforms a real-life object or scene into a surface for video projection (Raskar et al., 1998b). Although this technique has been pioneered and used by Disney since the seventies, it is in recent years that it has gained significant popularity due to the availability of specialized software which simplifies the otherwise cumbersome calibration process (Raskar et al., 1998a). Currently, PM is being widely used in advertising, marketing, cultural events, live performances, theater, etc as a way of enhancing an object/scene by superimposing visual content (Ridel et al., 2014). However, despite the wide availability of specialized software, several restrictions are still imposed on the type of objects/scenes on which PM can be applied. Most limitations are due to problems in handling objects/scenes with (a) complex reflectance properties and (b) low intensity or distinct colors. In this work, we address these limitations and present solutions for mitigating these problems. We present a complete framework for calibration, geometry acquisition and reconstruction, estimation of reflectance properties, and finally color compensation; all within the context of outdoor long-range PM of stereoscopic content. Using the proposed technique, the observed projections are as close as possible [constrained by hardware limitations] to the actual content being projected; therefore ensuring the perception of depth and immersion when viewed with stereo glasses. We have performed extensive experiments and the results are reported.

References

  1. Anaglyph image. https://goo.gl/9vSgkP. Accessed: 2016- 11-25.
  2. Bell, T., Xu, J., and Zhang, S. (2016). Method for out-offocus camera calibration. Applied optics, 55(9):2346- 2352.
  3. Debevec, P., Tchou, C., Gardner, A., Hawkins, T., Poullis, C., Stumpfel, J., Jones, A., Yun, N., Einarsson, P., Lundgren, T., et al. (2004). Estimating surface reflectance properties of a complex scene under captured natural illumination. Conditionally Accepted to ACM Transactions on Graphics, 19.
  4. Feris, R., Raskar, R., Tan, K.-H., and Turk, M. (2004). Specular reflection reduction with multi-flash imaging. In Computer Graphics and Image Processing, 2004. Proceedings. 17th Brazilian Symposium on, pages 316-321. IEEE.
  5. Furukawa, Y. and Ponce, J. (2010). Accurate, dense, and robust multiview stereopsis. IEEE transactions on pattern analysis and machine intelligence, 32(8):1362- 1376.
  6. Garcia, R. R. and Zakhor, A. (2013). Geometric calibration for a multi-camera-projector system. In Applications of Computer Vision (WACV), 2013 IEEE Workshop on, pages 467-474. IEEE.
  7. Grossberg, M. D., Peri, H., Nayar, S. K., and Belhumeur, P. N. (2004). Making one object look like another: Controlling appearance using a projector-camera system. In Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, volume 1, pages I452. IEEE.
  8. Herakleous, K. and Poullis, C. (2014). 3dunderworldsls: An open-source structured-light scanning system for rapid geometry acquisition. arXiv preprint arXiv:1406.6595.
  9. Lafortune, E. P. F., Foo, S.-C., Torrance, K. E., and Greenberg, D. P. (1997). Non-linear approximation of reflectance functions. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 7897, pages 117-126, New York, NY, USA. ACM Press/Addison-Wesley Publishing Co.
  10. Levenberg, K. (1944). A method for the solution of certain non-linear problems in least squares.
  11. Lin, S., Li, Y., Kang, S. B., Tong, X., and Shum, H.-Y. (2002). Diffuse-specular separation and depth recovery from image sequences. In European conference on computer vision, pages 210-224. Springer.
  12. Oren, M. and Nayar, S. K. (1995). Generalization of the lambertian model and implications for machine vision. International Journal of Computer Vision, 14(3):227-251.
  13. Phong, B. T. (1975). Illumination for computer generated pictures. Communications of the ACM, 18(6):311- 317.
  14. Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. (1998a). The office of the future: A unified approach to image-based modeling and spatially immersive displays. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pages 179-188. ACM.
  15. Raskar, R., Welch, G., and Fuchs, H. (1998b). Spatially augmented reality. In First IEEE Workshop on Augmented Reality (IWAR98), pages 11-20.
  16. Ridel, B., Reuter, P., Laviole, J., Mellado, N., Couture, N., and Granier, X. (2014). The revealing flashlight: Interactive spatial augmented reality for detail exploration of cultural heritage artifacts. Journal on Computing and Cultural Heritage (JOCCH), 7(2):6.
  17. Seitz, S. M., Matsushita, Y., and Kutulakos, K. N. (2005). A theory of inverse light transport. In Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, volume 2, pages 1440-1447. IEEE.
  18. Svoboda, T., Martinec, D., and Pajdla, T. (2005). A convenient multicamera self-calibration for virtual environments. Presence, 14(4):407-422.
  19. Torrance, K. E. and Sparrow, E. M. (1967). Theory for offspecular reflection from roughened surfaces. JOSA, 57(9):1105-1112.
  20. Tsai, R. (1987). A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Journal on Robotics and Automation, 3(4):323-344.
  21. Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11):1330-1334.
Download


Paper Citation


in Harvard Style

Maneshgar B., Sujir L., Mudur S. and Poullis C. (2017). A Long-range Vision System for Projection Mapping of Stereoscopic Content in Outdoor Areas . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017) ISBN 978-989-758-224-0, pages 290-297. DOI: 10.5220/0006258902900297


in Bibtex Style

@conference{grapp17,
author={Behnam Maneshgar and Leila Sujir and Sudhir P. Mudur and Charalambos Poullis},
title={A Long-range Vision System for Projection Mapping of Stereoscopic Content in Outdoor Areas},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)},
year={2017},
pages={290-297},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006258902900297},
isbn={978-989-758-224-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)
TI - A Long-range Vision System for Projection Mapping of Stereoscopic Content in Outdoor Areas
SN - 978-989-758-224-0
AU - Maneshgar B.
AU - Sujir L.
AU - Mudur S.
AU - Poullis C.
PY - 2017
SP - 290
EP - 297
DO - 10.5220/0006258902900297