Shinya Kitaoka, Tsukasa Noma, Yoshifumi Kitamura, Kunio Yamamoto



It is difficult to apply inverse rendering to artistic paintings than photographs of real scenes because (1) shapes and shadings in paintings are physically incorrect due to artistic effects and (2) brush strokes disturb other factors. To overcome this difficulty of non-photorealistic rendering, we make some reasonable assumptions and then factorize the image into factors of shape, (color- and texture-independent) shading, object texture, and brush stroke texture. By transforming and combining these factors, we can manipulate grate paintings, such as relighting them and/or obtaining new views, and render new paintings, e.g., ones with Cézanne’s shading and Renoir’s brush strokes.


  1. Brainard, D.H., Wandell, B.A., 1986. Analysis of the retinex theory of color vision. J. Opt. Soc. Am. A, 3(10):1651-1661.
  2. Debevec, P., Taylor, C., Malik, J., 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Proceedings of SIGGRAPH 7896, pages 11-20.
  3. Drori, I., Cohen-Or, D., Yeshurun, H., 2003. Examplebased style synthesis. In Proceedings of CVPR 2003, pages 143-150.
  4. Gooch, A., Gooch, B., Shirley, P., Cohen, E., 1998. A nonphotorealistic lighting model for automatic technical illustration. In Proceedings of SIGGRAPH 1998, pages 447-452.
  5. Gooch, B., Gooch, A., 2001. Non-Photorealistic Rendering. A. K. Peters.
  6. Haeberli, P., 1990. Paint by numbers: Abstract image representation. In Proceedings of SIGGRAPH 1990, pages 207-214.
  7. Heidrich, W., Seidel, H.-P., 1998. View-independent environment maps. In Proceedings of ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware, pages 39-45.
  8. Hertzmann, A., 2003. A survey of stroke-based rendering. IEEE Computer Graphics and Applications, 23(4):117-128.
  9. Igarashi, T., Matsuoka, S., Tanaka, H., 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of SIGGRAPH 1999, pages 409-416.
  10. Kimmel, F., Elad, M., Shaked, D., Keshet, R., Sobel, I., 2003. A variational framework for retinex. Int'l J. Comput. Vision, 52(1):7-23.
  11. Kulla, C.D., Tucek, J.D., Bailey, R.J., Grimm, C.M., 2003, Using texture synthesis for Non-Photorealistic shading from paint samples. In Proceedings of 11th Pacific Conference on Computer Graphics and Application 2003, pages 477-481.
  12. Lake, A., Marshall, C., Harris, M., Blackstein, M., 2000. Stylized rendering techniques for scalable real-time 3D animation. In Proceedings of NPAR 2000, pages 13-20.
  13. Marschner, S.R., Greenberg, D.P., 1997. Inverse lighting for photography. In Proceedings of IS&T/SID 5th Color Imaging Conference.
  14. Meier, B.J., 1996. Painterly rendering for animation. In Proceedings of SIGGRAPH 1996, pages 477-484.
  15. Oh, B.M., Chen, M., Dorsey, J., and Durand, F., 2001. Image-based modeling and photo editing. In Proceedings of SIGGRAPH 2001, pages 433-442.
  16. Powell, M. J. D., 1987. Radial basis functions for multivariable interpolation: A review. pages 143-167 Oxford Clarendon Press.
  17. Ramamoorthi, R., Hanrahan, P., 2001a. On the relationship between radiance and irradiance: Determining the illumination from images of a convex lambertian object. J. Opt. Soc. Am. A, 18(10):2448- 2459.
  18. Ramamoorthi, R., Hanrahan, P., 2001b. A signalprocessing framework for inverse rendering. In Proceedings of SIGGRAPH 2001, pages 117-128.
  19. Reinhard, E., Stark, M., Shirley, P., Ferwerda, J., 2002. Photographic tone reproduction for digital images, In Proceedings of SIGGRAPH 2002, pages 267-276.
  20. Sato, I., Sato, Y., Ikeuchi, K., 2003. Superimposing synthetic objects into oil paintings with artistic shadings. IPSJ Transactions on Computer Vision and Image Media, 44(SIG 9(CVIM 7)):132-142. (In Japanese)
  21. Sloan, P.-P. J., Martin, W., Gooch, A., Gooch, B., 2001. The lit sphere: A model for capturing NPR shading from art. In Proceedings of Graphics Interface 2001, pages 143-150.
  22. Turk, G., O'Brien, J.F., 2002. Modelling with implicit surfaces that interpolate. ACM Transactions on Graphics, 21(4):855-873.

Paper Citation

in Harvard Style

Kitaoka S., Noma T., Kitamura Y. and Yamamoto K. (2007). INVERSE RENDERING FOR ARTISTIC PAINTINGS . In Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, ISBN 978-972-8865-71-9, pages 293-298. DOI: 10.5220/0002079902930298

in Bibtex Style

author={Shinya Kitaoka and Tsukasa Noma and Yoshifumi Kitamura and Kunio Yamamoto},
booktitle={Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,},

in EndNote Style

JO - Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,
SN - 978-972-8865-71-9
AU - Kitaoka S.
AU - Noma T.
AU - Kitamura Y.
AU - Yamamoto K.
PY - 2007
SP - 293
EP - 298
DO - 10.5220/0002079902930298