AN EFFICIENT TEXTURE GENERATION TECHNIQUE FOR HUMAN HEAD CLONING AND MORPHING

Yu Zhang

2006

Abstract

This paper presents a technique to efficiently generate a parameterized full-head texture from a single face image of the scanned data for modeling photorealistic 3D heads. We automatically register face scans in a database by deforming a generic head mesh to fit the specific person’s face geometry with a volume morphing approach. After the face texture is transferred onto it, the 3D generic mesh is parameterized over a 2D texture domain to establish a correspondence between all the scanned textures. After having performed a vertex-to-image binding for all vertices of the head mesh, we automatically generate a full-head texture using color interpolation for unbound regions and weighted average splines for visual boundary removal. We also use a deformation method to extract ear textures from the input image for texturing individual ears. With the exception of the initial feature point selection, our method is fully automated. We show photorealistic and real-time head rendering and morphing with the resulting texture.

References

  1. Akimoto, T., Suenaga, Y., and Wallace, R. S. (1993). Automatic creation of 3d facial models. In IEEE Computer Graphics and Application. 13(5): 16-22.
  2. Blanz, V. and Vetter, T. (1999). A morphable model for the synthesis of 3d faces. In Proc. SIGGRAPH'99, pages 187-194.
  3. DeCarlo, D., Metaxas, D., and Stone, M. (1998). An anthropometric face model using variational techniques. In Proc. SIGGRAPH'98, pages 67-74.
  4. Essa, I. and Basu, S. (1996). Modeling, tracking and interactive animation of facial expressions and head movements using input from video. In Proc. Computer Animation'96, pages 68-79.
  5. Guenter, B., Grimm, C., Wood, D., Malvar, H., and Pighin, F. (1998). Making faces. In Proc. SIGGRAPH'98, pages 55-66.
  6. Kahler, K., Haber, J., Yamauchi, H., and Seidel, H. P. (2002). Head shop: Generating animated head models with anatomical structure. In Proc. ACM SIGGRAPH Symposium on Computer Animation, pages 55-64.
  7. Kalra, P., Mangili, A., Thalmann, N. M., and Thalmann, D. (1992). Simulation of facial muscle actions based on rational free form deformatios. In Proc. Proc. EUROGRAPHICS'92, pages 59-69.
  8. Koch, R., Gross, M., Carls, F., Buren, D., Fankhauser, G., and Parish, Y. (1996). Simulating facial surgery using finite element models. In Proc. SIGGRAPH'96, pages 421-428.
  9. Lee, W. S. and Thalmann, N. M. (2000). Fast head modeling for animation. In Journal Image and Vision Computing. 18(4): 355-364.
  10. Lee, Y., Terzopoulos, D., and Waters, K. (1995). Realistic modeling for facial animation. In Proc. SIGGRAPH'95, pages 55-62.
  11. Liu, Z., Zhang, Z., Jacobs, C., and Cohen, M. (2001). Rapid modeling of animated faces from video. In Journal of Visualization and Computer Animation. 12(4): 227- 240.
  12. Marschner, S., Guenter, B., and Raghupathy, S. (2000). Modeling and rendering for realistic facial animation. In Proc. 11th EG Workshop on Rendering, pages 231- 242.
  13. Nielson, G. M. (1993). Scattered data modeling. In IEEE Computer Graphics and Application. 13(1): 60-70.
  14. Parke, F. I. (1972). Computer Generated Animation of Faces. Master's thesis, University of Utah.
  15. Parke, F. I. (1982). Parameterized models for facial animation. In IEEE Computer Graphics and Application. 2(9): 61-68.
  16. Peleg, S. (1981). Elimination of seams from photomosaics. In Proc. Conference on Pattern Recognition and Image Processing, pages 426-429.
  17. Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., and Salesin, D. H. (1998). Synthesizing realistic facial expressions from photographs. In Proc. SIGGRAPH'98, pages 75-84.
  18. Pighin, F., Szeliski, R., and Salesin, D. H. (1999). Resynthesizing facial animation through 3d model-based tracking. In Proc. ICCV'99, pages 143-150.
  19. Platt, S. and Badler, N. (1981). Animating facial expressions. In Proc. SIGGRAPH'81, pages 245-252.
  20. Rocchini, C., Cignoni, P., Montani, C., and Scopigno, R. (1999). Multiple textures stitching and blending on 3d objects. In Proc. 10th EG Workshop on Rendering, pages 119-130.
  21. Tarini, M., Yamauchi, H., Haber, J., and Seidel, H.-P. (2002). Texturing faces. In Proc. Graphics Interface'02, pages 89-98.
  22. Terzopoulus, D. and Waters, K. (1990). Physically-based facial modeling, analysis and animation. In Journal of Visualization and Computer Animation. 1: 73-80.
  23. Thalmann, N. M., Minh, H., deAngelis, M., and Thalmann, D. (1989). Design, transformation and animation of human faces. In The Visual Computer. 5: 32-39.
  24. Waters, K. (1987). A muscle model for animating three-dimensional facial expression. In Proc. SIGGRAPH'87, pages 17-24.
  25. Waters, K. and Terzopoulos, D. (1991). Modeling and animating faces using scanned data. In Journal of Visualization and Computer Animation. 2: 123-128.
  26. Williams, L. (1990). Performance-driven facial animation. In Proc. SIGGRAPH'90, pages 235-242.
  27. Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. (2004a). Space-time faces: High resolution capture for modeling and animation. In Proc. SIGGRAPH'04, pages 548-558.
  28. Zhang, Y., Prakash, E. C., and Sung, E. (2004b). A new physical model with multi-layer architecture for facial expression animation using dynamic adaptive mesh. In IEEE Transactions on Visualization and Computer Graphics. 10(3): 339-352.
Download


Paper Citation


in Harvard Style

Zhang Y. (2006). AN EFFICIENT TEXTURE GENERATION TECHNIQUE FOR HUMAN HEAD CLONING AND MORPHING . In Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, ISBN 972-8865-39-2, pages 267-275. DOI: 10.5220/0001352202670275


in Bibtex Style

@conference{grapp06,
author={Yu Zhang},
title={AN EFFICIENT TEXTURE GENERATION TECHNIQUE FOR HUMAN HEAD CLONING AND MORPHING},
booktitle={Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,},
year={2006},
pages={267-275},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001352202670275},
isbn={972-8865-39-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,
TI - AN EFFICIENT TEXTURE GENERATION TECHNIQUE FOR HUMAN HEAD CLONING AND MORPHING
SN - 972-8865-39-2
AU - Zhang Y.
PY - 2006
SP - 267
EP - 275
DO - 10.5220/0001352202670275