TraceMove: A Data-assisted Interface for Sketching 2D Character Animation

Priyanka Patel, Heena Gupta, Parag Chaudhuri

Abstract

In this paper we present TraceMove, a system to help novice animators create 2D, hand-drawn, character animation. The system and interface assists not only in sketching the character properly but also in animating it. A database of image frames, from recorded videos of humans performing various motions, is used to provide pose silhouette suggestions as a static pose hint to the users as they draw the character. The user can trace and draw over the generated suggestions to create the sketch of the pose. Then the sketch of the next frame of the animation being drawn is automatically generated by the system as a moving pose hint. In order to do this, the user marks the skeleton of the character in a single sketched pose, and a motion capture database is used to predict the skeleton for the subsequent frame. The sketched pose is then deformed according to the predicted skeleton pose. Furthermore, the sketch generated by the system for any frame can always be edited by the animator. This lets novice artists and animators generate hand-drawn 2D animated characters with minimal effort.

References

  1. Bae, S., Balakrishnan, R., and Singh, K. (2009). Everybodylovessketch: 3d sketching for a broader audience. In Proceedings of ACM Symposium on User Interface Software and Technology, pages 59-68.
  2. Bhat, P., Zitnick, C. L., Cohen, M., and Curless, B. (2010). Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Transactions on Graphics, 29(2):10:1-10:14.
  3. Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. (2009). Sketch2photo: Internet image montage. ACM Transactions on Graphics, 28(5):124:1-124:10.
  4. Davis, J., Agrawala, M., Chuang, E., Popovic, Z., and Salesin, D. (2003). A sketching interface for articulated figure animation. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pages 320-328.
  5. De Paoli, C. and Singh, K. (2015). Secondskin: Sketchbased construction of layered 3d models. ACM Transactions on Graphics, 34(4):126:1-126:10.
  6. Dixon, D., Prasad, M., and Hammond, T. (2010). icandraw: Using sketch recognition and corrective feedback to assist a user in drawing human faces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 897-906.
  7. Dollr, P. and Zitnick, C. L. (2013). Structured forests for fast edge detection. In Proceedings of the 2013 IEEE International Conference on Computer Vision, ICCV 7813, pages 1841-1848. IEEE Computer Society.
  8. Igarashi, T., Matsuoka, S., and Tanaka, H. (1999). Teddy: A sketching interface for 3d freeform design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 7899, pages 409-416.
  9. Jacobs, C. E., Finkelstein, A., and Salesin, D. H. (1995). Fast multiresolution image querying. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 7895, pages 277-286.
  10. Jain, E., Sheikh, Y., and Hodgins, J. (2009). Leveraging the talent of hand animators to create three-dimensional animation. In Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pages 93-102.
  11. Lee, Y. J., Zitnick, C. L., and Cohen, M. F. (2011). Shadowdraw: Real-time user guidance for freehand drawing. ACM Transactions on Graphics, 30(4):27:1-27:10.
  12. Levi, Z. and Gotsman, C. (2013). ArtiSketch: A system for articulated sketch modeling. Computer Graphics Forum, 32(2):235-244.
  13. Li, Y., Gleicher, M., Xu, Y.-Q., and Shum, H.-Y. (2003). Stylizing motion with drawings. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 7803, pages 309-319.
  14. Oztireli, A. C., Baran, I., Popa, T., Dalstein, B., Sumner, R. W., and Gross, M. (2013). Differential blending for expressive sketch-based posing. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pages 155-164.
  15. Pan, J. and Zhang, J. J. (2011). Transactions on edutainment VI. chapter Sketch-based Skeleton-driven 2D Animation and Motion Capture, pages 164-181.
  16. Thomas, F. and Johnston, O. (1995). The Illusion of Life: Disney Animation. Hyperion.
  17. Thorne, M., Burke, D., and van de Panne, M. (2004). Motion doodles: An interface for sketching character motion. In Proceedings of ACM SIGGRAPH 2004, pages 424-431.
  18. Wang, L., Tan, T., Ning, H., and Hu, W. (2003). Silhoutte analysis based gait recognition for human identification. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 25(12):1505-1518.
  19. Williams, R. (2009). The Animator's Survival Kit-Revised Edition: A Manual of Methods, Principles and Formulas for Classical, Computer, Games, Stop Motion and Internet Animators. Faber & Faber, Inc.
  20. Xu, B., Chang, W., Sheffer, A., Bousseau, A., McCrae, J., and Singh, K. (2014). True2form: 3d curve networks from 2d sketches via selective regularization. ACM Transactions on Graphics, 33(4).
  21. Yang, R. and Wünsche, B. C. (2010). Life-sketch: A framework for sketch-based modelling and animation of 3d objects. In Proceedings of the Eleventh Australasian Conference on User Interface - Volume 106, pages 61- 70.
  22. Zitnick, C. L. (2010). Binary coherent edge descriptors. In Proceedings of the 11th European Conference on Computer Vision (ECCV), pages 170-182.
Download


Paper Citation


in Harvard Style

Patel P., Gupta H. and Chaudhuri P. (2016). TraceMove: A Data-assisted Interface for Sketching 2D Character Animation . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 191-199. DOI: 10.5220/0005672501890197


in Bibtex Style

@conference{grapp16,
author={Priyanka Patel and Heena Gupta and Parag Chaudhuri},
title={TraceMove: A Data-assisted Interface for Sketching 2D Character Animation},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2016)},
year={2016},
pages={191-199},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005672501890197},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2016)
TI - TraceMove: A Data-assisted Interface for Sketching 2D Character Animation
SN - 978-989-758-175-5
AU - Patel P.
AU - Gupta H.
AU - Chaudhuri P.
PY - 2016
SP - 191
EP - 199
DO - 10.5220/0005672501890197