THE SPIRAL FACETS - A Unified Framework for the Analysis and Description of 3D Facial Mesh Surfaces

Naoufel Werghi, Harish Bhaskar, Youssef Meguebli, Haykel Boukadida

Abstract

In this paper, we describe a framework for encoding 3D facial triangular mesh surface. We derive shape information from the triangular mesh surface by exploiting specific arrangements of facets in the model. We describe the foundations of the framework and adapt the framework for several original applications including: face landmark detection, frontal face extraction, face orientation and facial surface representation. We validate the framework through experimentation with raw 3D face mesh surfaces and demonstrate that the model allows simpler implementation, more compact representation and encompasses rich shape information that can be usefully deployed both locally and globally across the face in comparison to other standard representations.

References

  1. Ashbrook, A. P., Fisher, R. B., Robertson, C., and Werghi, N.(1998). Finding surface correspondance for object recognition and registration using pairwise geometric histograms. In Proc European Conference on Computer Vision, pages 674686.
  2. Berretti, S., Bimbo, A. and Pala, P.(2006). Description
  3. Ashbropoakg,eA1.3P2.,2F. isher, R. B., Robertson, C., and Werghi,
  4. BronNs.te(1in9,9A8).., FBinrodninsgtesinu,rfMac.e acnodrreKspimonmdealn,cRe.f(o2r0o0b3j)e.ctExrepcroegsnsiitoionn iannvdarrieagnitstr3aDtionfaucseinrgepcoaigrnwiitsioeng.eoAmuedtiroic-and hiVstiodgeroa-mbsa.seIdnPPerrosocnEAuruotpheeannticCaotinofner,epnacgeeson62C7o0m.- puter Vision, pages 674-686.
  5. Chua, C., Han, F. and Ho, Y.(2000). 3D Human face recog-
  6. Berrettin, iSti.o,Bniumsbinog,Ap.o,ianntdsPiganlaa,tPu.r(e2.00I6n).CDoensfc.roipntiAonutaonmdatic reFtraiecveaalnodf 3GdefsatcueremRoedceolsgnuistiinogn,ispoa-ggeeosd2es3i3c2s3tr8i.pes. In In Conf. Multimedia Information Retrieval, page
  7. Colb1r3y2,2.D., Stockman, G. and Jain, A.(2005). Detection of anchor points for 3D face verification. In
  8. BronstePinro,cA. C., oBmropnustteerinV,iMsi o.,naannddKPiamttmerenl,RRe.c(o2g0n0i3ti)o.nE. xpression invariant 3d face recognition. Audio- and
  9. CormViedne,o-BTa.seHd.,PeLresoisnerAsuotnh,enCti.c,aRtioivne,spt,agRes. 6L2.-7a0n.d Stein., C.(2001). Introduction to Algorithms, Second Edition.
  10. Chua, CM.,IHTaPnr,eFs.s,aanndd HMoc,GYr.a(w20-H00il)l.. 3d human face recognition using point signature. In In Conf. on Automatic
  11. F. RF.,aAce.-aOn.d, BGeensntuarmeoRuenco,gMn.itaionnd, Mpaigaens, 2A3.3(-2203088.). Integration of local and global geometrical cues for 3D face
  12. Colbry,rDec.,oSgtnoictikomn.anP,aGtt.e,ranndReJaciong,nAit.i(o2n0,0451)(.3D):e1t0ec3t0io1n04o0f anchor points for 3d face verification. In Proc. Com-
  13. Freyp,uPte.raVnidsioBnoarnoducPhaatkteir,nHR.e(1co9g9n9i)t.ionS. urface mesh quality evaluation. International Journal for Numerical
  14. CormenM, eTt.hHod.,sLineisEenrsgoinne,eCr.i,nRg,i4v5es(1t,):R1.0L11.,1a8n.d Stein., C. (2001). Introduction to Algorithms, Second Edition.
  15. HeseMltIiTneP,reTs.s, aPndeaMrsc,GNra.wa-Hnidll. Austin, J.(2008). Threedimensional face recognition using combinations of
  16. F.R., A.-O., Bennamounm,Map.,saunbdspMaicaenc,oAm.(p2o0n0e8n)t.sI.nItmegargae- and surface feature tioVnisoiofnloCcoalmapnudtignlgo,b2a6l:g3e8o2m-3e9tr6ical cues for 3d face recognition. Pattern Recognition, 41(3):1030-1040.
  17. Irfanoglu, M., Gokberk, B. and Akarun, L.(2004). 3D
  18. Frey, P.shaanpde-Bboarsoeudcfhaackei,reHc.og(1n9it9i9o)n. usSiunrgfaacuetommeasthicqaullayl- regityisteevraelduaftaiocina.l sIunrtfearcneast.ionInalCJoonufr.nPaaltftoerrnNRuemceorgicnaitlion, Methods in Engineering, 45(1):101-118. volume4, pages 183186.
  19. HKesaekltaidniea,ris, I.(2007). Three-dAimusetninsi,oJn.al(2fa0c0e8)r.ecoTghnrietieo-n in T., Pears, N., and dimensional face recognition of the presence of facial expreusssiinognsc:oAmnbiannatniootnasted deformable model approach. IEEE Transaction on Pattern Analysis and Machine Intelligence,29(4).
  20. Lee, Y., Park, K., Shim, J. and Yi, T.(2003). 3D face recognition using statistical multiple features for the local depth information. In Conf. Vision Interface, pages 102108.
  21. Lu, X. and Jain, A.(2005). Deformation analysis for 3D face matching. In IEEE Workshops on Application of Computer Vision, pages 99104.
  22. Mian, A., Bennamoun, M. and Owens, R.(2007). An efficient multimodal 2D-3D hybrid approach to automatic face recognition. IEEE Transactions in Pattern Analysis and Machine Intelligence, 29(11):19271943.
  23. Moreno, A., Sanchez, A. and Martinez, E.(2006). Robust representation of 3D faces for recognition. Int. Journal of Pattern Recognition and Artificial Intelligence, 20(8):11591186.
  24. Nair, P. and Cavallaro, A.(2009) 3-d face detection,landmark localization, and registration using a point distribution model. IEEE Trans. Multimedia, 1(4):611623.
  25. Pan, G., Wu, Y., Wu, Z. and Liu, W.(2003). 3D face recognition by profile and surface matching. In IEEE/INNS Conf. on Neural Networks, volume3, pages 21692174.
  26. Piegl, L. and Tiller, W.(2006) The NURBS Book. Springer.
  27. R. Niese, Al-Hamadi, A. and Michaelsi, B.(2007) A novel method for 3D face detection and normalization. Journal of Multimedia,2(5):112.
  28. Romero, M. and Pears, N.(2009). Landmark localisation in 3D face data. In IEEE Conf. on Advanced Video and Signal Based Surveillance, pages 7378.
  29. Ruiz, M. and Illingworth,J.(2008). Automatic landmarking of faces in 3D-alf. In 5th International Conference on Visual Information Engineering(VIE2008), pages4146.
  30. Samir, C., Srivastava, A., Daoudi, M. and Klassen, E. (2009) An intrinsic framework for Analysis of facial surfaces. International Journal of Computer Vision, 82(1).
  31. Segundo, M., Queirolo, C., Bellon,O. and Silva, L.(2007). Automatic 3D facial segmentation and landmark detection. In Proc. 14th Int.Conf. on Image Analysis and Processing, page431436.
  32. Sethian, J. and Kimmel., R.(1998). Computing geodesic paths on manifolds. Proc. National Academy of Sciences, 95(15):84318435.
  33. Wang, Y., Tang, X., Liu, J., Pan, G. and Xiao, R.(2008). 3D face recognition by local shape difference boosting. In Proc. European Conference on Computer Vision, ECCV, pages 603616.
  34. Wu, Y., Pan, G. and Wu, Z.(2003). Face authentication based on multiple profiles extracted from range data. In Conf. Audio-and Video-Based Biometric Person Authentication, volume 2688, pages 515522.
  35. Xu, C., Tan, T., Wang, Y. and Quan, L.(2006) Combining local features for robust nose location in 3D facial data. Pattern Recognition Letters, 27:14871494.
  36. Xu, C., Wang, Y., Tan, T. and Quan, L.(2004a). Automatic 3D face recognition combining global geometric features with local shape variation information. In IEEE Conf. on Automatic Face and Gesture Recognition, pages 302307.
  37. Xu, C., Wang, Y., Tan, T. and Quan, L.(2004b) A new attempt to face recognition using eigenfaces. In Asian Conference on Computer Vision, volume 2, pages 884889.
  38. Xu, D., Hu, P., Cao, W. and Li, H.(2008). 3D face recognition using moment in variants. In IEEE Int. Conference on Shape Modeling and Applications, pages 261262.
Download


Paper Citation


in Harvard Style

Werghi N., Bhaskar H., Meguebli Y. and Boukadida H. (2011). THE SPIRAL FACETS - A Unified Framework for the Analysis and Description of 3D Facial Mesh Surfaces . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011) ISBN 978-989-8425-47-8, pages 30-39. DOI: 10.5220/0003362300300039


in Bibtex Style

@conference{visapp11,
author={Naoufel Werghi and Harish Bhaskar and Youssef Meguebli and Haykel Boukadida},
title={THE SPIRAL FACETS - A Unified Framework for the Analysis and Description of 3D Facial Mesh Surfaces},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)},
year={2011},
pages={30-39},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003362300300039},
isbn={978-989-8425-47-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)
TI - THE SPIRAL FACETS - A Unified Framework for the Analysis and Description of 3D Facial Mesh Surfaces
SN - 978-989-8425-47-8
AU - Werghi N.
AU - Bhaskar H.
AU - Meguebli Y.
AU - Boukadida H.
PY - 2011
SP - 30
EP - 39
DO - 10.5220/0003362300300039