INNER LIP SEGMENTATION BY COMBINING ACTIVE CONTOURS AND PARAMETRIC MODELS

Sebastien Stillittano, Alice Caplier

2008

Abstract

Lip reading applications require accurate information about lip movement and shape, and both outer and inner contours are useful. In this paper, we introduce a new method for inner lip segmentation. From the outer lip contour given by a preexisting algorithm, we use some key points to initialize an active contour called “jumping snake”. According to some optimal information of luminance and chrominance gradient, this active contour fits the position of two parametric models; a first one composed of two cubic curves and a broken line in case of a closed mouth, and a second one composed of four cubic curves in case of an open mouth. These parametric models give a flexible and accurate final inner lip contour. Finally, we present several experimental results demonstrating the effectiveness of the proposed algorithm.

References

  1. Abboud, B., Chollet, G., 2005. Appearance Based Lip Tracking and Cloning on Speaking Faces. In ISPA'05, IEEE International Symposium on Image and Signal Processing and Analysis. pp. 301-305.
  2. Beaumesnil, B., Chaumont, M., Luthon, F., 2006. Liptracking and MPEG4 Animation with Feedback Control. In ICASSP'06, IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 2, pp. 677-680.
  3. Cootes, T. F., Hill, A., Taylor, C. J., Haslam, J., 1994a. Use of Active Shape Models for Locating Structures in Medical Images. In Image and Vision Computing. Vol. 12, No. 6, pp. 355-365.
  4. Cootes, T. F., Lanitis, A., Taylor, C. J., 1994b. Automatic Tracking, Coding and Reconstruction of Human Faces using Flexible Appearance Models. In IEE Electronic Letters. Vol. 30, No 19, pp.1587-1588.
  5. Delmas, P., Coulon, P-Y., Fristot V., 1999. Automatic snakes for robust lip boundaries extraction. In ICASSP'99, IEEE International Conference on Acoustic, Speech and Signal Processing. Vol. 6, pp. 3069-3072.
  6. Eveno, N., Caplier, A., Coulon P-Y, 2004. Automatic and Accurate Lip Tracking. In IEEE Trans. on Circuits and Systems for Video Technology. Vol. 14, No 5, pp. 706-715.
  7. Hulbert, A., Poggio, T., 1998. Synthesizing a Color Algorithm From Examples. In Science. Vol. 239, pp. 482-485.
  8. Luettin, J., Thacker, N. A., Beet, S. W., 1996. Statistical Lip Modelling for Visual Speech Recognition. In Eusipco'96, Proceedings of the 8th European Signal Processing Conference. Vol. 1, pp. 123-125.
  9. Martinez, A. M., Benavente, R., 1998. The AR Face Database. In CVC Tech. Report # 24.
  10. Neely, K. K., 1956. Effect of Visual Factors on the Intelligibility of Speech. J. Acoustical Society of America. Vol. 28, pp. 1275-1277.
  11. Sumby, W. H., Pollack, I., 1954. Visual Contribution to Speech Intelligibility in Noise. J. Acoustical Society of America. Vol. 26, pp. 212-215.
  12. Wang, S. L., Lau, W. H., Leung, S. H., Yan, H., 2004. A Real-time Automatic Lipreading System. In ISCAS, IEEE International Symposium on Circuits and Systems. Vol.2, pp. 101-104.
  13. Wyszecki, G., Stiles, W. S., 1982. Color Science: Concepts and Methods, Quantitative Data and Formulae. John Wiley & Sons, Inc., New York, New York, 2nd edition.
  14. Wu, Z., Aleksic, P. S., Katsaggelos, A. K., 2002. Lip tracking for MPEG-4 facial animation. In ICMI, IEEE International Conference on Multimodal Interfaces. pp. 293-298.
  15. Zhang, L., 1997. Estimation of the mouth features using deformable templates. In ICIP'97, IEEE International Conference on Image Processing. Vol. 3.pp. 328-331.
Download


Paper Citation


in Harvard Style

Stillittano S. and Caplier A. (2008). INNER LIP SEGMENTATION BY COMBINING ACTIVE CONTOURS AND PARAMETRIC MODELS . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 297-304. DOI: 10.5220/0001077402970304


in Bibtex Style

@conference{visapp08,
author={Sebastien Stillittano and Alice Caplier},
title={INNER LIP SEGMENTATION BY COMBINING ACTIVE CONTOURS AND PARAMETRIC MODELS},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={297-304},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001077402970304},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - INNER LIP SEGMENTATION BY COMBINING ACTIVE CONTOURS AND PARAMETRIC MODELS
SN - 978-989-8111-21-0
AU - Stillittano S.
AU - Caplier A.
PY - 2008
SP - 297
EP - 304
DO - 10.5220/0001077402970304