M. Usman Akram, Irfan Zafar, Wasim Siddique Khan, Zohaib Mushtaq



We present a novel scheme for facial expression recognition from facial features using Mamdani-type fuzzy system. Facial expression recognition is of prime importance in human-computer interaction systems (HCI). HCI has gained importance in web information systems and e-commerce and certainly has the potential to reshape the IT landscape towards value driven perspectives. We present a novel algorithm for facial region extraction from static image. These extracted facial regions are used for facial feature extraction. Facial features are fed to a Mamdani-type fuzzy rule based system for facial expression recognition. Linguistic models employed for facial features provide an additional insight into how the rules combine to form the ultimate expression output. Another distinct feature of our system is the membership function model of expression output which is based on different psychological studies and surveys. The validation of the model is further supported by the high expression recognition percentage.


  1. Assia Khanam, M. Z. S. and Muhammad, E. (2007). Cbr: Fuzzified case retreival approach for facial expression recognition. pp. 162-167, 25th IASTED International Conference on Artificial Intelligence and Aplications, February 2007, Innsbruck, Austria.
  2. Ayako Katoh, Y. F. (1998). Classification of facial expressions using self-organizing maps. 20th International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 20, No 2.
  3. Carlo Drioli, Graziano Tisato, P. C. and Tesser, F. (2003). Emotions and voice quality. Experiments with Sinusoidal Modeling, VOQUAL'03, Geneva, August 27- 29.
  4. D. H. Rao, S. S. S. (1995). Study of defuzzification methods of fuzzy logic controller for speed control of a dc motor. IEEE Transactions, 1995, pp. 782- 787.
  5. Diane J. Schiano, Sheryl M. Ehrlich, K. R. and Sheridan, K. (2000). Face to interface: Facial affect in (hu)man and machine. ACM CHI 2000 Conference on Human Factors in Computing Systems, pp. 193-200.
  6. Ekman, P. (1993). Facial expression and emotion. American Psychologist, Vol. 48, pp. 384-392.
  7. Ekman, P. (1994). Strong evidence for universals in facial expressions: A reply to russell's mistaken critique. Psychological Bulletin, pp.268-287.
  8. Ekman, P. and Friesen, W. (1978). Facial action coding system: Investigator's guide. Consulting Psychologists Press.
  9. Francisco Herrera, L. M. (1997). Genetic fuzzy systems. A Tutorial. Tatra Mt. Math. Publ. (Slovakia).
  10. Kim, D.-J. and Bien, Z. (2003). Fuzzy neural networks (fnn) - based approach for personalized facial expression recognition with novel feature selection method. The IEEE Conference on Fuzzy Systems.
  11. Klir, G. and Yuan, B. (1995). Fuzzy sets and fuzzy logic - theory and applications. Prentice-Hall.
  12. Koo, T. K. J. (1996). Construction of fuzzy linguistic model. Proceedings of the 35th Conference on Decision and Control, Kobe, Japan, 1996, pp.98-103.
  13. Kuncheva, L. I. (2000). Fuzzy classifier design. pp. 112- 113.
  14. Lien, J.-J. J. (1998). Automatic recognition of facial expressions using hidden markov modelsand estimation of expression intensity. Phd Dissertation, The Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania.
  15. M. Zubair Shafiq, A. K. (2006). Facial expression recognition system using case based reasoning system. pp. 147-151, IEEE International Conference on Advancement of Space Technologies.
  16. Muid Mufti, A. K. (2006). Fuzzy rule-based facial expression recognition. CIMCA-2006, Sydney.
  17. Ralescu, A. and Hartani, R. (1995). Some issues in fuzzy and linguistic modeling. IEEE Proc. of International Conference on Fuzzy Systems.
  18. Runkler, T. A. (1996). Extended defuzzification methods and their properties. IEEE Transactions, 1996, pp. 694-700.
  19. Shafiq, M. Z. (2006). Towards more generic modeling for facial expression recognition: A novel region extraction algorithm. International Conference on Graphics, Multimedia and Imaging, GRAMI-2006, UET Taxila, Pakistan.
  20. Shafiq, M. Z. and Khanum, A. (2006). A 'personalized' facial expression recognition system using case based reasoning. 2nd IEEE International Conference on Emerging Technologies, Peshawar,pp.630-635.
  21. Sherri C. Widen, J. A. R. and Brooks, A. (May 2004). Anger and disgust: Discrete or overlapping categories. In APS Annual Convention, Boston College, Chicago, IL.
  22. Ushida, H., T. T. and Yamaguchi, T. (1993). Recognition of facial expressions using conceptual fuzzy sets. Proc. of the 2nd IEEE International Conference on Fuzzy Systems, pp. 594-599.
  23. Wallhoff, F. (2006). Facial expressions and emotions database. Technische Universitt Mnchen 2006. http://www.mmk.ei.tum.de/ waf/fgnet/feedtum.html.
  24. Xiaoxu Zhou, Xiangsheng Huang, Y. W. (2004). Realtime facial expression recognition in the interactive game based on embedded hidden markov model. International Conference on Computer Graphics, Imaging and Visualization (CGIV'04).

Paper Citation

in Harvard Style

Usman Akram M., Zafar I., Siddique Khan W. and Mushtaq Z. (2008). FACIAL EXPRESSION RECOGNITION BASED ON FUZZY LOGIC . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 383-388. DOI: 10.5220/0001089603830388

in Bibtex Style

author={M. Usman Akram and Irfan Zafar and Wasim Siddique Khan and Zohaib Mushtaq},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},

in EndNote Style

JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
SN - 978-989-8111-21-0
AU - Usman Akram M.
AU - Zafar I.
AU - Siddique Khan W.
AU - Mushtaq Z.
PY - 2008
SP - 383
EP - 388
DO - 10.5220/0001089603830388