Which Strategy to Combine Face Identification Tools with Clothing Similarity: Contesting or Reinforcing?

Saïd Kharbouche, Michel Plu



This paper describes a novel and efficient approach that integrates clothing similarity into face identification process in personal photos. The information extracted from people’s clothes would be helpful if they are dissimilar, however, this information could make errors and noise if we have some people with similar clothes. To resolve this problem, we propose here a better methodology that exploits clothing similarity. The main idea is summarized as follows: if a person is well identified in a detected face, instead to reinforce this person in every face (in other photo) with similar clothes, we contest her/him in every face with dissimilar clothes. The weight and the influence of the information extracted from a face in a photo to another face depend on the spatiotemporal distance between photos, the similarity degree between the clothes and the incertitude level about their real identities. We utilize belief functions theory in order to manage efficiently the imprecision and the uncertainty. Besides, the results obtained showed off the interest of our approach.


  1. M. Abdel-Mottaleb and L. Chen. Content-based photo album management using faces' arrangement. In IEEE International Conference on Multimedia and Expo, ICME04, pages 2071-2074, Taipei, Taiwan, June 2004. IEEE.
  2. L. Agosto, M. Plu, P. Bellec, and L. Vignollet. Someone : A cooperative system for personalized information exchange. In International Conference of Enterprise Information Systems, pages 71-78, Angers, France, 2003.
  3. D. Anguelov, K. Lee, S. B. Gokturk, and B. Sumengen. Contextual identity recognition in personal photo albums. In IEEE Computer Society Conference on Computer Vision and Pattern Recognation, pages 01-07, June 2007.
  4. Y. A. Aslandogan and C. Yu. Multiple evidence combination in image retrieval: Diogenes searches for people on the web. In Proceedings of the 23rd Annual International ACM/SIGIR Conference on Research and Development in Information Retrieval, pages 88-95, Athens, Greece, June 2000.
  5. A.W.M.Smeulders, M.Worring, S. Santini, A.Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1349-1380, December 2000.
  6. M. Davis, M. Smith, F. Stentiford, A. Bambidele, J. Canny, N. Good, S. King, and R. Janakiraman. Using context and similarity for face and location identification. In Proceedings of the IS& T/SPIE 18th Annual Symposium on Electronic Imaging Science and Technology Internet Imaging VII, page cdrom, San Jose, California, 2006. IS& T/SPIE Press.
  7. A. Dempster. Upper and lower probabilities induced by a multivalued mapping. Annals of Mathematical Statistics, AMS 38:325-339, 1967.
  8. Y. Gong, C. Chuan, and G. Xiaoyi. Image indexing and retrieval using color histograms. Multimedia Tools and Applications, 2(2):133-156, March 1996.
  9. R. Gossweiler and J. Tyler. PLOG: Easily create digital picture stories through cell phone cameras. In First International Workshop on Ubiquitous Computing (IWUC 2004), pages 94-103, Porto, Portugal, April 2004. INSTICC Press.
  10. S. Kharbouche. Fonctions de croyance et indexation multimodale, application à l'identification de personnes dans des albums. Master's thesis, University of Rouen, Rouen, Normandy, France, December 2006.
  11. S. Kharbouche and M.Plu. Combination of face detection, face recognition and gender recognition using belief function using evidence theory. In IEEE International Conference on Information Reuse and Integration, pages 526-531, Las Vegas, USA, August 2007.
  12. M. Naaman, R. Yeh, H. Garcia-Molina, and A. Paepcke. Leveraging context to resolve identity in photo albums. In Proceedings of the Fifth ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), pages 178-187, Denver, Colorado, USA, June 2005.
  13. A. Pigeau and M. Gelgon. Incremental statistical geo-temporal structuring of a personal camera phone image collection. In Proceedings of the 17th International Conference on Pattern Recognition, ICPR'2004, volume 3, pages 878-881, 2004.
  14. G. Shafer. A mathematical theory of evidence. Princeton University Press, 1976.
  15. P. Smets. Belief induced by the partial knowledge of the probabilities. In D. Heckerman and Al., editors, Uncertainty in Artificial Intelligence, UAI'94, pages 523-530, San Mateo, 1994. Morgan Kaufmann.
  16. Y. Song and T. Leung. Context-aided human recognition - clustering. In 9th European Conference on Computer Vision ECCV 2006, pages 382-395, Graz, Austria, May 2006. Springer, LNCS.
  17. M. Visani, C. Garcia, and C. Laurent. Comparing robustness of two-dimensional PCA and eigenfaces for face recognition. In Proceedins of the International Conference on Image Analysis and Recognition, volume 3212/2004, pages 717-724, 2004.
  18. L. Zhang, L.Chen, M. Li, and H. Zhang. Automated annotation of human faces in family albums. In MULTIMEDIA 7803: Proceedings of the eleventh ACM international conference on Multimedia, pages 355-358, New York, NY, USA, 2003. ACM Press.

Paper Citation

in Harvard Style

Kharbouche S. and Plu M. (2008). Which Strategy to Combine Face Identification Tools with Clothing Similarity: Contesting or Reinforcing? . In Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008) ISBN 978-989-8111-24-1, pages 78-89. DOI: 10.5220/0002338500780089

in Bibtex Style

author={Saïd Kharbouche and Michel Plu},
title={Which Strategy to Combine Face Identification Tools with Clothing Similarity: Contesting or Reinforcing?},
booktitle={Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)},

in EndNote Style

JO - Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)
TI - Which Strategy to Combine Face Identification Tools with Clothing Similarity: Contesting or Reinforcing?
SN - 978-989-8111-24-1
AU - Kharbouche S.
AU - Plu M.
PY - 2008
SP - 78
EP - 89
DO - 10.5220/0002338500780089