Automatic Image Annotation using Visual Content and Folksonomies

Roland Mörzinger, Robert Sorschag, Georg Thallinger, Stefanie Lindstaedt



Automatic image annotation is an important and challenging task when managing large image collections. This paper describes techniques for automatic image annotation by taking advantage of collaboratively annotated image databases, so called visual folksonomies. Our approach applies two techniques based on image analysis: Classification annotates images with a controlled vocabulary while tag propagation uses user generated, folksonomic annotations and is therefore capable of dealing with an unlimited vocabulary. Experiments with a pool of Flickr images demonstrate the high accuracy and efficiency of the proposed methods in the task of automatic image annotation.


  1. I.T. Young, L.J. van Vliet, M. van Ginkel: Recursive Gabor Filtering. ICPR 7800: Proceedings of the Int. Conf. on Pattern Recognition, Vol. 50, Issue 11, Nov 2002, 2798 - 2805
  2. D. Forsyth, J. Ponce.: Computer Vision: A Modern Approach. Prentice Hall, 2002.
  3. Datta, Ritendra, Li, Jia, Wang, James Z.: Content-Based Image Retrieval - Approaches and Trends of the New Age. MIR 7805: Proc. of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, 2005
  4. A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta, R. Jain: Content-Based Image Retrieval at the End of the Early Years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
  5. A. Yavlinsky, E. Schofield, S. M. Rüger: Automated Image Annotation Using Global Features and Robust Nonparametric Density Estimation. Proc. of the 4th Int. Conf. on Image and Video Retrieval (CIVR), Vol. 3568, 507-517, July 2005
  6. C. Cusano, G. Ciocca, R. Schettini: Image annotation using SVM. Proceedings Of Internet imaging IV, SPIE, 2003
  7. B. S. Manjunath, J.-R. Ohm, V. V. Vasudevan, and A. Yamada: MPEG-7 color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 11, 703- 715, June 2001
  8. B. Shaw: Learning from a Visual Folksonomy. Automatically Annotating Images from Flickr. May 2006
  9. D.G. Lowe: Distinctive Image Features from Scale-Invariant Keypoints. Int. Journal of Computer Vision, 60(2), 91-110, 2004
  10. X. Li, L. Chen, L. Zhang, F. Lin, W.Y. Ma: Image Annotation by Large-Scale Content-based Image Retrieval. Proc. of ACM Int. Conf. on Multimedia, Santa Barbara, USA, 2006
  11. X. Wang, L. Zhang, F. Jing, W.Y. Ma: AnnoSearch: Image Auto-Annotation by Search. Proc. of the International Conference on Computer Vision and Pattern Recognition, New York, 2006
  12. D.R. Hardoon, C. Saunders, S. Szedmak, J. Shawe-Taylor: A Correlation Approach for Automatic Image Annotation. Int. Conf. on Advanced Data Mining and Applications, Springer LNAI 4093, 681-692, 2006
  13. N. Dalai, B. Triggs: Histograms of oriented gradients for human detection. Conf. on Computer Vision and Pattern Recognition, Vol. 1, 886-893, June 2005
  14. C. Chang, C.J. Lin: LIBSVM : a library for support vector machines. Software available at cjlin/libsvm
  15. D. Comaniciu, P. Meer: Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002.
  16. S. Ayache, G. Quenot, J. Gensel: Classifier Fusion for SVM-Based Multimedia Semantic Indexing. European Conf. on Information Retrieval, 2007
  17. J. Jeon, V. Lavrenko, R. Manmatha: Automatic image annotation and retrieval using crossmedia relevance models. ACM SIGIR Conference on Research and Development in Information Retrieval, 119-126, 2003.

Paper Citation

in Harvard Style

Mörzinger R., Sorschag R., Thallinger G. and Lindstaedt S. (2008). Automatic Image Annotation using Visual Content and Folksonomies . In Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008) ISBN 978-989-8111-24-1, pages 58-66. DOI: 10.5220/0002337600580066

in Bibtex Style

author={Roland Mörzinger and Robert Sorschag and Georg Thallinger and Stefanie Lindstaedt},
title={Automatic Image Annotation using Visual Content and Folksonomies},
booktitle={Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)},

in EndNote Style

JO - Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)
TI - Automatic Image Annotation using Visual Content and Folksonomies
SN - 978-989-8111-24-1
AU - Mörzinger R.
AU - Sorschag R.
AU - Thallinger G.
AU - Lindstaedt S.
PY - 2008
SP - 58
EP - 66
DO - 10.5220/0002337600580066