Elena Sokolova, Mikhail Boldasov



We present an experiment of image annotating for photographs of one collection on base of ontology. A fragment of ontology, which consists of concepts of visual objects, their features and relations, is constructed using SemTalk2 software tool. Using this ontology there are prepared semantic annotations for photographs from the collection. Semantic annotations are ready for their further automatic processing. We consider them as input for automatic generation of photograph descriptions in a given NL. In this paper we discuss types of visual concepts, structure of Ontology and Image Models and their possible applications.


  1. Gornostay T., Aker A. Development and implementation of multilingual object type toponym-referenced text corpora for optimizing automatic image description genereation // Proceedings of the Conference on computational linguistics and intellectual technologies DIALOG'2009 - 2009, Bekasovo, Russia May 27-31, 2009. Pages: 580 - 587.
  2. Deschacht K., Moens M-F. Text analysis for automatic image annotation // The 45th Annual meeting of the Association for Computational Linguistics, Prague, June 2007. 1126.pdf
  3. Schreiber A.Th., Dubbeldam B., Wielemaker J., Wielinga B.J. Ontology-based photo annotation //IEEE Intelligent systems, 16(3):66-74, May-June 2001.
  4. Hollink L., Shreiber G., Wielemaker J., Wielinga B. Semantic annotation of image collections // S. Handschuh, M. Koivunen, R. Dieng, and S. Staab, editors, Knowledge Capture 2003. Proceedings Knowledge Markup and Semantic Annotation Workshop, Florida, USA, October 2003. P. 41-48.
  5. Kruijff G-J., Bateman J., Teich E., Sharof S., Sokolova L., Kruijff-Korbayova I., Skoumalova H., Staykova K., Hana J., Hartley T. Multilinguality in a text generation system for three Slavic languages // Proceedings of the 18th conference on Computational linguistics - Volume 1, 2000, Saarbr?cken, Germany July 31 - August 04, 2000. Pages: 474 - 480.
  6. Boldasov M.V., Sokolova E.G. User query understanding by the InBASE system as a source for Multilingual NL generation module // Text, Speech and Dialogue (P. Sojka, I. Kopecek and K. Pala eds.). - Proceedings of the 5th International conference, TSD 2002, Brno, Czech Republic, September 2002. Springer-Verlag Berlin Heidelberg, Germany, 2002. Pages: 33-40.
  7. Boldasov M.V., Sokolova E.G. QGen - generation module for the register restricted InBASE system // Computational linguistics and intelligent text processing (A.Gelbukh ed.). - Proceedings of the 4th International conference, CICLing 2003, Mexico City, Mexico, September 2002. Springer Berlin Heidelberg, Germany, 2003. Pages: 465-476.
  8. Tam, A.M. Leung, C.H.C. Structured Natural-Language description for semantic content retrieval // Journal of the American Society for Information Science and Technology Vol. 52(11), September 2001. Pages: 930 - 937.
  9. Hunter J. Adding multimedia to the semantic Web - building an MPEG-7 ontology // Proceedings of International Semantic Web Working Symposium (SWWS), Stanford, July 30 - August 1, 2001 .

Paper Citation

in Harvard Style

Sokolova E. and Boldasov M. (2009). KNOWLEDGE-BASED IMAGE ANNOTATING . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2009) ISBN 978-989-674-012-2, pages 376-379. DOI: 10.5220/0002276303760379

in Bibtex Style

author={Elena Sokolova and Mikhail Boldasov},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2009)},

in EndNote Style

JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2009)
SN - 978-989-674-012-2
AU - Sokolova E.
AU - Boldasov M.
PY - 2009
SP - 376
EP - 379
DO - 10.5220/0002276303760379