Describing the Where – Improving Image Annotation and Search through Geography

Ross S. Purves, Alistair Edwardes, Mark Sanderson



Image retrieval, using either content or text-based techniques, does not match up to the current quality of standard text retrieval. One possible reason for this mismatch is the semantic gap – the terms by which images are indexed do not accord with those imagined by users querying image databases. In this paper we set out to describe how geography might help to index the where facet of the Pansofsky-Shatford matrix, which has previously been shown to accord well with the types of queries users make. We illustrate these ideas with existing (e.g. identifying place names associated with a set of coordinates) and novel (e.g. describing images using land cover data) techniques to describe images and contend that such methods will become central as increasing numbers of images become georeferenced.


  1. Ahern, S., Naaman, M., Nair, R., Yang, J.: World Explorer: Visualizing Aggregate Data from Unstructured Text in Geo-Referenced Collections. In Proceedings, Seventh ACM/IEEE-CS Joint Conference on Digital Libraries, (JCDL 07), June 2007, Vancouver, British Columbia, Canada. (2007)
  2. Ahn L. von, Dabbish, L.: Labeling Images with a Computer Game. In ACM Conference on Human Factors in Computing Systems. ACM, New York (2004) 319-326
  3. Armitage, L.H., Enser, P.G.B.: Analysis of user need in image archives. J. Info. Sci. 23 (1997) 287-299
  4. Battig, W. F., Montague, W. E.: Category norms for verbal items in 56 categories: a replication and extension of the Connecticut Norms. J. Expt. Psych. 80 (1969) 1-46.
  5. Carver, S., Evans, A.J., Fritz, S.: Wilderness attribute mapping in the United Kingdom. International Journal of Wilderness. 8 (2002) 24-29
  6. Craik, K.H.: Appraising the Objectivity of Landscape Dimensions. In: Krutilla, J.V. (ed): Natural Environments: Studies in Theoretical and Applied Analysis. John-Hopkins Uni. Press, Baltimore (1971) 292-346
  7. Deselaers, T., Müller, H., Clough, P., Ney, H., Lehmann. T.M.: The CLEF 2005 Automatic Medical Image Annotation Task. International Journal of Computer Vision. 74 (2007) 51-58
  8. Edwardes, A.J and Purves, R.S. A theoretical grounding for semantic descriptions of place. To appear in Proceedings of W2GIS.
  9. , 7807, over 30 million Flickr images were associated with coordinates
  10. Edwardes, A.J.: Re-placing Location: Geographic Perspectives in Location Based Services, Ph.D Thesis, University of Zurich (2007)
  11. Egenhofer, M.J.: Toward the semantic geospatial web. In: Voisard, A. and Chen, S.C. (eds.): Proceedings of the 10th ACM International Symposium In Geographic Information Systems. ACM Press, New York (2002) 1-4
  12. Enser, P.: Visual image retrieval: seeking the alliance of concept-based ad content-based paradigms. Journal of Information Science. 26 (2000) 199-210
  13. Fisher, P., Wood, J., Cheng, T.: Where is Helvellyn? Fuzziness of Multiscale Landscape Morphometry. Transactions of the Institute of British Geographers. 29 (2004) 106-128
  14. Goodrum, A. A.: Image Information Retrieval: An Overview of Current Research. Informing Science. 3 (2000), 64-67
  15. Hill, L.L., Frew, J., Zheng, Q.: Geographic names. The implementation of a gazetteer in a georeferenced digital library. Dig. Lib. 5 (1999)
  16. Iwahashi, J., Pike, R.J.: Automated classifications of topography from DEMs by an unsupervised nested-means algorithm and a three-part geometric signature. Geomorphology. 86 (2007) 409-440
  17. Jones, C.B., Purves, R.S., Clough, P.D AND Joho, H.: Modelling Vague Places with Knowledge from the Web. Int. J. of Geog. Info. Sci. (In press)
  18. MacFarlane, R., Haggett, C., Fuller, D., Dunsford, H. and Carlisle, B. (2004). Tranquillity Mapping: developing a robust methodology for planning support, Report to the Campaign
  19. Montello, D., Goodchild, M., Gottsegen, J., Fohl, P.: Where's Downtown?: Behavioral Methods for Determining Referents of Vague Spatial Queries. Spatial Cognition and Computation 3 (2003)185-204.
  20. Naaman, M., Harada, S., Wang, Q., Garcia-Molina, H., and Paepcke, A.: Context data in geo-referenced digital photo collections. In: Proceedings of the 12th Annual ACM international Conference on Multimedia (MULTIMEDIA 7804) ACM Press, NY (2004) 196-203.
  21. Naaman, M., Song, Y.J., Paepcke, A., Garcia-Molina, H: Assigning textual names to sets of geographic coordinates, Comp. Env. and Urban Sys. 30 (2006) 418-435
  22. O'Hare, N., Lee, H., Cooray, S., Gurrin, C., Jones, G.J.F., Malobabic, J., O'Connor, N.E. Smeaton, A.F., Uscilowski, B.: MediAssist: Using Content-Based Analysis and Context to Manage Personal Photo Collections. In: Proceedings of the 5th International Conference on Image and Video Retrieval (CIVR 2006). Tempe, AZ, U.S.A., (2006) 529-532
  23. Pasley, R.C., Clough, P. and Sanderson, M.: Geo-Tagging for Imprecise Regions of Different Sizes. In: Proceedings of GIR07. ACM, New York (2007) 77-82.
  24. Shatford, S: Analyzing the subject of a picture: a theoretical approach. Catalog. and Class. Quart. 6 (1986) 39-62
  25. Smeulders A.W.M., Worring, M., Santini, S., Gupta, A. Jain, R.: Content-Based Image Retrieval at the End of the Early Years, IEEE Trans. on PAMI 22 (2000) 1349-1380
  26. Smith B., Mark D. M.: Do mountains exist? Towards an ontology of landforms. Environment and Planning B: Planning and Design. 30 (2003) 411-427
  27. Smith, B. and Mark, D.M.: Geographical categories: an ontological investigation. Int. J. of Geog. Info. Sci. to Protect Rural England, Countryside Agency, North East Assembly, Northumberland Strategic Partnership, Northumberland National Park Authority and Durham County Council, Centre for Environmental & Spatial Analysis, Northumbria University. 15(2001) 59-612
  28. Turk, M.A., Pentland, A.P.: Face Recognition Using Eigenfaces. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR). (1991) 586-591.
  29. Tversky, B. and Hemenway, K., Categories of Environmental Scenes. Cogn. Psych. 15 (1983) 121-149.
  30. Worboys, M. F., Nearness relations in environmental space. Int. J. of Geog. Info. Sci. 15 (2001) 633-651
  31. Yang, M-H., Kriegman, D.J.; Ahuja, N.: Detecting faces in images: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence. 24 (2002) 34-58

Paper Citation

in Harvard Style

S. Purves R., Edwardes A. and Sanderson M. (2008). Describing the Where – Improving Image Annotation and Search through Geography . In Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008) ISBN 978-989-8111-24-1, pages 105-114. DOI: 10.5220/0002338401050114

in Bibtex Style

author={Ross S. Purves and Alistair Edwardes and Mark Sanderson},
title={Describing the Where – Improving Image Annotation and Search through Geography},
booktitle={Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)},

in EndNote Style

JO - Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)
TI - Describing the Where – Improving Image Annotation and Search through Geography
SN - 978-989-8111-24-1
AU - S. Purves R.
AU - Edwardes A.
AU - Sanderson M.
PY - 2008
SP - 105
EP - 114
DO - 10.5220/0002338401050114