An Approach to Natural Language Understanding Based on a Mental Image Model

Masao Yokota

Abstract

The Mental Image Directed Semantic Theory (MIDST) has proposed an omnisensual mental image model and its description language Lmd. This paper presents a brief sketch of the MIDST, and focuses on word meaning description and text understanding in association with the mental image model in view of cross-media reference between text and picture.

References

  1. Yokota,M. et al: Mental-image directed semantic theory and its application to natural language understanding systems. Proc. of NLPRS'91 (1991) 280-287
  2. Oda,S., Oda,M., Yokota,M. : Conceptual Analysis Description of Words for Color and Lightness for Grounding them on Sensory Data. Trans. of JSAI,Vol.16-5-E (2001) 436- 444
  3. Hironaka, D, Yokota, M.: Multimedia Description Language and Its Application to Crossmedia Referencing Systems. Proc. of DEXA workshop, Zaragoza, Spain (2004) 318-323
  4. Yokota,M., Shiraishi,M., Capi,G.: Human-robot communication through a mind model based on the Mental Image Directed Semantic Theory. Proc. of the 10th International Symposium on Artificial Life and Robotics (AROB 7805), Oita, Japan (2005) 695-698
  5. Dorr,B., Bonnie,J.: Large-Scale Dictionary Construction for Foreign Language Tutoring and Interlingual Machine Translation. Machine Translation, Vol.12-4 (1997) 271-322
  6. Zarri,G.P.: NKRL, a Knowledge Representation Tool for Encoding the Meaning of Complex Narrative Texts, Natural Language Engineering. Special Issue on Knowledge Representation for Natural Language Processing in Implemented Systems, Vol.3 (1997) 231-253
  7. Sowa,J.F.: Knowledge Representation: Logical, Philosophical, and Computational Foundations, Brooks Cole Publishing Co., Pacific Grove, CA (2000)
  8. Miller,G.A., Johnson-Laird,P.N.:Language and Perception, Harvard University Press (1976)
  9. Langacker,R.: Concept, Image and Symbol, Mouton de Gruyter, Berlin/New York (1991)
  10. Adorni,G., Di Manzo,M., Giunchiglia,F.: “Natural Language Driven Image Generation,” Proc. of COLING 84 (1984) 495-500
  11. Yamada, A. et al: “Reconstructing spatial image from natural language texts,” Proc. of COLING 92, Nantes (1992) 1279-1283
  12. Allen, J.F.: Towards a general theory of action and time. Artificial Intelligence, Vol.23-2 (1984) 123-154
  13. McDermott,D.V.: A temporal logic for reasoning about processes and plans. Cognitive Science, Vol.6 (1982) 101-155
  14. Shoham,Y.: Time for actions: on the relationship between time, knowledge, and action. Proc. of IJCAI\89, Detroit, MI (1989) 954-959
  15. Eakins,J.P., Graham,M.E.: Content-based Image Retrieval: A report to the JISC Technology Applications Programme. Institute for Image Data Research, University of Northumbria at Newcastle, January (1999)
  16. Kherfi,M.L., Ziou,D., Bernardi,A.: Image Retrieval from the World Wide Web : Issues, Techniques and Systems. ACM Computer Surveys, Vol.36-14 (2004) 35-67
Download


Paper Citation


in Harvard Style

Yokota M. (2005). An Approach to Natural Language Understanding Based on a Mental Image Model . In Proceedings of the 2nd International Workshop on Natural Language Understanding and Cognitive Science - Volume 1: NLUCS, (ICEIS 2005) ISBN 972-8865-23-6X, pages 22-31. DOI: 10.5220/0002562400220031


in Bibtex Style

@conference{nlucs05,
author={Masao Yokota},
title={An Approach to Natural Language Understanding Based on a Mental Image Model},
booktitle={Proceedings of the 2nd International Workshop on Natural Language Understanding and Cognitive Science - Volume 1: NLUCS, (ICEIS 2005)},
year={2005},
pages={22-31},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002562400220031},
isbn={972-8865-23-6X},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Workshop on Natural Language Understanding and Cognitive Science - Volume 1: NLUCS, (ICEIS 2005)
TI - An Approach to Natural Language Understanding Based on a Mental Image Model
SN - 972-8865-23-6X
AU - Yokota M.
PY - 2005
SP - 22
EP - 31
DO - 10.5220/0002562400220031