loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Christopher Baumgärtner and Wolfgang Menzel

Affiliation: University of Hamburg, Germany

Keyword(s): Natural Language Parsing, Cross-modal Interaction.

Abstract: We present a system for integrating knowledge about complex visual scenes into the process of natural language comprehension. The implemented system is able to choose a scene of reference for a natural language sentence from a large set of scene descriptions. This scene is then used to influence the analysis of a sentence generated by a broad coverage language parser. In addition, objects and actions referred to by the sentence are visualized by a saliency map which is derived from the bi-directional influence of top down and bottom-up information on a model of visual attention highlighting the regions with the highest probability of attracting the attention of an observer.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.188.142.146

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Baumgärtner, C. and Menzel, W. (2012). Integrating a Model for Visual Attention into a System for Natural Language Parsing. In Proceedings of the 9th International Workshop on Natural Language Processing and Cognitive Science (ICEIS 2012) - NLPCS; ISBN 978-989-8565-16-7, SciTePress, pages 24-33. DOI: 10.5220/0004088100240033

@conference{nlpcs12,
author={Christopher Baumgärtner. and Wolfgang Menzel.},
title={Integrating a Model for Visual Attention into a System for Natural Language Parsing},
booktitle={Proceedings of the 9th International Workshop on Natural Language Processing and Cognitive Science (ICEIS 2012) - NLPCS},
year={2012},
pages={24-33},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004088100240033},
isbn={978-989-8565-16-7},
}

TY - CONF

JO - Proceedings of the 9th International Workshop on Natural Language Processing and Cognitive Science (ICEIS 2012) - NLPCS
TI - Integrating a Model for Visual Attention into a System for Natural Language Parsing
SN - 978-989-8565-16-7
AU - Baumgärtner, C.
AU - Menzel, W.
PY - 2012
SP - 24
EP - 33
DO - 10.5220/0004088100240033
PB - SciTePress