Extracting Primary Objects and Spatial Relations from Sentences

Neha Baranwal, Avinash Kumar Singh, Suna Bensch

2019

Abstract

In verbal human-robot interaction natural language utterances have to be grounded in visual scenes by the robot. Visual language grounding is a challenging task that includes identifying a primary object among several objects, together with the object properties and spatial relations among the objects. In this paper we focus on extracting this information from sentences only. We propose two language modelling techniques, one uses regular expressions and the other one utilizes Euclidian distance. We compare these two proposed techniques with two other techniques that utilize tree structures, namely an extended Hobb’s algorithm and an algorithm that utilizes a Stanford parse tree. A comparative analysis between all language modelling techniques shows that our proposed two approaches require less computational time than the tree-based approaches. All approaches perform good identifying the primary object and its property, but for spatial relation extraction the Stanford parse tree algorithm performs better than the other language modelling techniques. Time elapsed for the Stanford parse tree algorithm is higher than for the other techniques.

Paper Citation

in Harvard Style

Baranwal N., Singh A. and Bensch S. (2019). Extracting Primary Objects and Spatial Relations from Sentences.In Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-350-6, pages 252-259. DOI: 10.5220/0007570002520259

in Bibtex Style

@conference{icaart19,
author={Neha Baranwal and Avinash Singh and Suna Bensch},
title={Extracting Primary Objects and Spatial Relations from Sentences},
booktitle={Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2019},
pages={252-259},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007570002520259},
isbn={978-989-758-350-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Extracting Primary Objects and Spatial Relations from Sentences
SN - 978-989-758-350-6
AU - Baranwal N.
AU - Singh A.
AU - Bensch S.
PY - 2019
SP - 252
EP - 259
DO - 10.5220/0007570002520259