Authors: Marco Stricker 1 ; Syed Saqib Bukhari 1 ; Damian Borth 1 and Andreas Dengel 2

Affiliations: 1 German Research Center for Artificial Intelligence (DFKI), Germany ; 2 German Research Center for Artificial Intelligence (DFKI) and Technical University of Kaiserslautern, Germany

ISBN: 978-989-758-275-2

Keyword(s): Saliency Detection, Human Gaze, Adjective Noun Pairs, Neural Networks.

Related Ontology Subjects/Areas/Topics: Artificial Intelligence ; Biomedical Engineering ; Biomedical Signal Processing ; Computational Intelligence ; Health Engineering and Technology Applications ; Human-Computer Interaction ; Methodologies and Methods ; Neural Networks ; Neurocomputing ; Neurotechnology, Electronics and Informatics ; Pattern Recognition ; Physiological Computing Systems ; Sensor Networks ; Signal Processing ; Soft Computing ; Theory and Methods ; Vision and Perception

Abstract: This paper investigates if it is possible to increase the accuracy of Convolutional Neural Networks trained on Adjective Noun Concepts with the help of saliency models. Although image classification reaches high accuracy rates, the same level of accuracy is not reached for Adjective Noun Pairs, due to multiple problems. Several benefits can be gained through understanding Adjective Noun Pairs, like automatically tagging large image databases and understanding the sentiment of these images. This knowledge can be used for e.g. a better advertisement system. In order to improve such a sentiment classification system a previous work focused on searching saliency methods that can reproduce the human gaze on Adjective Noun Pairs and found out that “Graph-Based Visual Saliency” belonged to the best for this problem. Utilizing these results we used the “Graph-Based Visual Saliency” method on a big dataset of Adjective Noun Pairs and incorporated these saliency data in the training ph ase of the Convolutional Neural Network. We tried out three different approaches to incorporate this information in three different cases of Adjective Noun Pair combinations. These cases either share a common adjective or a common noun or are completely different. Our results showed only slight improvements which were not significantly better besides for one technique in one case. (More)

PDF ImageFull Text


Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Stricker, M.; Bukhari, S.; Borth, D. and Dengel, A. (2018). Saliency based Adjective Noun Pair Detection System.In Proceedings of the 10th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-275-2, pages 387-394. DOI: 10.5220/0006578303870394

author={Marco Stricker. and Syed Saqib Bukhari. and Damian Borth. and Andreas Dengel.},
title={Saliency based Adjective Noun Pair Detection System},
booktitle={Proceedings of the 10th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},


JO - Proceedings of the 10th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Saliency based Adjective Noun Pair Detection System
SN - 978-989-758-275-2
AU - Stricker, M.
AU - Bukhari, S.
AU - Borth, D.
AU - Dengel, A.
PY - 2018
SP - 387
EP - 394
DO - 10.5220/0006578303870394

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.