loading
  • Login
  • Sign-Up

Research.Publish.Connect.

Paper

Authors: Sven Hertling 1 ; Markus Schröder 1 ; Christian Jilek 1 and Andreas Dengel 2

Affiliations: 1 German Research Center for Artificial Intelligence (DFKI) GmbH, Germany ; 2 German Research Center for Artificial Intelligence (DFKI) GmbH and Knowledge-Based Systems Group, Germany

ISBN: 978-989-758-220-2

Keyword(s): Information Retrieval, GUI Automation, Accessibility Interface.

Related Ontology Subjects/Areas/Topics: Applications ; Artificial Intelligence ; Computational Intelligence ; Enterprise Information Systems ; Evolutionary Computing ; Human-Computer Interaction ; Intelligent User Interfaces ; Knowledge Discovery and Information Retrieval ; Knowledge Engineering and Ontology Development ; Knowledge-Based Systems ; Machine Learning ; Natural Language Processing ; Pattern Recognition ; Soft Computing ; Symbolic Systems

Abstract: In feature-rich software a wide range of functionality is spread across various menus, dialog windows, toolbars etc. Remembering where to find each feature is usually very hard, especially if it is not regularly used. We therefore provide a GUI search engine which is universally applicable to a large number of applications. Besides giving an overview of related approaches, we describe three major problems we had to solve, which are analyzing the GUI, understanding the users’ query and executing a suitable solution to find a desired UI element. Based on a user study we evaluated our approach and showed that it is particularly useful if a not regularly used feature is searched for. We already identified much potential for further applications based on our approach.

PDF ImageFull Text

Download
Sign In Guest: Register as new SCITEPRESS user or Join INSTICC now for free.

Sign In SCITEPRESS user: please login.

Sign In INSTICC Members: please login. If not a member yet, Join INSTICC now for free.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.162.203.39. INSTICC members have higher download limits (free membership now)

In the current month:
Recent papers: 1 available of 1 total
2+ years older papers: 2 available of 2 total

Paper citation in several formats:
Hertling S., Schröder M., Jilek C. and Dengel A. (2017). Where is that Button Again?! – Towards a Universal GUI Search Engine.In Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-220-2, pages 217-227. DOI: 10.5220/0006201402170227

@conference{icaart17,
author={Sven Hertling and Markus Schröder and Christian Jilek and Andreas Dengel},
title={Where is that Button Again?! – Towards a Universal GUI Search Engine},
booktitle={Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2017},
pages={217-227},
publisher={ScitePress},
organization={INSTICC},
doi={10.5220/0006201402170227},
isbn={978-989-758-220-2},
}

TY - CONF

JO - Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Where is that Button Again?! – Towards a Universal GUI Search Engine
SN - 978-989-758-220-2
AU - Hertling S.
AU - Schröder M.
AU - Jilek C.
AU - Dengel A.
PY - 2017
SP - 217
EP - 227
DO - 10.5220/0006201402170227

Sorted by: Show papers

Note: The preferred Subjects/Areas/Topics, listed below for each paper, are those that match the selected paper topics and their ontology superclasses.
More...

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.

Show authors

Note: The preferred Subjects/Areas/Topics, listed below for each author, are those that more frequently used in the author's papers.
More...