Authors:
Toon De Pessemier
1
;
Laurens Van Acker
2
;
Emilie Van Dijck
3
;
Karin Slegers
3
;
Wout Joseph
1
and
Luc Martens
1
Affiliations:
1
Ghent University / IBBT, Belgium
;
2
Hogeschool Gent, Belgium
;
3
K. U. Leuven / IBBT, Belgium
Keyword(s):
Communication Assistant, Hearing-impaired, Context Clarification.
Related
Ontology
Subjects/Areas/Topics:
Mobile Information Systems
;
Mobile Navigation and Assistance
;
Web Information Systems and Technologies
Abstract:
Children and young people who are deaf or have hearing impairments do not master the spoken and written language well. Moreover, their friends and relatives do not always speak sign language. In this research, a communication aid is developed on the Google Android mobile operating system to reduce these barriers by converting text into relevant images and movies thereby clarifying the meaning of the text. Users can select text from webpages, e-mail and SMS messages, or text can be generated using speech recognition or optical character recognition as input source. The communication tool analyzes the sentences and tries to understand the context and meaning of the text in order to select the most appropriate visual content originating from online sources like YouTube, Flickr, Google Images, and Vimeo. User tests and focus groups with deaf children and interviews with experts in the field of deaf and hard hearing people confirmed the need for a communication aid and proved the utility
of the proposed tool.
(More)