Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users

Michela Ferron, Michela Ferron, Nadia Mana, Nadia Mana, Ornella Mich, Ornella Mich, Christopher Reeves, Christopher Reeves

Abstract

This paper presents two early studies aimed at investigating issues concerning the design of multimodal interaction - based on voice commands and mid-air gestures - with mobile technology specifically designed for visually impaired and elderly users. These studies have been carried out on a new device allowing enhanced speech recognition (interpreting lip movements) and mid-air gesture interaction on Android devices (smartphone and tablet PC). The initial findings and challenges raised by these novel interaction modalities are discussed. These mainly centre on issues of feedback and feedforward, the avoidance of false positives and point of reference or orientation issues regarding the device and the mid-air gestures.

References

Download


Paper Citation


in Harvard Style

Ferron M., Mana N., Mich O. and Reeves C. (2018). Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users.In Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP, ISBN 978-989-758-288-2, pages 140-146. DOI: 10.5220/0006638901400146


in Bibtex Style

@conference{hucapp18,
author={Michela Ferron and Nadia Mana and Ornella Mich and Christopher Reeves},
title={Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users},
booktitle={Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP,},
year={2018},
pages={140-146},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006638901400146},
isbn={978-989-758-288-2},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP,
TI - Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users
SN - 978-989-758-288-2
AU - Ferron M.
AU - Mana N.
AU - Mich O.
AU - Reeves C.
PY - 2018
SP - 140
EP - 146
DO - 10.5220/0006638901400146


in Harvard Style

Ferron M., Mana N., Mich O. and Reeves C. (2018). Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users.In - HUCAPP, ISBN , pages 0-0. DOI: 10.5220/0006638901400146


in Bibtex Style

@conference{hucapp18,
author={Michela Ferron and Nadia Mana and Ornella Mich and Christopher Reeves},
title={Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users},
booktitle={ - HUCAPP,},
year={2018},
pages={},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006638901400146},
isbn={},
}


in EndNote Style

TY - CONF

JO - - HUCAPP,
TI - Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users
SN -
AU - Ferron M.
AU - Mana N.
AU - Mich O.
AU - Reeves C.
PY - 2018
SP - 0
EP - 0
DO - 10.5220/0006638901400146