loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Ricardo Ribani and Mauricio Marengoni

Affiliation: Universidade Presbiteriana Mackenzie, São Paulo and Brazil

Keyword(s): Vibrotactile, Vision Substitution, Deep Learning, Object Detection.

Related Ontology Subjects/Areas/Topics: Applications and Services ; Computer Vision, Visualization and Computer Graphics ; Enterprise Information Systems ; Human and Computer Interaction ; Human-Computer Interaction

Abstract: The present work proposes the creation of a system that implements sensory substitution of vision through a wearable item with vibration motors positioned on the back of the user. In addition to the developed hardware, the proposal consists in the construction of a system that uses deep learning techniques to detect and classify objects in controlled environments. The hardware comprise of a simple HD camera, a pair of Arduinos, 9 cylindrical DC motors and a Raspberry Pi (responsible for the image processing and to translate the signal to the Arduinos). In the first trial of image classification and localization, the ResNet-50 model pre-trained with the ImageNet database was tried. Then we implemented a Single Shot Detector with a MobileNetV2 to perform real-time detection on the Raspberry Pi, sending the detected object class and location as defined patterns to the motors.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.88.16.192

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Ribani, R. and Marengoni, M. (2019). Vision Substitution with Object Detection and Vibrotactile Stimulus. In Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 4: VISAPP; ISBN 978-989-758-354-4; ISSN 2184-4321, SciTePress, pages 584-590. DOI: 10.5220/0007577205840590

@conference{visapp19,
author={Ricardo Ribani. and Mauricio Marengoni.},
title={Vision Substitution with Object Detection and Vibrotactile Stimulus},
booktitle={Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 4: VISAPP},
year={2019},
pages={584-590},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007577205840590},
isbn={978-989-758-354-4},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019) - Volume 4: VISAPP
TI - Vision Substitution with Object Detection and Vibrotactile Stimulus
SN - 978-989-758-354-4
IS - 2184-4321
AU - Ribani, R.
AU - Marengoni, M.
PY - 2019
SP - 584
EP - 590
DO - 10.5220/0007577205840590
PB - SciTePress