Towards an Interpretable Spanish Sign Language Recognizer

Itsaso Rodríguez-Moreno, José María Martínez-Otzeta, Izaro Goienetxea, Basilio Sierra

2022

Abstract

A significant part of the global population lives with hearing impairments, and the number of affected people is expected to increase in the coming decades. People with hearing problems experience daily difficulties in their interaction with non-deaf people, due to the lack of a widespread knowledge of sign languages by the general public. In this paper we present a blueprint for a sign language recognizer that takes advantage of the internal structure of the signs of the Spanish Sign Language (SSL). While the current dominant approaches are those based in deep learning and training with lot of recorded examples, we propose a system in which the signs are decomposed into constituents which are in turn recognized by a classical classifier and then assessed if their combination is congruent with a regular expression associated with a whole sign. While the deep learning with many examples approach works for every possible collection of signs, our suggestion is that we could leverage the known structure of the sign language in order to create simpler and more interpretable classifiers that could offer a good trade-off between accuracy and interpretability. This characteristic makes this approach adequate for using the system as part of a tutor or to gain insight into the inner workings of the recognizer.

Paper Citation

in Harvard Style

Rodríguez-Moreno I., Martínez-Otzeta J., Goienetxea I. and Sierra B. (2022). Towards an Interpretable Spanish Sign Language Recognizer. In Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-549-4, pages 622-629. DOI: 10.5220/0010870700003122

in Bibtex Style

@conference{icpram22,
author={Itsaso Rodríguez-Moreno and José María Martínez-Otzeta and Izaro Goienetxea and Basilio Sierra},
title={Towards an Interpretable Spanish Sign Language Recognizer},
booktitle={Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2022},
pages={622-629},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010870700003122},
isbn={978-989-758-549-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Towards an Interpretable Spanish Sign Language Recognizer
SN - 978-989-758-549-4
AU - Rodríguez-Moreno I.
AU - Martínez-Otzeta J.
AU - Goienetxea I.
AU - Sierra B.
PY - 2022
SP - 622
EP - 629
DO - 10.5220/0010870700003122