Authors:
João Freitas
1
;
António Teixeira
2
;
Samuel Silva
2
;
Catarina Oliveira
2
and
Miguel Sales Dias
3
Affiliations:
1
Microsoft Language Development Center and University of Aveiro, Portugal
;
2
University of Aveiro, Portugal
;
3
Microsoft Language Development Center and ISCTE-University Institute of Lisbon, Portugal
Keyword(s):
Nasal Vowels Detection, Surface Electromyography, Silent Speech Interfaces.
Related
Ontology
Subjects/Areas/Topics:
Biomedical Engineering
;
Biomedical Signal Processing
;
Cybernetics and User Interface Technologies
;
Devices
;
Health Information Systems
;
Human-Computer Interaction
;
Information and Systems Security
;
Physiological Computing Systems
;
Physiological Processes and Bio-Signal Modeling, Non-Linear Dynamics
;
Speech Recognition
;
Wearable Sensors and Systems
Abstract:
Conventional speech communication systems do not perform well in the absence of an intelligible acoustic signal. Silent Speech Interfaces enable speech communication to take place with speech-handicapped users and in noisy environments. However, since no acoustic signal is available, information on nasality may be absent, which is an important and relevant characteristic of several languages, particularly European Portuguese. In this paper we propose a non-invasive method – surface Electromyography (EMG) electrodes - positioned in the face and neck regions to explore the existence of useful information about the velum movement. The applied procedure takes advantage of Real-Time Magnetic Resonance Imaging (RT-MRI) data, collected from the same speakers, to interpret and validate EMG data. By ensuring compatible scenario conditions and proper alignment between the EMG and RT-MRI data, we are able to estimate when the velum moves and the probable type of movement under a nasality occurr
ence. Overall results of this experiment revealed interesting and distinct characteristics in the EMG signal when a nasal vowel is uttered and that it is possible to detect velum movement, particularly by sensors positioned below the ear between the mastoid process and the mandible in the upper neck region.
(More)