Authors:
Gabor Balazs
1
;
2
;
Mateusz Chmurski
1
;
3
;
Walter Stechele
2
and
Mariusz Zubert
3
Affiliations:
1
Infineon Technologies AG, Am Campeon 1-15, Neubiberg, Germany
;
2
Technical University of Munich, Munich, Germany
;
3
Lodz University of Technology, Lodz, Poland
Keyword(s):
Sensor Fusion, Gesture Recognition, Convolutional Neural Network, Radar, Time of Flight.
Abstract:
The goal of hand gesture recognition based on time-of-flight and radar sensors is to enhance the human-machine interface, while taking care of privacy issues of camera sensors. Additionally, the system needs to be deployable on low-power edge devices for applicability in serial-produced vehicles. Recent advances show the capabilities of deep neural networks for gesture classification but they are still limited to high performance hardware. Embedded neural network accelerators are constrained in memory and supported operations. These limitations form an architectural design problem that is addressed in this work. Novel gesture classification networks are optimized for embedded deployment. The new approaches perform equally compared to high-performance neural networks with 3D convolutions, but need only 8.9% of the memory. These lightweight network architectures allow deployment on constrained embedded accelerator devices, thus enhancing human-machine interfaces.