Real-Time Gesture Recognition using a Particle Filtering Approach

Frédéric Li, Lukas Köping, Sebastian Schmitz, Marcin Grzegorzek


In this paper we present an approach for real-time gesture recognition using exclusively 1D sensor data, based on the use of Particle Filters and Dynamic Time Warping Barycenter Averaging (DBA). In a training phase, sensor records of users performing different gestures are acquired. For each gesture, the associated sensor records are then processed by the DBA method to produce one average record called template gesture. Once trained, our system classifies one gesture performed in real-time, by computing -using particle filters- an estimation of its probability of belonging to each class, based on the comparison of the sensor values acquired in real-time to those of the template gestures. Our method is tested on the accelerometer data of the Multimodal Human Activities Dataset (MHAD) using the Leave-One-Out cross validation, and compared with state-of-the-art approaches (SVM, Neural Networks) adapted for real-time gesture recognition. It manages to achieve a 85.30% average accuracy and outperform the others, without the need to define hyper-parameters whose choice could be restrained by real-time implementation considerations.


  1. Akl, A., Feng, C., and Valaee, S. (2011). A novel accelerometer-based gesture recognition system. IEEE Transactions on Signal Processing, 59(12):6197-6205.
  2. Arulampalam, M. S., Maskell, S., Gordon, N., and Clapp, T. (2002). A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Transactions on Signal Processing, 50(2):174-188.
  3. Black, M. J. and Jepson, A. D. (1998). A probabilistic framework for matching temporal trajectories: Condensation-based recognition of gestures and expressions. In Computer Vision - ECCV'98: 5th European Conference on Computer Vision Freiburg, Germany, June, 2-6, 1998 Proceedings, Volume I” , pages 909-924.
  4. Caramiaux, B., Montecchio, N., Tanaka, A., and Bevilacqua, F. (2014). Adaptive gesture recognition with variation estimation for interactive systems. ACM Trans. Interact. Intell. Syst., 4(4):18:1-18:34.
  5. Chudgar, H. S., Mukherjee, S., and Sharma, K. (2014). S control: Accelerometer-based gesture recognition for media control. In Advances in Electronics, Computers and Communications (ICAECC), 2014 International Conference on, pages 1-6.
  6. Doucet, A., Godsill, S., and Andrieu, C. (2000). On Sequential Monte Carlo Sampling Methods for Bayesian Filtering. Statistics and Computing, 10(3):197-208.
  7. Gordon, N. J., Salmond, D. J., and Smith, A. F. M. (1993). Novel approach to nonlinear/non-gaussian bayesian state estimation. volume 140, pages 107-113.
  8. Isard, M. and Blake, A. (1998). Condensation - conditional density propagation for visual tracking. International Journal of Computer Vision, 29(1):5-28.
  9. Liu, J., Zhong, L., Wickramasuriya, J., and Vasudevan, V. (2009). uwave: Accelerometer-based personalized gesture recognition and its applications. Pervasive and Mobile Computing, 5(6):657 - 675. PerCom 2009.
  10. Liu, J. S. and Chen, R. (1998). Sequential monte carlo methods for dynamic systems. Journal of the American statistical association, 93(443):1032-1044.
  11. Mitra, S. and Acharya, T. (2007). Gesture recognition: A survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 37(3):311-324.
  12. Ofli, F., Chaudhry, R., Kurillo, G., Vidal, R., and Bajcsy, R. (2013). Berkeley mhad: A comprehensive multimodal human action database. In Applications of Computer Vision (WACV), 2013 IEEE Workshop on, pages 53- 60.
  13. Petitjean, F. and Ganc¸arski, P. (2012). Summarizing a set of time series by averaging: From steiner sequence to compact multiple alignment. Theoretical Computer Science, 414(1):76-91.
  14. Shoaib, M., Bosch, S., Incel, O., H.Scholten, and Havinga, P. (2015). A survey of online activity recognition using mobile phones. Sensors, 15:2059-2085.

Paper Citation

in Harvard Style

Li F., Köping L., Schmitz S. and Grzegorzek M. (2017). Real-Time Gesture Recognition using a Particle Filtering Approach . In Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-222-6, pages 394-401. DOI: 10.5220/0006189603940401

in Bibtex Style

author={Frédéric Li and Lukas Köping and Sebastian Schmitz and Marcin Grzegorzek},
title={Real-Time Gesture Recognition using a Particle Filtering Approach},
booktitle={Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},

in EndNote Style

JO - Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Real-Time Gesture Recognition using a Particle Filtering Approach
SN - 978-989-758-222-6
AU - Li F.
AU - Köping L.
AU - Schmitz S.
AU - Grzegorzek M.
PY - 2017
SP - 394
EP - 401
DO - 10.5220/0006189603940401