EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking

Thiago Santini, Wolfgang Fuhl, David Geisler, Enkelejda Kasneci

2017

Abstract

Head-mounted eye tracking offers remarkable opportunities for research and applications regarding pervasive health monitoring, mental state inference, and human computer interaction in dynamic scenarios. Although a plethora of software for the acquisition of eye-tracking data exists, they often exhibit critical issues when pervasive eye tracking is considered, e.g., closed source, costly eye tracker hardware dependencies, and requiring a human supervisor for calibration. In this paper, we introduce EyeRecToo, an open-source software for real-time pervasive head-mounted eye-tracking. Out of the box, EyeRecToo offers multiple real-time state-ofthe- art pupil detection and gaze estimation methods, which can be easily replaced by user implemented algorithms if desired. A novel calibration method that allows users to calibrate the system without the assistance of a human supervisor is also integrated. Moreover, this software supports multiple head-mounted eye-tracking hardware, records eye and scene videos, and stores pupil and gaze information, which are also available as a real-time stream. Thus, EyeRecToo serves as a framework to quickly enable pervasive eye-tracking research and applications. Available at: www.ti.uni-tuebingen.de/perception.

References

  1. Appel, T. et al. (2016). Brightness- and motion-based blink detection for head-mounted eye trackers. In Proc. of the Int. Joint Conf. on Pervasive and Ubiquitous Computing, UbiComp Adjunct. ACM.
  2. Babcock, J. S. and Pelz, J. B. (2004). Building a lightweight eyetracking headgear. In Proc. of the 2004 Symp. on Eye tracking research & applications. ACM.
  3. Bradski, G. et al. (2000). The OpenCV Library. Doctor Dobbs Journal.
  4. Cerrolaza, J. J. et al. (2012). Study of polynomial mapping functions in video-oculography eye trackers. Trans. on Computer-Human Interaction (TOCHI).
  5. Dalmaijer, E. S. et al. (2014). Pygaze: An open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments. Behavior research methods.
  6. Duchowski, A. T. (2002). A breadth-first survey of eyetracking applications. Behavior Research Methods, Instruments, & Computers.
  7. Eivazi, S. et al. (2016). Embedding an eye tracker into a surgical microscope: Requirements, design, and implementation. IEEE Sensors Journal.
  8. Ergoneers (2016). Dikablis. www.ergoneers.com.
  9. Fuhl, W. et al. (2015). Excuse: Robust pupil detection in real-world scenarios. In Computer Analysis of Images and Patterns 2015. CAIP 2015. 16th Int. Conf. IEEE.
  10. Fuhl, W. et al. (2016a). Else: Ellipse selection for robust pupil detection in real-world environments. In Proc. of the Symp. on Eye Tracking Research & Applications. ACM.
  11. Fuhl, W. et al. (2016b). Non-intrusive practitioner pupil detection for unmodified microscope oculars. Computers in Biology and Medicine.
  12. Fuhl, W. et al. (2016c). Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art. Machine Vision and Applications.
  13. Garrido-Jurado, S. et al. (2014). Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition.
  14. Guestrin, E. D. and Eizenman, M. (2006). General theory of remote gaze estimation using the pupil center and corneal reflections. Biomedical Engineering, IEEE Trans. on.
  15. Holmqvist, K. et al. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford University.
  16. Kasneci, E. et al. (2014). The applicability of probabilistic methods to the online recognition of fixations and saccades in dynamic scenes. In Proc. of the Symp. on Eye Tracking Research and Applications.
  17. Kasneci, E. et al. (2015). Online recognition of fixations, saccades, and smooth pursuits for automated analysis of traffic hazard perception. In Artificial Neural Networks. Springer.
  18. Kübler, T. C. et al. (2016). Rendering refraction and reflection of eyeglasses for synthetic eye tracker images. In Proc. of the Symp. on Eye Tracking Research & Applications. ACM.
  19. Larsson, L. et al. (2016). Head movement compensation and multi-modal event detection in eye-tracking data for unconstrained head movements. Journal of Neuroscience Methods.
  20. Li, D. et al. (2005). Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In Computer Vision and Pattern Recognition Workshops, 2005. CVPR Workshops. IEEE Computer Society Conf. on. IEEE.
  21. Li, D. et al. (2006a). openeyes: A low-cost head-mounted eye-tracking solution. In Proc. of the Symp. on Eye Tracking Research &Amp; Applications.
  22. Li, D. et al. (2006b). openeyes: a low-cost head-mounted eye-tracking solution. In Proc. of the 2006 Symp. on Eye tracking research & applications. ACM.
  23. Majaranta, P. and Bulling, A. (2014). Eye Tracking and Eye-Based Human-Computer Interaction. Advances in Physiological Computing. Springer.
  24. Model, D. and Eizenman, M. (2010). User-calibration-free remote gaze estimation system. In Proc. of the Symp. on Eye-Tracking Research & Applications. ACM.
  25. Morimoto, C. H. and Mimica, M. R. (2005). Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding.
  26. Pupil Labs (2016). www.pupil-labs.com/. Accessed: 16- 09-07.
  27. Qt Project (2016). Qt Framework. www.qt.io/.
  28. San Agustin, J. et al. (2010). Evaluation of a low-cost opensource gaze tracker. In Proc. of the 2010 Symp. on Eye-Tracking Research & Applications. ACM.
  29. Santini, T. et al. (2016a). Bayesian identification of fixations, saccades, and smooth pursuits. In Proc. of the Symp. on Eye Tracking Research & Applications. ACM.
  30. Santini, T. et al. (2016b). Eyerec: An open-source data acquisition software for head-mounted eye-tracking. In Proc. of the Joint Conf. on Computer Vision, Imaging and Computer Graphics Theory and Applications.
  31. Santini, T. et al. (2017). CalibMe: Fast and unsupervised eye tracker calibration for gaze-based pervasive human-computer interaction. In Proc. of the CHI Conf. on Human Factors in Computing Systems.
  32. SensoMotoric Instruments GmbH (2016). www.smivision. com/. Accessed: 16-09-07.
  33. Swirski, L. and Dodgson, N. A. (2013). A fully-automatic, temporal approach to single camera, glint-free 3d eye model fitting. InProc. of ECEM.
  34. Swirski, L. et al. (2012). Robust real-time pupil tracking in highly off-axis images. In Proc. of the Symp. on Eye Tracking Research and Applications. ACM.
  35. Tobii Technology (2016). www.tobii.com. Accessed: 16- 09-07.
  36. Vidal, M. et al. (2012). Wearable eye tracking for mental health monitoring. Computer Communications.
  37. Villanueva, A. and Cabeza, R. (2008). A novel gaze estimation system with one calibration point. IEEE Trans. on Systems, Man, and Cybernetics.
  38. Yu, L. H. and Eizenman, M. (2004). A new methodology for determining point-of-gaze in head-mounted eye tracking systems. IEEE Trans. on Biomedical Engineering.
Download


Paper Citation


in Harvard Style

Santini T., Fuhl W., Geisler D. and Kasneci E. (2017). EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 96-101. DOI: 10.5220/0006224700960101


in Bibtex Style

@conference{visapp17,
author={Thiago Santini and Wolfgang Fuhl and David Geisler and Enkelejda Kasneci},
title={EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={96-101},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006224700960101},
isbn={978-989-758-227-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking
SN - 978-989-758-227-1
AU - Santini T.
AU - Fuhl W.
AU - Geisler D.
AU - Kasneci E.
PY - 2017
SP - 96
EP - 101
DO - 10.5220/0006224700960101