Gesture-Based Virtual Control Interface: Enhancing Interaction with Eye Tracking and Voice Commands

Jothimani S., Dewadharshan K., Harish Madhavan A., Indhu Prakash S., Keerthivasan E.

2025

Abstract

To boost user engagement in a multi-modal system, this study proposes a novel virtual control interface that combines the capability of Convolutional Neural Networks (CNNs), edge and contour detection, gaze tracking algorithms, and voice command integration. To improve detection robustness in a variety of ambient circumstances, we updated our CNN model for complex hand gesture recognition incorporating edge and contour analysis. Advanced gaze estimating methods are used concurrently to implement eye tracking, enabling user-friendly control mechanisms that react to the user's visual focus. Incorporating voice commands adds another level of engagement and makes it possible for users to complete jobs more naturally and easily. The integrated strategy is intended to serve a wide range of users, including assistive technology applications where conventional interface systems are inadequate. When compared to traditional single-modality systems, our findings show a notable increase in both user engagement and gesture detection accuracy. This interface expands the usage of virtual control technologies in practical situations while also improving the user experience.

Paper Citation

in Harvard Style

S. J., K. D., A. H., S. I. and E. K. (2025). Gesture-Based Virtual Control Interface: Enhancing Interaction with Eye Tracking and Voice Commands. In Proceedings of the 1st International Conference on Research and Development in Information, Communication, and Computing Technologies - ICRDICCT`25; ISBN 978-989-758-777-1, SciTePress, pages 528-533. DOI: 10.5220/0013916100004919

in Bibtex Style

@conference{icrdicct`2525,
author={Jothimani S. and Dewadharshan K. and Harish A. and Indhu S. and Keerthivasan E.},
title={Gesture-Based Virtual Control Interface: Enhancing Interaction with Eye Tracking and Voice Commands},
booktitle={Proceedings of the 1st International Conference on Research and Development in Information, Communication, and Computing Technologies - ICRDICCT`25},
year={2025},
pages={528-533},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013916100004919},
isbn={978-989-758-777-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 1st International Conference on Research and Development in Information, Communication, and Computing Technologies - ICRDICCT`25
TI - Gesture-Based Virtual Control Interface: Enhancing Interaction with Eye Tracking and Voice Commands
SN - 978-989-758-777-1
AU - S. J.
AU - K. D.
AU - A. H.
AU - S. I.
AU - E. K.
PY - 2025
SP - 528
EP - 533
DO - 10.5220/0013916100004919
PB - SciTePress