A Proposed Immersive Digital Twin Architecture for Automated Guided Vehicles Integrating Virtual Reality and Gesture Control

Mokhtar Ba Wahal, Maram Selsabila Mahmoudi, Ahmed Bahssain, Ikrame Rekabi, Abdelhalim Saeed, Mohamad Alzarif, Mohamed Ellethy, Neven Elsayed, Mohamed Abdelsalam, Tamer ElBatt, Tamer ElBatt

2025

Abstract

Digital Twins (DTs) are virtual replicas of physical assets, facilitating a better understanding of complex Cyber-Physical Systems (CPSs) through bidirectional communication. As CPS grows in complexity, the need for enhanced visualization and interaction becomes essential. This paper presents a framework for integrating virtual reality (VR) with a Dockerized private cloud to minimize communication latency between digital and physical assets, improving real-time communication. The integration, based on the Robot Operating System (ROS), leverages its modularity and extensive libraries to streamline robotic control and system scalability. Key innovations include a proximity heat map surrounding the digital asset for enhanced situational awareness and VR-based hand gesture control for intuitive interaction. The framework was tested using TurtleBot3 and a 5-degree-of-freedom robotic arm, with user studies comparing these techniques to traditional web-based control methods. Our results demonstrate the efficacy of the proposed VR and private cloud integration, providing a promising approach to advance Human-Robot Interaction (HRI).

Paper Citation

in Harvard Style

Wahal M., Mahmoudi M., Bahssain A., Rekabi I., Saeed A., Alzarif M., Ellethy M., Elsayed N., Abdelsalam M. and ElBatt T. (2025). A Proposed Immersive Digital Twin Architecture for Automated Guided Vehicles Integrating Virtual Reality and Gesture Control. In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP; ISBN 978-989-758-728-3, SciTePress, pages 267-275. DOI: 10.5220/0013176900003912

in Bibtex Style

@conference{grapp25,
author={Mokhtar Wahal and Maram Mahmoudi and Ahmed Bahssain and Ikrame Rekabi and Abdelhalim Saeed and Mohamad Alzarif and Mohamed Ellethy and Neven Elsayed and Mohamed Abdelsalam and Tamer ElBatt},
title={A Proposed Immersive Digital Twin Architecture for Automated Guided Vehicles Integrating Virtual Reality and Gesture Control},
booktitle={Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP},
year={2025},
pages={267-275},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013176900003912},
isbn={978-989-758-728-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP
TI - A Proposed Immersive Digital Twin Architecture for Automated Guided Vehicles Integrating Virtual Reality and Gesture Control
SN - 978-989-758-728-3
AU - Wahal M.
AU - Mahmoudi M.
AU - Bahssain A.
AU - Rekabi I.
AU - Saeed A.
AU - Alzarif M.
AU - Ellethy M.
AU - Elsayed N.
AU - Abdelsalam M.
AU - ElBatt T.
PY - 2025
SP - 267
EP - 275
DO - 10.5220/0013176900003912
PB - SciTePress