Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality

Dagny Döring, Robin Horst, Linda Rau, Ralf Dörner

Abstract

Tangible Augmented Reality (TAR) is a subclass of Augmented Reality (AR). It uses real-world objects enabling users to interact with the virtual environment. This can make virtual content easier to grasp and increase the users’ immersion. However, the involvement of tangible objects in a TAR system is challenging. The system needs information on the interaction of users with the tangible object. Besides image-based tracking approaches that are commonly used for AR applications, additional sensors can be used to provide physical interaction possibilities for users. In this work, we investigate which opportunities hardware components can offer and how they can be integrated into a tangible object for a TAR application. We identify a taxonomy for categorizing sensors and control elements that can be used in a TAR setup and show how data provided by sensors can be utilized within such a TAR setup. At the example of a 3D print, we show how hardware elements can be attached to a tangible object and we discuss lessons learned based on a Unity TAR implementation. In particular, the discussion focuses on constructing 3D prints with sensors, exploiting hardware capabilities, and processing data from the additional hardware in a Unity application.

Download


Paper Citation


in Harvard Style

Döring D., Horst R., Rau L. and Dörner R. (2021). Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality.In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP, ISBN 978-989-758-488-6, pages 153-160. DOI: 10.5220/0010230301530160


in Bibtex Style

@conference{hucapp21,
author={Dagny Döring and Robin Horst and Linda Rau and Ralf Dörner},
title={Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP,},
year={2021},
pages={153-160},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010230301530160},
isbn={978-989-758-488-6},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP,
TI - Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality
SN - 978-989-758-488-6
AU - Döring D.
AU - Horst R.
AU - Rau L.
AU - Dörner R.
PY - 2021
SP - 153
EP - 160
DO - 10.5220/0010230301530160