TOWARDS INTELLIGENT VR - Multi-Layered Semantic Reflection for Intelligent Virtual Environments

Marc Latoschik, Christian Fröhlich



This paper introduces semantic reflection, a novel concept for a modular design of intelligent applications. SCIVE, a simulation core for intelligent Virtual Environments (IVEs), provides semantic reflection on multiple layers: SCIVE’s architecture grants semantic driven uniform access to low-level simulation core logic, to specific simulation modules’ application definitions, as well as to high-level semantic environment descriptions. It additionally provides a frame to conveniently interconnect various simulation modules, e.g., for graphics, physics, audio, haptics, or AI etc. SCIVE’s Knowledge Representation Layer’s base formalism provides the central organizing structure for the diverse modules’ data representations. It allows bidirectional knowledge driven access between the modules since their specific data structures and functions are transitively reflected by the semantic layer. Hence SCIVE preserves, integrates and provides unified access to the development paradigms of the interconnected modules, e.g., scene graph metaphors or field route concepts etc. well known from todays Virtual Reality systems. SCIVE’s semantic reflection implementation details are illustrated following a complex example application. We illustrate how semantic reflection and modularity support extensibility and maintainability of VR applications, potential for automatic system configuration and optimization, as well as the base for comprehensive knowledge driven access for IVEs.


  1. Allard, J., Gouranton, V., Lecointre, L., Limet, S., Melin, E., Raffin, B., and Robert, S. (2004). Flowvr: a middleware for large scale virtual reality applications. In Proceedings of Euro-par 2004 , Pisa, Italia.
  2. Allen, J. F. (1984). Towards a general theory of action and time. Artificial Intelligence, (23).
  3. Anthony Steed, E. F. (2004). Construction of collaborative virtual environments. In Segura, M.-I. S., editor, Developing Future Interactive Systems, number ISBN 1591404126, pages 235-268. Idea Group.
  4. Arnaud, R. and Jones, M. T. (1999). Innovative software architecture for real-time image generation. In Proceedings of the I/ITSEC Conference.
  5. Bethel, W., Bass, C., Clay, S. R., Hook, B., Jones, M. T., Sowizral, H., and van Dam, A. (1999). Scene graph apis: wired or tired? In SIGGRAPH 7899: ACM SIGGRAPH 99 Conference abstracts and applications, pages 136-138, New York, NY, USA. ACM Press.
  6. Bierbaum, A. D., Just, C., Hartling, P., Meinert, K., Baker, A., and Cruz-Neira, C. (2001). VR Juggler: A Virtual Platform for Virtual Reality Application Development virtual platform for virtual reality application development. In IEEE Virtual Reality 2001 conference proceedings, pages 89-96, Yokohama, Japan. IEEE Press.
  7. Biermann, P. and Wachsmuth, I. (2004). Non-physical simulation of gears and modifiable connections in virtual reality. In Proceedings of the fifth Virtual Reality International Conference (VRIC 2004), pages 159-164, Laval, France.
  8. Blach, R., Landauer, J., Rsch, A., and Simon, A. (1998). A Highly Flexible Virtual Reality System. In Future Generation Computer Systems Special Issue on Virtual Environments. Elsevier Amsterdam.
  9. Greenhalgh, C., Purbrick, J., and Snowdon, D. (2000). Inside massive-3: flexible support for data consistency and world structuring. In Proceedings of the third international conference on Collaborative virtual environments, pages 119-127. ACM Press.
  10. Hagsand, O. (1996). Interactive MultiUser VEs in the DIVE system. IEEE Multimedia Magazine, 3(1).
  11. Heumer, G., Schilling, M., and Latoschik, M. E. (2005). Automatic data exchange and synchronization for knowledge-based intelligent virtual environments. In Proceedings of the IEEE VR2005, pages 43-50, Bonn, Germany.
  12. ISO/IEC, JTC 1/SC 24 (2004). X3d abstract. Technical Report 19775-1:2004, ISO/IEC.
  13. Kalogerakis, E., Christodoulakis, S., and Moumoutzis, N. (2006). Coupling ontologies with graphics content for knowledge driven visualization. In Proceedings of the IEEE VR2006, pages 43-50.
  14. Kapolka, A., McGregor, D., and Capps, M. (2002). A unified component framework for dynamically extensible virtual environments. In Fourth ACM International Conference on Collaborative Virtual Environments.
  15. Latoschik, M. E. and Schilling, M. (2003). Incorporating VR Databases into AI Knowledge Representations: A Framework for Intelligent Graphics Applications. In Proceedings of the Sixth International Conference on Computer Graphics and Imaging. IASTED, ACTA Press.
  16. Luck, M. and Aylett, R. (2000). Applying Artificial Intelligence to Virtual Reality: Intelligent Virtual Environments. Applied Artificial Intelligence, 14(1):3-32.
  17. Lugrin, J.-L. and Cavazza, M. (2007). Making Sense of Virtual Environments: Action Representation, Grounding and Common Sense. In Proceedings of the Intelligent User Interfaces IUI'07.
  18. Meseguer, J. and Talcott, C. (2002). Semantic models for distributed object reflection. In ECOOP 2002 - Object-Oriented Programming: 16th European Conference Malaga, Lecture Notes in Computer Science, pages 1-36. Springer Berlin / Heidelberg.
  19. Peters, S. and Shrobe, H. (2003). Using semantic networks for knowledge representation in an intelligent environment. In PerCom 7803: 1st Annual IEEE International Conference on Pervasive Computing and Communications, Ft. Worth, TX, USA. IEEE.
  20. Preddy, S. M. and Nance, R. E. (2002). Key requirements for cave simulations: key requirements for cave simulations. In WSC 7802: Proceedings of the 34th conference on Winter simulation, pages 127-135. Winter Simulation Conference.
  21. Reiners, D., Voß, G., and Behr, J. (2002). OpenSG: Basic Concepts. symposium/Papers2002/Reiners Basics.pdf.
  22. Rohlf, J. and Helman, J. (1994). Iris performer: a high performance multiprocessing toolkit for real-time 3d graphics. In SIGGRAPH 7894: Proceedings of the 21st annual conference on Computer graphics and interactive techniques, pages 381-394, New York, NY, USA. ACM Press.
  23. Soto, M. and Allongue, S. (2002). Modeling methods for reusable and interoperable virtual entities in multimedia virtual worlds. Multimedia Tools Appl., 16(1- 2):161-177.
  24. Strauss, P. S. and Carey, R. (1992). An object-oriented 3D graphics toolkit. In Computer Graphics, volume 26 of SIGGRAPH Proceedings, pages 341-349.
  25. Tramberend, H. (1999). A distributed virtual reality framework. In IEEE Virtual Reality Conference, pages 14- 21.

Paper Citation

in Harvard Style

Latoschik M. and Fröhlich C. (2007). TOWARDS INTELLIGENT VR - Multi-Layered Semantic Reflection for Intelligent Virtual Environments . In Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP, ISBN 978-972-8865-72-6, pages 249-259. DOI: 10.5220/0002081302490259

in Bibtex Style

author={Marc Latoschik and Christian Fröhlich},
title={TOWARDS INTELLIGENT VR - Multi-Layered Semantic Reflection for Intelligent Virtual Environments},
booktitle={Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP,},

in EndNote Style

JO - Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP,
TI - TOWARDS INTELLIGENT VR - Multi-Layered Semantic Reflection for Intelligent Virtual Environments
SN - 978-972-8865-72-6
AU - Latoschik M.
AU - Fröhlich C.
PY - 2007
SP - 249
EP - 259
DO - 10.5220/0002081302490259