A Framework for the Development of Applications Allowing Multimodal Interaction with Virtual Reality Worlds

Abstract

With the definition of a mark-up language for specifying scenes, behaviour and multimodal interaction based on the metaphor of interactive movie, we want to propose a framework to develop applications allowing multimodal interaction with virtual reality worlds. Reusing standardized mark-up languages for describing graphics, vocal interaction and graphical interaction, we have defined the basis of an architecture for integrating components of this kind of applications of multimodal interaction with virtual reality worlds. Using this framework we make easier the development of these applications and we provide capabilities to reuse code, graphics and dialogues.