Towards a Unified Representation of Interactive 3D Scenes in Virtual Reality

The widespread adoption of immersive technologies requires tools to design pedagogical scenarios without technical expertise in virtual reality (VR). Current authoring systems are often domain-specific and tightly coupled to particular game engines, limiting their versatility. This paper introduces the Interaction Set, an abstract representation for modeling interactive scenes without any programming elements. Our approach enables the creation of immersive environments through an intuitive formalism that represents objects and their dynamic relationships using predicates and transformations, theoretically inspired by hybrid automata. We extend this with the concept of protocol, a sequencing mechanism that guides the user through a task while tolerating mistakes and providing corrective feedback. We illustrate its practical application through a VR chemistry lab implemented in Unity. This work contributes to standardization efforts for interactive 3D content creation, with potential applications across educational and industrial training domains.