Augmented Reality (AR) aims to seamlessly integrate virtual and real-world environments, enabling immersive and interactive user experiences. Semantic segmentation technology plays a critical role in enhancing AR systems by allowing them to understand and interpret the semantics of real-world scenes. This capability ensures that virtual objects are appropriately placed within real environments, facilitating seamless interaction between virtual and physical elements. We developed an AR application leveraging the ARDK and Unity engine, incorporating Meshing and Plane Detection techniques to design a virtual object placement system with scene semantic understanding. A series of experiments were conducted to evaluate the system's performance in terms of reaction speed, computation cost, and area accuracy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Virtual Object Placement in Augmented Reality Using Semantic Segmentation and Scene Understanding

  • Mau-Tsuen Yang,
  • Yun-Jhe Ku

摘要

Augmented Reality (AR) aims to seamlessly integrate virtual and real-world environments, enabling immersive and interactive user experiences. Semantic segmentation technology plays a critical role in enhancing AR systems by allowing them to understand and interpret the semantics of real-world scenes. This capability ensures that virtual objects are appropriately placed within real environments, facilitating seamless interaction between virtual and physical elements. We developed an AR application leveraging the ARDK and Unity engine, incorporating Meshing and Plane Detection techniques to design a virtual object placement system with scene semantic understanding. A series of experiments were conducted to evaluate the system's performance in terms of reaction speed, computation cost, and area accuracy.