Rapid advances in science and technology have led to the integration of artificial intelligence (AI) in many areas, including augmented reality (AR). This study explores the application of the Stable Diffusion (SD) model to develop an AR application that generates images based on text descriptions. Using Unity, a versatile game development platform, we implemented this AR application, scripting in C# with Visual Studio 2022. The user interface and functionality of the SD model were managed via the UI Stable Diffusion Automatic 1111 tool, allowing seamless integration and execution of SD functions. This work demonstrates the potential of AI-driven models in enhancing AR experiences and introduces a novel approach to dynamic visual content creation and editing. Furthermore, this technology has significant implications for the maintenance of municipal infrastructure and maintenance organizations. By converting text instructions into visual AR overlays, maintenance teams can improve the accuracy and efficiency of tasks such as inspections, repairs, and infrastructure management, streamlining operations and reducing errors.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Using Stable Diffusion Model for Text-Driven Generation in Augmented Reality Applications

  • Kristian Rücker,
  • Časlav Livada,
  • Tomislav Galba,
  • Alfonzo Baumgartner

摘要

Rapid advances in science and technology have led to the integration of artificial intelligence (AI) in many areas, including augmented reality (AR). This study explores the application of the Stable Diffusion (SD) model to develop an AR application that generates images based on text descriptions. Using Unity, a versatile game development platform, we implemented this AR application, scripting in C# with Visual Studio 2022. The user interface and functionality of the SD model were managed via the UI Stable Diffusion Automatic 1111 tool, allowing seamless integration and execution of SD functions. This work demonstrates the potential of AI-driven models in enhancing AR experiences and introduces a novel approach to dynamic visual content creation and editing. Furthermore, this technology has significant implications for the maintenance of municipal infrastructure and maintenance organizations. By converting text instructions into visual AR overlays, maintenance teams can improve the accuracy and efficiency of tasks such as inspections, repairs, and infrastructure management, streamlining operations and reducing errors.