Optimizing Real-Time Translation for AR Glasses: Enhancing Usability through Gesture and Content Algorithm
摘要
The aim of this study is to optimize an app for AR glasses that translates text-based signs, such as road signs and billboards, into a desired language in real time. With the release of devices like XREAL Air, Apple Vision Pro, and Meta Quest 3, AR technology has shown great potential for daily use. However, market research reveals high return rates due to a lack of engaging content. To address this, the project leverages AR’s unique strengths by developing a real-time translation service to assist travelers in reading foreign text. It incorporates a gesture-based communication system, a history-based search algorithm for quick word processing, and a content management algorithm for unused text. The app overlays translated text on the original in the user's view. Trials with 15 users assess the system's convenience and demonstrate its ability to enhance AR’s viability in everyday life.