MAR Enhanced Hiking Experience: Exploring Multimodal Experience Design in Outdoor Scenarios

In recent years, outdoor hiking has gained popularity, driven by increasing health awareness. However, enthusiasts of hiking encounter challenges related to equipment carrying, long-distance journeys, and environmental uncertainties. These challenges include the limitation of frequently checking routes on mobile devices due to the use of trekking poles. To address these obstacles, we undertake research and design efforts that integrate outdoor scenarios with Augmented Reality (AR) technology. Our approach involves establishing AR user interface design guidelines and design strategies tailored for outdoor scenarios, derived from a comprehensive systematic literature review. We propose a multimodal AR system solution that leverages AR glasses and trekking poles as dual inputs. The system incorporates multimodal interaction and natural information presentation, aiming to create a multilevel interactive experience enriched with tangible physical evidence. The goal is to establish a seamless connection between the virtual and real worlds, mitigating the challenges faced by hiking enthusiasts. Evaluation experiments conducted demonstrate that the system successfully meets user needs and expectations in terms of multimodal input, visual information recognizability, and the rationality of user interface layout. The system is noted for its close alignment with the usage scene, exhibiting enhanced user-friendliness in practical applications. This study provides valuable insights into the design of AR systems in outdoor sports scenes, offering a reference point for future endeavors in this domain.