EasyCaption: Investigating the Impact of Prolonged Exposure to Captioning on VR HMD on General Population

Recent research explores the potential of captioning within virtual environments. However, the effects of prolonged exposure to captioning in these environments have received scant attention. This study delves into the impacts of extended exposure to captions in a virtual reality (VR) setting, utilizing Head-Mounted Displays (HMDs). Its objective is to augment communication accessibility for individuals who are Deaf or Hard of Hearing (DHH), as well as the broader populace, by evaluating aspects such as user experience, cognitive load, and comprehension. To achieve this, the study adopts a mixed-methods framework, integrating quantitative data gathered via user surveys with qualitative insights obtained from semi-structured interviews. The findings suggest that prolonged eye gaze negatively impacts engagement levels, with participants without avatars exhibiting higher attention and engagement. Additionally, participants with avatars tend to experience slightly higher stress levels. The study concludes by recommending further exploration of robust personalization features and conducting user experience studies to refine captioning environments for improved readability and user satisfaction. This research contributes to the understanding of accessibility and VR technology for both Deaf and Hard of Hearing (DHH) and non DHH populations, offering valuable insights for designers, developers, and educators working towards creating more inclusive VR experiences.