Over 430 million individuals globally experience some form of hearing loss, which can hinder their interaction with auditory environments. While current assistive technologies offer partial support, they often fail to deliver a fully immersive experience. This article introduces a novel system that leverages smartwatch and smartphone vibrations to convey cinematic audio information to users with hearing impairments. By analyzing audio tracks in real time and generating synchronized tactile feedback, our technology enables users to perceive soundscapes through vibrations, enhancing emotional engagement and allowing them to feel the movie’s atmosphere as events are presented on screen. Results show that our approach improves users experience and immersion while watching TV series.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Improving the Experience of Deaf People Through Wearable Vibration System

  • Victor Santos,
  • João Marques,
  • Ianne Crisóstomo,
  • Marianna Sarmanho,
  • Mauro Teófilo,
  • Rayol Mendonca-Neto

摘要

Over 430 million individuals globally experience some form of hearing loss, which can hinder their interaction with auditory environments. While current assistive technologies offer partial support, they often fail to deliver a fully immersive experience. This article introduces a novel system that leverages smartwatch and smartphone vibrations to convey cinematic audio information to users with hearing impairments. By analyzing audio tracks in real time and generating synchronized tactile feedback, our technology enables users to perceive soundscapes through vibrations, enhancing emotional engagement and allowing them to feel the movie’s atmosphere as events are presented on screen. Results show that our approach improves users experience and immersion while watching TV series.