AirSync is an innovative VR game developed around the Air Guitar World Championships (AGWC), blending K-POP performance with cutting-edge technological experiences. The project utilizes advanced webcam-based motion recognition technologies and AI techniques to precisely track and mimic authentic guitar playing movements and postures. Artificial intelligence is employed to seamlessly separate musical components like melody, accompaniment, and vocals from K-POP tracks, enabling smooth interaction between motion and music. The developers leveraged the DTW algorithm and the “Note Highway” concept to create an immersive experience that uses AR technology to transform the user’s current space into a spectacular virtual stage. AirSync represents a pioneering approach to reimagining air guitar as a digital performing art, bridging popular culture and technological innovation while creating an interactive and participatory entertainment experience.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

AirSync: A New Way to Experience Air Guitar in VR

  • Suhyeon Seo,
  • Yangkyu Lim

摘要

AirSync is an innovative VR game developed around the Air Guitar World Championships (AGWC), blending K-POP performance with cutting-edge technological experiences. The project utilizes advanced webcam-based motion recognition technologies and AI techniques to precisely track and mimic authentic guitar playing movements and postures. Artificial intelligence is employed to seamlessly separate musical components like melody, accompaniment, and vocals from K-POP tracks, enabling smooth interaction between motion and music. The developers leveraged the DTW algorithm and the “Note Highway” concept to create an immersive experience that uses AR technology to transform the user’s current space into a spectacular virtual stage. AirSync represents a pioneering approach to reimagining air guitar as a digital performing art, bridging popular culture and technological innovation while creating an interactive and participatory entertainment experience.