Audio-visual embodied navigation is a key research direction in embodied intelligence. This task requires agents to leverage visual and audio cues in 3D environments to perceive and locate target sound sources. Although multimodal navigation frameworks based on deep reinforcement learning (DRL) have demonstrated promising results, existing approaches fail to dynamically model the importance of feature channels during visual-audio feature fusion. We introduce a feature-channel attention module with adaptive weighting to amplify task-critical features. Experiments confirm superior navigation success rates and path efficiency over baselines.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Boosting Audio-Visual Navigation Performance with Channel Attention in 3D Environments

  • Yi Wang,
  • Meiling Zhu,
  • Yinfeng Yu

摘要

Audio-visual embodied navigation is a key research direction in embodied intelligence. This task requires agents to leverage visual and audio cues in 3D environments to perceive and locate target sound sources. Although multimodal navigation frameworks based on deep reinforcement learning (DRL) have demonstrated promising results, existing approaches fail to dynamically model the importance of feature channels during visual-audio feature fusion. We introduce a feature-channel attention module with adaptive weighting to amplify task-critical features. Experiments confirm superior navigation success rates and path efficiency over baselines.