<p>Head-related transfer functions (HRTFs) play a critical role in the construction of immersive audio. However, traditional HRTF measurement systems are typically limited to obtaining sparse HRTF data, which is insufficient to meet the high-precision spatial resolution requirements of virtual acoustics. Therefore, there is an urgent need to generate impulse responses (IR) for target directions through spatial interpolation techniques. This paper proposes an HRTF spatial interpolation method based on Enhanced super-resolution generative adversarial networks (ESRGAN). The method uses Residual-in-residual dense blocks (RRDB) as the basic unit of the network and introduces the concept of Relativistic average generative adversarial networks (RaGAN) to enable the discriminator to predict relative realism, thereby improving the realism and consistency of the generated results. In addition, wavelet transform is used to extract high-frequency and low-frequency information, enhancing the representation of details, especially in peak and valley regions. To further improve localization performance, source position information is integrated into the network to provide additional spatial cues. Numerical experimental results show that the proposed method outperforms SRGAN, barycentric interpolation, and HRTF selection methods in terms of log-spectral distortion (LSD) and perceptual evaluation metrics, demonstrating significant advantages in sparse interpolation tasks.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Spatial interpolation of head-related transfer functions using enhanced generative adversarial networks

  • Wei Chen,
  • Wenpeng He,
  • Xiaogang Wei

摘要

Head-related transfer functions (HRTFs) play a critical role in the construction of immersive audio. However, traditional HRTF measurement systems are typically limited to obtaining sparse HRTF data, which is insufficient to meet the high-precision spatial resolution requirements of virtual acoustics. Therefore, there is an urgent need to generate impulse responses (IR) for target directions through spatial interpolation techniques. This paper proposes an HRTF spatial interpolation method based on Enhanced super-resolution generative adversarial networks (ESRGAN). The method uses Residual-in-residual dense blocks (RRDB) as the basic unit of the network and introduces the concept of Relativistic average generative adversarial networks (RaGAN) to enable the discriminator to predict relative realism, thereby improving the realism and consistency of the generated results. In addition, wavelet transform is used to extract high-frequency and low-frequency information, enhancing the representation of details, especially in peak and valley regions. To further improve localization performance, source position information is integrated into the network to provide additional spatial cues. Numerical experimental results show that the proposed method outperforms SRGAN, barycentric interpolation, and HRTF selection methods in terms of log-spectral distortion (LSD) and perceptual evaluation metrics, demonstrating significant advantages in sparse interpolation tasks.