<p>This study presents a novel framework for predominant instrument recognition in polyphonic music using Focal Modulation Networks (FMN). Trained on single-instrument data, FMN accurately identifies multiple instruments in unseen test data without sliding window analysis. It replaces self-attention with a focal modulation module, where focal context aggregation prioritizes key spectral regions, and adaptive query modulation refines feature representations. Extensive experiments demonstrate that FMN achieves a macro F1-score of 0.58 and a micro F1-score of 0.66, representing a 10 and 16% improvement over the state-of-the-art Han model, respectively. FMN consistently outperforms various transformer architectures, including Vision Transformers (ViT), Swin Transformers (SwinT), and Compact Convolutional Transformers (CCT), with enhanced accuracy and interpretability. Our findings highlight FMN’s potential in capturing complex musical patterns and relationships, establishing a new benchmark for predominant instrument recognition in polyphonic music, without the need for aggregation strategies or sliding window approaches</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Beyond transformers: hierarchical contextualization and gated aggregation for multiple predominant instrument recognition in polyphonic music

  • C. R. Lekshmi,
  • Rajeev Rajan

摘要

This study presents a novel framework for predominant instrument recognition in polyphonic music using Focal Modulation Networks (FMN). Trained on single-instrument data, FMN accurately identifies multiple instruments in unseen test data without sliding window analysis. It replaces self-attention with a focal modulation module, where focal context aggregation prioritizes key spectral regions, and adaptive query modulation refines feature representations. Extensive experiments demonstrate that FMN achieves a macro F1-score of 0.58 and a micro F1-score of 0.66, representing a 10 and 16% improvement over the state-of-the-art Han model, respectively. FMN consistently outperforms various transformer architectures, including Vision Transformers (ViT), Swin Transformers (SwinT), and Compact Convolutional Transformers (CCT), with enhanced accuracy and interpretability. Our findings highlight FMN’s potential in capturing complex musical patterns and relationships, establishing a new benchmark for predominant instrument recognition in polyphonic music, without the need for aggregation strategies or sliding window approaches