Although Retrieval-Augmented Generation (RAG) has shown promise in relation extraction, current methods mostly adopt single encoders, overlooking the potential gains from combining diverse encoding strategies. Multi-encoder frameworks can leverage the Mixture-of-Experts (MoE) architecture to adaptively select the most suitable encoder or encoder combination for a given input, thereby maximizing the effectiveness of feature representation. We propose RAG-MixSBERT-RE, a RAG framework that incorporates a gating network to dynamically select from multiple SBERT encoders based on input features. By fusing embeddings from diverse SBERT variants via weighted integration, our method enhances representation quality and adaptability in RE tasks. In our experiments, we evaluate our model on five benchmark datasets (TACRED, TACREV, Re-TACRED, SemEval, and Wiki80) and show that RAG-MixSBERT-RE consistently outperforms single-encoder baselines.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Retrieval-Augmented Generation with Mixed Sentence-BERT for Relation Extraction

  • JunFeng Luo,
  • WenXiang Fang,
  • JiaHui Guo,
  • Li Qin

摘要

Although Retrieval-Augmented Generation (RAG) has shown promise in relation extraction, current methods mostly adopt single encoders, overlooking the potential gains from combining diverse encoding strategies. Multi-encoder frameworks can leverage the Mixture-of-Experts (MoE) architecture to adaptively select the most suitable encoder or encoder combination for a given input, thereby maximizing the effectiveness of feature representation. We propose RAG-MixSBERT-RE, a RAG framework that incorporates a gating network to dynamically select from multiple SBERT encoders based on input features. By fusing embeddings from diverse SBERT variants via weighted integration, our method enhances representation quality and adaptability in RE tasks. In our experiments, we evaluate our model on five benchmark datasets (TACRED, TACREV, Re-TACRED, SemEval, and Wiki80) and show that RAG-MixSBERT-RE consistently outperforms single-encoder baselines.