This paper addresses the persistent problem of vocabulary mismatch in information retrieval, a field that aims to locate and retrieve relevant information from a database. The paper introduces the concept of query expansion, a technique that enhances the performance of retrieval models by expanding queries with semantically related terms. The primary goal of this research is to improve the query expansion using Asymmetric Kullback-Leibler Divergence from the randomness framework. This work also presents a comprehensive experimental analysis, implementing both classic and state-of-the-art algorithms like neural reranking models, i.e., Kernel Neural Ranking Model and Vanilla-Bert on two different large real-world datasets. The results demonstrate significant improvements in retrieval performance when using the proposed KL divergence method.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Improving Information Retrieval Task with Asymmetric Divergence from Randomness in Query Expansion

  • Lovely Yeswanth Panchumarthi,
  • Satya Krishna Nunna,
  • Lavanya Parchuri,
  • Sriya Padmanabuni,
  • Yogeshvar Reddy Kallam

摘要

This paper addresses the persistent problem of vocabulary mismatch in information retrieval, a field that aims to locate and retrieve relevant information from a database. The paper introduces the concept of query expansion, a technique that enhances the performance of retrieval models by expanding queries with semantically related terms. The primary goal of this research is to improve the query expansion using Asymmetric Kullback-Leibler Divergence from the randomness framework. This work also presents a comprehensive experimental analysis, implementing both classic and state-of-the-art algorithms like neural reranking models, i.e., Kernel Neural Ranking Model and Vanilla-Bert on two different large real-world datasets. The results demonstrate significant improvements in retrieval performance when using the proposed KL divergence method.