错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Query Expansion and Verification with Large Language Model for Information Retrieval

  • Wenjing Zhang,
  • Zhaoxiang Liu,
  • Kai Wang,
  • Shiguo Lian

摘要

Query expansion is a crucial task in information retrieval. Recent research has demonstrated that generative relevance feedback (GRF) based on large language models (LLMs) can significantly enhance the effectiveness of query expansion. However, user queries often suffer from issues such as unclear or incomplete semantics, and LLMs may also introduce hallucinations when assisting with query expansion, thereby reducing retrieval performance. In this paper, we semantically enrich queries by prompting a LLM to generate multiple query-related documents. Additionally, we employ a consistency verification method to remove meaningless information from the expanded results of LLM, mitigating the hallucination issues associated with large model generation. Given that dense retrievers have lower performance in encoding long texts expanded by LLMs, we adopt the BM25 sparse retrieval method in the downstream retrieval module. Our experiments show that the method proposed in this paper exhibits significant improvements compared to both the state-of-the-art sparse retrieval and dense retrieval methods.