This paper researches efficient techniques for retrieving precise information from similar documents in AI chatbot systems, particularly in enterprises with large document collections. Artificial Intelligence (AI) chatbots, powered by Large Language Models (LLMs), are increasingly used for customer service, with Retrieval Augmented Generation (RAG) employed to mitigate hallucinations. However, document types like terms and conditions or policy documents frequently contain highly similar content, leading to ambiguity in retrieval results. Therefore, we propose efficient search techniques using extended metadata and separate vector databases. This technique improves accuracy in retrieving relevant information. We experimented with this technique using a prototype chatbot service, demonstrating its potential to enhance chatbot performance in business applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Efficient Information Search Techniques for Similar Documents in AI Chatbots

  • Hyun Cheon Hwang,
  • Ji Su Park,
  • Jin Gon Shon

摘要

This paper researches efficient techniques for retrieving precise information from similar documents in AI chatbot systems, particularly in enterprises with large document collections. Artificial Intelligence (AI) chatbots, powered by Large Language Models (LLMs), are increasingly used for customer service, with Retrieval Augmented Generation (RAG) employed to mitigate hallucinations. However, document types like terms and conditions or policy documents frequently contain highly similar content, leading to ambiguity in retrieval results. Therefore, we propose efficient search techniques using extended metadata and separate vector databases. This technique improves accuracy in retrieving relevant information. We experimented with this technique using a prototype chatbot service, demonstrating its potential to enhance chatbot performance in business applications.