We have developed a Retrieval Augmented Generation Large Language Model specifically designed for IT help desks. The proposed model aims to enhance the efficiency and accuracy of the responses provided by engineers when addressing technical queries related to various IT topics, including but not limited to Red Hat, Windows, Azure, Kubernetes, and Cisco. A dedicated knowledge base of IT-related articles, documentation, and troubleshooting guides is meticulously maintained. This knowledge base functions as a search component, enabling the model to present relevant information based on user queries. For an IT help desk application to gain user trust, it must be supported by appropriate techniques and tools. Furthermore, when provided resources, such as manuals or books, lack the necessary information, the language model must transparently respond with “I do not know”. This honesty fosters a climate of trust and ensures that users receive accurate and reliable assistance. Performance evaluation metrics for the model include precision and recall, facilitating the assessment of its effectiveness in real-world applications, such as IT support. Encouraging results have been achieved, and further improvements are anticipated by expanding the knowledge base to include additional IT domains. This approach not only aims to refine the model’s capabilities but also strives to provide comprehensive support across a broader range of technical issues, thereby enhancing overall user satisfaction and operational efficiency in IT service environments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Large Language Models with Retrieval Augmented Generation for a Trusted Help Desk Solution

  • Mariem Tabib,
  • Ines Abdeljaoued-Tej,
  • Hazem Raouafi

摘要

We have developed a Retrieval Augmented Generation Large Language Model specifically designed for IT help desks. The proposed model aims to enhance the efficiency and accuracy of the responses provided by engineers when addressing technical queries related to various IT topics, including but not limited to Red Hat, Windows, Azure, Kubernetes, and Cisco. A dedicated knowledge base of IT-related articles, documentation, and troubleshooting guides is meticulously maintained. This knowledge base functions as a search component, enabling the model to present relevant information based on user queries. For an IT help desk application to gain user trust, it must be supported by appropriate techniques and tools. Furthermore, when provided resources, such as manuals or books, lack the necessary information, the language model must transparently respond with “I do not know”. This honesty fosters a climate of trust and ensures that users receive accurate and reliable assistance. Performance evaluation metrics for the model include precision and recall, facilitating the assessment of its effectiveness in real-world applications, such as IT support. Encouraging results have been achieved, and further improvements are anticipated by expanding the knowledge base to include additional IT domains. This approach not only aims to refine the model’s capabilities but also strives to provide comprehensive support across a broader range of technical issues, thereby enhancing overall user satisfaction and operational efficiency in IT service environments.