This paper presents KMagent, a multi-agent Large Language Model-based knowledge management platform designed to accelerate product innovation within industrial Research & Development environments. The system integrates structured Knowledge Graph construction, LLM-driven Question Answering, and a comprehensive evaluation framework under a Retrieval-Augmented Generation architecture. By combining LLM reasoning with domain-specific KGs, KMagent produces accurate and context-aware responses to complex queries. To assess performance, we introduce a dual-layered evaluation framework covering both the structural integrity of the KG and the factual quality of generated responses using reference-based metrics such as BLEU, ROUGE, METEOR, BERTScore and reference-free metrics such as UniEval and G-Eval. Using polymer degradation as a case study, we demonstrate the system’s effectiveness across knowledge extraction, reasoning, and evaluation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

KMagent: A Multi-agent Large Language Model-based Knowledge Management Platform for Product Innovation

  • Emmanuel Osei-Brefo,
  • Manish Bhardwaj,
  • Huizhi Liang,
  • Yong Zhang,
  • Sharon Scott,
  • Zahid Qayyam

摘要

This paper presents KMagent, a multi-agent Large Language Model-based knowledge management platform designed to accelerate product innovation within industrial Research & Development environments. The system integrates structured Knowledge Graph construction, LLM-driven Question Answering, and a comprehensive evaluation framework under a Retrieval-Augmented Generation architecture. By combining LLM reasoning with domain-specific KGs, KMagent produces accurate and context-aware responses to complex queries. To assess performance, we introduce a dual-layered evaluation framework covering both the structural integrity of the KG and the factual quality of generated responses using reference-based metrics such as BLEU, ROUGE, METEOR, BERTScore and reference-free metrics such as UniEval and G-Eval. Using polymer degradation as a case study, we demonstrate the system’s effectiveness across knowledge extraction, reasoning, and evaluation.