Have you ever noticed that large language models often struggle when attempting to modify their established fundamental facts? This paper examines the significant challenges that current knowledge editing techniques encounter when modifying information internally stored within models, particularly when dealing with highly interconnected knowledge. We find that existing methods typically operate at a superficial level, failing to adequately account for the complex networks of associations among different pieces of internal knowledge. This oversight frequently leads to unintended consequences, triggering a cascade of errors and inconsistencies, thereby severely undermining the model’s overall knowledge integrity. To better understand which types of knowledge can be effectively edited and which cannot, we propose a novel knowledge classification based on editability. Furthermore, we introduce the BoundaryEdit dataset, a new benchmark specifically designed for rigorously evaluating the performance of existing knowledge-editing techniques across different knowledge categories. Our experimental evaluation of mainstream knowledge-editing methods reveals significant limitations when attempting to modify fundamental, highly interconnected knowledge, often resulting in substantial breakdowns within the model’s knowledge system. To mitigate the risk of knowledge system collapse, we propose an automated classification approach leveraging advanced language models to distinguish editable from non-editable knowledge effectively. Our experiments using models such as ChatGPT-4o, Grok-3 beta, and Gemini 2.0 Flash demonstrate significant differences in accuracy across knowledge types, revealing distinct limitations particularly in handling partially information-missing and dependent uneditable knowledge.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

When the U.S. Capital Becomes Tokyo: The Boundary of Knowledge Editing

  • Xingda Yu,
  • Jiancheng Zhao,
  • Yuxiang Zhang,
  • Leqi Xu,
  • Zhen Yang

摘要

Have you ever noticed that large language models often struggle when attempting to modify their established fundamental facts? This paper examines the significant challenges that current knowledge editing techniques encounter when modifying information internally stored within models, particularly when dealing with highly interconnected knowledge. We find that existing methods typically operate at a superficial level, failing to adequately account for the complex networks of associations among different pieces of internal knowledge. This oversight frequently leads to unintended consequences, triggering a cascade of errors and inconsistencies, thereby severely undermining the model’s overall knowledge integrity. To better understand which types of knowledge can be effectively edited and which cannot, we propose a novel knowledge classification based on editability. Furthermore, we introduce the BoundaryEdit dataset, a new benchmark specifically designed for rigorously evaluating the performance of existing knowledge-editing techniques across different knowledge categories. Our experimental evaluation of mainstream knowledge-editing methods reveals significant limitations when attempting to modify fundamental, highly interconnected knowledge, often resulting in substantial breakdowns within the model’s knowledge system. To mitigate the risk of knowledge system collapse, we propose an automated classification approach leveraging advanced language models to distinguish editable from non-editable knowledge effectively. Our experiments using models such as ChatGPT-4o, Grok-3 beta, and Gemini 2.0 Flash demonstrate significant differences in accuracy across knowledge types, revealing distinct limitations particularly in handling partially information-missing and dependent uneditable knowledge.