Evaluating the incompleteness of machine-generated summaries remains a critical challenge in natural language generation. In domains such as healthcare, education, and policy, summaries that omit or distort key content can appear fluent yet undermine reliability and trust. We introduce a Lie algebra–based semantic flow framework that treats summarization as a geometric transformation in embedding space, where incompleteness manifests as segments with low semantic flow magnitudes. Unlike prior metrics that collapse evaluation into a single similarity score, our approach provides interpretable, segment-level signals through a dynamic mean-scaled thresholding mechanism, requiring no supervision. We evaluate our method on UniSumEval and SIGHT benchmarks, showing significant improvements over existing methods. Qualitative analysis further demonstrates that our framework not only identifies diverse forms of incompleteness but also provides actionable, interpretable signals for human-in-the-loop review.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Lie Algebra–Based Semantic Flow for Incompleteness Detection in Summarization

  • Manikandan Ravikiran,
  • Veeraraju Elluru,
  • Karrtik Iyer,
  • Prasanna Pendse,
  • Shayan Mohanty

摘要

Evaluating the incompleteness of machine-generated summaries remains a critical challenge in natural language generation. In domains such as healthcare, education, and policy, summaries that omit or distort key content can appear fluent yet undermine reliability and trust. We introduce a Lie algebra–based semantic flow framework that treats summarization as a geometric transformation in embedding space, where incompleteness manifests as segments with low semantic flow magnitudes. Unlike prior metrics that collapse evaluation into a single similarity score, our approach provides interpretable, segment-level signals through a dynamic mean-scaled thresholding mechanism, requiring no supervision. We evaluate our method on UniSumEval and SIGHT benchmarks, showing significant improvements over existing methods. Qualitative analysis further demonstrates that our framework not only identifies diverse forms of incompleteness but also provides actionable, interpretable signals for human-in-the-loop review.