Summarization of textual content is an essential task in natural language processing (NLP), enabling efficient information retrieval and comprehension. Traditional summarization models, while effective, often produce outputs that can miss critical information or introduce redundancy. This paper proposes a novel approach to enhance the quality of summaries by combining outputs from multiple summarization models and refining them using semantic similarity measures. Specifically, we utilize the finetuned BART, T5, and PEGASUS models to generate initial summaries. These outputs are then combined and redundant sentences are removed through semantic similarity analysis using the Sentence-BERT embeddings. Our experimental results demonstrate that this multi-model approach produces more comprehensive and coherent summaries, capturing a broader range of information with reduced redundancy. This method offers significant improvements in the quality of text summarization, making it a valuable tool for applications requiring precise and concise summaries.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Combining Summarization Models Using Semantic Similarity

  • S. Suguna Mallika,
  • G. Swetha,
  • Ch. Sarada,
  • KVijaya Lakshmi

摘要

Summarization of textual content is an essential task in natural language processing (NLP), enabling efficient information retrieval and comprehension. Traditional summarization models, while effective, often produce outputs that can miss critical information or introduce redundancy. This paper proposes a novel approach to enhance the quality of summaries by combining outputs from multiple summarization models and refining them using semantic similarity measures. Specifically, we utilize the finetuned BART, T5, and PEGASUS models to generate initial summaries. These outputs are then combined and redundant sentences are removed through semantic similarity analysis using the Sentence-BERT embeddings. Our experimental results demonstrate that this multi-model approach produces more comprehensive and coherent summaries, capturing a broader range of information with reduced redundancy. This method offers significant improvements in the quality of text summarization, making it a valuable tool for applications requiring precise and concise summaries.