Comparative Study of Methods for Text Summarization Using Generative AI
摘要
In this research paper, we delve into different methods of text summarization using LangChain and OpenAI LLM models. While performing summarization, it is hard for the user to find out which method will provide the best summary for their particular text. To solve this problem, five different methods of text summarization, namely basic prompt summarization, summarization using prompt template, stuff documents chain, map reduce method and refine technique are discussed in detail and implemented. Text summarization is performed on various speeches by great political leaders of India using these methods. Each model’s performance is evaluated and compared using BERT Score. For summarizing short texts, prompt template summarization performs best. While for summarizing lengthier multi-page documents, refine technique proves best.