This paper examines the need for efficient keyword extraction methods to improve search accuracy and indexing due to the increasing volume of digital information. Traditional approaches, often based on word occurrence counts, tend to lose the contextual meaning of the text. The current work proposes a four-step NLP-based method for keyword extraction, including tokenization, POS tagging, noun phrase extraction, and chunking. The novel contribution of this research is the design of a grammatical pattern for extracting keywords (in the form of noun phrases) without losing the actual meaning of the text. This approach aims to retain the contextual meaning of the text. When compared to the most popular NLTK tool RAKE, the proposed method delivers better results while preserving the contextual meaning of the input text.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

NLP-Based Approach for Efficient Keyword Identification in Unstructured Text

  • Minu Choudhary,
  • Sourabh Rungta,
  • Shikha Pandey

摘要

This paper examines the need for efficient keyword extraction methods to improve search accuracy and indexing due to the increasing volume of digital information. Traditional approaches, often based on word occurrence counts, tend to lose the contextual meaning of the text. The current work proposes a four-step NLP-based method for keyword extraction, including tokenization, POS tagging, noun phrase extraction, and chunking. The novel contribution of this research is the design of a grammatical pattern for extracting keywords (in the form of noun phrases) without losing the actual meaning of the text. This approach aims to retain the contextual meaning of the text. When compared to the most popular NLTK tool RAKE, the proposed method delivers better results while preserving the contextual meaning of the input text.