Unstructured data contains important information that can offer insights in a variety of fields, but the lack of a predefined format makes it difficult to analyze, manage, and use effectively. This paper investigates the crucial role that textual data processing plays and presents a web tool that was developed in Python and Django. This tool includes standard procedures for processing data, which include eliminating stop words, lemmatization, stemming, and generating bigrams and trigrams. Additionally, the tool was tested with citizen security-related data taken from X social media.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Supporting the Text Preprocessing by Means a Web Tool

  • Ruth Reátegui,
  • Janneth Chicaiza,
  • Edgar Guamo,
  • Henry N. Roa,
  • Daniel Pulla-Sánchez

摘要

Unstructured data contains important information that can offer insights in a variety of fields, but the lack of a predefined format makes it difficult to analyze, manage, and use effectively. This paper investigates the crucial role that textual data processing plays and presents a web tool that was developed in Python and Django. This tool includes standard procedures for processing data, which include eliminating stop words, lemmatization, stemming, and generating bigrams and trigrams. Additionally, the tool was tested with citizen security-related data taken from X social media.