Online academic content has become a key area of research for text analysis and the development of recommender systems. However, while existing tools typically offer content scraping or text complexity assessment, few integrate both within a unified framework. This paper introduces ASTRA (Academic Scraper for Text and Reading Analysis), a system that automates the collection of scholarly texts and evaluates their linguistic and readability features. ASTRA combines web scraping with Natural Language Processing (NLP) techniques to extract metadata, preprocess text, and compute lexical diversity and readability indexes. Unlike other tools, ASTRA generates text complexity information that supports the development of educational technology, academic writing evaluation, and large-scale corpus studies. Preliminary experiments show that ASTRA effectively retrieves relevant academic material while producing reliable complexity assessments. In general, ASTRA represents a practical resource for researchers and educators seeking to bridge automated data collection with advanced text analysis.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

ASTRA: A Web Scraping Tool Devoted to Academic Content Retrieval and Text Complexity Analysis

  • Jonathan Rojas-Simón,
  • Yulia Ledeneva,
  • Verónica Neri-Mendoza,
  • René A. García-Hernández,
  • Abner A. Gil-García,
  • Angel Barón-García

摘要

Online academic content has become a key area of research for text analysis and the development of recommender systems. However, while existing tools typically offer content scraping or text complexity assessment, few integrate both within a unified framework. This paper introduces ASTRA (Academic Scraper for Text and Reading Analysis), a system that automates the collection of scholarly texts and evaluates their linguistic and readability features. ASTRA combines web scraping with Natural Language Processing (NLP) techniques to extract metadata, preprocess text, and compute lexical diversity and readability indexes. Unlike other tools, ASTRA generates text complexity information that supports the development of educational technology, academic writing evaluation, and large-scale corpus studies. Preliminary experiments show that ASTRA effectively retrieves relevant academic material while producing reliable complexity assessments. In general, ASTRA represents a practical resource for researchers and educators seeking to bridge automated data collection with advanced text analysis.