Development of a Software Module for Collecting and Analyzing Web Content to Determine Extremist Direction in the Text

This article discusses the creation of a parser module for collecting texts from web resources. Detecting extremist content on the Internet and combating it is one of the most important problems of society and the state. Currently, the relevance of this problem is confirmed by the general spread of various Internet communications and social networks, along with the anonymity of Internet users. The massive growth in the number of these services contributes to the emergence of various criminal schemes, creates a problem of ensuring the security of presence in a virtual environment for humanity. A data collection module for building a text corpus for teaching and testing machine learning methods to identify extremist texts in the Kazakh language is presented.