Artificial Intelligence and content analysis: the large language models (LLMs) and the automatized categorization

The growing advancement of Artificial Intelligence models based on deep learning and the consequent popularization of large language models (LLMs), such as ChatGPT, place the academic community facing unprecedented dilemmas, in addition to corroborating questions involving research activities and human beings. In this work, Content Analysis was chosen as the object of study, an important technique for analyzing qualitative data and frequently used among Brazilian researchers. The objective of this work was to compare the process of categorization by themes carried out by human researchers on material from the Educational area, at the end of 2022, with the help of the ATLAS.TI software and the same process of categorization by themes, now carried out by the version 2023 of the ATLAS.TI software, carried out in an automated way by Artificial Intelligence, for the same material. Through lexical and semantic analysis, the themes used in the two processes were compared, observing similarities and differences between the two proposals, and verifying the consistency between the two analyses. The main result of this study is the difficulty of Artificial Intelligence in carrying out a broader categorization, eliminating specificities that were considered irrelevant by the authors for understanding the material. It is concluded, therefore, that the automated categorization process proposed by ATLAS.TI through Natural Language Processing (NLP) is consistent from a lexical point of view but is still insufficient from a semantic aspect.