Evaluation and Comparison of Tweppy and Snscrape Libraries for Efficient Data Gathering on X

Using digital social networks such as X, Facebook, and Instagram is increasingly common. We consider efficient data gathering on these platforms crucial for their analysis. However, the selection and use of inappropriate data gathering tools can be costly and ineffective due to wasted resources and the conclusions that researchers can draw from erroneous or incomplete data. To find an efficient tool for data gathering and provide the research community with a clear and accurate view of the strengths and weaknesses of each library, we evaluated the Tweepy and Snscrape libraries, which are the most commonly used for data gathering from Twitter now known as X. Then, researchers can make informed decisions regarding their use. We used a methodology based on an evaluation framework with comparative scores assigned by a group of experts. They evaluated performance, functionality, usability, and auxiliary tasks categories. We analyzed the results using statistical tests, and we concluded that there are significant differences between the means of the evaluations for the Tweepy and Snscrape libraries, which means that Snscrape has been more accepted than Tweepy by evaluators. On the other hand, from the analysis of results using graphic methods, we can see that in the usability category evaluation, particularly in criteria such as data visualization and learning curve, the scores of both libraries are practically equal. According to the obtained results, we believe that researchers can rely on the effectiveness and efficiency of Snscrape for their work.