Static, Dynamic, or Contextualized: What is the Best Approach for Discovering Semantic Shifts in Russian Media?

This paper is focused on discovering diachronic semantic shifts in Russian news and social media using different embedding methods. Namely, in our work, we explore the effectiveness of static, dynamic, and contextualized approaches. Using these methods, we reveal social, political, and cultural changes through semantic shifts in the News and Social media corpora; the latter was collected and released as a part of this work. In addition, we compare the performance of these three approaches and highlight their strengths and weaknesses for this task.