<p>Our contribution is concerned with the increasing amount of conspiracy theories and other forms of mis- or disinformation spreading on social media. We address this challenge to democratic opinion formation with a&#xa0;two-pronged approach. On the one hand, we identify specific conspiracy narratives in a&#xa0;social media corpus; on the other hand, we look at general linguistic dimensions that contribute to the overall drivel-like quality of such texts regardless of the narratives involved. For the present contribution, six distinct dimensions, along with an overall measure of drivel-like quality, were assessed using a&#xa0;five-point Likert scale. A&#xa0;sample of approximately 2000 texts drawn from German Telegram was manually annotated. We present the calculation of inter-annotator agreement to evaluate annotation consistency, conduct correlation analyses to examine the relationships between the individual dimensions, and fit a&#xa0;linear model to predict the overall drivel-like quality of the texts based on the individual dimensions. In addition, we train ordinal regression models to predict the values of each dimension from bag-of-<i>n</i>-grams representations. Finally, an analysis of feature weights identifies which <i>n</i>-grams serve as the most reliable indicators of each dimension.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Narratives and Linguistic Features of Drivel

  • Philipp Heinrich,
  • Andreas Blombach,
  • Stephanie Evert,
  • Fabian Schäfer

摘要

Our contribution is concerned with the increasing amount of conspiracy theories and other forms of mis- or disinformation spreading on social media. We address this challenge to democratic opinion formation with a two-pronged approach. On the one hand, we identify specific conspiracy narratives in a social media corpus; on the other hand, we look at general linguistic dimensions that contribute to the overall drivel-like quality of such texts regardless of the narratives involved. For the present contribution, six distinct dimensions, along with an overall measure of drivel-like quality, were assessed using a five-point Likert scale. A sample of approximately 2000 texts drawn from German Telegram was manually annotated. We present the calculation of inter-annotator agreement to evaluate annotation consistency, conduct correlation analyses to examine the relationships between the individual dimensions, and fit a linear model to predict the overall drivel-like quality of the texts based on the individual dimensions. In addition, we train ordinal regression models to predict the values of each dimension from bag-of-n-grams representations. Finally, an analysis of feature weights identifies which n-grams serve as the most reliable indicators of each dimension.