This empirical submission reports on two original methods geared towards producing semantic annotations for the decompositional marker again. The two methods are (i) expert annotation based on a comprehensive set of guidelines and (ii) quality-controlled crowdsourcing with ensuing evaluation on the basis of the expert annotation. We report on a number of strategies for yielding a ‘crowd winner’ and present as the most promising candidate KMeans clustering of annotation vectors which are supplemented with corpus and annotational features. We report an observed accuracy of 85.54% with Cohen’s \(\kappa \) at 0.73.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Decomposing Decomposition in Time: A Methodological Investigation

  • Martin Kopf,
  • Remus Gergel

摘要

This empirical submission reports on two original methods geared towards producing semantic annotations for the decompositional marker again. The two methods are (i) expert annotation based on a comprehensive set of guidelines and (ii) quality-controlled crowdsourcing with ensuing evaluation on the basis of the expert annotation. We report on a number of strategies for yielding a ‘crowd winner’ and present as the most promising candidate KMeans clustering of annotation vectors which are supplemented with corpus and annotational features. We report an observed accuracy of 85.54% with Cohen’s \(\kappa \) at 0.73.