Abstract <p>The problem of classifying source code reviews is considered. A new dataset 10 045 comments in size has been created and made publicly available, which combines four open datasets and is supplemented by 3200 hand-tagged comments. A hierarchical classification scheme has been developed, including 16 classes grouped into 5 categories. Various classification methods were tested, including FastText with F1-macro = 0.579 and CodeBERT with F1-macro = 0.775, with an assessment by computational costs. The obtained results confirm the applicability of automatic review classification for identifying discussions that require increased attention from developers.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Building a Dataset for Combined Classification of Source Code Reviews

  • P. A. Petrova,
  • S. I. Markov,
  • V. V. Kachanov

摘要

Abstract

The problem of classifying source code reviews is considered. A new dataset 10 045 comments in size has been created and made publicly available, which combines four open datasets and is supplemented by 3200 hand-tagged comments. A hierarchical classification scheme has been developed, including 16 classes grouped into 5 categories. Various classification methods were tested, including FastText with F1-macro = 0.579 and CodeBERT with F1-macro = 0.775, with an assessment by computational costs. The obtained results confirm the applicability of automatic review classification for identifying discussions that require increased attention from developers.