As a vital solution for data trading, blockchain often carries a substantial amount of critical data. Consequently, data quality, as a crucial evaluation metric, plays a key role in facilitating data trading on the blockchain. In the process of comprehensively evaluating the quality of multi-field datasets, it is crucial to determine the importance coefficient of each data item. The importance evaluation methods of data items include subjective methods that depend on expert scoring, as well as objective methods based on statistical methods. Objective methods evaluate field importance based on the laws of data itself. However, such methods start from the quality of data to be evaluated, and cannot reflect the mutual dependency between data items and the resulting field importance. To solve this problem, this article starts from the business dependency between data items, constructs a directed graph, namely dependency network. On this basis, according to the characteristics and quantity of data items that depend on fields, we propose the FieldRank algorithm. The algorithm objectively quantifies and evaluates the importance of each field, so that the field importance weight obtained based on the algorithm is directly related to the actual business and is more close to the essence of data business. Therefore, this algorithm can provide objective data quality evaluation results for data use. Practice has proved that in the case of large amounts of big data and closely related businesses, the data quality evaluation results obtained by this method are more close to actual business practice.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Dataset Quality Evaluation Algorithm for Data Trading on Blockchain

  • Bingchuan Chen,
  • Jiarui Chen,
  • Gansen Zhao,
  • Zhihao Hou

摘要

As a vital solution for data trading, blockchain often carries a substantial amount of critical data. Consequently, data quality, as a crucial evaluation metric, plays a key role in facilitating data trading on the blockchain. In the process of comprehensively evaluating the quality of multi-field datasets, it is crucial to determine the importance coefficient of each data item. The importance evaluation methods of data items include subjective methods that depend on expert scoring, as well as objective methods based on statistical methods. Objective methods evaluate field importance based on the laws of data itself. However, such methods start from the quality of data to be evaluated, and cannot reflect the mutual dependency between data items and the resulting field importance. To solve this problem, this article starts from the business dependency between data items, constructs a directed graph, namely dependency network. On this basis, according to the characteristics and quantity of data items that depend on fields, we propose the FieldRank algorithm. The algorithm objectively quantifies and evaluates the importance of each field, so that the field importance weight obtained based on the algorithm is directly related to the actual business and is more close to the essence of data business. Therefore, this algorithm can provide objective data quality evaluation results for data use. Practice has proved that in the case of large amounts of big data and closely related businesses, the data quality evaluation results obtained by this method are more close to actual business practice.