The rapid growth of large language models has increased the need for high-quality data, making efficient data acquisition a challenge. Blockchain-based crowdsourcing enhances data annotation efficiency in untrusted environments, but existing static or heuristic matching methods struggle in high-dimensional dynamic settings. This paper proposes an intelligent crowdsourcing framework using deep reinforcement learning for blockchain scenarios to improve data annotation in complex dynamic environments. The framework employs deep reinforcement learning for intelligent task-worker matching and dynamic allocation, optimizing scheduling based on task difficulty, worker performance, and resources. Blockchain smart contracts ensure secure, traceable, and fair user management, task management, and auditing. Experiments show the framework outperforms static and heuristic methods, improving on-time completion rate and transaction volume by 7.7% and 15% over heuristic strategies, and 6.5% and 14.3% over static strategies in high-dimensional dynamic environments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Data Annotation Crowdsourcing Matching Optimization Method in Blockchain Environment: Based on Deep Reinforcement Learning

  • Zhaorui Hou,
  • Chunpei Li,
  • Peng Liu,
  • Xianxian Li,
  • Yuxing Liu,
  • Yanli Jin

摘要

The rapid growth of large language models has increased the need for high-quality data, making efficient data acquisition a challenge. Blockchain-based crowdsourcing enhances data annotation efficiency in untrusted environments, but existing static or heuristic matching methods struggle in high-dimensional dynamic settings. This paper proposes an intelligent crowdsourcing framework using deep reinforcement learning for blockchain scenarios to improve data annotation in complex dynamic environments. The framework employs deep reinforcement learning for intelligent task-worker matching and dynamic allocation, optimizing scheduling based on task difficulty, worker performance, and resources. Blockchain smart contracts ensure secure, traceable, and fair user management, task management, and auditing. Experiments show the framework outperforms static and heuristic methods, improving on-time completion rate and transaction volume by 7.7% and 15% over heuristic strategies, and 6.5% and 14.3% over static strategies in high-dimensional dynamic environments.