<p>With the continuous proliferation of wireless devices, the growing pressure on wireless channels has resulted in degraded network quality for edge users and increased energy consumption of mobile devices. To enhance user experience and extend devices’ battery life, this paper proposes a multi-agent deep reinforcement learning-based task-offloading algorithm, referred to as cell-free multi-agent deep reinforcement learning (CFMADRL). Under a cell-free architecture, the proposed model introduces two representative task types, namely, delay-sensitive tasks and energy-sensitive tasks. The model also designs a multidimensional task classification mechanism that integrates task complexity, device status, and delay-energy pressure metrics. To effectively handle heterogeneous tasks, a dual-agent collaborative framework is constructed, where each agent is dedicated to a specific optimization objective: minimizing task completion delay or reducing energy consumption. Both objectives are achieved through global task offloading and resource scheduling. Furthermore, CFMADRL incorporates a user-driven access point (AP) cooperative offloading mechanism and a hierarchical optimization strategy. The system optimization problem is decomposed into two subproblems: computational resource allocation and task offloading/power control, which are addressed using convex optimization and multi-agent deep reinforcement learning, respectively. Simulation results demonstrate that the proposed algorithm significantly outperforms existing benchmark methods in terms of reducing system delay and energy consumption, and the method also shows strong robustness and adaptability in dynamic edge computing environments.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A deep reinforcement learning-based task offloading algorithm for cell-free architecture CFMADRL: co-optimization of delay-energy-sensitive tasks

  • Keke Li,
  • Xiaochun Wu,
  • Jiali Liu,
  • Yichao Lou,
  • Mingjun Qi

摘要

With the continuous proliferation of wireless devices, the growing pressure on wireless channels has resulted in degraded network quality for edge users and increased energy consumption of mobile devices. To enhance user experience and extend devices’ battery life, this paper proposes a multi-agent deep reinforcement learning-based task-offloading algorithm, referred to as cell-free multi-agent deep reinforcement learning (CFMADRL). Under a cell-free architecture, the proposed model introduces two representative task types, namely, delay-sensitive tasks and energy-sensitive tasks. The model also designs a multidimensional task classification mechanism that integrates task complexity, device status, and delay-energy pressure metrics. To effectively handle heterogeneous tasks, a dual-agent collaborative framework is constructed, where each agent is dedicated to a specific optimization objective: minimizing task completion delay or reducing energy consumption. Both objectives are achieved through global task offloading and resource scheduling. Furthermore, CFMADRL incorporates a user-driven access point (AP) cooperative offloading mechanism and a hierarchical optimization strategy. The system optimization problem is decomposed into two subproblems: computational resource allocation and task offloading/power control, which are addressed using convex optimization and multi-agent deep reinforcement learning, respectively. Simulation results demonstrate that the proposed algorithm significantly outperforms existing benchmark methods in terms of reducing system delay and energy consumption, and the method also shows strong robustness and adaptability in dynamic edge computing environments.