With the rapid growth of multimedia content and online gaming, traditional cloud computing faces difficulties in meeting real-time requirements, particularly in optimizing caching strategies, managing dynamic environments, and handling user location uncertainties. To overcome these limitations, we propose a novel AI-Enhanced Edge Cooperation framework based on Multi-Agent Deep Reinforcement Learning (EC-MADRL) to optimize scheduling and resource allocation across edge nodes. This framework enables adaptive caching and replenishment strategies in a cooperative environment, modeled as a multi-agent Markov Decision Process (MDP). By integrating an online MADRL approach, the EC-MADRL algorithm allows edge nodes to collaboratively learn optimal policies for caching and resource distribution. We analyze the time complexity and convergence of the algorithm, demonstrating its effectiveness in improving edge node performance. Experimental results show a 30.12% increase in edge node profits, a 20.67% reduction in user latency, and a 24.31% decrease in user costs, highlighting the superior performance of our AI-enhanced approach over baseline methods, including DDQN-ECMP, MADRL-ECMP, and P4LRU algorithms.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

EC-MADRL: AI-Enhanced Edge Cooperation Caching Based on Multi-agent Deep Reinforcement Learning

  • Yuzhu Liang,
  • Jiandian Zeng,
  • Haodong Zou,
  • Yaxin Mei,
  • Guangxue Zhang,
  • Tian Wang

摘要

With the rapid growth of multimedia content and online gaming, traditional cloud computing faces difficulties in meeting real-time requirements, particularly in optimizing caching strategies, managing dynamic environments, and handling user location uncertainties. To overcome these limitations, we propose a novel AI-Enhanced Edge Cooperation framework based on Multi-Agent Deep Reinforcement Learning (EC-MADRL) to optimize scheduling and resource allocation across edge nodes. This framework enables adaptive caching and replenishment strategies in a cooperative environment, modeled as a multi-agent Markov Decision Process (MDP). By integrating an online MADRL approach, the EC-MADRL algorithm allows edge nodes to collaboratively learn optimal policies for caching and resource distribution. We analyze the time complexity and convergence of the algorithm, demonstrating its effectiveness in improving edge node performance. Experimental results show a 30.12% increase in edge node profits, a 20.67% reduction in user latency, and a 24.31% decrease in user costs, highlighting the superior performance of our AI-enhanced approach over baseline methods, including DDQN-ECMP, MADRL-ECMP, and P4LRU algorithms.