RADEAN: A Resource Allocation Model Based on Deep Reinforcement Learning and Generative Adversarial Networks in Edge Computing
摘要
Edge computing alleviates the network congestion and latency pressure on the remote cloud as well as the computation stress on end devices. However, facing numerous tasks, how to effectively allocate and manage the resources of edge servers is of great significance, which affects both the benefits of service providers and Quality of Service (QoS) of users. This paper proposes a resource allocation model based on Deep Reinforcement Learning (DRL) and Generative Adversarial Networks (G AN)(RADEAN). It considers the future resource occupancy of edge servers, and applies multi-replay memory with priority to eliminate the interaction between experiences and improve sampling efficiency. We maximize the average resource utilization of edge servers while ensuring the average transmission latency (ATL) and average execution time (AET) of tasks in a long-term view. Specifically, based on the state which consists the predicted resource occupation output by GAN, the current resource usage status of edge servers and the characteristics of the task queue, DRL agent makes resource allocation decision for each task. We conduct experiments using real-world data trace, and show that RADEAN outperforms traditional and state-of-the-art models with great generalization, reaching the maximum performance improvement of 48.21% compared with MMRA. The ATL and AET of tasks are also presented to reflect the QoS guarantee. Ablation experiments prove the effectiveness of multi-replay memory and priority sub-modules.