A Balanced Scheduling Technique for Distributed Inference Resources Based on Edge Computing
摘要
The load indicators of CPU utilization, memory utilization, disk space utilization, and network bandwidth utilization increase the complexity of resource scheduling. In order to achieve the goal of balanced scheduling of distributed reasoning resources, a new balanced scheduling technology is proposed by using edge computing. First, evaluate the load. Monitor and evaluate the load of each edge node in real time according to four indicators, so that the most suitable node can be selected to perform tasks when scheduling tasks. Secondly, according to the characteristics of the task and the real-time status of the node, the task is matched with the distributed reasoning resources. Finally, based on the matched resources, the edge computing is used to design a balanced scheduling algorithm for distributed reasoning resources, and the balanced scheduling of distributed reasoning resources is achieved by executing the algorithm. The test results show that the application of this technology can significantly improve resource utilization, achieve better load balancing, and make resource allocation more balanced.