A Fairness-Aware Load Balancing Strategy in Multi-tenant Clouds

Load balancing is an important issue in multi-tenant clouds to ensure the load balanced on computing resources belonged to different tenants. A containerized multi-tenant environment could be managed by Kubernetes using different scheduling policies. For improving scheduling performance of Kubernetes, Apache Yunikorn project provides the fine-grain control by hierarchical resource queues to enhance the resource utilization. However, the fairness-aware load balance among tenants is missed in Yunikorn, which may result in poor resource utilization in some tenants. This paper proposes a fairness-aware load balance policy for multi-tenant environments to keep the balance of resources allocated in different tenants, and also the balance of the utilizations of different resources in a computing node. Experimental results show the superiority of the proposed policy.