<p>Optimizing service latency while controlling resource costs is a critical challenge in cloud-native microservice deployments. This paper proposes Horizontal Pod Splitting (HPS), a novel scheduling method that jointly optimizes the number of pod replicas and resource quotas under fixed total resources to minimize service latency. We construct a double-exponential service latency model that characterizes the relationships among total resources, unit resource concurrency, pod replicas, and service latency. Based on this model, we theoretically derive the optimal number of pod replicas and schedulability condition. Experimental results on a Kubernetes cluster demonstrate that HPS reduces service latency by 6–12% compared to HPA and by 7–22% compared with Libra under equivalent resource conditions, while achieving higher cloud resource utilization and reducing deployment costs for service providers.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Horizontal pod splitting scheduling for cost-effectiveness in cloud computing

  • Shengyi Wang,
  • Xianhui Liu,
  • Jianwei Fu,
  • Shunzhang Liu,
  • Xiaoyong Tian,
  • Xiaowei Du

摘要

Optimizing service latency while controlling resource costs is a critical challenge in cloud-native microservice deployments. This paper proposes Horizontal Pod Splitting (HPS), a novel scheduling method that jointly optimizes the number of pod replicas and resource quotas under fixed total resources to minimize service latency. We construct a double-exponential service latency model that characterizes the relationships among total resources, unit resource concurrency, pod replicas, and service latency. Based on this model, we theoretically derive the optimal number of pod replicas and schedulability condition. Experimental results on a Kubernetes cluster demonstrate that HPS reduces service latency by 6–12% compared to HPA and by 7–22% compared with Libra under equivalent resource conditions, while achieving higher cloud resource utilization and reducing deployment costs for service providers.