This paper proposes a Monte Carlo Tree Search algorithm based on p-rollout that leverages the tree structure of MCTS to significantly enhance search performance in high-dimensional state spaces. The EOS task scheduling problem is modeled as a Markov Decision Process, with newly designed state space, action space, and reward function. A pretrained PPO network, referred to as p-rollout, replaces the traditional random rollout in MCTS. Experimental results demonstrate that this algorithm effectively improves task scheduling accuracy, enables reasonable task structuring, and ensures the completion of scheduling under resource constraints. Ultimately, the proposed approach provides near-optimal planning solutions without compromising spacecraft safety or computational efficiency.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MCTS Based on p-rollout for Autonomous Task Scheduling of Earth Observation Satellites

  • Xiao Wang,
  • Lishuo Wang,
  • Chen Zhang,
  • Hao Zhang,
  • Dazi Li

摘要

This paper proposes a Monte Carlo Tree Search algorithm based on p-rollout that leverages the tree structure of MCTS to significantly enhance search performance in high-dimensional state spaces. The EOS task scheduling problem is modeled as a Markov Decision Process, with newly designed state space, action space, and reward function. A pretrained PPO network, referred to as p-rollout, replaces the traditional random rollout in MCTS. Experimental results demonstrate that this algorithm effectively improves task scheduling accuracy, enables reasonable task structuring, and ensures the completion of scheduling under resource constraints. Ultimately, the proposed approach provides near-optimal planning solutions without compromising spacecraft safety or computational efficiency.