Automatic scheduling of satellite tracking tasks by means of policy-gradient reinforcement learning and transformer-based pointer networks
摘要
Low-Earth-orbit (LEO) mega-constellations turn satellite–ground scheduling into a large-scale, real-time combinatorial problem. This work presents a neural-combinatorial framework that couples policy-gradient reinforcement learning with a transformer-based pointer network. The overall solution is implemented as a modular pipeline composed of distinct components for preprocessing, training, scheduling, and emergency handling, wherein the learning component consists of a single policy-gradient agent. The policy operates on ephemeris-derived contact graphs where candidates are encoded by priority, start time, satellite ID, and ground-station ID; feasibility is enforced through masking and a reward that captures buffer, non-overlap, and cool-down constraints. In simulations on OneWeb (