Recently, a large number of low Earth orbit (LEO) satellites have been launched and deployed successfully in space. These LEO satellites are equipped with advanced multimodal sensors capable of collecting massive sensor data, serving as fuel for various space-based deep learning (DL) applications. However, ground stations (GS) cannot download such massive raw data for centralized training due to intermittent connectivity between satellites and GS, while the scaled-up DL models pose substantial barriers to distributed training on resource-constrained satellites. Though split learning (SL) has emerged as a promising solution to offload major training workloads to GS via model partitioning, the reliance on continuous connectivity significantly limits its deployment in satellite networks. To address this challenge, we propose ESL-LEO, an efficient SL framework specifically tailored for LEO satellite networks to enable full-satellite period training. We first construct an auxiliary model to tackle the training failure of the satellite-GS non-contact time, leveraging on-satellite idle resources to expedite model convergence. Moreover, we design the online knowledge distillation mechanism to extract GS-side knowledge for guiding and refining the satellite-side training, thereby further enhancing training performance. Extensive experiments demonstrate that ESL-LEO outperforms state-of-the-art benchmarks in both accuracy and convergence speed.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

ESL-LEO: An Efficient Split Learning Framework over LEO Satellite Networks

  • Zheng Lin,
  • Yuxin Zhang,
  • Zhe Chen,
  • Zihan Fang,
  • Yanni Yang,
  • Guoming Zhang,
  • Huan Yang,
  • Cong Wu,
  • Xianhao Chen,
  • Yue Gao

摘要

Recently, a large number of low Earth orbit (LEO) satellites have been launched and deployed successfully in space. These LEO satellites are equipped with advanced multimodal sensors capable of collecting massive sensor data, serving as fuel for various space-based deep learning (DL) applications. However, ground stations (GS) cannot download such massive raw data for centralized training due to intermittent connectivity between satellites and GS, while the scaled-up DL models pose substantial barriers to distributed training on resource-constrained satellites. Though split learning (SL) has emerged as a promising solution to offload major training workloads to GS via model partitioning, the reliance on continuous connectivity significantly limits its deployment in satellite networks. To address this challenge, we propose ESL-LEO, an efficient SL framework specifically tailored for LEO satellite networks to enable full-satellite period training. We first construct an auxiliary model to tackle the training failure of the satellite-GS non-contact time, leveraging on-satellite idle resources to expedite model convergence. Moreover, we design the online knowledge distillation mechanism to extract GS-side knowledge for guiding and refining the satellite-side training, thereby further enhancing training performance. Extensive experiments demonstrate that ESL-LEO outperforms state-of-the-art benchmarks in both accuracy and convergence speed.