STCL-Dynamic Sparsity-Driven Transition Feature Replay Continual Learning for Edge Devices
摘要
With the growing adoption of AI models and the increasing scale and complexity of inference tasks, continual learning (CL) has gained prominence for edge devices. However, traditional CL methods rely on large replay buffers to mitigate forgetting, which conflicts with the limited resources of edge systems and struggles with task ambiguity and sudden data shifts. To address these issues, we proposes Dynamic Sparsity-driven Transition Feature Replay Continual Learning (STCL), a lightweight CL framework tailored for edge devices. STCL tackles three key challenges: (i) limited on-chip memory for CNN parameters, (ii) insufficient compute power for multi-epoch training, and (iii) the need for real-time adaptation to new environments. It achieves this through weight sparsity, transition feature activation, and adaptive dual-memory replay. Extensive experiments on large-scale CL benchmarks show that STCL achieves 95.6% adaptive accuracy on CORe50, outperforming state-of-the-art methods while significantly reducing memory usage.