Breaking Information Silos: Global Guided Task Prediction for Class-Incremental Learning
摘要
Class-incremental learning (CIL) aims to learn a series of tasks sequentially, each introducing several new categories. Because providing the task labels during inference can significantly increase accuracy, many approaches attempt to predict task labels in CIL. However, existing works focus on learning local information and overlook the importance of global information. The absence of global guidance leads to the formation of information silos across disparate tasks, resulting in potential inter-task interference. To break information silos, we propose a method called Global Guided Task Prediction (GGTP) to introduce global information. Our method consists of two modules. The local de-redundant module aims to reduce information redundancy across different tasks from a global perspective. We combine dual encoders and feature decorrelation loss to effectively reduce redundancy while minimizing catastrophic forgetting. The global information module explicitly extracts global information to serve as auxiliary information guiding task prediction. We extract the most important information from all local information through a global encoder and then aggregate them to form global information. Extensive experiments validate the effectiveness of our method, which achieves state-of-the-art results.