Artificial neural networks often forget knowledge from previous tasks while adapting to new ones, a phenomenon known as catastrophic forgetting. Traditional experience replay and generative replay continual learning (CL) methods address this by reintroducing original samples or pseudo-samples during training. However, experience replay requires large memory, and generative replay has difficulty handling tasks with complex inputs. Inspired by the brain’s mechanisms of memory consolidation and replay, we propose Brain Generative Replay, a novel approach that leverages the rich semantic and detailed information encoded in electroencephalography (EEG) signals to generate high-quality, task-relevant samples. Furthermore, by uniquely incorporating human brain knowledge representation (EEG signals) as the foundation for replay, our method requires storing only minimal EEG data and dynamically generates semantically consistent yet detail-diverse replay samples by decoding multiple times, thereby improving storage efficiency. Extensive experiments demonstrate that Brain Generative Replay effectively mitigates catastrophic forgetting while balancing storage and performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Brain Generative Replay for Continual Learning

  • Jianguo Zhou,
  • Dongjun Liu,
  • Wanzeng Kong

摘要

Artificial neural networks often forget knowledge from previous tasks while adapting to new ones, a phenomenon known as catastrophic forgetting. Traditional experience replay and generative replay continual learning (CL) methods address this by reintroducing original samples or pseudo-samples during training. However, experience replay requires large memory, and generative replay has difficulty handling tasks with complex inputs. Inspired by the brain’s mechanisms of memory consolidation and replay, we propose Brain Generative Replay, a novel approach that leverages the rich semantic and detailed information encoded in electroencephalography (EEG) signals to generate high-quality, task-relevant samples. Furthermore, by uniquely incorporating human brain knowledge representation (EEG signals) as the foundation for replay, our method requires storing only minimal EEG data and dynamically generates semantically consistent yet detail-diverse replay samples by decoding multiple times, thereby improving storage efficiency. Extensive experiments demonstrate that Brain Generative Replay effectively mitigates catastrophic forgetting while balancing storage and performance.