<p>Few-shot class-incremental learning (FSCIL) is the challenge of learning new categories with limited labeled samples while preserving previously learned knowledge. Although existing methods mainly focus on 2D images, the increasing use of 3D data, combined with its inherent scarcity, necessitates exploring FSCIL for 3D data. Traditional approaches rely on projecting 3D point clouds to 2D planes, causing significant loss of geometric information. This loss occurs because 2D images cannot fully represent the 3D structure. To address this issue, we propose a multimodal framework that integrates the benefits of 2D depth maps and 3D point clouds for improved feature extraction. Additionally, we designed a Task-Adaptive Learning Strategy (TLS) to reduce catastrophic forgetting and enhance performance. TLS adjusts the model’s adaptability based on task-specific features, improving its incremental learning capacity. Experimental results demonstrate that our method outperforms state-of-the-art techniques across several standard 3D FSCIL benchmark datasets.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Multimodal framework for 3D few-shot class-incremental learning

  • Zhang Senbao,
  • Huang Shucheng,
  • Li Pengyi,
  • Li Mingxing

摘要

Few-shot class-incremental learning (FSCIL) is the challenge of learning new categories with limited labeled samples while preserving previously learned knowledge. Although existing methods mainly focus on 2D images, the increasing use of 3D data, combined with its inherent scarcity, necessitates exploring FSCIL for 3D data. Traditional approaches rely on projecting 3D point clouds to 2D planes, causing significant loss of geometric information. This loss occurs because 2D images cannot fully represent the 3D structure. To address this issue, we propose a multimodal framework that integrates the benefits of 2D depth maps and 3D point clouds for improved feature extraction. Additionally, we designed a Task-Adaptive Learning Strategy (TLS) to reduce catastrophic forgetting and enhance performance. TLS adjusts the model’s adaptability based on task-specific features, improving its incremental learning capacity. Experimental results demonstrate that our method outperforms state-of-the-art techniques across several standard 3D FSCIL benchmark datasets.