Offline trained object detectors perform well on public datasets but degrade in the real world due to distributional shifts. Embodied intelligence, by enabling sample collection in the target environment, offers a solution. A key challenge is determining which samples to collect. Current methods primarily focus on semantically uncertain data, overlooking the importance of missed detection samples. This paper addresses this by using a class-agnostic detector to identify potential objects within the agent’s egocentric view, integrating local and global information as rewards. Experiments show that the proposed method effectively captures informative detection samples for perception model training.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Missed Sample Exploration by Class-Agnostic Detector for Embodied Learning

  • Panpan Wang,
  • Di Guo

摘要

Offline trained object detectors perform well on public datasets but degrade in the real world due to distributional shifts. Embodied intelligence, by enabling sample collection in the target environment, offers a solution. A key challenge is determining which samples to collect. Current methods primarily focus on semantically uncertain data, overlooking the importance of missed detection samples. This paper addresses this by using a class-agnostic detector to identify potential objects within the agent’s egocentric view, integrating local and global information as rewards. Experiments show that the proposed method effectively captures informative detection samples for perception model training.