Deep neural networks learning (DNNs) becomes extremely challenging in high-noise environments. Currently, popular learning strategies under noisy label conditions can be roughly classified into four categories: Robust Architecture, Robust Regularization, Robust Loss Design, and Sample Selection. Building upon our theoretical framework, we integrate two major strategies: sample selection and robust loss functions. The robust loss function can mitigate the negative impact of noise on DNNs, while the sample selection strategy removes some noisy samples. These two strategies complement each other. We integrate them into a new framework to enhance the performance of DNNs in high-noise environments. Additionally, we propose two new strategies: 1) Limitation of forget rate, and 2) Replacement of sample selection loss functions, effectively addressing the shortcomings of sample selection and robust loss functions. We conducted experiments on datasets such as CIFAR-10, achieving significant accuracy improvements under high-noise conditions (0.8 noise rate). We have published the code at: https://github.com/fang-sen-wei/Collaborative-Learning-for-Noisy-Labels .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Collaborative Learning of Sample Selection and Robust Functions for Noisy Labels

  • Senwei Fang,
  • Tao Yang,
  • Chuanyi Zhang

摘要

Deep neural networks learning (DNNs) becomes extremely challenging in high-noise environments. Currently, popular learning strategies under noisy label conditions can be roughly classified into four categories: Robust Architecture, Robust Regularization, Robust Loss Design, and Sample Selection. Building upon our theoretical framework, we integrate two major strategies: sample selection and robust loss functions. The robust loss function can mitigate the negative impact of noise on DNNs, while the sample selection strategy removes some noisy samples. These two strategies complement each other. We integrate them into a new framework to enhance the performance of DNNs in high-noise environments. Additionally, we propose two new strategies: 1) Limitation of forget rate, and 2) Replacement of sample selection loss functions, effectively addressing the shortcomings of sample selection and robust loss functions. We conducted experiments on datasets such as CIFAR-10, achieving significant accuracy improvements under high-noise conditions (0.8 noise rate). We have published the code at: https://github.com/fang-sen-wei/Collaborative-Learning-for-Noisy-Labels .