LADA: Label Disambiguation and Domain-Aware Learning for Domain Generalization
摘要
Domain generalization aims to train models on multiple source domains to perform well on unseen target domains. Large vision-language backbones such as CLIP demonstrate strong zero-shot transfer and have sparked many parameter-efficient ways to leverage pre-trained features. However, ambiguous labels are universal in real-world data but largely ignored, which not only shrinks out-of-distribution robustness but also generalization. To address this challenge, we introduce a concise two-stage remedy: LAbel disambiguation first, then Domain-Aware learning (LADA). First, we convert hard labels into calibrated soft labels, down-weighting low-confidence samples. Then, we capture domain-related information via a domain-aware prompt and a prototype-based projection head with the enriched soft labels. These two coupled steps encode more informative cues for each domain, unleashing CLIP’s potential. Our LADA delivers a +5.7% gain on average and markedly improves performance on the most distribution-shifted datasets for the ResNet-50 CLIP (OpenAI) backbone. Furthermore, extensive model analysis demonstrates the superiority of our method in effectiveness, robustness, efficacy, flexibility, and efficiency.