Active learning (AL) is a popular machine learning algorithm designed to iteratively query and label informative data points from an unlabeled dataset, reducing the need for extensive labeled data. While AL improves labeling efficiency, a major challenge lies in accurately assessing the true value of unlabeled data. In this study, we propose a pioneering AL approach employing Conditional Variational Deep Embedding (CVaDE), aimed at discerning the most informative samples for labeling from both implicit and explicit perspectives. First, CVaDE implicitly learns a latent data representation by co-training a task learner and a discriminator, enabling the estimation of an uncertainty score for each sample. Second, it explicitly performs clustering on the latent representations to compute a representativeness score for each sample. Additionally, we introduce a diversity score that quantifies the average dissimilarity of each sample to the candidate set, aiding in identifying the most valuable samples. Through the combination of uncertainty, representativeness, and diversity scores, CVaDE selects the most informative samples for labeling. Our empirical evaluation on multiple benchmark datasets demonstrates notable performance improvements compared to existing baselines, highlighting the efficacy of our proposed approach.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Informative Sample Labeling with Conditional Variational Deep Embedding for Active Learning

  • Zhao Li,
  • Qinxue Meng,
  • Haitao Xu,
  • Jiaming Huang,
  • Yangbohan Jiao,
  • Buqing Cao

摘要

Active learning (AL) is a popular machine learning algorithm designed to iteratively query and label informative data points from an unlabeled dataset, reducing the need for extensive labeled data. While AL improves labeling efficiency, a major challenge lies in accurately assessing the true value of unlabeled data. In this study, we propose a pioneering AL approach employing Conditional Variational Deep Embedding (CVaDE), aimed at discerning the most informative samples for labeling from both implicit and explicit perspectives. First, CVaDE implicitly learns a latent data representation by co-training a task learner and a discriminator, enabling the estimation of an uncertainty score for each sample. Second, it explicitly performs clustering on the latent representations to compute a representativeness score for each sample. Additionally, we introduce a diversity score that quantifies the average dissimilarity of each sample to the candidate set, aiding in identifying the most valuable samples. Through the combination of uncertainty, representativeness, and diversity scores, CVaDE selects the most informative samples for labeling. Our empirical evaluation on multiple benchmark datasets demonstrates notable performance improvements compared to existing baselines, highlighting the efficacy of our proposed approach.