Bayesian active learning is based on information theoretical approaches that focus on maximising the information that new observations provide to the model parameters. This is commonly done by maximizing the Bayesian Active Learning by Disagreement (BALD) acquisition function. However, it is challenging to estimate BALD when the new data points are subject to censorship, where only clipped values of the targets are observed. To address this, we derive the entropy and the mutual information for right-censored distributions and derive the BALD objective for active learning in censored regression ( \(\mathcal {C}\) -BALD). We propose a novel modeling approach to estimate the \(\mathcal {C}\) -BALD objective and use it for active learning in the censored setting. Across a wide range of datasets and models, we demonstrate that \(\mathcal {C}\) -BALD outperforms other Bayesian active learning methods in censored regression.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Bayesian Active Learning for Censored Regression

  • Frederik Boe Hüttel,
  • Christoffer Riis,
  • Filipe Rodrigues,
  • Francisco Pereira

摘要

Bayesian active learning is based on information theoretical approaches that focus on maximising the information that new observations provide to the model parameters. This is commonly done by maximizing the Bayesian Active Learning by Disagreement (BALD) acquisition function. However, it is challenging to estimate BALD when the new data points are subject to censorship, where only clipped values of the targets are observed. To address this, we derive the entropy and the mutual information for right-censored distributions and derive the BALD objective for active learning in censored regression ( \(\mathcal {C}\) -BALD). We propose a novel modeling approach to estimate the \(\mathcal {C}\) -BALD objective and use it for active learning in the censored setting. Across a wide range of datasets and models, we demonstrate that \(\mathcal {C}\) -BALD outperforms other Bayesian active learning methods in censored regression.