FI-CBL: A Probabilistic Method for Concept-Based Learning with Expert Rules
摘要
A method for solving the concept-based learning (CBL) problem is proposed. An idea behind the method is to divide each concept-annotated image into patches, transform them into embeddings using an autoencoder, and cluster the embeddings assuming that each cluster will primarily contain embeddings of patches representing certain concepts. To infer concepts for a new image, the method employs frequentist inference by computing prior and posterior probabilities of concepts based on frequencies of patches from images associated with concept values. The proposed method is named Frequentist Inference CBL (FI-CBL). It enables the incorporation of expert rules in a form of logical functions into the inference process by updating probabilities of concepts to ensure consistency with these rules. FI-CBL offers a clear frequency-based interpretation. Numerical experiments show that FI-CBL outperforms the concept bottleneck model, particularly when the amount of training data is limited. The code of proposed algorithms is publicly available.