Human perception and cognition rely on the ability to decompose complex scenes into object-centric representations. Recent advances in unsupervised object segmentation have enabled the discovery of structured, interpretable representations that improve performance across a wide range of computer vision tasks. While object-centric learning has shown promising results, existing methods often struggle with generalization across diverse domains, typically being limited to either synthetic or controlled real-world settings. Slot Attention has become a dominant architecture for object-centric representation learning. An alternative approach based on Gaussian mixture modeling—known as the Slot Mixture Module (SMM)—offers conceptual advantages by replacing cross-attention with probabilistic mixture components. However, SMM exhibits unstable convergence and limited performance on real-world data. In this work, we propose a novel training mechanism for slot-based models that significantly improves stability and adaptability. Our method introduces a hierarchical key aggregation strategy in the encoder, combined with an iterative refinement scheme within each slot update step. The pseudo-attention weights and mixture component parameters are modeled probabilistically and refined through a stabilized optimization procedure. https://github.com/VovaFrolow/rapid .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

RAPID: Robust Adaptive Probabilistic Inference with DINO Features

  • Vladimir Frolov,
  • Vitaliy Vorobyov,
  • Leonid Ugadiarov,
  • Aleksandr Panov

摘要

Human perception and cognition rely on the ability to decompose complex scenes into object-centric representations. Recent advances in unsupervised object segmentation have enabled the discovery of structured, interpretable representations that improve performance across a wide range of computer vision tasks. While object-centric learning has shown promising results, existing methods often struggle with generalization across diverse domains, typically being limited to either synthetic or controlled real-world settings. Slot Attention has become a dominant architecture for object-centric representation learning. An alternative approach based on Gaussian mixture modeling—known as the Slot Mixture Module (SMM)—offers conceptual advantages by replacing cross-attention with probabilistic mixture components. However, SMM exhibits unstable convergence and limited performance on real-world data. In this work, we propose a novel training mechanism for slot-based models that significantly improves stability and adaptability. Our method introduces a hierarchical key aggregation strategy in the encoder, combined with an iterative refinement scheme within each slot update step. The pseudo-attention weights and mixture component parameters are modeled probabilistically and refined through a stabilized optimization procedure. https://github.com/VovaFrolow/rapid .