The paper presents an adaptive, hierarchical data fusion method for security biometric applications, with design elements for a software architecture. The methodology relies on a 2-layer (intra- and inter-modal) data fusion of texture (Haralick) features. The framework uses adaptive weighting based on the sample’s quality integrated into a quality-aware intra-modal attention (for the intra-modal layer). A gating mechanism for the inter-modal layer dynamically selects the fusion rule for the current context (combination of experts). The methodology could consider a security-by-design approach with cancellable templates. The score−/decision-level fusion can be used for the cases in which the feature representations are very heterogeneous or with missing features. This framework is suitable for systems working under varying conditions impacting on the data quality.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An Adaptive Hierarchical Multimodal Fusion for Security Biometric Applications

  • Sorin Soviany,
  • Cristina-Gabriela Gheorghe,
  • Maria Gheorghe-Moisii

摘要

The paper presents an adaptive, hierarchical data fusion method for security biometric applications, with design elements for a software architecture. The methodology relies on a 2-layer (intra- and inter-modal) data fusion of texture (Haralick) features. The framework uses adaptive weighting based on the sample’s quality integrated into a quality-aware intra-modal attention (for the intra-modal layer). A gating mechanism for the inter-modal layer dynamically selects the fusion rule for the current context (combination of experts). The methodology could consider a security-by-design approach with cancellable templates. The score−/decision-level fusion can be used for the cases in which the feature representations are very heterogeneous or with missing features. This framework is suitable for systems working under varying conditions impacting on the data quality.