<p>Sequential recommender systems (SRSs) investigate users’ behavioral patterns to ascertain their next favored item. User behavior sequences inherently offer personalized insights; however, extracting interpretable and motivation-oriented behavioral patterns remains a significant challenge. Although attention-based models in SRSs perform well by learning sequential dependencies, they fail to effectively exploit item–attribute relationships and have difficulty in differentiating between users’ short-term preferences and long-term intended actions. Additionally, traditional multi-head self-attention assumes that each head operates independently, which results in redundant representations and limits the model’s ability to capture complex cross-head interactions. To address these limitations, we propose Mixed-Weighted Head Attention Networks (MWHAN), a comprehensive framework for context-aware attribute-based session recommendation that integrates real-time user purpose and contextual attributes within a unified model. Specifically, we develop a Dynamic Purpose-Aware module thats captures the hierarchical relationships between items and their associated attributes, providing insights into how users’ goals evolve. Furthermore, we introduce the Mixed-Weighted Multi-Head Attention Network (MWHAN), in which multiple attention heads share projections and learn mixing vectors, thereby enabling more diverse preference representations while reducing redundancy. Extensive experiments on benchmark datasets demonstrate that MWHAN consistently outperforms recent self-supervised Transformer-based models, while offering meaningful interpretability regarding how user behaviors are driven by underlying motivations.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MWHAN: Mixed-weighted multi-head attention network for context-aware attribute-based session recommendation

  • Hadise Vaghari,
  • Mehdi Hosseinzadeh Aghdam,
  • Hojjat Emami

摘要

Sequential recommender systems (SRSs) investigate users’ behavioral patterns to ascertain their next favored item. User behavior sequences inherently offer personalized insights; however, extracting interpretable and motivation-oriented behavioral patterns remains a significant challenge. Although attention-based models in SRSs perform well by learning sequential dependencies, they fail to effectively exploit item–attribute relationships and have difficulty in differentiating between users’ short-term preferences and long-term intended actions. Additionally, traditional multi-head self-attention assumes that each head operates independently, which results in redundant representations and limits the model’s ability to capture complex cross-head interactions. To address these limitations, we propose Mixed-Weighted Head Attention Networks (MWHAN), a comprehensive framework for context-aware attribute-based session recommendation that integrates real-time user purpose and contextual attributes within a unified model. Specifically, we develop a Dynamic Purpose-Aware module thats captures the hierarchical relationships between items and their associated attributes, providing insights into how users’ goals evolve. Furthermore, we introduce the Mixed-Weighted Multi-Head Attention Network (MWHAN), in which multiple attention heads share projections and learn mixing vectors, thereby enabling more diverse preference representations while reducing redundancy. Extensive experiments on benchmark datasets demonstrate that MWHAN consistently outperforms recent self-supervised Transformer-based models, while offering meaningful interpretability regarding how user behaviors are driven by underlying motivations.