Graph neural networks (GNNs) have shown exceptional performance in recommendation tasks. Prevailing graph recommendation models depend on message passing (MP) for aggregating node information, and backpropagation (BP) via chain rules for optimization. However, this combination risks under-trained nodes propagating incomplete or incorrect information to neighbors. Moreover, multi-layer aggregation further compounds these issues, leading to challenges such as over-smoothing and personalization loss. To address these limitations, we propose ForwardRec, a novel graph recommendation framework integrating the Forward-Forward (FF) algorithm with Hierarchical Rejection Sampling (HRS). The FF algorithm facilitates precise and comprehensive semantics by forward learning, while circumventing the drawbacks inherent to the aforementioned combination. Additionally, HRS utilizes rejection sampling within a hierarchical sampling process to ensure the generation of informative negative samples and computational efficiency. Crucially, the personalized preferences retrieved by FF enhance HRS’s capability to distinguish hard negatives from true positives. Meanwhile, due to the nuanced hard negatives, the optimization process in turn reduces the high-frequency noise induced by FF and helps each node become well-trained for further propagation. Theoretical analysis and extensive experiments demonstrate the superior efficacy and efficiency of ForwardRec for graph recommendation tasks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Aggregate, Optimize, and Propagate: A Forward-Forward Algorithm Framework for Graph-Based Recommendation

  • Ximing Chen,
  • Pui Ieng Lei,
  • Yijun Sheng,
  • Yanyan Liu,
  • Zhiguo Gong

摘要

Graph neural networks (GNNs) have shown exceptional performance in recommendation tasks. Prevailing graph recommendation models depend on message passing (MP) for aggregating node information, and backpropagation (BP) via chain rules for optimization. However, this combination risks under-trained nodes propagating incomplete or incorrect information to neighbors. Moreover, multi-layer aggregation further compounds these issues, leading to challenges such as over-smoothing and personalization loss. To address these limitations, we propose ForwardRec, a novel graph recommendation framework integrating the Forward-Forward (FF) algorithm with Hierarchical Rejection Sampling (HRS). The FF algorithm facilitates precise and comprehensive semantics by forward learning, while circumventing the drawbacks inherent to the aforementioned combination. Additionally, HRS utilizes rejection sampling within a hierarchical sampling process to ensure the generation of informative negative samples and computational efficiency. Crucially, the personalized preferences retrieved by FF enhance HRS’s capability to distinguish hard negatives from true positives. Meanwhile, due to the nuanced hard negatives, the optimization process in turn reduces the high-frequency noise induced by FF and helps each node become well-trained for further propagation. Theoretical analysis and extensive experiments demonstrate the superior efficacy and efficiency of ForwardRec for graph recommendation tasks.