Large Language Models (LLMs) have demonstrated robust general-purpose task-solving capabilities across various domains, prompting researchers to investigate their potential for application in recommender system tasks. However, a significant semantic gap exists between LLMs and recommender systems: while LLMs excel at capturing language semantics, recommender systems rely on collaborative semantics, which limits the reasoning capability of LLMs for recommendations. Additionally, the majority of existing research adopts a generalized approach to user reviews, neglecting the possibility that users might express distinct sentiments toward different attributes in a single review. To address these challenges, we propose FADERec, a lightweight model combining fine-grained attribute-sentiment pairs distillation with collaborative signal learning. Specifically, FADERec employs a collaborative graph encoder to explicitly model user-item interaction patterns, extracting high-order collaborative signals from implicit feedback. These signals are then fused with attribute-sentiment pairs generated by Llama-2-7b. Extensive experiments on benchmark datasets demonstrate FADERec’s superiority, achieving state-of-the-art (SOTA) performance in both top-N and sequential recommendations.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

FADERec: Fine-Grained Attribute Distillation Enhanced by Collaborative Fusion for LLM-Based Recommendation

  • Mingzhi Xu,
  • Ruizhe Li,
  • Huimin Deng,
  • Biqing Zeng

摘要

Large Language Models (LLMs) have demonstrated robust general-purpose task-solving capabilities across various domains, prompting researchers to investigate their potential for application in recommender system tasks. However, a significant semantic gap exists between LLMs and recommender systems: while LLMs excel at capturing language semantics, recommender systems rely on collaborative semantics, which limits the reasoning capability of LLMs for recommendations. Additionally, the majority of existing research adopts a generalized approach to user reviews, neglecting the possibility that users might express distinct sentiments toward different attributes in a single review. To address these challenges, we propose FADERec, a lightweight model combining fine-grained attribute-sentiment pairs distillation with collaborative signal learning. Specifically, FADERec employs a collaborative graph encoder to explicitly model user-item interaction patterns, extracting high-order collaborative signals from implicit feedback. These signals are then fused with attribute-sentiment pairs generated by Llama-2-7b. Extensive experiments on benchmark datasets demonstrate FADERec’s superiority, achieving state-of-the-art (SOTA) performance in both top-N and sequential recommendations.