Scholarlink

<p>Adopting multimodal embeddings in recommender systems has become standard practice, typically leveraging text and visual embeddings derived from pre-trained multimodal foundation models. While these embeddings are widely assumed to improve recommendation performance, systematic empirical evidence remains limited. In this work, we present a comprehensive reproducibility study that critically examines the actual contribution of multimodal embeddings to recommender systems. Through large-scale experiments on 14 widely used state-of-the-art models, we evaluate the effectiveness of multimodal embeddings both jointly and per modality. Using a modality knockout strategy, an architecture-preserving diagnostic intervention, we measure model sensitivity to text and image embeddings by replacing them with constants or noise, rather than removing or altering architectural components. Our results indicate that multimodal embeddings generally improve performance, particularly in graph-based fusion models, while simpler fusion methods yield marginal gains that are difficult to attribute purely to multimodal semantics. Notably, text embeddings alone often match full multimodal performance, whereas image embeddings alone provide limited benefit. These findings clarify the practical value of multimodal embeddings and offer reproducible insights for future multimodal recommendation research. Our code and datasets are available under <a href="https://github.com/GAIR-Lab/MKF4MMRec">https://github.com/GAIR-Lab/MKF4MMRec</a>.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A Reproducibility Study of Multimodal Embeddings for Recommender Systems

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年5月29日

查看全文
  • Yu Ye,
  • Junchen Fu,
  • Yu Song,
  • Kaiwen Zheng,
  • Joemon M. Jose

摘要

Adopting multimodal embeddings in recommender systems has become standard practice, typically leveraging text and visual embeddings derived from pre-trained multimodal foundation models. While these embeddings are widely assumed to improve recommendation performance, systematic empirical evidence remains limited. In this work, we present a comprehensive reproducibility study that critically examines the actual contribution of multimodal embeddings to recommender systems. Through large-scale experiments on 14 widely used state-of-the-art models, we evaluate the effectiveness of multimodal embeddings both jointly and per modality. Using a modality knockout strategy, an architecture-preserving diagnostic intervention, we measure model sensitivity to text and image embeddings by replacing them with constants or noise, rather than removing or altering architectural components. Our results indicate that multimodal embeddings generally improve performance, particularly in graph-based fusion models, while simpler fusion methods yield marginal gains that are difficult to attribute purely to multimodal semantics. Notably, text embeddings alone often match full multimodal performance, whereas image embeddings alone provide limited benefit. These findings clarify the practical value of multimodal embeddings and offer reproducible insights for future multimodal recommendation research. Our code and datasets are available under https://github.com/GAIR-Lab/MKF4MMRec.