While Information Retrieval (IR) and Recommender Systems (RecSys) have made significant strides, reproducibility and replicability remain elusive due to methodological inconsistencies and pressures for high-impact results. Despite reproducibility tracks, guidelines, and frameworks, inconsistent application and limited motivation for rigorous reproducibility hinder progress. This tutorial introduces tools and methodologies for reproducibility in IR and RecSys research. It focuses on foundational concepts like selecting appropriate baselines and designing replicable experimental pipelines, and practical case studies demonstrating the impact of minor experimental variations. This session equips researchers with actionable strategies for producing robust, transparent studies, fostering scientific integrity within the IR and RecSys communities and supporting more reliable and impactful research advancements.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Reproducibility and Replicability in Information Retrieval: A Path Towards Scientific Integrity and Effective Research

  • Antonio Ferrara,
  • Claudio Pomo,
  • Nicola Tonellotto

摘要

While Information Retrieval (IR) and Recommender Systems (RecSys) have made significant strides, reproducibility and replicability remain elusive due to methodological inconsistencies and pressures for high-impact results. Despite reproducibility tracks, guidelines, and frameworks, inconsistent application and limited motivation for rigorous reproducibility hinder progress. This tutorial introduces tools and methodologies for reproducibility in IR and RecSys research. It focuses on foundational concepts like selecting appropriate baselines and designing replicable experimental pipelines, and practical case studies demonstrating the impact of minor experimental variations. This session equips researchers with actionable strategies for producing robust, transparent studies, fostering scientific integrity within the IR and RecSys communities and supporting more reliable and impactful research advancements.