Scholarlink

<p>Research assessment reform and open science are frequently presented as aligned reform movements within science, with assessment reform expected to incentivize open science practices. However, empirical evidence of this integration remains limited. We conducted a quantitative content analysis of open science terminology in action plans from Coalition for Advancing Research Assessment (CoARA) signatories—institutions publicly committed to reforming research assessment. Analysing 248 publicly available action plans, we coded mentions of open science terms across values, umbrella, and operational categories. Results reveal skewed distributions of open science terms: most terms appear in fewer than 20% of documents. Values terms substantially outnumber operational terms in top mentions, suggesting organizations currently emphasize aspirational principles over concrete practices. Open Access emerges as the by far the most widely mentioned operational practice, while key activities emphasized in policy frameworks (Open Evaluation, Open Methods, Open Software) receive minimal attention. Overall, our findings suggest open science integration into assessment reform remains in early developmental stages, characterized by values-heavy discourse, and gaps between policy aspirations and organizational commitments. Beyond substantive findings, this study demonstrates how terminological analysis can track science reform movement development and provide data for longitudinal monitoring of open science and its convergence with reforms of research assessment.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Advancing open science through research assessment reform? Content analysis of CoARA action plans

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年5月27日

查看全文
  • Alexander Rushforth,
  • Nino Gogadze,
  • Tornike Skhirtladze,
  • Janne Pölönen

摘要

Research assessment reform and open science are frequently presented as aligned reform movements within science, with assessment reform expected to incentivize open science practices. However, empirical evidence of this integration remains limited. We conducted a quantitative content analysis of open science terminology in action plans from Coalition for Advancing Research Assessment (CoARA) signatories—institutions publicly committed to reforming research assessment. Analysing 248 publicly available action plans, we coded mentions of open science terms across values, umbrella, and operational categories. Results reveal skewed distributions of open science terms: most terms appear in fewer than 20% of documents. Values terms substantially outnumber operational terms in top mentions, suggesting organizations currently emphasize aspirational principles over concrete practices. Open Access emerges as the by far the most widely mentioned operational practice, while key activities emphasized in policy frameworks (Open Evaluation, Open Methods, Open Software) receive minimal attention. Overall, our findings suggest open science integration into assessment reform remains in early developmental stages, characterized by values-heavy discourse, and gaps between policy aspirations and organizational commitments. Beyond substantive findings, this study demonstrates how terminological analysis can track science reform movement development and provide data for longitudinal monitoring of open science and its convergence with reforms of research assessment.