Scholarlink

Background <p>Untrustworthy randomised controlled trials (RCTs) and other study types are an increasingly recognised problem in health and medical research. Assessing and responding to this problem is essential for ensuring the reliability of scientific evidence informing clinical practice. We consider theory, methods and tools for assessing research integrity and the trustworthiness of both aggregate and individual-level data from peer-reviewed, published RCTs.</p> Methods <p>We review approaches to the assessment of trustworthiness based on published checklists, the statistical analysis of aggregate and individual participant data, and the use of AI tools.</p> Results <p>We found checklists that examine the trustworthiness of data considering questions about the timeframe, authors, governance, and plausibility of a published, peer-reviewed paper. These checks of authenticity are complemented by statistical techniques that identify unusual patterns in aggregate or individual data, including new procedures for simulating data to determine if any of the possible distributions are realistic. The unique character of RCTs provides additional opportunities for checks, specifically for the baseline data.</p> Conclusions <p>The approaches presented offer a series of novel, quantitative tools for assessing research integrity and data trustworthiness across published RCTs. These techniques can detect instances of data duplication, questionable research practices, and check if any aspects of the study or results are unrealistic. They work best when employed beyond isolated, single-trial analyses and, when embedded in AI platforms, should scale to meet the volume of corrupted papers already published and the stream of fake research from paper mills.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Methods to assess trustworthiness of data from peer-reviewed, published randomised controlled trials

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年7月16日

查看全文
  • Lyle C. Gurrin,
  • Nicole Au,
  • Jeremy Nielsen,
  • Nicholas J. L. Brown,
  • Kylie E. Hunter,
  • Ben W. Mol

摘要

Background

Untrustworthy randomised controlled trials (RCTs) and other study types are an increasingly recognised problem in health and medical research. Assessing and responding to this problem is essential for ensuring the reliability of scientific evidence informing clinical practice. We consider theory, methods and tools for assessing research integrity and the trustworthiness of both aggregate and individual-level data from peer-reviewed, published RCTs.

Methods

We review approaches to the assessment of trustworthiness based on published checklists, the statistical analysis of aggregate and individual participant data, and the use of AI tools.

Results

We found checklists that examine the trustworthiness of data considering questions about the timeframe, authors, governance, and plausibility of a published, peer-reviewed paper. These checks of authenticity are complemented by statistical techniques that identify unusual patterns in aggregate or individual data, including new procedures for simulating data to determine if any of the possible distributions are realistic. The unique character of RCTs provides additional opportunities for checks, specifically for the baseline data.

Conclusions

The approaches presented offer a series of novel, quantitative tools for assessing research integrity and data trustworthiness across published RCTs. These techniques can detect instances of data duplication, questionable research practices, and check if any aspects of the study or results are unrealistic. They work best when employed beyond isolated, single-trial analyses and, when embedded in AI platforms, should scale to meet the volume of corrupted papers already published and the stream of fake research from paper mills.