<p>In phase III oncology trials, superiority is defined by statistical significance using <i>P</i> thresholds. However, this approach has been criticized because <i>P</i> is continuous. Here, we reconstruct patient-level data for 230 phase III oncology trials to model the robustness of statistical significance by estimating the survival-inferred fragility index (SIFI), defined as the smallest number of patients changing arms that alters the statistical significance interpretation. The median SIFI was 8 patients (IQR 4–19), representing 1.4% of enrollments (IQR 0.7%–3%). As a continuous statistic, <i>P</i>—but not the significance interpretation—was correlated with SIFI. Moreover, overall survival endpoints were more fragile than surrogate endpoints. Taken together, while phase III oncology trials are intended to robustly inform patient care, shifting the assignment of a few patients is often sufficient to upend the statistical significance interpretation. This vulnerability underscores the need for more robust strategies to identify superiority in oncology.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Survival-inferred fragility of statistical significance in phase III oncology trials

  • Alexander D. Sherry,
  • Yufei Liu,
  • Pavlos Msaouel,
  • Timothy A. Lin,
  • Alex Koong,
  • Christine Lin,
  • Joseph Abi Jaoude,
  • Roshal R. Patel,
  • Ramez Kouzy,
  • Molly B. El-Alam,
  • Avital M. Miller,
  • Mohannad Owiwi,
  • Jonathan Ofer,
  • David Bomze,
  • Zachary R. McCaw,
  • Tomer Meirson,
  • Ethan B. Ludmir

摘要

In phase III oncology trials, superiority is defined by statistical significance using P thresholds. However, this approach has been criticized because P is continuous. Here, we reconstruct patient-level data for 230 phase III oncology trials to model the robustness of statistical significance by estimating the survival-inferred fragility index (SIFI), defined as the smallest number of patients changing arms that alters the statistical significance interpretation. The median SIFI was 8 patients (IQR 4–19), representing 1.4% of enrollments (IQR 0.7%–3%). As a continuous statistic, P—but not the significance interpretation—was correlated with SIFI. Moreover, overall survival endpoints were more fragile than surrogate endpoints. Taken together, while phase III oncology trials are intended to robustly inform patient care, shifting the assignment of a few patients is often sufficient to upend the statistical significance interpretation. This vulnerability underscores the need for more robust strategies to identify superiority in oncology.