<p>This technical note investigates a <i>p</i>-value paradox that emerges in the conventional proportion test. The paradox is defined as the phenomenon where “decisions made on the same effect size from data of different sample sizes may be inconsistent.” It is illustrated with two examples from clinical trial research. We argue that this <i>p</i>-value paradox stems from the use (or misuse) of <i>p</i>-values to compare two proportions and make decisions. We propose replacing the conventional proportion test and its <i>p</i>-value with estimation statistics that include both the observed effect size and a reliability measure known as the signal content index (SCI).</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A p-Value Paradox in Proportion Tests and its Resolution

  • Hening Huang

摘要

This technical note investigates a p-value paradox that emerges in the conventional proportion test. The paradox is defined as the phenomenon where “decisions made on the same effect size from data of different sample sizes may be inconsistent.” It is illustrated with two examples from clinical trial research. We argue that this p-value paradox stems from the use (or misuse) of p-values to compare two proportions and make decisions. We propose replacing the conventional proportion test and its p-value with estimation statistics that include both the observed effect size and a reliability measure known as the signal content index (SCI).