Table 1 Criteria for an “incorrect answer” based on difference in statistical significance and magnitude of effect
Criteria for incorrect answer | |
|---|---|
Change in statistical significance | Statistical significance changes between graded effect and gold standard effect (trivial changes in p values within the range of 0.04 to 0.06 are not considered as a change). |
Change in magnitude of effect | Difference in magnitude of effects is larger than a relative risk change (increase or reduction) of 25 percentage points for dichotomous outcomes or 0.20 SMDs for continuous outcomes. |