## Access

You are not currently logged in.

Access your personal account or get JSTOR access through your library or other institution:

# Statistical "Discoveries" and Effect-Size Estimation

Branko Soric
Journal of the American Statistical Association
Vol. 84, No. 406 (Jun., 1989), pp. 608-610
DOI: 10.2307/2289950
Stable URL: http://www.jstor.org/stable/2289950
Page Count: 3
Preview not available

## Abstract

Current methods of statistical inference are correct but incomplete. Small probability (α) of wrong null-hypothesis rejections can be misunderstood. Definitive rejections of null hypotheses, as well as interval assessments of effect sizes, are impossible in single cases with significance probabilities like .05. Sufficiently large sets of independent experiments and attained significance levels (p-values) should be registered. From such data it is possible to calculate least upper bounds for proportions of fallacies in sets of null-hypothesis rejections or effect-size assessments. A provisional rejection of a null hypothesis in a one-tailed test, or a one-sided confidence interval showing a nonzero effect, is here called a discovery. Consider a large number n of independent experiments with r discoveries. For r rejections of null hypotheses the proportion of fallacies Q has least upper bound $Q_{\max} = (n/r - 1) \alpha/(1 - \alpha) < 1$. For r confidence intervals, the proportion of fallacies is E = α n/r (assuming that no alternative is in the "wrong" direction).

• 608
• 609
• 610