If You Use a Screen Reader
This content is available through Read Online (Free) program, which relies on page scans. Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.Journal Article
On the Post Hoc Power in Testing Mean Differences
Ke-Hai Yuan and Scott Maxwell
Journal of Educational and Behavioral Statistics
Vol. 30, No. 2 (Summer, 2005), pp. 141-167
Published by: American Educational Research Association and American Statistical Association
Stable URL: http://www.jstor.org/stable/3701347
Page Count: 27
You can always find the topics here!
Topics: Sample size, Post hoc, Statistical variance, Sampling bias, Estimation bias, Unbiased estimators, Cumulative distribution functions, Probabilities, Confidence interval
Were these topics helpful?
Select the topics that are inaccurate.
Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Abstract
Retrospective or post hoc power analysis is recommended by reviewers and editors of many journals. Little literature has been found that gave a serious study of the post hoc power. When the sample size is large, the observed effect size is a good estimator of the true effect size. One would hope that the post hoc power is also a good estimator of the true power. This article studies whether such a power estimator provides valuable information about the true power. Using analytical, numerical, and Monte Carlo approaches, our results show that the estimated power does not provide useful information when the true power is small. It is almost always a biased estimator of the true power. The bias can be negative or positive. Large sample size alone does not guarantee the post hoc power to be a good estimator of the true power. Actually, when the population variance is known, the cumulative distribution function of the post hoc power is solely a function of the population power. This distribution is uniform when the true power equals 0.5 and highly skewed when the true power is near 0 or 1. When the population variance is unknown, the post hoc power behaves essentially the same as when the variance is known.
Page Thumbnails
-
141
-
142
-
143
-
144
-
145
-
146
-
147
-
148
-
149
-
150
-
151
-
152
-
153
-
154
-
155
-
156
-
157
-
158
-
159
-
160
-
161
-
162
-
163
-
164
-
165
-
166
-
167
Journal of Educational and Behavioral Statistics © 2005 American Educational Research Association