1
Views
6
CrossRef citations to date
0
Altmetric
Original Articles

Replicability Reconsidered: An Excessive Range of Possibilities

Pages 365-373 | Published online: 15 Jun 2010
 

Abstract

Following a suggestion from Greenwald, Gonzalez, Harris, and Guthrie (1996), Posavac (2002) developed an approach to estimate the probability that replications of completed studies would be statistically significant. We argue that this approach is faulty because it is based on the unjustifiably restrictive assumption that the effect size observed in the initial study is the population effect size. Using the noncentral t distribution and methods presented by Cumming and Finch (2001), we construct a confidence interval for the observed effect size. Boundaries of that confidence interval are used to compute the limits of plausible replicability (post hoc power) values. It is demonstrated that the possible values span an impractically large range, rendering the post hoc analysis of replicability without merit. These issues are discussed in the broader context of post hoc power analyses.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.