In psychology, attempts to replicate published findings are less successful than expected. For properly powered studies replication rate should be around 80%, whereas in practice less than 40% of the studies selected from different areas of psychology can be replicated. Researchers in cognitive psychology are hindered in estimating the power of their studies, because the designs they use present a sample of stimulus materials to a sample of participants, a situation not covered by most power formulas. To remedy the situation, the authors review the literature related to the topic and introduce recent software packages, which they apply to the data of two masked priming studies with high power. They checked how they could estimate the power of each study and how much they could be reduced to remain powerful enough. On the basis of this analysis, they recommend that a properly powered reaction time experiment with repeated measures has at least 1,600 word observations per condition (e.g., 40 participants, 40 stimuli). This is considerably more than current practice. The authors also show that researchers must include the number of observations in meta-analyses because the effect sizes currently reported depend on the number of stimuli presented to the participants. Their analyses can easily be applied to new datasets gathered. (Author/publisher)
Samenvatting