Statistics and Methodology

When you could be sure that the submarine is yellow, it’ll frequentistly appear red, blue, or green

In yesterday’s post, I showed that conventional frequentist confidence intervals are far from straightforward and often do not permit the inference one wants to make. Typically, we would like to use confidence intervals to infer something about a population parameter: if we have a 95% confidence interval, we would like to conclude that there is a […]

Continue Reading

The 95% Stepford Interval: Confidently not what it appears to be

What could be more straightforward than the confidence interval? I compute the mean shoe size of a random sample of first-graders and surround it by whiskers that are roughly twice the standard error of that mean. Presumably I can now have 95% confidence that the “true” value of first-graders’ shoe size, in the population at […]

Continue Reading

Trumping Bonferroni to keep your ANOVAs honest

Chemists have test tubes and Bunsen burners. Astronomers have telescopes, computer scientists have computers, and psychologists and cognitive scientists have ANOVAs. If there is one tool that is being used across virtually all domains of psychology, cognitive science, and neuroscience, it is the Analysis of Variance or ANOVA. Somewhat ironically, ANOVA does not actually test […]

Continue Reading