Psychological science needs theory development before preregistration

“(…) a substantial proportion of research effort in experimental psychology isn’t expended directly in the explanation business; it is expended in the business of discovering and confirming effects” —Cummins (2000). I am contributing to this digital event from a theoretician’s perspective. I thought I’d be upfront about this to set the right expectations. Theoretical perspectives […]

Continue Reading

You must tug that thread: why treating preregistration as a gold standard might incentivize poor behavior

It is too early to know whether the recent period of methodological introspection in psychological science, and the sciences in general, will lead to positive changes in practices. As with any revolution, there is the potential of moving backward. One problem that has been consistently acknowledged is the problem of incentives: what gets one attention […]

Continue Reading

Preregistration of a forking path – What does it add to the garden of evidence?

Preregistration has many advantages, which have been pointed out in Steve Lindsay’s post yesterday and many other places. The most important advantage is probably that it demonstrates without doubt that the hypotheses and data-analysis path chosen for a study were not chosen in response to the data with an eye towards obtaining the desired results. […]

Continue Reading

Arguments for Preregistering Psychology Research

Richard Shiffrin’s 2018 PNAS article on the nature of scientific progress is beautifully written, erudite, and insightful. I learned a lot from it and agree with most of his arguments. But with the greatest respect I would like to counter Shiffrin’s expressions of doubt regarding the value of preregistering research plans. Those doubts were lightly […]

Continue Reading

Hippopotamus sauce or handcuffs for the Texas sharpshooter: #PSprereg digital event on preregistration

We all want to be free. Freedom of choice is perhaps one of the most foundational principles of western societies, and it can empower lives. As academics, we cherish academic freedom, and academic freedom has been called essential to democracy for very good reasons. However, no matter how enthusiastically we may endorse academic freedom, we […]

Continue Reading

Perfect unison or perfect fourth? Practice makes perfect only with exposure during musical interval training

There are only a handful of things in life that have the ability to cross social, generational, cultural, and economic boundaries. Music is one of them! Whether you are on stage in a symphony hall, a sold-out concert arena, or in the bathroom shower, there is likely a musician in all of us. But what […]

Continue Reading

As easy as Do-Re-Mi: Is there a correlation between musical ability and executive function?

Musical training encompasses a broad range of skills, which likely rely on a similarly large range of cognitive abilities. Consider the act of sight-reading, in which a musician plays from a piece of sheet music they have never seen before. The musician must read the upcoming notes (a feat of translating visual information into a […]

Continue Reading

Freedom of choice vs. undisclosed flexibility: Researcher degrees of freedom in model-based inference

When we talk about statistical modeling, we often encounter the concept of “degrees of freedom.”  Remember?  It’s the n-1 in t[n-1] or the [1] in χ2[1].  In our off-the-shelf statistical procedures, the degrees of freedom refers to the information content of some statistical construct.  It can loosely be thought of as the number of independent […]

Continue Reading