Debating the merits of pre-registering research protocols.
When the Chris Chambers/Marcus Munafo Manifesto was published in the Guardian, a twitter-debate broke out about the pro’s and con’s of pre-registration. Not everybody is enamored with the idea (as I have linked in on these pages before), and one of them distinctly against was Sophie Scott. She promised to put her thoughts down. Here they are, in Times Higher Education. Also, along with the article, she linked in this series of commentaries from people who have reservations against pre-registration, and their reasons for being either ambivalent or against.
Right now (July 25, 2013) there is a Twitter debate going on, and Pete Etchell’s has more or less promised to collate them. I’ll link that in when that happens. Debates are always good. It is so easy to go “what could possibly go wrong” when one is enthusiastic.*
One of the worries is that this is even more hoops to run through, puts even more power in the hands of journals and peer-reviewers (and the possibility to block science that goes against… well. Some people clearly shun no means to try to stop a view that they deem wrong, so I can kind of see it).
There is also a worry that non-preregistered and exploratory work will be seen as “lesser” than the pre-registered work, and a worry that it will water down the research even further.
Lots of interesting points being brought up.
I don’t think registered reports are a panacea for fixing what ails science. But, hey, let’s try something, or let’s try a lot of different things. Rolf Zwaan and Micah Allen had an exchange where one of the points was that let it be a trial run with business as usual (or other alternative models) as comparisons. See how things work out. We are researchers after all. Kind of…. Exploratory. Not all journals are implementing it right away, and I don’t think anyone is touting it as the one fix.
I’m sure there will be more blogging about this, as it evolves, but here is one from Daniel Lakens.
*On edit – Pete is quick! Here is the storify!