Skip to content

Gregory Francis on Publication Bias.

October 22, 2012

Neuroskeptic links to and comments on a new paper by Gregory Francis, and the issue of publication bias.  Neuroskeptics post is, as always, worth reading.  It is also worth reading Francis paper (NS links to the PubMed abstract, so it takes a few more clicks for the fortunate people inside the academic walls to get to the paper).  Francis goes through first Bem’s now infamous paper, and then Schoolers talk of the decline effec.  Both had some explanations for their results that would require some radical modification about how we believe the universe works.  Francis shows why that is unlikely the case.

Francis is actually not that much for a pre-publication registry of planned research.  Considering how often we really don’t know what we are doing anyway (he calls it exploratory. And, of course it is.) Or, more that when you are doing basic exploration, requiring that much work up front on things that can go wrong a thousand ways for no clear reason is maybe not the best use of our time.  He suggests that we all learn Bayesian analysis instead, as he claims this can reliably demonstrate null effects also.  I take his word for it.  Time to crack open my Krushke textbook. 

Advertisements
3 Comments
  1. I think Francis’s approach is interesting & important, but I disagree with him about Bayes and about registration – I’ll be posting about those aspects of his paper, shortly.

    • Yeah. I spent some time going through a few of the various papers on both the fraud and the bias issue, and there seem to be this little division between the pre-post and bayesian camps – and both sides consider the other interesting but not the solution. Oh, the social psychology of it all…

Trackbacks & Pingbacks

  1. Report from the symposium on Moving Beyond Questionable Practices « Åse Fixes Science

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: