Peer review
Oct 2, 2009
Bishop Hill in Climate

David Appell has picked up my comments on his comments on peer review. To recap somewhat, David suggested that McIntyre's findings on Yamal should not be taken seriously because they are not peer reviewed. I pointed out that Einstein and Watson and Crick were not peer reviewed either, to which David has now responded

Steve McIntyre isn't Einstein. Enough said.

In technical terms, this is what is known as a "straw man". The point at issue was whether Steve McIntyre should be taken seriously, not whether he is Einstein.

Given that David has not disputed that Einstein, Watson and Crick were not peer reviewed, I think we can probably now agree that peer review is not a suitable criterion for deciding if an idea should be taken seriously.

David then goes on to say that Einstein, Watson and Crick were published in the best journals of their day. This is a better point, but I think it's hardly persuasive. If the papers passed the review of an editor instead of a pair of peer reviewers, what does that amount to other than another kind of peer review?

Lucia makes some pertinent comments on the need for peer review today too:

...these communications about published papers happen in both formal and informal settings. Historically, no one has said, “Oh. But who cares about Prof. X’s opinion about paper B. He only said it in a conversation at a conference. Until he writes a journal article, I’m not going to pay attention to that opinion."

And besides, if we should ignore McIntyre's comments because they are not published in a journal, hasn't David shot himself in the foot by quoting, in his very next post, the responses of Briffa and the Real Climate team, none of which were (a) peer reviewed or (b) published in a journal?

Article originally appeared on (http://www.bishop-hill.net/).
See website for complete article licensing information.