Buy

Books
Click images for more details

Twitter
Support

 

Recent comments
Recent posts
Currently discussing
Links

A few sites I've stumbled across recently....

Powered by Squarespace
« Give us a clouseau - Josh 166 | Main | Fulmination in Oz »
Wednesday
May092012

The Yamal deception

As many readers are probably aware, there has been an important new posting at Climate Audit about the Yamal affair. This posting is an attempt to set out the whole story of Yamal. It reworks an article I did in 2009 and incorporates new developments since that time. I hope readers find it useful. I have also prepared a Kindle version of the post, for which there is a small charge - click here:

Add to Cart

Please also consider hitting the tip jar.

The story of Michael Mann's Hockey Stick reconstruction, its statistical bias and the influence of the bristlecone pines is well known. Steve McIntyre's research into the other reconstructions of the temperatures of the last millennium has received less publicity, however. The story of the Yamal chronology may change that.

The bristlecone pines that created the shape of the Hockey Stick graph are used in nearly every millennial temperature reconstruction around today, but there are also a handful of other tree ring series that are nearly as common and just as influential on the results. Back at the start of McIntyre's research into the area of paleoclimate, one of the most significant of these was called Polar Urals, a chronology first published by Keith Briffa of the Climate Research Unit (CRU) at the University of East Anglia. At the time, it was used in pretty much every temperature reconstruction around. In his paper, Briffa made the startling claim that the coldest year of the millennium was AD 1032, a statement that, if true, would have completely overturned the idea of the Medieval Warm Period.  It is not hard to see why paleoclimatologists found the series so alluring.

Yamal saves the day

Keith BriffaSome of McIntyre's research into Polar Urals deserves a story in its own right, but it is one that will have to wait for another day. We can pick up the narrative again in 2005, when McIntyre discovered that an update to the Polar Urals series had been collected in 1999. Through a contact he was able to obtain a copy of the revised series. Remarkably, in the update the eleventh century appeared to be much warmer than in the original - in fact it was higher even than the twentieth century. This must have been a severe blow to paleoclimatologists, a supposition that is borne out by what happened next, or rather what didn't: the update to the Polar Urals was not published, it was not archived and it was almost never seen again.

With Polar Urals now unusable, paleclimatologists had a pressing need for a hockey stick shaped replacement and a solution appeared in the nick of time in the shape of a series from the nearby location of Yamal.

The Yamal data had been collected by a pair of Russian scientists, Hantemirov and Shiyatov, and was published in 2002. In their version of the data, Yamal had little by way of a twentieth century trend. Strangely though, Briffa's version, which had made it into print before even the Russians', was somewhat different. While it was very similar to the Russians' version for most of the length of the record, Briffa's verison had a sharp uptick at the end of the twentieth century -- another hockey stick, made almost to order to meet the requirements of the paleoclimate community.  Certainly, after its first appearance in Briffa's 2000 paper in Quaternary Science Reviews, this version of Yamal was seized upon by climatologists, appearing again and again in temperature reconstructions; it became virtually ubiquitous in the field: apart from Briffa 2000, it also contributed to the reconstructions in Mann and Jones 2003, Jones and Mann 2004, Moberg et al 2005, D'Arrigo et al 2006, Osborn and Briffa 2006 and Hegerl et al 2007, among others.

The data is not free

When McIntyre started to look at the Osborn and Briffa paper in 2006, he quickly ran into the problem of the Yamal chronology: he needed to understand exactly how the difference between the Briffa and Hantemirov versions of Yamal had arisen. McIntyre therefore wrote to the Englishman asking for the original tree ring measurements involved. When Briffa refused, McIntyre wrote to Science, who had published the new paper, pointing out that, since it was now six years since Briffa had originally published his version of the chronology, there could be no reason for withholding the underlying data. After some deliberation, the editors at Science declined the request, deciding that Briffa did not have to publish anything more as he had merely re-used data from an earlier study. McIntyre should, they advised, approach the author of the earlier study, that author being, of course, Briffa himself. Wearily, McIntyre wrote to Briffa again, this time in his capacity as author of the original study in Quaternary Science Reviews and he was, as expected, turned down flat.

That was how the the investigation of the Yamal series stood for the next two years until, in July 2008, a new Briffa paper appeared in the pages of the Philosophical Transactions of the Royal Society B, the Royal Society's journal for the biological sciences. The new paper discussed five Eurasian tree ring datasets, which, in fairly standard Hockey Team fashion, were unarchived and therefore not susceptible to detailed analysis. Among these five were Yamal and the equally notorious Tornetrask chronology. McIntyre observed that the only series with a strikingly anomalous twentieth century was Yamal. It was frustratingly therefore that he had still not managed to obtain Briffa's measurement data. It appeared that he was going to hit another dead end. However, in the comments to his article on the new paper, a possible way forward presented itself. A reader pointed out that the Royal Society had what appeared to be a fairly clear and robust policy on data availability:

As a condition of acceptance authors agree to honour any reasonable request by other researchers for materials, methods, or data necessary to verify the conclusion of the article...Supplementary data up to 10 Mb is placed on the Society's website free of charge and is publicly accessible. Large datasets must be deposited in a recognised public domain database by the author prior to submission. The accession number should be provided for inclusion in the published article.

Having had his requests rejected by every other journal he had approached, McIntyre had no great expectations that the Royal Society would be any different, but there was no harm in trying and he duly sent off an email pointing out that Briffa had failed to meet the Society's requirement of archiving his data prior to submission and that the editors had failed to check that Briffa had done so. The reply, to McIntyre's surprise, was very encouraging:

We take matters like this very seriously and I am sorry that this was not picked up in the publishing process.

Was the Royal Society, in a striking contrast to every other journal in the field, about to enforce its own data availability policy? Had Briffa made a fatal mistake?

Summer gave way to autumn and as October drew to a close, McIntyre had still heard nothing from the Royal Society. However, in response to some further enquiries, the journal sent McIntyre some more encouraging news -- Briffa would be producing most of his data, although not immediately. Most of it would be available by the end of the year, with the remainder to follow in early 2009.

Some Briffa data

The first batch of data appeared on schedule in the dying days of 2008 and it was something of a disappointment. The Yamal data, as might have been expected, was to be archived with the second batch, so there would be a further delay before the real action could start. Meanwhile, however, McIntyre could begin to look at what Briffa had done elsewhere. It was not to be plain sailing. For a start, Briffa had archived data in an obsolete data format, last used in the era of punch-cards. This was inconvenient, and apparently deliberately so, but it was not an insurmountable problem -- with a little work, McIntyre was able to move ahead with his analysis. Briffa had also thrown a rather larger spanner in the works though: while he had archived the tree ring measurements, he had not supplied any metadata to go with it -- in other words there was no information about where the measurements had come from. All there was was a tree number and the measurements that went with it. However, McIntyre was well used to this kind of behaviour from climatologists and he had some techniques at hand for filling in some of the gaps. Climate Audit postings on the findings followed in fairly short order, some of which were quite intriguing. There was, however, no smoking gun.

There followed a long hiatus, with no word from the Royal Society or from Briffa. McIntyre would occasionally visit Briffa's web page at the CRU website to see if anything new had appeared, but to no avail. Eventually, though, Briffa's hand was forced, and in late September 2009, a reader pointed out to McIntyre that the remaining data was now available. It had been quietly posted to Briffa's webpage, without announcement or the courtesy of an email to Mcintyre. It was nearly ten years since the initial publication of Yamal and three years since McIntyre had requested the measurement data from Briffa. Now at last some of the questions could be answered.

A strange lack of twentieth century data

When McIntyre started to look at the numbers it was clear that there were going to be the usual problems with a lack of metadata, but there was more than just this. In typical climate science fashion, just scratching at the surface of the Briffa archive raised as many questions as it answered. Why did Briffa only have half the number of cores covering the Medieval Warm Period that the Russian had reported? And why were there so few cores in Briffa's twentieth century? By 1988 there were only 12 cores used, an amazingly small number in what should have been the part of the record when it was easiest to obtain data. By 1990 the count was only ten, dropping still further to just five in 1995. Without an explanation of how the selection of this sample of the available data had been performed, the suspicion of `cherrypicking' would linger over the study, particularly since the sharp twentieth century uptick in the series was almost entirely due to a single tree (It is true to say, however, that Hantemirov also had very few cores in the equivalent period, so it is possible that this selection had been due to the Russian and not Briffa).

The lack of twentieth century data was still more remarkable when the Yamal chronology was compared to the Polar Urals series, to which it was now apparently preferred. The ten or twelve cores used in Yamal was around half the number available at Polar Urals, which should presumably therefore have been considered the more reliable. Why then had climatologists almost all preferred to use Yamal? Could it be because it had a hockey stick shape?

Briffa's regional chronology

The low core counts in the Yamal series certainly looked odd, but when they were seen in the context of Briffa's 2008 Royal Society paper they looked positively suspicious. In the paper, Briffa had explained that he and his co-authors had combined series so as to create regional chronologies covering much wider areas. These regional chronologies, he suggested provided  "strong evidence that the extent of recent widespread warming across northwest Eurasia, with respect to 100- to 200-year trends, is unprecedented in the last 2000 years". 

One of Briffa's regional chronologies was AVAM-TAIMYR, which was produced by merging the Taimyr chronology with another site, Bol'shoi Avam, located no less than 400 kilometres away. While the original Taimyr site had something of a divergence problem, with narrowing ring widths implying cooler temperatures, the new composite site of Avam--Taimyr had a rather warmer twentieth century and a cooler Medieval Warm Period. The effect of this blending of datasets was therefore, as so often with paleoclimate adjustments, to produce a warming trend.

This however, was not what was interesting McIntyre. What was odd about AVAM-TAIMYR was that the series seemed to have more tree cores recorded than had been reported in the two papers on which it was based. So it looked as if something else had been merged in as well. But what?

With no metadata archived for AVAM-TAIMYR, McIntyre had another puzzle to occupy him, but with some effort he was able to unravel the mystery. Forty-two of the cores turned out to be from another location called Balschaya Kamenka, some 400 km from Taimyr. The data had been collected by the Swiss researcher, Fritz Schweingruber. The fact that the use of Schweingruber's data had not been reported by Briffa was odd in itself, but what intrigued McIntyre was why Briffa had used Balschaya Kamenka and not any of the other Schweingruber sites in the area. Several of these were much closer to Taimyr -- Aykali River was one example, and another, Novaja Rieja, was almost next door. The suspicion of cherrypicking was hard to avoid.

The Khatdyta River experiment

But there was another mystery in Briffa's paper too. As we have seen, Briffa had been in the business of creating regional chronologies, for example supplementing Taimyr with data from other locations such as Avam and Balschaya Kamenka. Similar regional chronologies had been created for Fennoscandia and allegedly for Yamal. But the Yamal data appeared to represent only the original Hantemirov and Shiyatov data with no supplementation with other sites in the area at all. Why had Briffa left Yamal on its own, when the core count was so low? Suitable data was certainly available - Schweingruber had collected samples at a site called Khadyta River, close to Yamal, and with 34 cores recorded it represented a much more reliable basis for reconstructing temperatures.

McIntyre decided to perform a sensitivity test on Briffa's database, replacing the 12 cores that were behind the twentieth century uptick in the Yamal series with the 34 from Khadtya River. The revised chronology was simply staggering. The sharp uptick in the series at the end of the twentieth century had vanished, leaving a twentieth century apparently without a significant trend. The blade of the Yamal hockey stick, used in so many of those temperature reconstructions that the IPCC said validated Michael Mann's work, was gone.

Sound and fury

The reaction to McIntyre's blog posts on Yamal was almost instantaneous. The RealClimate blog, run by prominent climate scientists in an effort to protect the IPCC orthodoxy, ridiculed McIntyre's work:

McIntyre has based his ‘critique’ on a test conducted by randomly adding in one set of data from another location in Yamal that he found on the internet. People have written theses about how to construct tree ring chronologies in order to avoid end-member effects and preserve as much of the climate signal as possible. Curiously no-one has ever suggested simply grabbing one set of data, deleting the trees you have a political objection to and replacing them with another set that you found lying around on the web.

A few weeks later, Briffa and some of his colleagues joined in, writing a long response to McIntyre. Interestingly, this took a slightly different line to their colleagues at RealClimate, acknowledging that Khadtya River met the criteria for inclusion in the the Yamal chronology, but claiming somewhat implausibly that they had not considered it at the time.

Judged according to [our normal] criterion it is entirely appropriate to include the data from the [Khadtya River] site...when constructing a regional chronology for the area. However,we simply did not consider these data at the time, focussing only on the data used in the companion study by Hantemirov and Shiyatov and supplied to us by them.

However, they also presented what they said was a revised Yamal chronology, produced "by making use of all the data to hand", and giving broadly the same result as the figures they had published previously:

Original caption: Comparison of published and reworked Yamal chronologies. This Figure shows the two earlier versions of the Yamal RCS larch chronology in red (published in Briffa, 2000) and blue (Briffa et al., 2008) compared to the new version, based on all of the currently available data (Yamal_All) for the original (POR, YAD and JAH) sites and including the additional data from the KHAD site (in black). Tree sample counts for this 'new' chronology are shown by the grey shading. The upper panel shows the data smoothed with a 40-year low-pass cubic smoothing spline. The lower panel shows the yearly data from 1800 onwards. All series have been scaled so the yearly data have the same mean and standard deviation as the Yamal_All series over the period 1-1600.

Climategate and the Yamal-Urals chronology

Just weeks later, the attention of the Climate blogosphere was well and truly diverted by the Climategate disclosures, and the arguments over the Yamal core count was forgotten in the media storm that followed. However, there were many emails in the Climategate zip file that directly pertained to the Yamal story. The message that immediately attracted attention was one that demonstrated that CRU had funded Hantemirov and Shiyatov to collect the Yamal data in the first place, something that did raise questions over Briffa's claim that the data was not theirs to give to McIntyre. However, at the time most attention was focused on Shiyatov's request that the funds be sent to his private bank account so as to avoid problems with the Russian tax authorities.

However, there was another email that was much more important, although it was barely noticed by anyone apart from McIntyre. The email in question, number 1146252894, was from Briffa to a scientist at the Met Office and dated back to 2006.

Hi Philip,
We have three "groups" of trees:
"SCAND" (which includes the Tornetrask and Finland multi-millennial chronologies, but also some shorter chronologies from the same region).  These trees fall mainly within the 3 boxes centred at:
     17.5E, 67.5N
     22.5E, 67.5N
     27.5E, 67.5N
"URALS" (which includes the Yamal and Polar Urals long chronologies, plus other shorter ones).  These fall mainly within these 3 boxes:
     52.5E, 67.5N
     62.5E, 62.5N (note this is the only one not at 67.5N)
     67.5E, 67.5N
"TAIMYR" (which includes the Taimyr long chronology, plus other shorter ones).  These fall mainly within these 4 boxes:
     87.5E, 67.5N
     102.5E, 67.5N
     112.5E, 67.5N
     122.5E, 67.5N

There could be little doubt that these were the regional chronologies that had been prepared for the Royal Society paper. Crucially then, this email showed that Briffa and his colleagues had prepared a regional chronology that incorporated Yamal and the Polar Urals - a much wider area than the Yamal-only chronology that had appeared in the final paper.

Briffa's decision to drop the URALS regional chronology (incorporating Yamal and sites in the Polar Urals) in favour of a Yamal-only chronology with only a handful of trees in its modern section was starting to look indefensible. It was also hard to square the existence of the URALS chronology with Briffa's rebuttal of McIntyre's earlier blog post. When Briffa had said his revised Yamal chronology incorporated "all the data", he  had actually only incorporated a handful of sites in the Yamal area, without mentioning that he had prepared the much broader-based URALS chronology. The deception in Briffa's response was now clear, at least to McIntyre.

The only way to prove that all this mattered, however, was to find out what the URALS chronology looked like. If it lacked the hockey stick shape, as McIntyre suspected, Briffa would be completely undone. McIntyre duly submitted a freedom of information request for the chronology itself and a list of the sites used. As he expected, this was refused, and before long the long and tedious appeals process was set in motion.

The Climategate inquiries

While the wheels of the FOI appeals process were grinding away, Briffa was having to fend off the Yamal allegations again. These had been put to him by members of the Russell panel, which was investigating Climategate on behalf of the University of East Anglia. However, a former colleague, Geoffrey Boulton, was dealing with the investigation of the Yamal allegations, so Briffa would presumably have had few concerns.

Since the Russell panel had only allowed a few days for submissions of evidence, the Yamal allegations had not been formally put to the inquiry, although McIntyre had covered it briefly, mentioning the email that revealed existence of the URALS chronology. Boulton, however, had asked Briffa to respond to a distillation of the allegations that McIntyre's co-author Ross McKitrick had written as an op-ed in a Canadian newspaper.

Briffa's response repeated the story he had made in his earlier rebuttal of McIntyre, namely that he and his colleagues had never considered the other data in the region:

The data that he is referring to were never considered at the time because the purpose of the work reported in Briffa (2000) and Briffa et al. (2008) was to reprocess the existing dataset of Hantemirov and Shiyatov (2002).

Readers may already have noticed that Briffa's explanation was directly contradicted by the Climategate email quoted above, which showed that the data referred to had actully been under consideration since at least 2006. Remarkably, despite having Briffa's email available, Boulton does not seem to have noticed this obvious deceit. Since the Russell panel decided not to allow CRU's critics to challenge the evidence of the CRU scientists, nobody else could point out the truth either. The Russell panel's decision therefore appears culpable.

The second part of Briffa's explanation is equally misleading. While the purpose of the original Briffa 2000 paper was indeed to reprocess the Hantemirov and Shiyatov data, this could not be said of the later, 2008 paper, the purpose of which was to prepare and examine regional chronologies. This second deceit, like the first, went unremarked by Boulton.

Later on in the same document, Briffa changed his story slightly. He said that the 2008 paper had been intended for a special issue of the journal concerned and he had therefore been working to a strict deadline. He said that he and his colleagues had simply run out of time to prepare the URALS regional chronology and had decided to reprocess Yamal on its own:

...we had intended to explore an integrated Polar Urals/Yamal larch series but it was felt that this work could not be completed in time and Briffa made the decision to reprocess the Yamal ring-width data to hand, using improved standardization techniques, and include this series in the submitted paper.

This story was again entirely implausible. As we have seen, the regional chronology had been around since at least 2006, but Briffa chose not to mention this in his evidence to Russell.

Briffa also made the extraordinary claim that he and his colleagues had not looked at Polar Urals for many years:

We had never undertaken any reanalysis of the Polar Urals temperature reconstruction subsequent to its publication in 1995.

Again, this was directly refuted by the Climategate emails, which showed that Briffa had incorporated Polar Urals into the URALS regional chronology in 2006. Once again, the deceit was missed by Boulton.

Boulton had missed three clear deceptions in as many paragraphs of Briffa's evidence. It is perhaps not surprising that with an inquiry of this nature, a "not guilty" verdict regarding the Yamal allegations was subsequently issued in the Russell Panel's final report.

The Commissioner calls

In April 2012, the tide began to shift against Briffa. The UK's Information Commissioner wrote to UEA with some bad news - although a decision on the release of the URALS chronology had not been reached, the commissioner advised the university that there could be no good reason not to disclose the list of sites used and accordingly he intended to rule against them on this issue. Briffa's hand was finally going to be forced.

The list of 17 sites that was finally sent to McIntyre represented complete vindication. The presence of Yamal and Polar Urals had already been obvious from the Climategate emails, but the list showed that Briffa had also incorporated the Polar Urals update (which, as we saw above, did not have a hockey stick shape, and which Briffa claimed he had not looked at since 1995) and the Khadtya River site, McIntyre's use of which the RealClimate authors had ridiculed.

Although the chronology itself was not yet available, the list of sites was sufficient for McIntyre to calculate the numbers himself, and the results were breathtaking. Firstly, the URALS regional chronology had vastly more data behind it than the Yamal-only figures presented in Briffa's paper

But what was worse, the regional chronology did not have a hockey stick shape - the twentieth century uptick that Briffa had got from the handful of trees in the Yamal-only series had completely disappeared.

 Direct comparison of the chronology that Briffa chose to publish against the full chronology that he withheld makes the point clear:

It seems clear then that the URALS chronology Briffa prepared to go alongside the others he put together for the 2008 paper gave a message that did not comply with the message that he wanted to convey - one of unprecedented warmth at the end of the twentieth century. In essence the URALS regional chronology was suffering from the divergence problem - the widely noted failure of some tree ring series to pick up the recent warming seen in instrumental temperature records, which led to the infamous 'hide the decline' episode.

Remarkably, however, Briffa did allude to the divergence problem in his paper:

These [regional chronologies] show no evidence of a recent breakdown in [the association between tree growth and temperature] as has been found at other high-latitude Northern Hemisphere locations.

The reason for dropping the URALS chronology looks abundantly clear. It would not have supported this message.

PrintView Printer Friendly Version

Reader Comments (122)

Myth -BUSTED!

May 8, 2012 at 8:58 PM | Unregistered CommenterAdam Gallon

Good timing. I was wondering if you could do us a favor and get in touch with Andy Revkin. I believe this would be a good time for you and Steve McIntyre to have a sit-down face-to-face looong interview with him. Mann walks with impunity now, bestowed on him by the media. You and Steve have the goods and this farce must end. I'm guessing that Andy is sick of being portrayed as a lapdog for the "Team" and secretly wants to be a real journalist, someone who will seek out the Truth, no matter what blah, blah. This is a terrific story after all, but it's time to break the logjam. Worth a shot, no?

May 8, 2012 at 9:17 PM | Unregistered CommenterMike Mangan

Thank you for the lucid explanation.

It ought to be compulsory reading for every MP.

May 8, 2012 at 9:24 PM | Unregistered CommenterJoe Public

Superb detective work. What next? This is a clear case of fraud.

May 8, 2012 at 9:26 PM | Unregistered CommenterJeremy Poynton

Thank you for providing this summary, and clarifying the expose.

The host of ScottishSceptic has informed the authorities crimes may have been committed.

http://scottishsceptic.wordpress.com/2012/05/08/a-sad-day-for-british-science-indeed-for-britain/

May 8, 2012 at 9:28 PM | Unregistered CommenterDon B

Still reading, but if I may, a small suggestion -- remove accusatory phrasing such as these:

"Had Briffa made a fatal mistake?"

"This was inconvenient, and apparently deliberately so, but it was not an insurmountable problem" ->
"This was inconvenient, but it was not an insurmountable problem"

Present facts; let the reader conclude.

May 8, 2012 at 9:31 PM | Registered CommenterHaroldW

Thank you for the excellent commentary on the twists and turns of this deception.

How about another post with a nicely crafted lead paragraph that the MSM hacks can copy and paste? Better still, if you have direct contacts with any....

May 8, 2012 at 9:32 PM | Unregistered CommenterSchrodinger's Cat

What we need is a 2012 Bernstein & Woodward......the trouble is we also need a 2012 version of the Washington Post to take it up.

May 8, 2012 at 9:33 PM | Unregistered Commentermeltemian

I have been mostly lurking over at CA and WUWT - I was initially puzzled why you there was no mention of the latest CRU mendacity here. But then it was obvious you would be busy putting together your own summary, and it has been worth the wait. I have not had time to follow all the fine details of the Yamal deceit so appreciate your efforts to make it so accessible and understandable for lay-grouse like myself.

FYI, Mike Haseler has also been busy, in the two days since Steve's landmark post:

* Informed the Norfolk police of a likely crime at the UEA.

* Asked my MP (Jo Swinson) to inform the appropriate parliamentary authorities that they appear to have been lied to.

* Written to Sir Muir Russell (by way of the judicial appointments board) making him aware of these allegations.

* Initiated a complaint with the UK civil service against Sir John Beddington.

It will be interesting to read what responses Mike gets.

May 8, 2012 at 9:46 PM | Registered Commenterlapogus

Brilliant, Bish. Not for the first time, I tip my hat to the lucidity of your writing - one could almost forget it was a complex web of deceit in an obscure scientific subject!

May 8, 2012 at 9:54 PM | Registered Commenterjamesp

Good timing. I was wondering if you could do us a favor and get in touch with Andy Revkin.... I'm guessing that Andy is sick of being portrayed as a lapdog for the "Team" and secretly wants to be a real journalist
May 8, 2012 at 9:17 PM Mike Mangan

Two days ago, Revkin tweeted Mann suggesting he should discuss Steve McIntyre's findings at Real Climate.

Anthony Watts repeated the request.

http://wattsupwiththat.files.wordpress.com/2012/05/mann_yamal_capture.png

Revkin's response was to block Watts from his twitter feed and delete his original request to Mann.

Does that sound like the action of an honest journalist?

http://wattsupwiththat.com/2012/05/07/three-questions-for-andrew-revkin-and-michael-mann/

May 8, 2012 at 9:54 PM | Registered CommenterFoxgoose

@haroldw

IMO the time for olive branches and assumptions of fair dealing have long since passed on this issue; a very modest seasoning of subjective opinion along with the enormous helping of solid facts is more than justified.

May 8, 2012 at 10:04 PM | Unregistered Commentermrsean2k

Well, the greens are always demanding "climate justice".

Maybe, when the plod turn up at CRU - we'll finally see some.

May 8, 2012 at 10:10 PM | Registered CommenterFoxgoose

On an old thread, Steve McIntyre reamed me out.-

http://www.bishop-hill.net/blog/2011/5/29/quote-of-the-day.html

I can see clearly why he did so.

May 8, 2012 at 10:19 PM | Registered CommenterPharos

Many thanks for this, Bishop: I had twice read through Steve McIntyre's own post, but didn't feel I'd grasped the significance of the latest discovery, but I do now!

A while ago I speculated in a comment (probably on WUWT) that Briffa had been leant on from above at some point to conform with the 'Team' position, and cited a series of Climategate 1 Emails c.22/3/2002 to mid 4/2002 between Briffa, Ed Cook, Mann, Malcolm, where it was clear they had a big "dust up", and with Mann actually referring to 'funding managers' in one.

PS. Sorry I can't furnish Email details more specifically, my old machine with all details is currently u/s.

Maybe this is the subject of which Mann is fighting to keep his own Emails secret now, particularly any that might not have been circulated to UEA.

May 8, 2012 at 10:34 PM | Registered CommentermikemUK

@Foxgoose, that was Michael Mann that blocked Watts, not Revkin. Andy is much more congenial than that. Mann is [snip - manners], prancing around the world, giving interviews to sycophantic reporters who do not question his fables.

May 8, 2012 at 10:58 PM | Unregistered CommenterMike Mangan

a couple of years ago I asked gavin at realclimate whether we could build public policy on the science as it stood. Not surpringly, the answer was. robustly, yes. Gavin aside, I wonder whether in other quarters, doubts are beginning to creep in

May 8, 2012 at 11:02 PM | Unregistered Commenterbill

I liked the picture of Briffa. Perhaps it could be forwarded to Heartland so they can put up another poster: "On this man's say-so, you will be mightily impoverished: for more Briffa in your life Vote......." fill it in yourselves

May 8, 2012 at 11:11 PM | Unregistered Commenterbill

I bought Briffa and all my lights went out!

Hey the tin said peace fair shares for all, karma round the block, happy dusky dudes, and guess what ....

Briffa: You know it makes sense.

May 8, 2012 at 11:16 PM | Unregistered Commenterbill

McIntyre Clan motto: Per ardua

May 8, 2012 at 11:16 PM | Unregistered Commenterclipe

Scottish Sceptic's blog on it

http://scottishsceptic.wordpress.com/2012/05/07/uea-accused-of-lying/

May 8, 2012 at 11:25 PM | Registered CommenterPharos

@Foxgoose, that was Michael Mann that blocked Watts, not Revkin. Andy is much more congenial than that.
May 8, 2012 at 10:58 PM Mike Mangan

Yes, Anthony originally said he had been blocked "by Mann & Revkin respectively" - but I see he's changed that somewhat.

The fact remains though - why would an honest journalist remove traces of a perfectly legitimate question he had asked an important source who was well known to him?

The only reason I can think of is to spare the source embarrassment - and that's not journalism.

May 8, 2012 at 11:28 PM | Registered CommenterFoxgoose

Very lucid post. But IMHO it is significant only to those of us have been following this soap opera for quite a while.
How do we break the wall of confirmation bias in the MSM in general, and in Andy in particular?
The recent opinion gains toward the skeptic side are as a result of self serving economic realities and the fact that within the time frame of the public's perception of how temperature has changed (i.e. within their lifetime and more so within the last 10 years).
It is frustrating to realize data and facts are not as compelling as feelings and beliefs.
Heartland was my hope for being a possible vehicle, but they just shot themselves in the foot.
The example of Germany suggests the way is for recognized warmists to recant.

May 9, 2012 at 12:03 AM | Unregistered CommenterGeorge Daddis

George Daddis May 9, 2012 at 12:03 AM

How do we break the wall of confirmation bias in the MSM in general, and in Andy in particular?

That's almost like asking:

Q: "How many journalists does it take to change a light bulb?"

A: Not too many. One to broadcast a tweet that it must be changed; and a few more to rebroadcast without any of them checking to see if it really needs changing.

But, kidding aside ... I respectfully disagree with your conclusion that "it is significant only to those of us have been following this soap opera for quite a while."

Of course I have no scientific poll to prove this, but I believe that the majority of silent lurkers is increasing by the day, and more of them are doing their own due diligence.

By the same token, the readership and influence of the MSM (and particularly the NYT) is decreasing by the day, as more and more people recognize how shallow and advocacy-tainted the writings of Revkin, Hickman and their ilk have become.

May 9, 2012 at 1:22 AM | Unregistered CommenterHilary Ostrov

The fact remains though - why would an honest journalist remove traces of a perfectly legitimate question he had asked an important source who was well known to him?

@Foxgoose, If you mean this question, it's still there:

http://twitter.com/#!/Revkin/status/199498887646560257

May 9, 2012 at 1:28 AM | Unregistered CommenterScrutineer

Here's the message with Mann referring to 'funding managers':

It would probably also be helpful for me to point out, without naming names, that many of our most prominent colleagues in the climate research community, as well government funding agency representatives, have personally contacted me over the past few weeks to express their dismay at the way they believe this study was spun.

This was an exchange in April 2002 - Mann appears to have been applying pressure to Briffa to be less 'sloppy or disingenuous' toward the cause. This was perhaps one of the points where Briffa and Jones moved further along the path of cherry picking and dishonesty.

May 9, 2012 at 1:36 AM | Unregistered CommenterZT

Does Richard Betts know Briffa? Maybe he can get Briffa here to explain this ?

May 9, 2012 at 1:47 AM | Unregistered CommenterJack Hughes

Jack Hughes, what a delicious idea.... I won't hold my breath for it to happen but that would be "interesting".....

ZT, while searching around I came upon this intriguing thread (it looks like you commented there at the time) from Dec. 12, 2009 at AJ Strata's blog:

AJ Strata on Keith Briffa and Climategate

I haven't followed all the ins and outs and only started reading BH and WUWT in the past few months, so I can't begin to guess about possible candidates for who "FOIA" might be (I would be guessing it was some IT person unknown to the public, and not one of the climate scientists themselves). It is possible, even probable, that within CRU Briffa was amassing quite an "FOIA" archive in the autumn of 2009 as he prepared to respond to McIntyre and other critics, address the FOIA requests, etc., but that does not imply he was the one to decide it needed to be released to the public which would be such a huge personal and professional risk for any 'insider' .... presumably there were a variety of people with certain levels of access.

Still, it is a fascinating exercise to think about what the various players knew and believed and did in the months just before the first Climategate release, i.e., how did various members of "The Team" stand in relation to Yamal issues, how were these issues affecting (or not) research published by these various people, etc.

In any case, reviewing some of the controversies that ensnared Briffa and Mann and others is most interesting for understanding the "context" of the Yamal issues (we're always told that the Climategate emails need context, yes?).

May 9, 2012 at 3:43 AM | Registered CommenterSkiphil

CAGW is dying "Death by a thousand cuts " Steve M has just made a mayor incision,
Incision is defined as an opening made in something with a sharp tool.
In this case, it is an opening made by somebody with a sharp mind.

May 9, 2012 at 3:49 AM | Unregistered Commenterpesadia

Oops Major...

May 9, 2012 at 3:50 AM | Unregistered Commenterpesadia

In a CG email, Osborn lied to Science by saying that he didn't have the requested data. ALso the data requests to briffa were for the three sites: Taimyr and Tornetrask as well.

May 9, 2012 at 4:04 AM | Unregistered CommenterSteve McIntyre

The FOI request wasn't made until well after the inquiries. In my submission to Muir Russell, I drew attention to the Climategate email and the regional chronology.

May 9, 2012 at 4:07 AM | Unregistered CommenterSteve McIntyre

The name "FOIA" looks to Mosher and me like misdirection. Just like "Heartland Insider" was misdirection. The emails are nothing about FOIA.

However, CG2 has documentary evidence of all Briffa's emails being copied to a thumb drive. Curious, no?


3939. 2009-10-12 12:07:03
______________________________________________________
cc: Keith
date: Mon Oct 12 12:07:03 2009
from: Tom Melvin <...>
subject: Keith Email
to: Mike
Mike,
For Keith's Email :
1. Copied the full C:\Eudora directory to my portable.
2. Deleted the 12000 temporay .gif files from C:\Eudora\Embedded.
3. Copied 3.5 gig of attachments (1 year or older) from C:\Eudora\Attach to C:\OldAttach - this will need to be copied back to his PC
4. He is left with a 1.5 gig C:\Eudora directory on my portable which can be copied back to his PC and readily be moved from PC to portable etc.
5. When using my portable (via yellow cable (in office) or various WiFi networks) Keith logs in to VPN.
Tom
PS. I need to take my portable to a conference w/c 26th Oct.

May 9, 2012 at 4:20 AM | Unregistered CommenterSteve McIntyre

Bish, I stand in awe of the quality of Steve M's remarkable patience and forensic skills and of your equally skilled writing which lays out all the detail of this sorry affair with incredible clarity. My copy of HSI is looking quite shabby for a relatively recent purchase, a testament to how frequently it is used as a reference.
I am very interested to learn of any reactions to Mike Haseler's various missives to relevant authorities individuals.
When family ask me why this affair fascinates me so, I tell them that I am watching the unfolding of a gripping epic saga which is part detective story and part morality play; how could one NOT be fascinated? Will Good defeat Evil - I certainly hope so, but really have no idea, so I MUST stay tuned-in!

May 9, 2012 at 4:22 AM | Unregistered CommenterAlexander K

Through a contact he was able to obtain a copy of the revised series.

More like a war of attrition with Sciencemag. I sent them about 25 emails trying to get the Esper et al 2002. One of these series was Polar Urals using updated data. I got a bit lucky because the Hwang fraud broke in late 2005 and Science took a slightly harder line on Esper the non-archiver.

May 9, 2012 at 4:25 AM | Unregistered CommenterSteve McIntyre

Andrew:
That was a terrific summary - clear and with the emphasis on the significance of locations to Briffa's representations of his analysis. It must have taken more than a few "billable" hours.
It was well worth the price of a couple of pints I dropped in the tip jar. Cheers!

May 9, 2012 at 4:51 AM | Unregistered CommenterBernie

also, per ZT's link above, it is worth keeping in mind the kinds of pressure and un-collegial humiliation Mann was applying behind the scenes to Briffa, accusing him of "spin" and "sloppy" work for daring to question Mann's work. I love the disjunction of "sloppy" or "disingenuous" which Michael Mann (pot meets kettle) applies to potential critics. Why should Briffa worry about being called "disingenous" when Mann only means to describe his work as "sloppy" in that instance?? (of course, the Yamal and Urals data issues as explored by Steve McIntyre would seem to reveal new levels of both "sloppy" and "disingenuous" for The Team in subsequent years, but perhaps the felt pressures to line up the paleo work with the story desired for IPCC purposes produced at least a strong confirmation bias, if not worse??)

[April 12, 2002, Michael Mann to Keith Briffa]: "Whoaah...Please don't put words in my mouth Keith, especially such inflamatory word! I was not attributing the entirety of "spin" here (which is of a pretty massive scale) to you! And I said I think such "spin", where it has occurred, is EITHER sloppy OR disingenuous. You chose to assume I was talking about you in specific, and that I was attributing the latter rather than the former. My actual words don't bear this out. In the case of the Briffa & Osborn piece, I actually tend to believe that sloppiness was the main problem. In other cases of "spin" (e.g., the skeptics web pages of Daly and his ilk) it is most clearly disingenousnous...I don't equate you with Daly and those folks by any stretch of the imagination. Hopefully, you know that I respect you quite a bit as a scientist! But in this case, I think you were sloppy. And the sloppiness had a real cost...".

May 9, 2012 at 5:16 AM | Registered CommenterSkiphil

skiphill, you have to take care to distinguish Briffa's attitudes before and after MM2003. Before we came along, he and Ed Cook complained to one another about Mann.

But these differences were forgotten when we came on the scene. Briffa was one of the first off the mark to excoriate us - he didnt even need to read or assimilate our article to oppose us. So be careful in extrapolating quotes from 2002 or earlier into the later disputes.

May 9, 2012 at 5:28 AM | Unregistered CommenterSteve McIntyre

Thank you, Steve McIntyre, for these clarifications & explanations, and for all of your remarkable work on these issues. It may be that the prior insults and humiliations from Mann et al (pre-2003) made Briffa more determined than ever to be seen as a true, loyal "team" player once he faced MM2003 and subsequent issues, but of course I am speculating. He would also be digging in defending his own work, not simply "The Team" in general. Still, Michael Mann's words above indicate how readily Briffa could be viewed by certain colleagues as "sloppy or disingenuous" if he did not toe the line and support the "story" very closely. Mann seems to have created a lot of personal as well as intellectual pressure toward conformity. When examined as a case of "groupthink" and loyalty-building Mann's words seem quite comprehensible if not defensible! The CG emails (which I have read only in excerpts) do seem to show a tale of "The Team" drawing into an "us vs. them" circling of the wagons over time??

May 9, 2012 at 5:48 AM | Registered CommenterSkiphil

Bish, I've dropped an email to Dr. Phil Jones, advising him.

On another note, I'm crossposting an excerpt of this on WUWT to give you extra exposure.

May 9, 2012 at 6:17 AM | Unregistered CommenterAnthony

Interestingly, Briffa's email address shows up more than anyone else's in the CG1 emails, and Jones' more than anyone else'e in the CG2 emails.

May 9, 2012 at 6:24 AM | Unregistered CommenterZT

From the Ecclesiastical Uncle, an old retired bureaucrat in a field only remotely related to climate, with minimal qualifications and only half a mind.

Why am I not surprised at these goings on?

1. Is not the first part of this saga set out in the HSI?

2. Following attainment of a science qualification, the aspiring graduate, doc or whatever embarks on a scientific career, which, it seems, comes in two sorts:
A. Pure investigative science: how does this or that work? and
B. Using science for some purpose.

What we have here is a conflict between the two: Steve McI, the Bishop and the cognoscenti on this and other blogs who espouse 'A' on the one hand, and the IPCC (and all who sail in her), Mann, the UEA crew and numerous others who espouse 'B' on the other hand. Many of the ‘B’ crew’s purpose is to follow the money to be made from governments who have adopted the idea that global warming is the enemy of mankind (warm-ism?), probably as a replacement for Mao, Joe Stalin, and their ‘ism’, although a few may go to bed feeling they work to save mankind.

The stakes are large so the conflict is fierce. The whole truth and nothing but the truth is an inevitable casualty. Collateral damage? The view to take on the morality and ethics of all this depends on how you balance the need for a few porkies with pursuit of a livelihood, and I dare say, in a few rare cases, with the need for urgent action to ensure the future of the species.

Carry on..

May 9, 2012 at 6:49 AM | Unregistered CommenterEcclesiastical Uncle

Hot on the heals of the recent BH post about submissions in psychology journals being held to account. Imagine if they set out to replicate the work of the tree ringers? Oh yeah Steve already has: just have to prod and probe for data, wait years, email leaks, FOI requests, eventually you get there!

May 9, 2012 at 7:09 AM | Unregistered CommenterDavid

These people have apparently lived a form of mass self-deception encouraged from the mid 1980s when Houghton's 'The Physics of Atmospheres' formalised an incorrect view of the main boundary condition for atmospheric modelling.

Manabe and Wetherald 1967 assumed SW down = LW up, a gross exaggeration but not physically incorrect. Houghton assumed all heat transfer is by radiation and is comprised of two LW components, up and down, the two-stream approximation, and black body although this is ambiguous.

Thus the modellers programmed black body IR from the earth's surface when experiment completely disproves this. So IR warming has been grossly exaggerated, a factor of 15.5 in the 2009 Trenberth cartoon. The tree ringers fitted their results to an entirely imaginary thermal runaway.

May 9, 2012 at 7:52 AM | Unregistered Commentermydogsgotnonose

Seems to me that we have found our latter day Holmes and Watson!

More like this please.

May 9, 2012 at 7:55 AM | Unregistered CommenterLatimer Alder

Well written your grace. It needs someone of your calibre to pull all the threads together and you have shown remarkable ability to do it. I look forward to the next book to put alongside the well-thumbed HSI.

May 9, 2012 at 8:22 AM | Unregistered CommenterPhillip Bratby

Great job!

It is also worth comparing the curves in "Yamal and regional Chronologies" (green and black lines), with the nearest GISS temperatures:

http://data.giss.nasa.gov/cgi-bin/gistemp/gistemp_station.py?id=222233300000&data_set=14&num_neighbors=1

Even better with GISS 2009 version:

http://foro.tiempo.com/reconstrucciones-climaticas-hockey-stick-etc-t92633.24.html

May 9, 2012 at 8:53 AM | Unregistered Commenterplazaeme

Briffa's reponse repeated the story he had made in his earlier rebuttal of McIntyre, namely that he and his colleagues had never considered the other data in the region:

The data that he is referring to were never considered at the time.

Andrew, Brifffa misled (in parliamentary language) Muir Russell. He therefore caused Sir Muir Russell to mislead parliament, the press and the public.

There is a clear financial gain for Briffa in what he did. Using deception for financial gain is fraud. This is a crime. There is also clear evidence of a conspiracy by those involved both in the act and in the attempt to cover up the act.

When you have the evidence of a crime, the proper thing to do, is to inform the police and parliamentary authorities to have it investigated.

Have you informed the proper authorities?

May 9, 2012 at 9:00 AM | Registered CommenterMikeHaseler

Thank you Bishop. Another clear summary and milestone. And thank you again Steve McIntyre.

However, a former colleague, Geoffrey Boulton, was dealing with the investigation of the Yamal allegations, so Briffa will presumably have had few concerns.

That's a masterpiece of understatement.

I'd like to add my two cents' worth. I did three articles on Yamal myself, which coming just before Climategate also got lost in that epic. The one below was published by Anthony. My aim was also to make the Yamal story accessible, from two other angles:
* I compared the treering record with many local temperature records. The temperature records, even over wider distances, clearly harmonized with each other. The treering record was the outsider.
* I used lots of pictures.

Bishop, if you want to include any of my stuff in any future update of your piece here, please feel free.

http://www.greenworldtrust.org.uk/Science/Scientific/Arctic-Yamal3.htm

May 9, 2012 at 9:14 AM | Unregistered CommenterLucy Skywalker

Very good write up. The one thing I always come away with in climate science is the lack of rigour and self discipline that is easy for a layman to see exists in every other science domain. The real desire to trap all possible self delusion and blind themselves to confirmation bias seems absent, or, only a PR cargo cult lip service is paid to the concept.

Looking at this it seems like paleo-dendro work must be like selecting at the pick-n-mix counter at Woolies to get your preferred selection ;)

May 9, 2012 at 9:17 AM | Registered CommenterThe Leopard In The Basement

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>