Wednesday
Nov232011
by 
Bishop Hill
Bishop Hill The CRUTEM code
Nov 23, 2011 Climate: Surface This webpage looks as if it contains the CRUTEM code. The code they wouldn't release.
Can this be right?
Nov 23, 2011 Climate: Surface
Reader Comments (14)
You get the feeling there is now a sword of Damocles hanging over Phil Jones.
It looks like the Perl scripts that call the programmes that calculate crutem. Doesn't include the critical code.
Though on digging more deeply much of the code is in the directories linked below, and some of the missing stuff is just format converters. So it may be mostly there.
I think its almost all there. I've copied it to my website just in case it goes AWOL suddenly http://www.di2.nu/foia/crutem3/
I'd like to do some checking of this against the notes in HARRY but I don't really have the time right now
For comparison: My mirror image is 529 files (9618789 bytes overall), 8 files failed.
Love the circular flow diagram...!
I feel for the tortured temperatures circulating around looking for the exit.
I would like to quote Philip Brohan: "Anyone can be a climate scientist."
But I would, alas, be quoting him out of context:
OldWeather
Anyone can be a climate scientist.
I'm very excited to be involved with the OldWeather project:
Where citizen scientists are helping to reconstruct weather and climate variability by looking at Royal Navy ship's [sic] logbooks from the period around the First World War.
Citizen Scientists - just a touch of condescension?
Surprised this isn't getting more attention.
harry was not working on crutem
Added crutem3 to my search site (http://di2.nu/foia/foia.pl ) though Mosher is right, this is the sea part rather than the land part. Still interesting to review.
Actually I take my previous agreement with mosher back. This is what HARRY was workign on, or at least it is closely related to it. And is I believe what the Met Office adapted to create the pure perl version they released after the original climate gate.
See http://di2.nu/foia/crutem3/docs/obs_data/station_file.html for documentation of some of the crud in the raw files
Very interesting to see this finally. It explains how the small bug that I (and a reader) found back in February 2010 came about. I wrote up a blog post about it.
http://blog.jgc.org/2011/11/anatomy-of-crutem3-bug.html
http://di2.nu/foia/foia2011/mail/3428.txt is interesting (it's a reply that includes 2 other emails 2024 & 2095) to read for a bunch of reasons for those of us who delved into HARRY_READ_ME and co.
One irritation is that they include the extract of a project log which is clearly similar to HARRY_READ_ME but which does not appear to be the same thing.
Was the revelation of this information related to the email below:
Email #2955:
cc: Ian Harris
date: Mon, 08 Oct 2007 16:45:56 +0100
from: philip.brohan@metoffice.gov.uk
subject: Re: [Fwd: CRU Station Lists]
to: P.Jones@uea.ac.uk
Phil, Harry.
I'm sorry to admit that I can't find the 4349 list, or the program I
used to find that number. Attempting to reproduce it now, I get the same
count as you: 4138 stations provide at least 1 observation to CRUTEM3.
I can't think of any set of 4349 stations that I might have got by
mistake, so I suspect that it's a typo - It's certainly an error, and
(unless you object) I'll write to Steve McIntyre to say so (and add a
note to the CRUTEM3 web page).
On McIntyre's other points: He can get all the near-real-time updates
from the CRUTEM3 web page
( http://hadobs.metoffice.com/crutem3/data/station_updates )
We could also put the source code online - I've copied the internal
software and documentation to a temporary site so you can see it
( http://brohan.org/philip/job/crutem3/docs/ - please keep this URL
secret) - this could be added to http://hadobs.metoffice.com/crutem3 if
that would help to damp the conspiracy theories. What do you think?
Regards,
Philip