Friday
Aug312012
by Bishop Hill
Lewandowsky's data
Aug 31, 2012
Geoff Chambers has obtained Stephan Lewandowsky's survey data which can be seen as an attachment at the bottom of this post. Of course it's anonymised, so we are not going to get to the bottom of the question of the number of sceptics he approached, but you may be interested.
Reader Comments (106)
I'm keen to do a little number crunching and data visualisation on this data. Since in Excel can turn this into a standard Table and do some pivots. Almost always draws out something of interest.
Do you know where there is a key to what all the numbers mean?
And there are numbers on the right which look to be the result of computations, but no formulae given.
Rob
See comments by DR at
http://bishophill.squarespace.com/discussion/post/1904675?currentPage=2
Ignore my earlier comments. I got it wrong.
For the questions, see Table 2 at the end of Lewandowsky’s paper.
The numbers at the right are %s, given in answer to open ended questions how many x scientists do you think believe...?
Like Rob sayss, the numbers on the right are just dumb - there is no fomula behind them. It also looks that the numbers in the individual columns (question answers on a 1-4 scale perhaps) bear little relationship to the "totals" in columns AD to AF. Perhaps it need a Mannian analysis to get the right answers?
Run the right algo and you can make a hockey stick out of those numbers.
I spent a while looking at the data last evening. As Geoff says,it's only possible to understand the columns by reference to the paper itself (pdf here http://websites.psychology.uwa.edu.au/labs/cogscience/documents/LskyetalPsychScienceinPressClimateConspiracy.pdf)
The last 3 columns (ConsensHIV ConsensSmoke ConsensCO2) are the respondents' answers to the questions "Out of 100 medical scientists how many do you think believe that the HIV virus causes AIDS?" "...smoking causes lung cancer?" "...climate scientists think human CO2 emissions cause climate change?"
@DR - I'm not surprised at the lack of consistency in the questions that leads to difficulties in analysing the data. This is thoroughly consistent with climate 'science' as anyone who has looked at "HARRY_READ_ME.txt" already knows...
(Now posting on correct thread!)
Thanks to all for the links. If the climate changes tomorrow (I want the back garden "office" to be warm enough to sit there), I'll play with the data a bit. I like data.
Oh bugger. Why does everything have to be in Excel ?
Oh bugger. Why does everything have to be in Excel ?
Aug 31, 2012 at 9:24 AM | P. Jones
..................................................
Settle down, Jones. Nobody asked you to calculate an Excel trend.
Just view the figures so that you can peer-review the papers of others, knowing that you have read the Lewandowski data.
Ha, sorry Phil.
You can take comfort though in the fact that Lewandowsky took a leaf out of your book in saying that confidentiality concerns prevent him from disclosing the data, in this case the list of sceptic blogs approached. You and your Mum should be proud.
"the list of sceptic blogs approached"
That's none, then.
Any chance someone can just cut and paste a few changes to the paper such as replacing denier with doomsday cultist and then resubmit it has proof that global warming nutters don't believe in the moon landing and such...
I would think it would be pretty easy to do.
Maybe he thinks ScepticalScience is a sceptic blog?
What I found interesting was the selection of "conspiracies" presented.
What about "big oil" influence on government, or the "military indistrial complex"? My prior would have me believe that "alternative medicine" or "spiritual beliefs" would more closely link with alarmist warming beliefs than sceptical ones.
Gold standard SI
Two puzzles:
1) Where did the respondents come from? Only at Tamino’s did the survey announcement provoke any discussion, where a couple of dozen regulars made largely critical comments about how difficult it was to fill in honestly.
The obvious answer is Skeptical Science, but there’s no mention of it at the site, and John Cook (who had developed quite a crush on Lew) can be seen in a private email ten months after the fieldwork mentioning to a colleague the research that his mate Lewandowsky had done, as if it was nothing to do with him.
2) Why the four point scale? Leaving out the “don’t know” option is a perfectly legitimate way of encouraging a meaningful response. But you then count a blank as a ”don’t know”. But Lewandowsky actually threw out any incomplete questionnares - in a survey intended to capture sceptics! Nobody throws out a perfectly good questionnaire because of one blank box. Yet there’s not a single blank cell on his data.
What he ended up with is respondents with no shred of doubt at all - who have fixed opinions about everything - aliens, nazis in Oklahoma, SARL, AIDS - you name it. Including a number who think that global warming is a conspiracy to place alongside 9-11 and the murder of Martin Luther King.
Anyone here recognise themselves in that description?
Lewandowsky is not actually offering anything different than Gleick's forged HI trash.
The very large majority of the respondents are extremist believers in AGW.
That it made its way through peer review is strong evidence that anything making caricatures of skeptics is quite acceptable for many academics, and offsets any need for accuracy integrity or honesty.
As we saw with Peter Gleick's fraud and forgery, the climate kooks will rally anything under any circumstance that offers a chance to pretend skeptics are wicked, evil and ignorant.
The irony that the believer obsession on climate is making them become what they claim skeptics are is apparently lost on the climate concerned.
In case of any interest to others, I've done a little data munging. At the following public DropBox is the file:
https://dl.dropbox.com/u/1933832/LskyetalPsychSciClimate.zip which holds the data in a number of formats:
LskyetalPsychSciClimate.xlsx ... Excel as original, but "un-pivoted" the data into a standard Excel Table in tab "LskyetalPsychSciClimate"
LskyetalPsychSciClimate.txt ... text file with the un-pivoted data (tab delimited) as extracted from the Excel un-pivoted
LskyetalPsychSciClimate.accb ... Microsoft Access database with the data in a relational table as imported from the Excel un-pivoted data
LskyetalPsychSciClimate.sql ... moved the data into a MySQL database then made a standard dump of that data.
The fields in the relational table are: ID, Person ID, Question, and Response. There is 36,640 records. I'll probably add a Question table for presentation purposes.
Not sure what I will do next. Just sort of mess around with it a bit with various tools, being cognisant of course that the survey data appears to be suspect; but data none less.
What he ended up with is respondents with no shred of doubt at all - who have fixed opinions about everything - aliens, nazis in Oklahoma, SARL, AIDS - you name it. Including a number who think that global warming is a conspiracy to place alongside 9-11 and the murder of Martin Luther King.
Anyone here recognise themselves in that description?
Aug 31, 2012 at 12:04 PM geoffchambers
Nope not even me.
Which leaves us with just relatively sane, AGW enthusiast, regulars at the exclusively warmist blogs - who filled in his stupid questionnaire with the most extreme answers for a giggle.
Some of their posts at the time made it obvious this was the intention.
Incidentally, if he claimed to have offered the survey to a number of sceptic blogs who refused to co-operate, but if in fact he hadn't - that would be scientific fraud, wouldn't it?
Geoff,
2) Why the four point scale? no option for a neutral "3" in the answers, you either agree or you don't. Same with "don't know" no answer is the preferred option as it doesn't taint the results.
Sandy
My guess is that the online questionnaire did not allow respondents to leave questions blank and had to choose one answer in order to proceed to the next question. Hence there is more apparent certainty than the respondents probably wanted or felt.
DR
I think you’re right about the questionnaire blocking unanswered questions. I seem to remember someone commenting (but where?) on this, which would explain why it took 40 minutes to complete.
I’ve just noticed that it was on the thread to Adam Corner’s article at
http://talkingclimate.org/are-climate-sceptics-more-likely-to-be-conspiracy-theorists/
that you get the maximum of useful background information (all from BH regulars).
Barry Woods gives links to the original survey announcements on the “science-based” blogs. Foxgoose gives links to Lewandowsky’s articles at DeSmog and Deltoid, and I give a “best of” compilation of John Cook’s references to his pal Stephan in the SkeptikalScience internal emails. And thanks to Adam Corner for letting the comments through and replying to many.
No IP data... drat!
The sample distribution is interesting but not surprising.
The were 4 questions on climate science, with a score of 1 (reject the science) to 4 (accept the science) possible. The 48 who ticked 1 in every case compares to 498 who ticked 4 in every case.
More broadly, those whose average was less than 2 was 125 compares to 854 whose average was greater than 3. There were a further 50 who average 2.0 to 2.4. Depending of your definition of climate "denial", 4.2% and 15.3% of responses were from deniers. 48 to 175 responses is insufficient to make any claims about the sceptic population at large.
Also, there is reason to believe that the sceptics that responded were a skewed sample. My limited experience of the blogs is of polarized viewpoints and politically-incorrect language directed at those who disagree with them. To regularly read stuff that denigrates your opinions and to have comments deleted, or deliberately misinterpreted by people, takes a sort of person who is a minority subset of the sceptics who comment here, or at Wattsupwiththat or Climateaudit.
There is also the issue of unfinished responses. Progressing through such a questionnaire, you quickly realise that it is trying to confirm pre-conceived opinions that I certainly find distasteful.
For those who don’t like looking up links to links, here’s a “Best of” compilation
http://scienceblogs.com/illconsidered/2010/08/counting-your-attitudes/of comments on the survey from the warmist blogs where it was posted.
One thing it shows, I think, is that frequenters of warmists blogs are cynical, critical critters just like us - normal human beings in fact.
Makes you think...
From
http://profmandia.wordpress.com/2010/08/29/opinion-survey-regarding-climate-change/
http://scienceblogs.com/deltoid/2010/08/29/survey-on-attitudes-towards-cl/
http://hot-topic.co.nz/questionnaire/
http://tamino.wordpress.com/2010/08/28/survey-says/
Lewandowsky et al say:
The thing I don't understand is, why didn't they just make a post on sceptic blogs themselves, rather than approaching blog owners. They could have posted as a Discussion topic here at Bishop Hill without even asking the host, and I very much doubt that the Bish would have removed it. Climate Audit also has very light-touch moderation and I doubt whether Steve McIntyre would have removed such an unsolicited post. Same probably goes for many of the sceptic blogs, in my experience.
So it does appear to that they didn't try very hard to solicit views from the climate sceptic community.
A commenter has just mentioned on The Blackboard that they spotted two old OT postings of the survey link on sceptic sites from back in 2010 by anonymous posters, one on this blog and one on WUWT.
I had a go a searching for the key ID* of the survey and currently only get 15 results coming back, all from 2010, the two sceptic links mentioned above and the rest are showing up on only the deltoid and profmandia blogs.
How has Lewandowsky got his data together?
This is looking Glieckier and Glieckier by the hour ;)
*
H K M K N F_ 9 9 1 e 2 4 1 5 – Added a space between each char to not contaminate searches for this key
Richard Betts
You’re right, there are so many ways they could have solicited the co-operation of sceptics. Joanna has a growing list of all the major sceptic blogs who definitely weren’t approached. The nuts and bolts of the research were apparently the work of Lewandowsky’s junior associate, but that’s no excuse. Lewandowsky had published articles on several major warmist blogs. These blogs know everything there is to know about us sceptics. As is shown by my contact with Adam Corner - the Guardian journalist and researcher into the psychology of scepticism - it’s perfectly possible to make contact with “the other side” if you want to.
I’m interested in your opinion, as a “hard” scientist, of the publishing habits of social scientists like Lewandowsky. No raw figures or percentages, just betas and correlation coefficients, incomprehensible to the common of mortals. You wouldn’t be allowed to publish an opinion survey in a national newspaper with such opaque data. No client of a market research company would accept such findings on trust. What about in the world of meteorology and climate science?
Heh, heh, you now get 16 results searching for that key, Lucia has another post up
Multiple IPs, Hide My Ass and the Lewandowsky survey.
I'd be very surprised if Richard were to answer you, Geoff. It would be a bit like stepping out of his role.
As for Lewandosky...I'm convinced the whole thing is a mess of badly-collected and totally-invented data. It's the most shameful CAGW article in the history of the world. Now Briffa and Mann can proudly think they have many defects, but at least they're not Lewandosky.
Maurizio
I fear the most shameful is yet to come. They’re not finished yet.
Leopard
Just as I get my evidence that Lewandowsky is lying into moderation at Lucia’s first post, she starts another, and goes out to dinner! The ways of the internet...
I compiled a list of John Cook’s references to his mate the cognitive psychologist Lewandowsky (aka Lew the Mind) which I posted at
http://talkingclimate.org/are-climate-sceptics-more-likely-to-be-conspiracy-theorists/
and subsequently forgot about. Lewandowsky asserts at Lucia’s that Skeptical Science linked to his survey. There is no evidence of this on Wayback, who were sampling SkS every week. I think the following quotes from John Cook’s emails to felllow authors on his private email threads demonstrate that Skepticalscience did NOT participate in the survey - whatever else Stephan and John may have got up to together. Dates of fieldwork were Aug-Oct 2010. All other blogs posted links to survey in Aug 2010. (dates are US style).
By looking up the survey number posted by leopard at the internet archive you can find the first page of the survey from a snapshot on Sep 3 2010.
There are various interesting things in the pre-amble. I cannot find the rest of the original survey this way.
Also, note that some of the links had a slightly different url for the survey from the number given by Leopard,
http://www.kwiksurveys.com/online-survey.php?surveyID=HKMKNG_ee191483
I can't find this one on the archive.
Come to think, 1,145 complete answers is a miraculous feat indeed.
Is there any way to check if Lew's results follow Benford's law?
Aug 31, 2012 at 11:15 PM | Paul Matthews
Ah I never thought of using wayback. Plugging some of the preamble text from that into Google I get something vaguely similar showing on a 2010 archive page of the Junkscience blog (Look for the text "University of Western Australia seeks survey respondents" about 1/3 way down), it's not the same survey I think but its from the same Oz team. The host doesn't recommend taking this survey but posts the link nonetheless with the following observation:
I get the impression this department is a real little conveyor belt of hack "academia". A bit of an eyeopener. I really can't believe anyone with any decent cognitive ability can take the results of this stuff seriously.
Maurizio
I’ll report back here about any possible reply.It’s easy enough to falsify Benford by changing the rules of the game. Opinion pollsters often aim for a thousand responses, as being a nice comforting number that instils confidence in their clients, and fall short by a few. Thus many polls start with the statement: “based on a survey of 998 informants...”. Levandovsky likes correlations rather than raw data, so theres lots of 0.9xxs.. I wouldn’t worry about what is simply modern numerology.
The following post has just gone up at
http://www.skepticalscience.com/AGU-Fall-Meeting-sessions-social-media-misinformation-uncertainty.html#comments
Leopard
This is indeed the Lewandowsky study. Hanich is the name spotted by a commenter on one of the blogs as being responsible for the study; the date, subject and description of the questionnaire all correspond.
The survey linked from junkscience is not the same survey as the one linked from Tamino and Deltoid. See http://web.archive.org/web/20100928145229/http://www.kwiksurveys.com/online-survey.php?surveyID=HKMKNI_9a13984&UID=3313891469
Sep 1, 2012 at 1:01 AM | geoffchambers
Yeah it might be the same Lewandowsky study but I think its not the same questionnaire used by the final paper. Sorry I should have said earlier, but I did what Paul Matthews did and checked the webarchive for the link indicated on the JunkScience site, I got a single page of the first 5 questions, and this questionnaire seems to have a different set of questions to the ones declared on the final Lewandowsky paper e.g.
That's what prompted my conveyor belt comment, it seems that this Hanich (at Lewandosky's behest?) was generating a few of these study questionnaires at about the same time and throwing them out - seeing who bit.
As someone else said, the whole study is a mess. It just strikes me as a totally slapdash and haphazard venture. Using a freebie survey system and just plopping it down on your mates self described "pro-science" sites with a nod and a wink and waiting for the junk responses to reach a certain level. It makes me wonder if it took nearly 2 years for the number of answers to fill up to the right level, waiting for half assed idiots to stumble on the survey link?
Also how many other surveys were going on at the same time by that same department, with the same aim, but didn't give the required result?
Since the study is clearly primed for bad answers to skew the results towards skeptics=nutters, all Lewandowsky would have to do is wait until enough answers come back that fit a basic criteria on at least one questionaire. It almost writes itself. Hack, hackie, retarded, hackie shite.
I really love this paper:)
Next time someone tries the "sceptics = nutters is proven by scientific evidence line" it will be fun to point to how well publicised and lauded this Lewandowsky crap was, and then walk people through the shittiness of its quality :)
OK the thick plottens.
Just for completeness I have to post this here ;)
I now notice manicbeancounter has a list of questions of a survey he spotted doing the rounds in early June this year. He thought it may have been the basis of the Lewandowsky paper but someone points out in his comments there are some differences in the questions, although there are enough similarities.
It does seem interesting that the link for this more recent study is actually associated with the university and not one of the kwiksurveys ones:
http://uwa.qualtrics.com/SE/?SID=SV_0UtxttVraAorKNS
But the survey has expired now.
Now it does seems this survey was the subject of a Special Request on the SKS site. The link doesn't come up on wayback however, it must have been pretty short lived.
However since the questions apparently don't include the ones mentioned on the final Lewandowsky paper, and given the relative lateness of its date, it can't be the same one used for this latest Lew paper*.
Just what is going with old Charles Hanich spraying around similar sounding surveys like this?
Is this all a texas sharpshooter fallacy writ large!?
*pun intended ;)
Leopard
Congratulations on your efforts. The explanation may be simply this: running surveys, like plotting Arctic ice cover, is one of those things which used to require a lot of time and effort, and can now be done practically for free by anyone. All you need is an interesting enough end result to begin with.
Geoff & Leopard - very impressive research on this.
I think a real showstopper is SKS moderator & author Tom Curtis' reply to Geoff at SkS:-
.... in my opinion, the title of the paper is not justified by the results, and is needlessly sensationalizing and offensive
I wonder if Lewandowsky groupie John Cook agrees.
This is damn near unbelievable, except we've seen the Peter Glieck's and the ClimateGaters, and still, my sense of being offended for the craft of Einstein, Bohrs, Newton, Feynman, and so many other giants, being sullied by hacks and propagandists, still has the ability to be amazed and saddened and disgusted. Who in a modern University department, or as an editor of a supposed science publication or a peer reviewer can bloody hell think an on-line self-selecting subject base can be used to conclude anything on any topic? This Lew guy is a professor? He should be demoted and forbidden from ever again using the words science, skeptic, research and knowledge, and instead trained in the language of his new craft with words like mop, bucket and Caution: Wet Floor.
Lewandowsky, of course, wrote an enthusiastic endorsement of Gleick's actions - even comparing him to Winston Churchill, who had to deceive the Nazis to pursue victory.
It includes the ringing words:-
Revealing to the public the active, vicious, and well-funded campaign of denial that seeks to delay action against climate change likely constitutes a classic public good.
Does this sound like the measured judgement of an impartial academic - or the wild ranting of an obsessed activist?
It's not hard to believe that striking a blow against the "deniers" might come higher in his priorities than careful and honest application of the scientific method.
http://theconversation.edu.au/the-morality-of-unmasking-heartland-5494
Sep 1, 2012 at 1:30 PM | Foxgoose
Hmm the way I read that comment by Tom Curtis is that he just seems to think that Lewandowsky has possibly over-egged the PR side by accentuating the sceptic=conspiracy nutters with his title - Lewandowsky clearly has a better eye for PR than poor naive Tom though and clearly knew what would sell to the gullible press ;)
Other than that Curtis seems to think "deniers" have made "unwarranted" criticisms of the paper - he doesn't trouble to list these - I guess because once he has spat the word "deniers" out he feels his work is done.
Curtis seems to have essentially uncritically lapped up the bull offered from Lewandowsky though - Curtis thinks there is a so-called "big result" from the paper about free-market bias, whilst ignoring the basic issue with the murky state of the origin of the data. Curtis is just another puffed-up idiot coprophage.
Cook is claiming at
http://www.skepticalscience.com/AGU-Fall-Meeting-sessions-social-media-misinformation-uncertainty.html#comments
that the Lewandowsky questionnaire was posted at SkS in 2011, while Lew says the fieldwork was completed in Oct 2010. It’s possible that SkS carried an invitation to participate in a different survey (an invitation that was quickly removed) but even this seems unlikely, because right up to February 2012 Cook is informing his fellow SkS authors of plans to cooperate on some research work with Lew. But they would surely have been aware if a survey had already been promoted on the site for which they are jointly responsible.
There is still no sensible explanation of the absence of the Lewandowsky research from the Septical Science site, and one of either the list of participating sites, or the dates of the Lewandowsky research is clearly wrong.
Once people decide to mispresent and smear their enemies, rather than deal with their legitimate arguments, who knows to what depths they may sink. Even so, the ineptness exposed in the last few days - thanks Leopard and others - is a surprise. I do prefer botched conspiracies to the others.
By a strange turn of wiki search I came across my notes on Brigitte Nerlich this afternoon. I didn't remember the name either. But this is what Steve McIntyre wrote on Climate Audit in April 2011:
This rang rather strong bells. Nerlich hails from Nottingham, possibly the only characteristic she may share with Paul Matthews. But had it become some kind of habit by 'researchers' in 2010 to more or less invent the sceptics of their own choosing, rather than deal with the messier but much more interesting reality?
It was Brigitte Nerlich, of course, who collaborated with Adam Corner to use Nottingham Uni public money for Adam's "Talking Climate" activist site - she also lists, in her grant progress reports, her liaisons with the local Greenpeace group
I remember Adam complained to Geoff Chambers that Barry Woods ringing her up to ask about it was "smearing" him.
I also noticed from Katabasis, at Jo Nova's, that Adam Corner's Guardian article on Lewandowsky's unpublished paper appeared a full month before the official UWA press release - and contained a lot of background spin that wasn't in the draft paper.
At the risk of fulfilling Prof Lewandowsky's worst fears and succumbing to my inner conspiracy theorist, a clear picture is emerging of a coterie of academics in the "climate psychology" business who maintain a public face as serious and impartial academic researchers - while collaborating frantically behind the scenes as committed climate activists.
Think about it -
Adam runs around with banners demanding "Action Now", puts himself forward as a Green Party parliamentary candidate and acts as adviser to activist group COIN - whilst telling an important committee of MP's and policy makers "I'm a researcher, not a campaigner".
When challenged he announces on his blog "In my personal time — when I do not represent anyone but myself — I have taken part in many campaigning activities, and I plan on continuing to do so. You will no doubt be able to find pictures of me holding various placards... I don’t see any conflict in what I do in my personal time and what I do at work."
Adam & Brigitte put their heads together with self-described "lifetime green campaigner" George Marshall to siphon public money from Cardiff & Notttingham Universities for a blatant climate activist site.
Brigitte writes in her official grant progress reports of liaising with activist Marshall and her local Greenpeace group as part of her academic work.
Adam gets an article in the Guardian to plug Lewandowsky's upcoming garbage a month before it's even press released - with all the exact same spin that later turns up in the release.
Are we dealing with academics who happen to have an interest in green issues which they keep separate from their day job - or a bunch of fully committed activists who are using their academic roles to promote "the cause"?
What do you think?
This post at Skeptical Science was snipped (part in italics) because it contained
“References to stolen intellectual property”.
It's interesting isn't it. When thieving politicians, fornicating slebs or naked royals are caught out by illegally obtained evidence - they have to deal with the revealed reality, even while the source of the leak suffers opprobrium or prosecution.
Only in the wonderful, wacky world of climate "science" does what you say or do cease to have been said or done when revealed by irregular means.
It's real Winston Smith "Memory Hole" stuff.
Still - top marks for forensics & persistence Geoff, I see you've reposted the $64,000 question and we'll all await their reply with interest.
Foxgoose, thanks for the additional info on Nerlich, revealing that I know little of this offshoot of climate studies. Not that whether you "succumb to your inner conspiracy theorist" or not doesn't alter whether the info is correct, which kyboshes the whole thrust of this kind of thinking anyway. But it does seem from his reaction on the blog that Adam Corner is a decent human being as well as a dedicated activist. That tends to limit what the dark side can achieve with him around, even if they are strongly organised.