Observations on the Shollenberger Survey

In late 2012 there was a lot of adverse comment about the paper Lewandowsky, Oberauer & Gignac – NASA faked the moon landing:Therefore (Climate) Science is a Hoax: An Anatomy of the Motivated Rejection of Science (in press, Psychological Science). I did my own quick analysis using pivot tables, which was referred to elsewhere.

Last week, Brandon Shollenberger produced a shorter survey that, though tongue in cheek, aimed to replicate the findings of the Lewandowsky et al. He wrote

As you’re aware, Stephan Lewandowsky has written several papers claiming to have found certain traits amongst global warming skeptics. I believe his methodology is fundamentally flawed. I believe a flaw present in his methodology is also present in the work of many others.

To test my belief, I’m seeking participants for a short survey (13 questions). The questions are designed specifically to test a key aspect of Lewandowsky’s methodology. The results won’t be published in any scientific journal, but I’ll do a writeup on them once the survey is closed and share it online.

This was published at the blogs Wattsupwiththat, JoanneNova and BishopHill blogs. The poll is still available to view.

A few hours ago Jo Nova published Shollenberger’s initial findings, as “Warmists Are Never Wrong, Even When Supporting Genocide“. Using the same methodology that Lewandowsky et al (LOG12) “demonstrated” that those who reject the climate religion have a propensity to believe in cranky conspiracy theories, Shollenberger showed that believers in catastrophic global warming have a propensity to believe in genocide, paedophilia and human trafficking. Like for the LOG12, I have run the data through Excel pivot tables to reveal that Shollenberger was successful in undermining LOG12.

Categorizing the responses

For the LOG12 I split the respondents according to the average response to the four LOG12 “climate science” questions.


Similarly, with the Shollenberger survey, I have categorised the respondents according to response to the three questions on global warming. This time I weighted the responses in relation to belief in catastrophic anthropogenic global warming. First I changed the 1 to 5 response to a 0 to 4 response. The weightings were then 1 for Ques 1, 2 for Ques 2 and 4 for Ques 3. By dividing by the maximum score of 28, I obtained a “believer” percentage. Questions are below.

Also, I have looked at the percentage with the outlier scores, along with the average scores.


Preliminary observations

Some brief preliminary observations that stand out from the pivot tables. These are the green bordered summaries below and the responses to the individual questions at the foot.

  1. Compared with LOG12, Schollenberger gets three times the responses and takes a week rather than 18 months to publish the results.
  2. Schollenberger shows the result of only publishing a survey on only one side of the global warming divide, whilst trying to analyse the other side. The vast majority of responses are from people you are not targeting.
  3. The three times response, in a much shorter time frame indicates that sceptics are far more interested in the subject of global warming than the believers.
  4. Proportionately, more far sceptics seem to visit “believer” blogs than “believers” visit sceptic blogs. This should not be controversial. Sceptics look to understand the view they oppose, whilst “believers” look for confirmation. Climate change is no different from many other areas, including many of the softer sciences.
  5. Schollenberger, in his three questions on belief in global warming captures a broader possible range of beliefs in the climate science, than LOG12 does in four questions. In particular it is possible to distinguish between those who believe humans have caused most of the recent warming, but it is fairly trivial, and those who (like the MSM) believes we are all doomed unless we abandon out cars for bicycles and go to 2W lightbulbs everywhere. The LOG12 questions were designed to polarize views into “pro-science” and “deniers”. Schollenberger thus achieves very quickly what millions of dollars spent on opinion surveys conceals. The extreme alarmism that justifies policy is not held by the majority who believe that anthropogenic global warming is an issue.
  6. Both surveys were uncontrolled for “scam” responses. That is for those on one side to be able to mischievously post as an opponent, but with reprehensible views. The Schollenberger survey had more, and (to a lesser extent) a higher proportion of scam responses. Given the knowledge of LOG12, this is not surprising. But, given the proportions of non-scam responses, “believers” seem to have a greater propensity to scam “sceptics” than the opposite.
  7. Thus Schollenberger can demonstrate that Lewandowsky’s conclusions are as much based on scam responses as his survey.



The Survey Questions


Number of Responses to questions 4 to 13, in relation to CAGW score.


Kevin Marshall