Last week I challenged a particularly nasty commentary by David Paul Kuhn that alleged that Democrats were even nuttier than the Republicans who believe the ‘birther” narrative because many Dems believe that George W Bush had “advance knowledge of the 9/11 attacks”. Here’s what I said:
There are two different ways that a survey respondent could interpret the Rasmussen question about Bush’s possible “advance knowledge of the 9/11 attacks” – one of which is entirely rational and, in fact, undeniably true.
Gee whiz, come on. Doesn’t everyone still remember the warnings Bush received about the potential use of airplanes as terrorist weapons in the summer of 2001 – warnings Condi Rice admitted did not get followed up? Don’t we all remember the CIA memos saying that “something big” was in the works in September? Don’t we all remember the 9/11 Commission and Richard Clarkes’ dramatic statement that “We failed the American people”
These were not hallucinations or the product of fevered, paranoid Democratic brains. They were component elements of the undeniable fact that there were indeed significant advance warnings that a terrorist attack was in the works for the fall of 2001 – a fact that was the central subject of the 9/11 commission hearings, 10 or 15 books and hundreds of articles.
One would have to throw out every single academic study of the past 30 or 40 years about the effects of question wording on survey response not to recognize that, for many survey respondents who remembered the 9/11 Commission Report and other media coverage, the phrase “advanced knowledge of the 9/11 attacks” could be cognitively processed as meaning:
“The Bush administration had substantial advance knowledge from U.S. intelligence sources that a terrorist attack on the U.S. was being predicted as imminent in the fall of 2001”
Rather than interpreting the question as saying:
“The Bush Administration had specific and detailed advance knowledge about a particular group of 19 Saudi Arabian terrorists armed with box cutters and trained to fly commercial jet aircraft who planned to hijack four U.S. airliners at 9:45 in the morning on September 11th 2001 and attempt to crash two of them into the New York World Trade Center”
This week, in his blog, Brendan Nyhan offers essentially the same criticism of the Rasmussen question. As he says:
The problem, as Media Matters points out, is that the wording of the Rasmussen poll (“Did Bush know about the 9/11 attacks in advance?”) almost surely conflates people who believe Bush intentionally allowed an attack to occur with those who think the administration was negligent in its attention to the potential threat from Al Qaeda. Even National Review Online’s Jonah Goldberg conceded this point in a column published soon after the poll was released.
But then he goes on to say the following:
Another, lesser-known poll used less ambiguous wording and found similar results. A July 2006 Scripps Howard/Ohio University poll asked the following question:
There are also accusations being made following the 9/11 terrorist attack. One of these is: People in the federal government either assisted in the 9/11 attacks or took no action to stop the attacks because they wanted to United States to go to war in the Middle East….
In short, using a more appropriate comparison poll, the primary conclusion stands — both party’s bases are disturbingly receptive to wild conspiracy theories.
Nyhan is clearly right that this question is better than the previous one. But – when viewed in light of the academic literature about how ordinary respondents actually cognitively process poll questions – the fact is that it is still insufficient to support his conclusion.