Say everybody, I’ve got a great new game to play! It’s the “How Can Gallup…..” game.
How do you play? It’s easy! Just take the latest Gallup outlier and compare it to other publicly available data that seem to contradict it. And let the fun begin!
Today’s Gallup outlier is their RV result in their latest poll. As many have no doubt heard, that result puts Bush up a whopping 13 points over Kerry in a head-to-head matchup. Maybe that 13 points sounds familiar. Well, last Gallup poll, it was their LV result that had Bush ahead by 13 and that was far away from everyone else’s results. Guess they like to spread those outliers around.
Here are some examples I’ve come up with, but the great thing about this game is that all of you can play at home and make up your own examples, so be sure to do so.
How can Gallup……have Bush up by 13 nationwide, when he’s only up by 2 points among Florida RVs?–and according to their own poll!
How can Gallup…..have Bush up by 13 nationwide, when he’s only up by 2 points among Nevada RVs?–again, according to their own poll.
How can Gallup….have Bush up by 13 nationwide, when he’s only up by 3 points in Ohio, according to Fox News?
How can Gallup….have Bush up by 13 nationwide, when he trailing by 5 points in Pennsylvania and 2 points in Michigan, according to Fox News?
How can Gallup…..have Bush up by 13 nationwide, when he’s only leading in Montana by 18 points? (in 2000, Bush won Montana by 25 points)
How can Gallup…..have Bush up by 13 nationwide, when he’s behind Kerry by 15 points in California and 20 points in New York?
How can Gallup…..have Bush tied in the solid blue states (that is, the non-battleground blue states, so WI, MN, IO etc aren’t included), when he is trailing Kerry by 15 points in California and 20 points in New York?
How can Gallup…..have Bush up by 13, when he’s only leading among independents by 2 (and that was exactly Bush’s margin among independents in 2000 when, as you recall, he did not win the popular vote by 13 points)?
Not only that, Bush’s current margin among Republicans in the Gallup poll is not too far from his 2000 margin (93-6 now vs. 91-8 then) and Kerry’s margin among Democrats is identical in magnitude to Gore’s (85-10 now vs. 86-11 then).
Actually, this one is kind of easy. The only way you can produce a 13 point Bush lead with these internals is if you have quite a few more Republicans than Democrats in the sample–my guess is 7-8 points more. If you re-weight their sample to the 2000 exit poll party ID distribution (and I kind of have to do this, just to drive certain pollsters and their acolytes into a frenzy), you wind up with a modest Bush lead of 2 points.
See? This game is fun! Tell a friend about the “How Can Gallup…..” game and add a little zing to your election season.
Latest Research from:
tds-wwc-roundtable
Read this, my fellow Dems and Kerry supporters and take heart all ye of faint heart (or hort, as Bush might say in his ersatz TX, affected, pork rind eatin’ accent):
http://zogby.com/news/ReadNews.dbm?ID=873
Shrub is in big trouble.
Well if one starts to believe it, then when the election is… umm what’s the word?…. yes, stolen with electronic voting from Diebold, a Bush inner-circle member who has sworn to “do everything in his power to elect G W bush” … folks won’t be so surprised… after all, they’ll say, he was ‘up by 13%’.
How do we know that the VNS exit poll results are the true partisan distribution numbers by which we should be weighting?
You wrote: “The only way you can produce a 13 point Bush lead with these internals is if you have quite a few more Republicans than Democrats in the sample–my guess is 7-8 points more. If you re-weight their sample to the 2000 exit poll party ID distribution (and I kind of have to do this, just to drive certain pollsters and their acolytes into a frenzy), you wind up with a modest Bush lead of 2 points.”
Is this what happened, or are you just guessing? Did Gallup poll REGISTERED voters or LIKELY voters? What exactly were the samples used, and if they were not representative, how so? Without this information, any substantive criticism of the Gallup results is meaningless; i.e., your numbers are less reliable than you claim Gallup’s are, and you’re blowing smoke.
There is a reason Gallup has more Republicans than Democrats in their poll. The reason is that Gallup, unlike other polls, doesn’t consider political affiliation to be a demographic. That is to say, if they – in their completely random dialing – get more Republicans than Democrats, then they assume that this simply means that there are more Republicans than Democrats in the population. There are obviously a lot of cons to this, but it is not totally devoid of pros, either. What is most important to remember with this is that Gallup has consistently done this for the entire time they’ve been taking polls, ie. they have not chaned their methodology for this election. So, the Gallup poll should be comparable to previous Gallup polls, but not so with other polls taken currently. And one more thing to ponder: Gallup consistently had Bush ahead in the popular vote in 2000, including in all of their polls in the final days of the election. If I were a Kerry fan, I wouldn’t pay any attention to ANY of the national polls. They really mean nothing, especially when you have states like Utah and Vermont, states where each candidate is up by ridiculously huge margins. The more important polls to look at are ones that look at the electoral map. There, sadly, Kerry’s chances are fading by the day.
the gallup poll will come in line with other polls the last week before the election. they did the same thing in 2000, they had bush up 13 the week before
election day and the poll right before the election he suddenly was down to a 2 point lead. they spin for the republicans until the very end and then switch to an accurate poll so they don`t foolish.
I Mourn the death of the Gallup Poll
I strongly applaud the actions here, but I also want to be sure that everyone here realizes the seriousness of what we are witnessing.
We are dancing on the grave of what was until recently a respected institution. As we point out these obvious and deliberat flaws, we drive nails into the coffin of this once venerable organization.
I am overjoyed to see people loudly taunting the right wing effort to “manufacture consent” for Dubya, our commander in thief, but I am unsettled by what it means for our future trust in the supposed ethics and impartiality of nationwide polls of any sort.
What Gallup has done here is akin to what Enron did to the energy trading business. I used to work for UtiliCorp in a Kansas City (now called Aquila if it’s still around). This was a company that I believe was destroyed by the criminals at Enron. UtiliCorp had flaws, but it was a good company. Guilt by association, however, is a horrible thing and virtually impossible to escape.
I am sure Colin Powell would agree with me right about now.
Some of the latest state polls
CA: K 53; B:40 (Rasmussen)
NY: K 53; B:41 (Rasmussen)
FL: K 47; B; 49 (Gallup)
PA: K: 46; B:42 (Quinnipac)
NJ: K:49; B: 46 (Rasmussen)
WA:K: 50; B: 43 (Rasmussen)
OR: K: 50; B: 43 (Rasmussen)
IL: K: 51; B: 42(Rasmussen)
MI: K: 48; B:45 (Rasmussen)
MA: K: 64; B: 27 (ARG)
Gallup: B: 54; K:41.
Quite a Bush landslide indeed! I would not believe these state polls if they were outliers. Actually most other state polls except the partisan ones confirm these results!
The constant bombardment by major media of “Bush with big lead” is erosive to Kerry’s position, and is done for that reason. Big media is backing Bush in a big way. This should end the myth of “liberal media” but it won’t.
I agree that Gallup has to know what it is doing, and is doing so for business reasons. They sell the name, and they do it to people who can afford to pay top dollar. It’s all about the name ID and the ability to sell it to big business.
Has anyone here posted the internals on the Gallup number? I read elsewhere that the spread between Republicans and Dems was even greater than the last poll — 43% GOP, 31% Dem.
It’s as if Gallup’s been reading all the debunking of its LV model, and decided, Okay, I’m going to screw around with the RV model and REALLY play with their heads.
The ABC poll, as many have said, is more disturbing, because it’s not quite as GOP tilted (though it probably cedes a few points) and because the approval rating puts Bush over the magic 50. The question then becomes, who’s got the right formula for approval rating this year? Such things didn’t matter in ’92 — when Bush’s rating was so low, it didn’t matter whether the high or low estimates were correct — or in ’96, when Clinton was so far over 50% a few points could be subtracted with no significant change. With this Bush, however, hovering around the 50% mark, it matters alot whether the low estimates (45-48) or the higher (51-52) have it right. I don’t see how we’re going to know before Election Day — unless the market crashes on oil/job/consumer confidence numbers, or Iraq truly explodes, sending Bush’s numbers decisively south in even his best polls.
Ruy: Great site – lot’s of good info. Question: What explanation has Gallup given for weighting their samples heavily with R’s? And WHY don’t they provide that information openly?
Clearly, Gallup must be aware of the contradiction in their numbers based on the state by state data. Why don’t they just say, “If turnout is 7-8 points in favor of R’s, we expect Bush to win by 13. If it turnout resembles 2000, we expect Bush to win by a nose, based on current polling data.” Wouldn’t that be better than misleading everyone?
Good Post, perhaps you should consider creative writing.
I agree.
The painfully obvious conclusion is that they are doing it to sell a position, not to get an accurate poll.
Ruy’s arguments are persuasive as far as they go but only look at one side of the equation. The ABC poll has Bush up by 7, the CBS poll by 8, the TIME poll by 4, the AP poll by 9. A couple of polls show a tighter race, but in the range of things, the Gallup poll is no more out of the pack than the Marist poll showing a close race.
I am willing to give Ruy the benefit of the doubt and suggest that there is MORE bias in the Gallup poll perhaps than some of the others, but why should he interpret it so that it supposedly comes out at the other end of the bell curve. The idea of party ID as a fixed rather than idea issue has been debunked on a number of blogs quite cogently, and while the arguments for consistency are not without merit, I don’t see why when a slew of polls come up with random samples (the four polls cited above together with Gallup average an 8 point lead — NOT a neck and neck race) that show a wide lead a pollster would have so much resistance in recognizing that the average is probably fairly close to accurate. The notion is that the polls showing a close race are right and all the others are biased and THAT argument, as a Democratic voter who has donated to and will vote for Kerry (in Mass where it won’t do much good) I don’t buy it.
Strategically, as I have said before, the repeated flipflop mantra, a mere fatuous spin, unconfronted can do what happened when Dukakis failed to fight back properly in 1988. The issue of running against the incumbent or the VP as a difference is not the determinative factor in this problem. UNLESS KERRY CONFRONTS THE FLIPFLOP ISSUE, DISMISSING IT AS THE “SPIN” THAT IT IS, AND POINTS TO THOSE ARTICLES THAT HAVE NOTED HIS CONSISTENCY SUCH AS THE SEPT 23 SF CHRONICLE PIECE AND THE SEPT 7 SPINSANITY PIECE AND EXPLAINS HIMSELF HE IS A GONER. He can use the ‘voted for it before I voted against it’ blooper to his advantage, by pointing out NOT HALF-HEARTEDLY THE WAY HE COUNTERED O’NEILL’S SLANDER IN 1971 OR RATHER INTRODUCING THE “STUDY” THAT HE WAS THE MOST LIBERAL SENATOR EITHER forcefully, like the NYU speech, that there were two versions of the bill. He must establish this point in the debate, probably the first one, or forget it. He’s losing even states Dukakis carried. Of course he can help himself in other ways, comparing the linear and one-sided thinking of Bush on Iraq with those who, without even thinking about strategy, call for “complete, unconditional, immediate” withdrawal regardless of circumstances. (My own views are close to but not the same as the latter). He can suggest that both views are simple answers but wrong. He can hammer at Bush for his father and Dole both in similar parroted ways trying to promote the SwiftBoat smear, while the candidates stay above the fray. He can lambaste Bush for trying to suppress dissent. He is NOT Dean and is NOT likely to lose it, although Bush might a little, if handled skillfully. BUT IF HE DOESN’T CONFRONT THE FLIPFLOP ISSUE IN THE DEBATES HE IS SUNK.
Only by really turning the issue around can he win, and all this pollyannaism about the polls distracts from that strategic reality.
Also, in the vein of realism, I must admit that it isn’t like what I have seen of Kerry for him to go on the offensive that way, although I am sure he knows how to do it in a firm and gentlemanly way if he goes into the debates with that strategy. But the whole campaign is one of default, of “Dukakissing” and THAT IS WHAT THE POLLS ARE REFLECTING. This would be the third “blown” election by the Democrats out of the last five. And the one who got in was a shill to get an otherwise impossible Republican Congress in 1994. Walter Karp in Indispensable Enemies understood well (despite a few off kilter specific theories) exactly how the two party system works. And any pundit who wants to do more than merely trying to justify the lying needs to recognize that.
I will add that a very big part of the hound that didn’t bark in this election is the virtual silence, especially until very recently, about the fatuousness of the flipflop spin in the media, not only the mainstream but the watchdogs. Factcheck.org had nothing along the lines of Marc Sandalow’s column in the SF Chronicle Sept 23 in over 60 pieces going back to when Bush first raised the spin in a speech. No one called Bush on it at the RNC, tho they were sharp enough to catch McCain on bashing Kerry for referring to the Iraqi “occupation” when so had Bush. But the voted for before voted against that was a centerpiece of Bush’s speech — bupkis. (Sandalow’s article, notable in this campaign for its unusualness and the obviousness of its points is at:
http://www.sfgate.com/cgi-bin/article.cgi?file=/c/a/2004/09/23/MNGQK8TI8O1.DTL) or just sfgate.com on the web. The paucity of press coverage both means that liberals don’t and haven’t picked up on this crucial spin & mantra, and Kerry has a greater lack of material to use to dismiss it as the “fatuous spin” that it is.
Instead of the “selling of the president” they should have books entitled “the arranging of the president”.
We need some analysis of the ABC/Washpost poll. It shows bush over 50% with RV’s. What has been the history of this poll all year? Why are the big name corporate polls all showing large edges for Bush while the independent ones show a tie or a small Bush lead?
I know among the grass roots that these polls are having a demoralizing effect on people bothering to vote. And it is propping up the Kerry is weak so let’s criticize him meme which can only serve to make him seem weaker to the the undecided. That is what they like about Bush and criticizing our own candidate is terribly counterproductive.
I am going to be running a phone bank into Fla. and I have people I may turn away because their carping at Kerry will leak negatively into their persuasion calls.
general poll comment:
a pollster called my mom today and asked her her party affilliation. “independent.” “GREAT. will you vote for Bush?” “no way in hell.” Click ….
They’re getting those numbers the old fashioned way … lyiin’ and cheatin’ and stealin’.
Chin up Rex. Read ya every post.
I wonder why Gallup is stopping at a 13 point spread between Bush and Kerry? Given the absurd assumptions underlying their methodology, Gallup may as well rejig their polling so that Bush can be ahead of Kerry by 20 or even 30 points? That would generate some interesting headlines! Oh heck, why not go for broke and say that Bush is ahead by 40 points. Or that Nader is now running ahead of Kerry. Any of those scenarios would have about as much credibility as Gallup’s current polling showing a 13 point spread in what virtually every other poll is showing as a very close race.
Gallup is a complete joke. I wonder how long it will take for them to come to their senses and change their methodology?
Here’s another way of thinking about the absurdity of a 13 point lead for Bush over Kerry. That would mean that over one-eighth of the people who voted for Gore now favor Bush. One out of eight, absolute minimum, and a hell of a lot more if there are many cancelling Bush voters who now favor Kerry.
So the Gore voter who now would vote for Bush, which has seemed to everyone to be as elusive as a unicorn, is now actually around every corner, and likely at any small gathering.
That really fits in with what people are seeing, doesn’t it?
Sometimes anecdote trumps “scientific” polling.