Errors in exit polls still a puzzle to many

Originally published at http://www.philly.com/mld/inquirer/news/editorial/10258265.htm

John Allen Paulos
is a professor of mathematics at Temple University

Why did the exit polls on Election Day in the battleground states differ so starkly from the final tallies in those states? As my crosstown colleague, Steven Freeman of the University of Pennsylvania, has demonstrated in his paper, "The Unexplained Exit Poll Discrepancy," the pattern is unmistakable. In Ohio, Pennsylvania, and Florida, the differences between Bush's final tallies and his earlier exit poll percentages were, respectively, 6.7 percent, 6.5 percent, and 4.9 percent.

Similarly, huge differences between the final tallies and the exit poll percentages occurred in 10 of the 11 battleground states, all of them in Bush's favor. If the people sampled in the exit polls were a random sample of voters, Freeman's standard statistical techniques show that these large discrepancies are way, way beyond the margins of error. The odds against them occurring by chance are almost 1 million to one.

Since exit polls historically have been quite accurate, and the differences as likely to have been in one candidate's favor as the other's, we're confronted with the question of what caused them. Given the indefensible withholding of the full exit-poll data by Edison Media Research, Mitofsky International, the Associated Press and various networks, we can only hazard guesses based on what was available election night. The obvious speculation, alluded to above, is that the exit samples were decidedly nonrandom.

Earlier voters across the country might have differed significantly from later voters. More women might have voted then or angrier partisans did or unemployed people walking their dogs wanted to cast their ballots sooner rather than later. This is hard to credit, however, without any supporting evidence for such an effect in other elections.

Another possible explanation is that a fraction of the Bush voters were ashamed of their vote for him and lied to or avoided the exit pollsters. This happens regularly in polls on personal matters, but rarely in political polls. One example is David Duke, a former Ku Klux Klan wizard running for governor of Louisiana several years ago, who received many more votes than exit polls suggested because people didn't want to admit their preference for Duke and be labeled racists. Bush is certainly no Duke, and very few of his supporters seemed in the least shy, but an attenuated version of this phenomenon may be behind the difference. Who knows?

Absent any proof or compelling reasons for the differences between the final tallies and the exit polls in the swing states, I don't understand why these gross discrepancies are being so widely shrugged off. After all, the procuring of random samples is far more of a problem for ordinary telephone polls, where the minority of people who cooperate with pollsters presumably differs in some way from the majority who don't. Still, these polls are not dismissed with the same impatient nonchalance as this year's exit polls.

What makes these discrepancies more than a technical problem is that there is a much less likely, much more ominous explanation: massive fraud. Fraud is hard to believe for many reasons, one being the widespread nature, extending over different states and regions, of the shift to Bush. The difficulty of concealing a conspiracy grows very rapidly with the number of conspirators.

Another disturbing possibility is that there was no coordinated conspiracy, but rather many people working independently to subvert the election. The election has prompted extensive allegations of fraud, some of which have been debunked, but many of which have not. In several cases, nontrivial errors have been established and official tallies changed. One other scenario doesn't require many conspirators: the tabulating machines and the software they run conceivably could have been dragooned into malevolent service by relatively few operatives. Without paper trails, this would be difficult, but probably not impossible, to establish.

Hard evidence? Definitely not. Nevertheless, the present system is such a creaky patchwork, and angry suspicions so prevalent, that there is, despite the popular vote differential, a fear that the election was tainted and possibly stolen. (If 68,000 Ohio Bush supporters - only about a half dozen voters per precinct in the state - switched their votes, Kerry would be president-elect. Considerably fewer switches would be required if, as is likely, most provisional and spoiled ballots were good and went for Kerry.) A high-level commission should thoroughly examine the exit poll discrepancies and our electoral apparatus in general.

This is not a partisan issue. People differ about whom they want in the White House, but almost everybody wants whoever is there to be seen by all as having been rightfully elected.


The Web site address for John Allen Paulos is www.math.temple.edu/paulos.