What A Night! Interpreting the New Hampshire Primary

A few observations about last night’s surprise result in the New Hampshire primary. Let me draw on the thoughts outlined in my column for the Wall Street Journal.

First, red faces all around for the political prognosticators:

Judging by the pre-vote polls and prediction markets, the Democratic primary in New Hampshire created one of the most surprising upsets in U.S. political history. Illinois Sen. Barack Obama was favored in the final pre-election poll of all 12 pollsters who surveyed voters since his surprise victory in Iowa, and was the unanimous favorite among television pundits. The only real question to be resolved appeared to be the size of Mr. Obama’s majority. His loss to New York Sen. Hillary Clinton was equally embarrassing for prediction markets.

How surprising is this result?

Historical comparisons are already being drawn between the New Hampshire primary and the famous 1948 presidential race in which President Harry S. Truman beat Republican challenger Thomas Dewey … Yet the magnitude of the Clinton surprise is arguably even greater. Indeed, historical research by Professors Paul Rhode of the University of Arizona and Koleman Strumpf of Kansas University has shown that in the Truman-Dewey race, prediction markets had seen hope for President Truman despite his dreadful polling numbers, and he was rated an 11% chance of winning the election by election-eve. Thus, Sen. Clinton’s victory on Tuesday was more surprising than President Truman’s in 1948.

And finally, this is a chance to remind ourselves just what a prediction market price means:

While Sen. Clinton’s unexpected victory has yielded red faces among the punditocracy, this also provides a useful opportunity for emphasizing just what a prediction market forecast says. That the price of a contract paying $1 if Sen. Clinton won in New Hampshire was selling for seven cents doesn’t suggest that she was a sure loser. Rather, these prices suggest a probabilistic statement that the ultimate outcome was about a 7% chance. And as any horseplayer can tell you, sometimes the long shots do win.

And let me emphasize, this isn’t a “get-out-of-jail-free” card for my own prognostications. One of my current research projects (with Andrew Leigh and Eric Zitzewitz) documents evidence of a favorite-longshot bias in political prediction markets:

We were led to this research by an age-old racetrack puzzle economists call the “favorite-longshot bias”: horse bettors historically have overbet long shots, and they win less often than their odds suggest. Our research suggests that similar biases hold in political prediction markets.

Against this baseline, it is even more surprising that Ms. Clinton was the winner.

Read the full column here. And here’s Paul Krugman:

There’s no hint that the market saw either Iowa or New Hampshire coming, or knew anything beyond the bloviations of the talking heads.

Perhaps the clearest explanation lies in the title of Krugman’s post: “Nobody knows anything.” If true, it wouldn’t be surprising that any information aggregation mechanism did poorly.

It is also interesting to see the hand-wringing among the pollsters. Gary Langer, a former Freakonomics guest blogger (and ABC’s Poobah of Polling) has a very honest, straightforward piece that I liked. And it is worth revisiting this earlier post by Dubner (quoting Langer) about inaccurate polling and minority candidates.

Finally, a fun aside. I didn’t bet a dime on last night’s race, but at this fantasy prediction market I put my whole portfolio into Clinton to win New Hampshire. If you click through to the leaderboard this morning you’ll see I’m finally winning something! (But click soon — my lead won’t last!)

What are the lessons for pundits, polls, prediction markets, and other prognosticators?

Leave A Comment

Comments are moderated and generally will be posted if they are on-topic and not abusive.

 

COMMENTS: 28

View All Comments »
  1. PEZ says:

    I’m just an ignorant Swede. But isn’t this the first time a Woman runs for president in the United States? If so I think that some women, who formally haven’t felt enough reason to vote, might now actually bother. Since women represent about half the population my guess is that this effect might be quite powerful and may very well make the difference.

    Thumb up 0 Thumb down 0
  2. Jonathan says:

    If the favored outcome in prediction markets always came true, it would be strong evidence against the efficiency of the prediction markets. A 93% favorite should only win 93% of the time. Hillary Clinton had about a 1/13 chance of winning the NH primary. There is no reason for the prediction markets to be embarassed that a 1/13 event happened. Anybody who’s experienced a ‘bad beat’ on the river knows that 1/13 events happen often.

    Thumb up 0 Thumb down 0
  3. Rich Wilson says:

    PEZ- you are correct. The closest we’ve had was Geraldine Ferraro who ran for VP with Walter Mondale, and was defeated by Reagan/Bush in ’84.

    Thumb up 0 Thumb down 0
  4. Bill says:

    Gimme a break…these are the same people that just a few months ago said Ms Clinton had the nomination sewn up. Hear this click? It’s the sound of my TV going off every time a talking head comes on.
    Hat Tip to all the NH voters who threw off the pollsters…now let’s have a few big states do this, and maybe they will all go home.

    Thumb up 0 Thumb down 0
  5. discordian says:

    @ 1

    Hillary is not running for president at this time.
    She is running for her party’s nomination.
    Women have run for party nominations in past primaries (Shirley Chisolm and Margaret Chase Smith to name 2).

    Thumb up 0 Thumb down 0
  6. Tom Martin says:

    Something slightly unrelated that I really don’t get. I would love it if a veteran who is more into politics than I could answer this:

    Romney has gotten 2nd place in Iowa and NH while no single candidate has won both. He currently has the most delegates pledged to him and has gotten more combined votes than anyone else. Also, less than 1% of the country has even voted at this point. Why then, does the media portray it as though Romney’s campaign is dead in the water? I just don’t get it. Does the media just not like him and want to malign his campaign? If he’s not the current leader on the republican side then who is?

    Thumb up 0 Thumb down 0
  7. Eric Goebelbecker says:

    Oh my gawd! We still have to actually hold the elections in order to determine the outcome! What a shocker!

    How does a contract that pays $1 if the pundits and pollsters get February 5 wrong cost?

    If it’s anything less than $1, take it!

    Thumb up 0 Thumb down 0
  8. Nick M. says:

    Obama is the first African-American to have a fighting chance, so I would expect that to bring out more African-Americans the same way Clinton might bring out more women.
    Though I think there are more white women in NH than African-Americans, so I guess that would favor Clinton.

    Thumb up 0 Thumb down 0