The Macrosite for News, Analysis and Opinion about the Future of the Internet
Mitch Wagner

Analytics Gets the Last Laugh in the 'Moneyball' Election

Written by Mitch Wagner
11/8/2012 6 comments
no ratings
DISCUSS     Email This

Any business managers still skeptical about the power of analytics should keep their mouths shut following this week's election. The Presidential race was a demonstration of the power of analytics over gut instinct and experience.

According to Time.com, President Barack Obama's campaign relied on analytics and techniques that will be familiar to smart businesses.

[F]rom the beginning, campaign manager Jim Messina had promised a totally different, metric-driven kind of campaign in which politics was the goal but political instincts might not be the means. "We are going to measure every single thing in this campaign," he said after taking the job. He hired an analytics department five times as large as that of the 2008 operation, with an official "chief scientist" for the Chicago headquarters named Rayid Ghani, who in a previous life crunched huge data sets to, among other things, maximize the efficiency of supermarket sales promotions.

While Obama's team won praise in 2008 for its "high-tech wizardry," it suffered from a proliferation of databases. Volunteers making phone calls through the Obama Website worked with different lists than callers in the campaign offices. Get-out-the-vote lists and fundraising lists were different. Businesses face these issues all the time, as sales lists for different business units differ from each other, as well as from CRM systems.

For the first 18 months of the re-election drive, the campaign started from scratch with a single, massive database, capable of merging information from pollsters, fundraisers, field workers, consumer databases, social media, mobile contacts, and the main Democratic voter files in swing states.

How did the campaign use that data?

  • To predict what kinds of people would be persuaded by what kinds of appeals. "Call lists in field offices, for instance, didn't just list names and numbers; they also ranked names in order of their persuadability, with the campaign's most important priorities first."

  • The campaign discovered that people who had unsubscribed from 2008 campaign email lists were susceptible to being pulled back into the campaign. Marketers call this technique "retargeting."

    For example, if a consumer puts an item in their shopping cart but decides not to buy it, marketing automation software will fire off an email to the consumer the next day to attempt to nudge the consumer to buy, perhaps with a special discount offer. It works for selling pants online, and it turns out to work for electing a president, too.

  • Strategists tested scripts for different demographic groups, and whether a call from a local volunteer would perform better than someone from a non-swing state, like California.

  • The new database allowed the campaign to beat fundraising goals as well.

The campaign also used sophisticated online marketing techniques, targeting ads based on individual behavior that was tracked with cookies, said the Wall Street Journal. "A wealthy urban liberal sees different ads online than a working-class centrist. People who care more about jobs see different ads than people who focus on social issues."

But the most visible way that metrics won the 2012 election was in predicting the winner. While TV pundits used their long experience and gut feelings to say the election was too close to call, or even predicting a Romney landslide; statistician Nate Silver, writing at the New York Times blog FiveThirtyEight, called the election with staggering accuracy.

Just predicting that Obama would win wasn't particularly interesting. After all, a coin-toss can predict the winner half the time in a two-person race. No, Silver's analytics predicted the outcome in 49 of the 50 states (Florida still hasn't weighed in as I write this late Wednesday), and got the margin of victory right within a half percentage point. (Silver predicted 50.8 percent Obama and 48.3 percent Romney. The reality as of Wednesday was 50.4 percent Obama to 48.1 percent Romney.) See for yourself:

Actual Election Results Wednesday
Source: The New York Times

Nate Silver's Final Prediction Tuesday
Source: FiveThirtyEight

And Silver wasn't alone. Several other statisticians made similarly accurate predictions. Silver, in particular, was widely derided by political pundits before the election, but now he's getting the last laugh as he called the election right, and the pundits got it wrong.

Source: xkcd
Source: xkcd

The 2012 election is one where science and analytics beat instinct and experience. The lesson is clear for business as well as politicians.

Related posts:

— Mitch Wagner Circle me on Google+Follow me on TwitterVisit my LinkedIn pageSubscribe to my Facebook feed, Editor in Chief, Internet Evolution

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
swijeyakumar
IQ Crew
Monday November 26, 2012 6:38:41 AM
no ratings

I would love to know all the variables Nate Silver used in his preditiions I believe his breed of analytics will drive many elections for years to come

Kim Davis
Thinkernetter
Friday November 9, 2012 4:30:46 PM
no ratings

It's a remarkable result, but I admit I can't see how those electoral college numbers add up either.  I thought every state was winner-take-all -- it turns out Nebraska and Maine aren't, but that doesn't really solve the conundrum.

abdlah
IQ Crew
Friday November 9, 2012 1:17:12 PM
no ratings

I am exited that Knowledge through analytics is able to better help us make decisions on what may happen. Of course having a background in IT is the reason I  am happy analytics is beginning to show the way.

 

Mitch Wagner
Thinkernetter
Thursday November 8, 2012 7:55:30 PM
no ratings

I'm seeing reports that Florida has gone to Obama. The Huffington Post calls it that way. The New York Times still shows the count as not done, with Obama leading. 

If the HuffPo is right, that'll make Silver 50 for 50. However, the final electoral tally would be 332 votes for Obama, compared with Silver's predicted 313. I suspect the difference is because of some states giving part of their electoral votes to one candidate and part to another, but I'm not sufficiently familiar with election mechanics to be sure. 

It's a powerful illustration of the power of analytics. 

Kim Davis
Thinkernetter
Thursday November 8, 2012 12:10:51 PM
no ratings

There is indeed some long term significance to all this, if 2008 and 2012 are any guide.  If it becomes possible to know, with some accuracy, the outcome of the election well in advance of Election Day, what do the campaigns do?  Concentrate on turnout, I suggest.

The number of undecideds in US Presidential elections now seems so small, that one wonders whether the vast expenditure is worth it, in an attempt to change a few, unpredictable votes.

And what will the media do, if the "horse race" is a foregone conclusion?

Alison Diana
Thinkernetter
Thursday November 8, 2012 11:53:16 AM
no ratings

Personally, I was fed-up with all the polls and predictions long before the real results were created. And part of me is sad that we can predict human behavior like this, even in the voting booth. The other part of me is amazed -- and I'd be astounded at any company that doesn't invest in analytics and big data. It should be just as much a part of SOP as email and spreadsheets, given the incredible results we're seeing from so many disparate disciplines and industries. 

The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Analytics Clan Editor's Blog
Kim Davis
Kim Davis   5/21/2013   10 comments
The big announcement at the opening keynotes of IBM's 2013 Smarter Commerce Global Summit is that IBM is putting Watson into companies, and companies are putting Watson to work.
Kim Davis
Kim Davis   5/16/2013   37 comments
A study of US ecommerce trends in the run up to Mother's Day points to what Jay Henderson, Global Strategy Director for IBM Smarter Commerce, called "a pretty seismic shift" in online shopping habits.
Kim Davis
Kim Davis   5/7/2013   14 comments
The New York Times made a fuss about the obvious this week, as it so often does, pointing out that Hollywood increasingly leverages big-data to select and hone movie scripts.
Kim Davis
Kim Davis   5/2/2013   9 comments
State and local government agencies would love to get their hands around big-data. All they lack is adequate data storage and computer power, and enough staff.
Kim Davis
Kim Davis   4/22/2013   6 comments
It's unwise to overlook significant data trends, even if you're not sure what's causing them.
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Drives Conversions With Analytics

3|1|13   |   1:20   |   No comments


The automotive website uses propensity modeling of customer behavior to convert more site visitors into leads, says Brian Baron, director of business analytics, in an interview at the Predictive Analytics Innovation Summit.
Marketing Takes
How Four Seasons Handles Content Marketing

6|20|12   |   7:47   |   4 comments


Elizabeth Pizzinato, SVP of marketing and communications at Four Seasons Hotels and Resorts, calls content marketing "the new black" and explains how her brand engages its target audience.
Marketing Takes
An Evolving Take on Marketing at Citi

6|18|12   |   7:56   |   1 comment


Linda Descano, President and CEO of Women & Co., and managing director of partnerships and branded content of North America marketing at Citi, explains her firm's marketing opportunities and challenges.
Gil Elbaz
Gathering the World's Data

5|21|12   |   1:49   |   2 comments


The founder and CEO of Factual, Gil Elbaz, is trying to aggregate all the world's information. But… that's not so simple.
Gil Elbaz
Tying Marketing With Analytics

5|17|12   |   1:56   |   4 comments


Gil Elbaz, CEO of Factual, talks about the importance of data and analytics for marketers and how the technology is evolving to better assist automated, real-time decisions.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE