Predicting presidents, storms and life through a computer
By SETH BORENSTEIN
WASHINGTON — Forget political pundits, gut instincts, and psychics. The mightier-than-ever silicon chip seems to reveal the future.
In just two weeks this fall, computer models displayed an impressive prediction prowess.
It started when the first computer model alerted meteorologists to the pre-Halloween disaster headed for the Northeast from a bunch of clouds in the Caribbean. Nearly a week later, that weather system became Hurricane Sandy and grew into a superstorm after taking a once-in-a-century sharp turn into New Jersey.
Then, statistician and blogger Nate Silver correctly forecast on his beat-up laptop how all 50 states would vote for president. He even predicted a tie in Florida and projected it eventually would tip to President Barack Obama, which is the equivalent of predicting a coin landing on its side. He did it by taking polling data, weighing it for past accuracy and running 40,000 computer simulations at a time.
He then gave his forecast in terms of percentages, saying that Obama had a 91 percent chance of being re-elected.
In the case of Sandy, lives were at stake. With the election, reputations were on the line and some pundits were dismissive of the computer modeling. Bets were made. Challenges issued.
The math majors came out on top thanks to better and more accessible data and rapidly increasing computer power.
Computers soon should be able to tell health officials where the next food poisoning outbreak will spread, a U.S. government lab predicts.
Tom Mitchell, head of the Machine Learning Department at Carnegie Mellon University, called computer model predictions based on historical evidence “one of more positive trends we’re going to see this century. … We’re just beginning.”
For computer models to make predictions, three things are needed: computer power, mathematical formulas designed to mirror real world cause-and-effects and current conditions converted into numbers that can be used in formulas.
Experts input the data of current conditions into the formulas that say if X and Y happen, then it will produce Z. Then the computers run those what-if simulations over and over again, with slight variations changing the end results. These scenarios are run tens of thousands of times, giving a whole range of outcomes.
The key is seeing what happens most often and why. It’s not a dead-on prediction, but breaks down the future into probabilities.
It all comes down to collecting data, crunching it and spitting out probabilities. It’s evidence turned into numbers. It’s math.
Experts believe it’s the future.
Silver said what he did with the election was nothing compared with what meteorologists did with Sandy, which was a matter of “real life-and-death consequences.”
The National Weather Service forecast an extremely rare due-west turn by the storm into southern New Jersey, he said. “It’s astounding. That’s a huge win for computer modeling.”
Silver’s bold predictions that Obama would win upset some political pundits who predicted a Romney victory, based on what they perceived as momentum, the enthusiasm of crowds, gut instinct and partisanship.
But Silver was right, besting his 2008 record of getting 49 of 50 states right for president.
“This is a victory for the stuff (computer modeling) in politics,” he said Thursday in a telephone interview. “It doesn’t mean we’re going to solve world peace with a computer. It doesn’t mean we’re going to be able predict earthquakes … but we can chip away at the margins.”
One of the next fields Silver said he’d like to get into is education because he feels that all the data being generated “is not being used in the best way.”
“I hope that people focus not on me personally, but what I’m trying to do,” Silver said.
What he and his colleagues are trying to do is take a chaotic world and make sense of it, turn events into equations to be solved.
More than anything statistics are tools for understanding, like a wrench for an auto mechanic, said Bill James, the godfather of modern baseball statistics and a colleague of Silver’s.
James said in an email that contemplating what will happen in the future is something that “we all do every day, without really thinking about it. It is a necessary and relevant process. Thus, it is something that is worthy of our best analytical efforts.”
Nate Silver’s election blog: http://fivethirtyeight.blogs.nytimes.com/
Princeton Election Consortium: http://election.princeton.edu/
National Hurricane Center’s computer models: http://www.nhc.noaa.gov/modelsummary.shtml
Rules for posting comments
Comments posted below are from readers. In no way do they represent the view of Oahu Publishing Inc. or this newspaper. This is a public forum.
Comments may be monitored for inappropriate content but the newspaper is under no obligation to do so. Comment posters are solely responsible under the Communications Decency Act for comments posted on this Web site. Oahu Publishing Inc. is not liable for messages from third parties.
IP and email addresses of persons who post are not treated as confidential records and will be disclosed in response to valid legal process.
Do not post:
- Potentially libelous statements or damaging innuendo.
- Obscene, explicit, or racist language.
- Copyrighted materials of any sort without the express permission of the copyright holder.
- Personal attacks, insults or threats.
- The use of another person's real name to disguise your identity.
- Comments unrelated to the story.
If you believe that a commenter has not followed these guidelines, please click the FLAG icon below the comment.