meta_pixel
Tapesearch Logo
Log in
The Ezra Klein Show

Predicting the Future Is Possible. ‘Superforecasters’ Know How.

The Ezra Klein Show

New York Times Opinion

Society & Culture, Government, News

4.611K Ratings

🗓️ 3 December 2021

⏱️ 54 minutes

🧾️ Download transcript

Summary

Can we predict the future more accurately? It’s a question we humans have grappled with since the dawn of civilization — one that has massive implications for how we run our organizations, how we make policy decisions, and how we live our everyday lives. It’s also the question that Philip Tetlock, a psychologist at the University of Pennsylvania and a co-author of “Superforecasting: The Art and Science of Prediction,” has dedicated his career to answering. In 2011, he recruited and trained a team of ordinary citizens to compete in a forecasting tournament sponsored by the U.S. intelligence community. Participants were asked to place numerical probabilities from 0 to 100 percent on questions like “Will North Korea launch a new multistage missile in the next year” and “Is Greece going to leave the eurozone in the next six months?” Tetlock’s group of amateur forecasters would go head-to-head against teams of academics as well as career intelligence analysts, including those from the C.I.A., who had access to classified information that Tetlock’s team didn’t have. The results were shocking, even to Tetlock. His team won the competition by such a large margin that the government agency funding the competition decided to kick everyone else out, and just study Tetlock’s forecasters — the best of whom were dubbed “superforecasters” — to see what intelligence experts might learn from them. So this conversation is about why some people, like Tetlock’s “superforecasters,” are so much better at predicting the future than everyone else — and about the intellectual virtues, habits of mind, and ways of thinking that the rest of us can learn to become better forecasters ourselves. It also explores Tetlock’s famous finding that the average expert is roughly as accurate as “a dart-throwing chimpanzee” at predicting future events, the inverse correlation between a person’s fame and their ability to make accurate predictions, how superforecasters approach real-life questions like whether robots will replace white-collar workers, why government bureaucracies are often resistant to adopt the tools of superforecasting and more. Mentioned: Expert Political Judgment by Philip E. Tetlock “What do forecasting rationales reveal about thinking patterns of top geopolitical forecasters?” by Christopher W. Karvetski et al. Book recommendations: Thinking, Fast and Slow by Daniel Kahneman Enlightenment Now by Steven Pinker Perception and Misperception in International Politics by Robert Jervis This episode is guest-hosted by Julia Galef, a co-founder of the Center for Applied Rationality, host of the “Rationally Speaking” podcast and author of “The Scout Mindset: Why Some People See Things Clearly and Others Don’t.” You can follow her on Twitter @JuliaGalef. (Learn more about the other guest hosts during Ezra’s parental leave here.) Thoughts? Guest suggestions? Email us at [email protected]. You can find transcripts (posted midday) and more episodes of "The Ezra Klein Show" at nytimes.com/ezra-klein-podcast, and you can find Ezra on Twitter @ezraklein. Book recommendations from all our guests are listed at https://www.nytimes.com/article/ezra-klein-show-book-recs. “The Ezra Klein Show” is produced by Annie Galvin, Jeff Geld and Rogé Karma; fact-checking by Michelle Harris; original music by Isaac Jones; mixing by Jeff Geld; audience strategy by Shannon Busta. Special thanks to Kristin Lin and Alison Bruzek.

Transcript

Click on a timestamp to play from that location

0:00.0

I'm Ezra Client and this is the Ezra Clancho.

0:10.0

Hey, it's Ezra.

0:20.4

While I'm on paternity leave, we've got an all-star team guest hosts.

0:24.1

This week is Julie Agalif, the host of the Great Rationally Speaking Podcast and author

0:28.0

of the book The Scout Mindset.

0:30.0

Julia is unusually good at thinking about thinking, so this should be a lot of fun.

0:41.2

My guest today is Phil Tetlock. He's a professor of psychology at the University of Pennsylvania

0:47.1

and a professor of management at the Wharton School. He's also the author of several books,

0:51.4

including the 2015 Best Seller Super Forecasting, the Art and Science of Prediction,

0:56.7

co-authored with Dan Gardner.

0:58.7

In my view, Tetlock is doing some of the most important research in social science today,

1:03.3

research that has the potential to revolutionize how we run our organizations,

1:07.8

how we make consequential policy decisions, and how we live our everyday lives.

1:12.4

And that's because at the center of his work is a question that humans have been trying to

1:16.4

answer for as long as the history of civilization. How can we predict the future more accurately?

1:21.7

And Tetlock isn't just an ivory tower academic here. In 2011, he entered a team in a competition

1:29.0

sponsored by the US government, in which participants were asked to make forecasts about questions like,

1:35.3

how long will the Syrian Civil War last? And is Greece going to leave the Eurozone,

1:41.2

putting numerical probabilities on their guesses from 0 to 100 percent?

1:45.8

Tetlock's group consisted of amateurs, with nothing but an internet connection, who agreed to make

1:53.0

predictions in their spare time. And they were going head-to-head against not only other teams,

1:58.0

but also the highly trained career intelligence analysts from the CIA, who had access to classified

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from New York Times Opinion, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of New York Times Opinion and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2025.