meta_pixel
Tapesearch Logo
Log in
Rationally Speaking Podcast

Rationally Speaking #145 - Phil Tetlock on "Superforecasting: The Art and Science of Prediction"

Rationally Speaking Podcast

New York City Skeptics

Society & Culture, Skepticism, Science, Philosophy

4.6787 Ratings

🗓️ 18 October 2015

⏱️ 56 minutes

🧾️ Download transcript

Summary

Most people are terrible at predicting the future. But a small subset of people are significantly less terrible: the Superforecasters. On this episode of Rationally Speaking, Julia talks with professor Phil Tetlock, whose team of volunteer forecasters has racked up landslide wins in forecasting tournaments sponsored by the US government. He and Julia explore what his teams were doing right and what we can learn from them, the problem of meta-uncertainty, and how much we should expect prediction skill in one domain (like politics or economics) to carry over to other domains in real life.

Transcript

Click on a timestamp to play from that location

0:00.0

Rationally speaking is a presentation of New York City skeptics dedicated to promoting critical thinking, skeptical inquiry, and science education.

0:22.6

For more information, please visit us at NYCCEceptics.org.

0:31.1

Welcome to Rationally Speaking, the podcast where we explore the borderlands between reason and nonsense.

0:41.3

I'm your host, Julia Galeith, and with me is today's guest, Professor Philip Tetlock.

0:46.9

He is a professor at the University of Pennsylvania, where he serves in the departments of psychology, political science, and then also the Wharton School of Business.

0:56.3

He is the author of many books, including famously expert political judgment. How good is it? How can we know?

1:03.8

And his most recent book, Super Forecasting, The Art and Science of Prediction.

1:08.2

Philip is also the co-founder and co-principal investigator of the Good

1:12.4

Judgment Project, which is a long-term study on how to improve the accuracy of human

1:18.0

judgment and forecasting. Phil, welcome to rationally speaking. Thank you. So we're going to be

1:24.4

talking today about super forecasting and what you've learned from running the Good Judgment Project.

1:29.4

And probably a good place to start is to say that many of our listeners, I'm sure a large chunk of our audience is already familiar with you in your work to at least some extent.

1:40.3

But probably many of them associate you most strongly with the finding that received quite a lot of publicity in the years since expert political judgment came out, that experts, forecasters of economic or political topics are not really experts.

1:59.0

That their judgment, their forecasting is no better than, well,

2:02.8

sometimes the claim goes no better than amateurs, sometimes it goes no better than chance.

2:06.6

And you, in the beginning of your new book, Super Forecasting, you talk about how that

2:11.2

finding has sort of gotten distorted from the original, from the actual conclusion that you found

2:17.4

in your research.

2:18.3

So why don't you kick things off by elaborating a little bit on that?

2:22.3

Sure.

2:24.3

I think I started the mischief by using the dart-throwing chimpanzee metaphor in the book,

2:30.3

although I don't think the metaphor was unique to me.

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from New York City Skeptics, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of New York City Skeptics and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2025.