This AI Broke Every Benchmark — Then It Did Something Worse. Vivienne Ming - #551
Into the Impossible With Brian Keating
Brian Keating
4.7 • 1.1K Ratings
🗓️ 16 April 2026
⏱️ 68 minutes
🧾️ Download transcript
Summary
Transcript
Click on a timestamp to play from that location
| 0:00.0 | What if the smartest thing AI could do is refuse to give you the answer? |
| 0:04.0 | We trained it to never give answers. It is Socrates. It only gives context and questions. |
| 0:12.0 | But amazingly, upwards of 20% of participants switched into cyborg mode and did this amazing, not just superhuman, but super AI performance. |
| 0:23.8 | What is the point of us if the best and brightest can't beat what an AI can do? |
| 0:31.1 | But then in about 5 to 10 percent, did something amazing. |
| 0:34.1 | We called them the cyborics. |
| 0:35.7 | If we zombie walk our way into a future where it has all the answers and we don't, what's the point of us? |
| 0:43.4 | Exploring the unknown is the one thing humans are uniquely well-suited to do. |
| 0:48.9 | What is the best use of AI right now? |
| 0:51.3 | I have a paper coming up, and the title of that paper is human capital, not AI benchmarks, predicts hybrid intelligence |
| 1:00.9 | in forecasting. |
| 1:02.1 | So how do you measure how creative a human is or an AI is or the two together when maybe, |
| 1:09.6 | you know, a massive large language model has just memorized |
| 1:13.3 | every measure of it we would typically use in science, which, by the way, it has. |
| 1:17.6 | And so it distorts. |
| 1:18.8 | And then you have a bunch of, like, marketing professors or computer scientists who, I love |
| 1:24.4 | them, but they aren't scientists, running these experiments that aren't really valid. |
| 1:30.2 | What have we made predictions of the future? |
| 1:32.0 | What will the price of oil be in six months? |
| 1:34.7 | Which, as we record this, everybody has some sense. |
| 1:38.0 | But I will tell you, when we ran the experiment several months ago, nobody knew what the price of oil was today, much less than six months from now. |
| 1:45.7 | So the humans in this experiment did terribly. |
... |
Please login to see the full transcript.
Disclaimer: The podcast and artwork embedded on this page are from Brian Keating, and are the property of its owner and not affiliated with or endorsed by Tapesearch.
Generated transcripts are the property of Brian Keating and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.
Copyright © Tapesearch 2026.

