The Quest for AGI: Q*, Self-Play, and Synthetic Data
The a16z Show
a16z
4.2 • 1.2K Ratings
🗓️ 4 December 2023
⏱️ 27 minutes
🧾️ Download transcript
Summary
Transcript
Click on a timestamp to play from that location
| 0:00.0 | Highly ambiguous problems with unclear reward functions that do have correct answers. |
| 0:05.6 | That's sort of the elusive goal right now. |
| 0:07.6 | The big idea for why people are so interested in understanding what Q-star is, is that if you can produce an AI system that is |
| 0:16.4 | four to six orders of magnitude better than GPD4, right? So 10,000 times better or 100,000 times better, |
| 0:22.0 | then you start approaching this North Star of an AGI. |
| 0:25.0 | Synthetic data and self-play come into relevance here because when you're having an AI |
| 0:30.0 | score each individual step of your reasoning, then you're generating a bunch of really valuable data |
| 0:34.8 | that then you can train the system on. |
| 0:37.2 | We don't actually know how much data is required |
| 0:40.1 | to get and surpass human level intelligence. |
| 0:43.5 | Chat JBT was launched on November 30th, 2022. |
| 0:48.0 | Little did we know just how much would change in the whirlwind year that followed. |
| 0:53.0 | And quite frankly, the speed of change during the last few weeks |
| 0:55.7 | has been no different. |
| 0:57.9 | One topic at the center of the AI universe |
| 1:00.3 | this week was a potential breakthrough called Q-Star. Now, universe this |
| 1:03.3 | week was a potential breakthrough called Q-Star. |
| 1:04.2 | Now, little has been revealed about this open AI project |
| 1:07.5 | other than its likely relationship to solving certain grade school |
| 1:11.6 | math problems. |
| 1:13.0 | Amid much speculation, we decided to bring in our new general partner at A16C, |
| 1:18.0 | who's focused on all things AI to sift through this sea of noise. So today, together with Antray Mida, we discuss the key frontier |
... |
Please login to see the full transcript.
Disclaimer: The podcast and artwork embedded on this page are from a16z, and are the property of its owner and not affiliated with or endorsed by Tapesearch.
Generated transcripts are the property of a16z and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.
Copyright © Tapesearch 2026.

