Revolutionizing AI: Tackling the Alignment Problem | Zuzalu #3
Bankless
Bankless
4.7 • 1.2K Ratings
🗓️ 20 July 2023
⏱️ 128 minutes
🧾️ Download transcript
Summary
In this episode, we delve into the frontier of AI and the challenges surrounding AI alignment. The AI / Crypto overlap at Zuzalu sparked discussions on topics like ZKML, MEV bots, and the integration of AI agents into the Ethereum landscape.
However, the focal point was the alignment conversation, which showcased both pessimistic and resigned optimistic perspectives. We hear from Nate Sores of MIRI, who offers a downstream view on AI risk, and Deger Turan, who emphasizes the importance of human alignment as a prerequisite for aligning AI. Their discussions touch on epistemology, individual preferences, and the potential of AI to assist in personal and societal growth.
------
🚀 Join Ryan & David at Permissionless in September. Bankless Citizens get 30% off. 🚀
https://bankless.cc/GoToPermissionless
------
BANKLESS SPONSOR TOOLS:
🐙KRAKEN | MOST-TRUSTED CRYPTO EXCHANGE
https://k.xyz/bankless-pod-q2
🦊METAMASK PORTFOLIO | TRACK & MANAGE YOUR WEB3 EVERYTHING
https://bankless.cc/MetaMask
⚖️ ARBITRUM | SCALING ETHEREUM
https://bankless.cc/Arbitrum
🛞MANTLE | MODULAR LAYER 2 NETWORK
https://bankless.cc/Mantle
👾POLYGON | VALUE LAYER OF THE INTERNET
https://polygon.technology/roadmap
------
Timestamps
0:00 Intro
1:50 Guests
5:30 NATE SOARES
7:25 MIRI
13:30 Human Coordination
17:00 Dangers of Superintelligence
21:00 AI’s Big Moment
24:45 Chances of Doom
35:35 A Serious Threat
42:45 Talent is Scarce
48:20 Solving the Alignment Problem
59:35 Dealing with Pessimism
1:03:45 The Sliver of Utopia
1:14:00 DEGER TURAN
1:17:00 Solving Human Alignment
1:22:40 Using AI to Solve Problems
1:26:30 AI Objectives Institute
1:31:30 Epistemic Security
1:36:18 Curating AI Content
1:41:00 Scalable Coordination
1:47:15 Building Evolving Systems
1:54:00 Independent Flexible Systems
1:58:30 The Problem is the Solution
2:03:30 A Better Future
-----
Resources
Nate Soares
https://twitter.com/So8res?s=20
Deger Turan
https://twitter.com/degerturann?s=20
MIRI
https://intelligence.org/
Less Wrong AI Alignment
xhttps://www.lesswrong.com/tag/ai-alignment-intro-materials
AI Objectives Institute
https://aiobjectives.org/
------
Not financial or tax advice. This channel is strictly educational and is not investment advice or a solicitation to buy or sell any assets or to make any financial decisions. This video is not tax advice. Talk to your accountant. Do your own research.
Disclosure. From time-to-time I may add links in this newsletter to products I use. I may receive commission if you make a purchase through one of these links. Additionally, the Bankless writers hold crypto assets. See our investment disclosures here:
https://www.bankless.com/disclosures
Transcript
Click on a timestamp to play from that location
| 0:00.0 | Welcome to Banclists, where we explore the frontier of internet money and internet finance. |
| 0:08.8 | And today, on this episode of our Zuzalu series, we are exploring some new frontiers, new |
| 0:12.9 | frontiers and new technologies, all of which are poised to completely revolutionize the |
| 0:16.9 | world and change everything about the operating system that society is currently running. |
| 0:22.0 | Banclistation today, we are exploring the frontier of AI, which is actually a frontier |
| 0:26.5 | that we've already been exploring on Banclists. |
| 0:28.7 | So if you've been listening to our other AI episodes, these will make you feel right at home. |
| 0:32.8 | AI had a big week at Zuzalu. |
| 0:36.3 | The AI crypto overlap, everyone knows it's huge, and it seems like such a massive frontier |
| 0:40.9 | that people don't actually know where to start with it. |
| 0:43.7 | ZKML or machine learning models and data that's verified by zero knowledge cryptography |
| 0:49.1 | was a huge topic of conversation, and you'll hear about that in our cryptography episode |
| 0:54.1 | with Daniel Short. |
| 0:55.4 | Daniel Diane at AI Week gave a killer talk titled MEV for AI people, which was this gigabrain |
| 1:02.2 | presentation about how MEV bots in aggregate kind of presents this omnipotent, omnipresent |
| 1:08.6 | artificial intelligence. |
| 1:10.2 | And since MEV has been decently corralled and contained, maybe we can learn a thing |
| 1:14.3 | or two from the MEV industry in our approach to managing AI risk. |
| 1:18.7 | There were conversations at Zuzalu about how AI can put the autonomous back into DAO's |
| 1:24.0 | and how AI agents could soon be roaming the Ethereum landscape shoulder to shoulder |
| 1:28.4 | with all the human players out there. |
| 1:30.8 | But mainly, as Zuzalu, the AI conversation inevitably converged into the alignment conversation |
... |
Please login to see the full transcript.
Disclaimer: The podcast and artwork embedded on this page are from Bankless, and are the property of its owner and not affiliated with or endorsed by Tapesearch.
Generated transcripts are the property of Bankless and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.
Copyright © Tapesearch 2026.