20VC: AI Scaling Myths: More Compute is not the Answer | The Core Bottlenecks in AI Today: Data, Algorithms and Compute | The Future of Models: Open vs Closed, Small vs Large with Arvind Narayanan, Professor of Computer Science @ Princeton

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

The Twenty Minute VC

Finance, Venturecapital, Tech News, News, Siliconvalley, Technology, Investing, Startups, Business

4.4 • 637 Ratings

🗓️ 28 August 2024

⏱️ 52 minutes

🔗️ Recording | iTunes | RSS

🧾️ Download transcript

Summary

Arvind Narayanan is a professor of Computer Science at Princeton and the director of the Center for Information Technology Policy. He is a co-author of the book AI Snake Oil and a big proponent of the AI scaling myths around the importance of just adding more compute. He is also the lead author of a textbook on the computer science of cryptocurrencies which has been used in over 150 courses around the world, and an accompanying Coursera course that has had over 700,000 learners.

In Today's Episode with Arvind Narayanan We Discuss:

1. Compute, Data, Algorithms: What is the Bottleneck:

Why does Arvind disagree with the commonly held notion that more compute will result in an equal and continuous level of model performance improvement?
Will we continue to see players move into the compute layer in the need to internalise the margin? What does that mean for Nvidia?
Why does Arvind not believe that data is the bottleneck? How does Arvind analyse the future of synthetic data? Where is it useful? Where is it not?

2. The Future of Models:

Does Arvind agree that this is the fastest commoditization of a technology he has seen?
How does Arvind analyse the future of the model landscape? Will we see a world of few very large models or a world of many unbundled and verticalised models?
Where does Arvind believe the most value will accrue in the model layer?
Is it possible for smaller companies or university research institutions to even play in the model space given the intense cash needed to fund model development?

3. Education, Healthcare and Misinformation: When AI Goes Wrong:

What are the single biggest dangers that AI poses to society today?
To what extent does Arvind believe misinformation through generative AI is going to be a massive problem in democracies and misinformation?
How does Arvind analyse AI impacting the future of education? What does he believe everyone gets wrong about AI and education?
Does Arvind agree that AI will be able to put a doctor in everyone's pocket? Where does he believe this theory is weak and falls down?

Transcript

Click on a timestamp to play from that location

0:00.0	we're not going to have too many more cycles, possibly zero more cycles of a model that's,
0:05.2	you know, almost an order of magnitude bigger in terms of the number of parameters than what
0:09.6	came before and thereby more powerful. And I think a reason for that is data becoming a bottleneck.
0:15.7	These models are already trained on essentially all of the data that companies can get their hands on.
0:21.5	So while data is becoming a bottleneck, I think more compute still helps, but maybe not as much
0:27.0	as it used to.
0:28.0	This is 20VC with me, Harry Stebbings, and we're sitting down today with one of my favorite
0:31.6	writers in AI.
0:32.9	He's been a big proponent in the belief that despite what many people think, increasing the amount of compute
0:39.1	from this point will be unlikely to increase model performance significantly moving forward.
0:45.3	I'm thrilled to welcome Arvid Nari Annan, Professor of Computer Science at Princeton and the
0:49.7	director of the Center for Information Technology Policy. This is an incredible discussion that goes very deep on the bottlenecks in AI today,
0:57.0	and you can watch it on YouTube by searching for 20VC.
1:00.0	But before we dive in today, all of you listening use tons of software every day.
1:05.0	Sometimes it fills us with rage.
1:07.0	You can't figure something out.
1:08.0	The chatbot in the bottom right is useless.
1:10.0	You keep getting bombarded with these useless pop-ups. And for those of you who build products, no one
1:15.0	wants their product to feel like this. Thankfully, a company exists to help users without
1:19.4	annoying them. Command bar. It does a couple of very helpful things. First, it's a chatbot
1:24.6	that uses AI to give users extremely personalized responses and deflect tickets.
1:29.3	But it can be beyond just text.
	...

Please login to see the full transcript.

Previous episode | Next episode

Disclaimer: The podcast and artwork embedded on this page are from The Twenty Minute VC, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of The Twenty Minute VC and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.