20VC: Why Data Size Matters More Than Model Size, Why The Google Employee Was Wrong; OpenAI and Google Have the Advantage & Why Open Source is Not Going to Win with Douwe Kiela, Co-Founder @ Contextual AI

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

The Twenty Minute VC

Finance, Venturecapital, Tech News, News, Siliconvalley, Technology, Investing, Startups, Business

4.4 • 637 Ratings

🗓️ 30 June 2023

⏱️ 42 minutes

🔗️ Recording | iTunes | RSS

🧾️ Download transcript

Summary

Douwe Kiela is the CEO of Contextual AI, building the contextual language model to power the future of businesses. Last month Contextual closed a $20M funding round including Bain Capital, Sarah Guo, Elad Gil and 20VC. He is also an Adjunct Professor in Symbolic Systems at Stanford University. Previously, he was the Head of Research at Hugging Face, and before that a Research Scientist at Facebook AI Research.

In Today's Episode with Douwe Kiela We Discuss:

1. Founding a Foundational Model Company in 2023:

How did Douwe make his way into the world of AI and ML over a decade ago?
What are some of his biggest lessons from his time working with Yann LeCun and Meta?
How does Douwe's background in philosophy help him in AI today?

2. Foundational Model Providers: Challenges and Alternatives:

What are the biggest problems with the existing foundational data models?
Will there be one to rule them all? How does the landscape play out?
Why does Douwe believe OpenAI's data acquisition strategy has been the best?

3. Data Models: Size and Structure:

Why does Douwe believe it is naive to think the open approach will beat the closed approach?
What are the biggest downsides to the open approach?
Does the size of data model matter today? What matters more?
How important is access to proprietary data? Are VCs naive to turn down founders due to a lack of access to proprietary data?

4. Regulation and the World Around Us:

How does Douwe expect the regulatory landscape to play out around AI?
Why is Europe the worst when it comes to regulation? Will this be different this time?
How does Douwe analyse Elon's petition to pause the development of AI for 6 months?
Do founders building AI companies have to be in the valley?

Transcript

Click on a timestamp to play from that location

0:00.0	Data size matters even more than model size. If you train a smaller model on more data for longer,
0:06.7	then you get a better model. There was this Google memo from an internal Google employee
0:12.5	who had written that Open AI and Google have no mode. For me, as an AI researcher, when I read
0:18.3	that memo, I was like, this person has no idea what they're talking about.
0:21.9	Welcome back to 20VC with me, Harry Stebbings.
0:24.4	And today we delve further into the world of AI with an expert who's been in the industry for the last 15 years.
0:30.2	Dow Kila, co-found and CEO of Contextual AI, building the contextual language model to power the future of businesses.
0:37.3	Last month, Contextual
0:38.5	closed a $20 million funding round, including Bain Capital, Sarah Guo, Eli-Gil, and 20VC. He's also
0:45.2	an adjunct professor in symbolic systems at Stanford University. Previously, he was the head of
0:50.1	research at Hugging Face, and before that that a research scientist at Facebook AI research.
0:55.1	But before we dive into the show state, did you know that over 50% of your day is filled with
0:59.3	tedious tasks? What would you do if you got half a day back? Well, you can with Coda, the all-in-one
1:05.0	platform that changes the way your team works together. And Coda just introduced an AI-powered
1:10.7	work assistant to take the busy out of work. With Coda just introduced an AI-powered work assistant to take the busy
1:12.6	out of work. With Coda, your team's important workflows and content already live in one place,
1:18.4	and Coda AI helps each team member focus on the highest priority work, even as priorities shift across the team.
1:25.1	By taking over recurring, and let's be honest, very tedious
1:28.3	work often, Coda AI empowers team members to prioritize longer term and strategic work to accomplish
1:34.6	goals. Coda AI not only makes space for collaboration in each person's work day, but can make it
1:40.1	easier to stay in the loop and share informed opinions. So if you want to work a system that
1:44.8	lets you get back to work, you can get started with Coda AI today for free. Head over to coda.io
	...

Please login to see the full transcript.

Previous episode | Next episode

Disclaimer: The podcast and artwork embedded on this page are from The Twenty Minute VC, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of The Twenty Minute VC and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.