meta_pixel
Tapesearch Logo
Log in
Marketplace Tech

Costs of AI spur quest for a cheaper chatbot

Marketplace Tech

American Public Media

Technology, News

4.61.2K Ratings

🗓️ 12 June 2023

⏱️ 12 minutes

🧾️ Download transcript

Summary

Generative artificial intelligence tools such as ChatGPT have caught on like wildfire, largely because of their impressive capabilities, but also because they’re free, or nearly free, to use. But just because a service doesn’t charge users doesn’t mean it doesn’t have costs. In reality, sophisticated large language models cost a lot to build and maintain. AI companies will have to recoup that investment eventually, in one way or another. Marketplace’s Meghan McCarty Carino spoke about the high costs of AI chatbots with Will Oremus, technology news analysis writer for The Washington Post. Oremus recently delved into how the financial aspect of AI development could influence the course of the technology.

Transcript

Click on a timestamp to play from that location

0:00.0

Marketplace Morning reports new Skin in the Game series explores what we can learn about

0:04.6

money and careers from the $300 billion video game industry. Plus, here how an Oakland-based

0:11.0

program helps young people get the skills they need to break into this booming industry.

0:15.9

Listen to Skin in the Game and more from the Marketplace Morning report wherever you get your

0:20.7

podcasts. The best things in life or the best AI at least aren't actually free. From American

0:29.8

public media, this is Marketplace Tech. I'm Megan McCarty-Karino.

0:42.9

Generative artificial intelligence tools like ChatGPT have caught on like wildfire.

0:49.2

In large part because they are impressive and also because they're free or nearly free for

0:55.2

the public to use. But just because a service doesn't charge doesn't mean it doesn't have a cost

1:02.1

and sophisticated large language models cost a lot to build and maintain. A price tag AI

1:09.3

companies are going to have to recoup eventually. Says Will Oremis who wrote about this recently

1:15.2

for the Washington Post. So there's a huge initial cost when you're training the models.

1:20.7

But then that cost in the long run is actually dwarfed by the cost of just running the models.

1:27.2

The computing cost every time you use a chatbot or every time you call on one of these models.

1:32.4

And it runs only on specific high end chips called GPUs for a set of GPUs that can run AI

1:40.4

applications can cost in the tens of thousands of dollars. And it's not just chatbots. I mean,

1:45.7

Microsoft is putting GPT type software into everything from Microsoft Excel, Word, PowerPoint,

1:55.2

Bing, Skype, you know. And so the proliferation of these large language models across all kinds

2:02.3

of applications just racks up more and more and more computing cost.

2:07.2

Yeah. And I mean, in the case of chat GPT, this has sort of been referred to as like the most

2:14.8

quickly adopted technology in history, you know, in a matter of months got 100 million users.

2:20.7

And people using it for just all kinds of silly things probably without kind of considering

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from American Public Media, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of American Public Media and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2025.